-- Logs begin at Tue 2021-05-25 16:18:44 UTC, end at Tue 2021-05-25 17:22:24 UTC. -- May 25 16:50:09.127312 dv-cinder-790492-4-iscsi systemd[1]: Started Devstack devstack@q-svc.service. May 25 16:50:10.107587 dv-cinder-790492-4-iscsi neutron-server[91722]: Beware of the coming changes in the project packaging May 25 16:50:10.108179 dv-cinder-790492-4-iscsi neutron-server[91722]: https://github.com/svinota/pyroute2/discussions/786 May 25 16:50:11.586207 dv-cinder-790492-4-iscsi neutron-server[91722]: INFO neutron.common.config [-] Logging enabled! May 25 16:50:11.586875 dv-cinder-790492-4-iscsi neutron-server[91722]: INFO neutron.common.config [-] /usr/local/bin/neutron-server version 18.1.0.dev240 May 25 16:50:11.586978 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.common.config [-] command line: /usr/local/bin/neutron-server --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini {{(pid=91722) setup_logging /opt/stack/neutron/neutron/common/config.py:112}} May 25 16:50:11.590357 dv-cinder-790492-4-iscsi neutron-server[91722]: INFO neutron.common.config [-] Logging enabled! May 25 16:50:11.590609 dv-cinder-790492-4-iscsi neutron-server[91722]: INFO neutron.common.config [-] /usr/local/bin/neutron-server version 18.1.0.dev240 May 25 16:50:11.590911 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.common.config [-] command line: /usr/local/bin/neutron-server --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini {{(pid=91722) setup_logging /opt/stack/neutron/neutron/common/config.py:112}} May 25 16:50:11.591857 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.common.config [-] ******************************************************************************** {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 25 16:50:11.592088 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.common.config [-] Configuration options gathered from: {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 25 16:50:11.592452 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.common.config [-] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 25 16:50:11.592695 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.common.config [-] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 25 16:50:11.592918 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.common.config [-] ================================================================================ {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 25 16:50:11.593237 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.common.config [-] allow_bulk = True {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:11.593532 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.common.config [-] allow_overlapping_ips = True {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:11.593827 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.common.config [-] api_extensions_path = {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:11.594088 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.common.config [-] api_paste_config = api-paste.ini {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:11.594383 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.common.config [-] api_workers = 2 {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:11.594703 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.common.config [-] auth_strategy = keystone {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:11.594986 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.common.config [-] backlog = 4096 {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:11.595276 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.common.config [-] base_mac = fa:16:3e:00:00:00 {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:11.595573 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.common.config [-] bind_host = 0.0.0.0 {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:11.595862 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.common.config [-] bind_port = 9696 {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:11.596144 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.common.config [-] client_socket_timeout = 900 {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:11.596431 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.common.config [-] config_dir = [] {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:11.596663 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.common.config [-] config_file = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:11.596944 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.common.config [-] config_source = [] {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:11.597229 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.common.config [-] control_exchange = neutron {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:11.597516 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.common.config [-] core_plugin = ml2 {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:11.597739 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.common.config [-] debug = True {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:11.598047 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.common.config [-] default_availability_zones = [] {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:11.598476 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.common.config [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:11.598903 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.common.config [-] dhcp_agent_notification = True {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:11.599188 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.common.config [-] dhcp_lease_duration = 86400 {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:11.599477 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.common.config [-] dns_domain = openstacklocal {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:11.599757 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.common.config [-] enable_traditional_dhcp = True {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:11.600026 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.common.config [-] external_dns_driver = None {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:11.600302 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.common.config [-] filter_validation = True {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:11.600586 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.common.config [-] global_physnet_mtu = 1500 {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:11.600914 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.common.config [-] host = dv-cinder-790492-4-iscsi {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:11.601196 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.common.config [-] http_retries = 3 {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:11.601482 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.common.config [-] instance_format = [instance: %(uuid)s] {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:11.601767 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.common.config [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:11.602086 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.common.config [-] ipam_driver = internal {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:11.602360 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.common.config [-] ipv6_pd_enabled = False {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:11.602636 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.common.config [-] log_config_append = None {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:11.602921 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.common.config [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:11.603193 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.common.config [-] log_dir = None {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:11.603463 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.common.config [-] log_file = None {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:11.603738 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.common.config [-] log_rotate_interval = 1 {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:11.604025 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.common.config [-] log_rotate_interval_type = days {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:11.604317 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.common.config [-] log_rotation_type = none {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:11.604627 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.common.config [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:11.604834 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.common.config [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:11.605059 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.common.config [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:11.605343 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.common.config [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:11.605631 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.common.config [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:11.605941 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.common.config [-] max_dns_nameservers = 5 {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:11.606211 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.common.config [-] max_header_line = 16384 {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:11.606489 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.common.config [-] max_logfile_count = 30 {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:11.606819 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.common.config [-] max_logfile_size_mb = 200 {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:11.607098 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.common.config [-] max_subnet_host_routes = 20 {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:11.607369 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.common.config [-] network_link_prefix = None {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:11.607656 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.common.config [-] notify_nova_on_port_data_changes = True {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:11.607943 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.common.config [-] notify_nova_on_port_status_changes = True {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:11.608229 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.common.config [-] pagination_max_limit = -1 {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:11.608506 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.common.config [-] periodic_fuzzy_delay = 5 {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:11.608781 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.common.config [-] periodic_interval = 40 {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:11.609055 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.common.config [-] publish_errors = False {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:11.609332 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.common.config [-] rate_limit_burst = 0 {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:11.609617 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.common.config [-] rate_limit_except_level = CRITICAL {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:11.609895 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.common.config [-] rate_limit_interval = 0 {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:11.610714 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.common.config [-] retry_until_window = 30 {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:11.610992 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.common.config [-] rpc_response_max_timeout = 600 {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:11.611286 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.common.config [-] rpc_state_report_workers = 0 {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:11.611559 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.common.config [-] rpc_workers = None {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:11.611838 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.common.config [-] send_events_interval = 2 {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:11.612142 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.common.config [-] service_plugins = ['router', 'neutron.services.metering.metering_plugin.MeteringPlugin'] {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:11.612433 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.common.config [-] setproctitle = on {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:11.612719 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.common.config [-] state_path = /opt/stack/data/neutron {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:11.613007 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.common.config [-] syslog_log_facility = LOG_USER {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:11.613285 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.common.config [-] tcp_keepidle = 600 {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:11.613569 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.common.config [-] transport_url = **** {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:11.613843 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.common.config [-] use_eventlog = False {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:11.614142 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.common.config [-] use_journal = False {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:11.614419 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.common.config [-] use_json = False {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:11.614694 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.common.config [-] use_ssl = False {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:11.614967 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.common.config [-] use_stderr = False {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:11.615252 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.common.config [-] use_syslog = False {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:11.615526 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.common.config [-] vlan_transparent = False {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:11.615799 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.common.config [-] watch_log_file = False {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:11.616073 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.common.config [-] wsgi_default_pool_size = 100 {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:11.616347 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.common.config [-] wsgi_keep_alive = True {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:11.616633 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.common.config [-] wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:11.616933 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.common.config [-] oslo_concurrency.disable_process_locking = False {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:11.617234 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.common.config [-] oslo_concurrency.lock_path = /opt/stack/data/neutron/lock {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:11.617536 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.common.config [-] profiler.connection_string = messaging:// {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:11.617824 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.common.config [-] profiler.enabled = False {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:11.618143 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.common.config [-] profiler.es_doc_type = notification {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:11.618430 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.common.config [-] profiler.es_scroll_size = 10000 {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:11.618722 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.common.config [-] profiler.es_scroll_time = 2m {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:11.619001 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.common.config [-] profiler.filter_error_trace = False {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:11.619297 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.common.config [-] profiler.hmac_keys = SECRET_KEY {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:11.619587 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.common.config [-] profiler.sentinel_service_name = mymaster {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:11.619878 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.common.config [-] profiler.socket_timeout = 0.1 {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:11.620157 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.common.config [-] profiler.trace_sqlalchemy = False {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:11.620449 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.common.config [-] oslo_policy.enforce_new_defaults = False {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:11.620729 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.common.config [-] oslo_policy.enforce_scope = False {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:11.621025 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.common.config [-] oslo_policy.policy_default_rule = default {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:11.621332 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.common.config [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:11.621628 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.common.config [-] oslo_policy.policy_file = /etc/neutron/policy.json {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:11.621945 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.common.config [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:11.622224 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.common.config [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:11.622501 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.common.config [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:11.622778 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.common.config [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:11.623058 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.common.config [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:11.623346 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.common.config [-] nova.auth_section = None {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:11.623641 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.common.config [-] nova.auth_type = password {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:11.623933 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.common.config [-] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:11.624205 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.common.config [-] nova.certfile = None {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:11.624484 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.common.config [-] nova.collect_timing = False {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:11.624775 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.common.config [-] nova.endpoint_type = public {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:11.625057 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.common.config [-] nova.insecure = False {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:11.625330 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.common.config [-] nova.keyfile = None {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:11.625610 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.common.config [-] nova.live_migration_events = False {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:11.626478 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.common.config [-] nova.region_name = RegionOne {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:11.626762 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.common.config [-] nova.split_loggers = False {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:11.627038 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.common.config [-] nova.timeout = None {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:11.627321 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.common.config [-] placement.auth_section = None {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:11.627599 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.common.config [-] placement.auth_type = None {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:11.627873 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.common.config [-] placement.cafile = None {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:11.628145 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.common.config [-] placement.certfile = None {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:11.628422 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.common.config [-] placement.collect_timing = False {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:11.628713 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.common.config [-] placement.endpoint_type = public {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:11.628992 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.common.config [-] placement.insecure = False {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:11.629270 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.common.config [-] placement.keyfile = None {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:11.629543 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.common.config [-] placement.region_name = None {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:11.629820 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.common.config [-] placement.split_loggers = False {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:11.630118 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.common.config [-] placement.timeout = None {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:11.630409 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.common.config [-] ironic.auth_section = None {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:11.630689 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.common.config [-] ironic.auth_type = None {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:11.630965 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.common.config [-] ironic.cafile = None {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:11.631238 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.common.config [-] ironic.certfile = None {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:11.631516 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.common.config [-] ironic.collect_timing = False {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:11.631790 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.common.config [-] ironic.connect_retries = None {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:11.632062 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.common.config [-] ironic.connect_retry_delay = None {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:11.632337 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.common.config [-] ironic.enable_notifications = False {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:11.632607 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.common.config [-] ironic.endpoint_override = None {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:11.632884 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.common.config [-] ironic.insecure = False {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:11.633158 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.common.config [-] ironic.interface = None {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:11.633430 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.common.config [-] ironic.keyfile = None {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:11.633702 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.common.config [-] ironic.max_version = None {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:11.634002 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.common.config [-] ironic.min_version = None {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:11.634276 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.common.config [-] ironic.region_name = None {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:11.634545 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.common.config [-] ironic.service_name = None {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:11.634816 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.common.config [-] ironic.service_type = None {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:11.635096 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.common.config [-] ironic.split_loggers = False {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:11.635366 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.common.config [-] ironic.status_code_retries = None {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:11.635636 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.common.config [-] ironic.status_code_retry_delay = None {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:11.635910 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.common.config [-] ironic.timeout = None {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:11.636180 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.common.config [-] ironic.valid_interfaces = None {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:11.636453 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.common.config [-] ironic.version = None {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:11.636738 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.common.config [-] service_providers.service_provider = [] {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:11.637039 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:11.637318 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:11.637598 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:11.637877 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:11.638191 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:11.638467 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:11.638743 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:11.639021 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:11.639305 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:11.639578 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:11.639865 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:11.640147 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:11.640431 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:11.640709 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:11.640987 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:11.641282 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:11.641583 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:11.641867 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:11.642168 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:11.642446 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:11.642733 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:11.643015 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl = False {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:11.643311 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:11.643605 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:11.643898 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:11.644191 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl_version = {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:11.644480 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.common.config [-] oslo_messaging_notifications.driver = [] {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:11.644759 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.common.config [-] oslo_messaging_notifications.retry = -1 {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:11.645085 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.common.config [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:11.645346 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.common.config [-] oslo_messaging_notifications.transport_url = **** {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:11.645561 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.common.config [-] ******************************************************************************** {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 25 16:50:11.645806 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo.service.wsgi [-] Loading app neutron from /etc/neutron/api-paste.ini {{(pid=91722) load_app /usr/local/lib/python3.8/dist-packages/oslo_service/wsgi.py:349}} May 25 16:50:11.998782 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_concurrency.lockutils [-] Lock "plugin-directory" acquired by "neutron_lib.plugins.directory._create_plugin_directory" :: waited 0.000s {{(pid=91722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:50:11.998974 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_concurrency.lockutils [-] Lock "plugin-directory" released by "neutron_lib.plugins.directory._create_plugin_directory" :: held 0.001s {{(pid=91722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:50:11.999263 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_concurrency.lockutils [-] Lock "manager" acquired by "neutron.manager.NeutronManager._create_instance" :: waited 0.000s {{(pid=91722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:50:11.999734 dv-cinder-790492-4-iscsi neutron-server[91722]: INFO neutron.manager [-] Loading core plugin: ml2 May 25 16:50:12.396240 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=91722) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 16:50:12.396521 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=91722) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 16:50:12.396789 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=91722) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 16:50:12.398111 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=91722) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 16:50:12.398381 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=91722) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 16:50:12.398641 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=91722) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 16:50:12.434083 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=91722) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 16:50:12.434356 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=91722) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 16:50:12.434620 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=91722) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 16:50:12.448154 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=91722) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 16:50:12.448436 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=91722) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 16:50:12.448702 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=91722) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 16:50:12.480171 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=91722) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 16:50:12.480445 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=91722) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 16:50:12.480709 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=91722) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 16:50:12.518363 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=91722) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 16:50:12.518638 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=91722) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 16:50:12.518904 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=91722) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 16:50:12.754002 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: agent after_create 55550000 {{(pid=91722) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 16:50:12.754639 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: agent after_update 55550000 {{(pid=91722) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 16:50:12.754639 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: segment precommit_create 55550000 {{(pid=91722) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 16:50:12.754838 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: network precommit_delete 55550000 {{(pid=91722) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 16:50:12.755455 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: segment before_delete 55550000 {{(pid=91722) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 16:50:12.883104 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > network before_delete 55550000 {{(pid=91722) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 16:50:12.883424 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: agent before_delete 55550000 {{(pid=91722) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 16:50:12.883703 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > network before_create 55550000 {{(pid=91722) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 16:50:12.883971 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port before_create 55550000 {{(pid=91722) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 16:50:12.884232 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port before_update 55550000 {{(pid=91722) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 16:50:12.884539 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > segment precommit_create 55550000 {{(pid=91722) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 16:50:12.884796 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > segment precommit_delete 55550000 {{(pid=91722) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 16:50:12.885047 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > segment after_create 55550000 {{(pid=91722) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 16:50:12.885299 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > segment after_delete 55550000 {{(pid=91722) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 16:50:12.885574 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > network after_delete 55550000 {{(pid=91722) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 16:50:12.885827 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > network precommit_delete 0 {{(pid=91722) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 16:50:12.886110 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port provisioning_complete 55550000 {{(pid=91722) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 16:50:12.886375 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=91722) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 16:50:12.886621 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy after_delete 55550000 {{(pid=91722) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 16:50:12.886883 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > agent after_update 55550000 {{(pid=91722) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 16:50:12.887149 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > subnet after_delete 55550000 {{(pid=91722) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 16:50:12.888595 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > subnet precommit_delete 0 {{(pid=91722) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 16:50:12.888887 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=91722) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 16:50:12.889155 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=91722) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 16:50:12.889445 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > segment_host_mapping after_create 55550000 {{(pid=91722) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 16:50:12.889797 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port after_create 55550000 {{(pid=91722) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 16:50:12.890085 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port after_update 55550000 {{(pid=91722) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 16:50:12.890343 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port after_delete 55550000 {{(pid=91722) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 16:50:12.890629 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=91722) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 16:50:12.890882 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=91722) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 16:50:12.891129 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=91722) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 16:50:12.891545 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: network configured {{(pid=91722) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} May 25 16:50:12.891783 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: port configured {{(pid=91722) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} May 25 16:50:12.892027 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: subnet configured {{(pid=91722) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} May 25 16:50:12.892260 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: subnetpool configured {{(pid=91722) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} May 25 16:50:12.892493 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: security_group configured {{(pid=91722) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} May 25 16:50:12.892725 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: security_group_rule configured {{(pid=91722) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} May 25 16:50:12.893094 dv-cinder-790492-4-iscsi neutron-server[91722]: INFO neutron.plugins.ml2.managers [-] Configured type driver names: ['local', 'flat', 'vlan', 'gre', 'vxlan', 'geneve'] May 25 16:50:12.896404 dv-cinder-790492-4-iscsi neutron-server[91722]: INFO neutron.plugins.ml2.drivers.type_flat [-] Allowable flat physical_network names: ['physnet1'] May 25 16:50:12.900345 dv-cinder-790492-4-iscsi neutron-server[91722]: INFO neutron.plugins.ml2.drivers.type_local [-] ML2 LocalTypeDriver initialization complete May 25 16:50:12.904233 dv-cinder-790492-4-iscsi neutron-server[91722]: INFO neutron.plugins.ml2.drivers.type_vlan [-] Network VLAN ranges: OrderedDict([('physnet1', [(650, 699)])]) May 25 16:50:12.905870 dv-cinder-790492-4-iscsi neutron-server[91722]: INFO neutron.plugins.ml2.managers [-] Loaded type driver names: ['flat', 'geneve', 'gre', 'local', 'vlan', 'vxlan'] May 25 16:50:12.906452 dv-cinder-790492-4-iscsi neutron-server[91722]: INFO neutron.plugins.ml2.managers [-] Registered types: dict_keys(['flat', 'geneve', 'gre', 'local', 'vlan', 'vxlan']) May 25 16:50:12.906673 dv-cinder-790492-4-iscsi neutron-server[91722]: INFO neutron.plugins.ml2.managers [-] Tenant network_types: ['vlan'] May 25 16:50:12.907589 dv-cinder-790492-4-iscsi neutron-server[91722]: INFO neutron.plugins.ml2.managers [-] Configured extension driver names: ['port_security'] May 25 16:50:12.910831 dv-cinder-790492-4-iscsi neutron-server[91722]: INFO neutron.plugins.ml2.managers [-] Loaded extension driver names: ['port_security'] May 25 16:50:12.911079 dv-cinder-790492-4-iscsi neutron-server[91722]: INFO neutron.plugins.ml2.managers [-] Registered extension drivers: ['port_security'] May 25 16:50:12.911433 dv-cinder-790492-4-iscsi neutron-server[91722]: INFO neutron.plugins.ml2.managers [-] Configured mechanism driver names: ['openvswitch', 'hyperv'] May 25 16:50:12.939237 dv-cinder-790492-4-iscsi neutron-server[91722]: INFO neutron.plugins.ml2.drivers.openvswitch.mech_driver.mech_openvswitch [-] Open vSwitch agent's supported_vnic_types: ['normal', 'direct', 'smart-nic', 'vdpa'] May 25 16:50:12.939693 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > qos_plugin after_init 55550000 {{(pid=91722) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 16:50:12.939988 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.services.qos.drivers.openvswitch.driver [-] Open vSwitch QoS driver registered {{(pid=91722) register /opt/stack/neutron/neutron/services/qos/drivers/openvswitch/driver.py:82}} May 25 16:50:12.940350 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > logging-plugin after_init 55550000 {{(pid=91722) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 16:50:12.941720 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.services.logapi.drivers.openvswitch.driver [-] Open vSwitch logging driver registered {{(pid=91722) register /opt/stack/neutron/neutron/services/logapi/drivers/openvswitch/driver.py:69}} May 25 16:50:12.942023 dv-cinder-790492-4-iscsi neutron-server[91722]: INFO neutron.plugins.ml2.managers [-] Loaded mechanism driver names: ['openvswitch', 'hyperv'] May 25 16:50:12.942270 dv-cinder-790492-4-iscsi neutron-server[91722]: INFO neutron.plugins.ml2.managers [-] Registered mechanism drivers: ['openvswitch', 'hyperv'] May 25 16:50:12.945512 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > floatingip before_response 55550000 {{(pid=91722) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 16:50:12.945787 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port before_response 55550000 {{(pid=91722) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 16:50:13.015507 dv-cinder-790492-4-iscsi neutron-server[91722]: INFO neutron.plugins.ml2.managers [-] Initializing driver for type 'flat' May 25 16:50:13.015690 dv-cinder-790492-4-iscsi neutron-server[91722]: INFO neutron.plugins.ml2.drivers.type_flat [-] ML2 FlatTypeDriver initialization complete May 25 16:50:13.015932 dv-cinder-790492-4-iscsi neutron-server[91722]: INFO neutron.plugins.ml2.managers [-] Initializing driver for type 'geneve' May 25 16:50:13.016317 dv-cinder-790492-4-iscsi neutron-server[91722]: INFO neutron.plugins.ml2.drivers.type_tunnel [-] geneve ID ranges: [(1, 1000)] May 25 16:50:13.047307 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_db.sqlalchemy.engines [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=91722) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 25 16:50:13.388463 dv-cinder-790492-4-iscsi neutron-server[91722]: INFO neutron.plugins.ml2.managers [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Initializing driver for type 'gre' May 25 16:50:13.389017 dv-cinder-790492-4-iscsi neutron-server[91722]: INFO neutron.plugins.ml2.drivers.type_tunnel [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] gre ID ranges: [(1, 1000)] May 25 16:50:13.440259 dv-cinder-790492-4-iscsi neutron-server[91722]: INFO neutron.plugins.ml2.managers [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Initializing driver for type 'local' May 25 16:50:13.440624 dv-cinder-790492-4-iscsi neutron-server[91722]: INFO neutron.plugins.ml2.managers [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Initializing driver for type 'vlan' May 25 16:50:13.452513 dv-cinder-790492-4-iscsi neutron-server[91722]: INFO neutron.plugins.ml2.drivers.type_vlan [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] VlanTypeDriver initialization complete May 25 16:50:13.452858 dv-cinder-790492-4-iscsi neutron-server[91722]: INFO neutron.plugins.ml2.managers [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Initializing driver for type 'vxlan' May 25 16:50:13.453363 dv-cinder-790492-4-iscsi neutron-server[91722]: INFO neutron.plugins.ml2.drivers.type_tunnel [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] vxlan ID ranges: [(1, 1000)] May 25 16:50:13.505439 dv-cinder-790492-4-iscsi neutron-server[91722]: INFO neutron.plugins.ml2.managers [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Initializing extension driver 'port_security' May 25 16:50:13.505782 dv-cinder-790492-4-iscsi neutron-server[91722]: INFO neutron.plugins.ml2.extensions.port_security [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] PortSecurityExtensionDriver initialization complete May 25 16:50:13.506136 dv-cinder-790492-4-iscsi neutron-server[91722]: INFO neutron.plugins.ml2.managers [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Initializing mechanism driver 'openvswitch' May 25 16:50:13.506456 dv-cinder-790492-4-iscsi neutron-server[91722]: INFO neutron.plugins.ml2.managers [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Initializing mechanism driver 'hyperv' May 25 16:50:13.512942 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.plugins.ml2.plugin [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] neutron.plugins.ml2.plugin.Ml2Plugin method _start_rpc_notifiers called with arguments () {} {{(pid=91722) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 16:50:13.513708 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron_lib.callbacks.manager [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Subscribe: > port after_create 55550000 {{(pid=91722) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 16:50:13.514113 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron_lib.callbacks.manager [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Subscribe: > port after_update 55550000 {{(pid=91722) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 16:50:13.514467 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron_lib.callbacks.manager [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Subscribe: > port after_delete 55550000 {{(pid=91722) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 16:50:13.514843 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron_lib.callbacks.manager [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Subscribe: > subnet after_create 55550000 {{(pid=91722) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 16:50:13.515192 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron_lib.callbacks.manager [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Subscribe: > subnet after_update 55550000 {{(pid=91722) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 16:50:13.515610 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron_lib.callbacks.manager [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Subscribe: > subnet after_delete 55550000 {{(pid=91722) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 16:50:13.517491 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron_lib.callbacks.manager [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Subscribe: > network after_create 55550000 {{(pid=91722) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 16:50:13.517491 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron_lib.callbacks.manager [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Subscribe: > network after_update 55550000 {{(pid=91722) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 16:50:13.517491 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron_lib.callbacks.manager [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Subscribe: > network after_delete 55550000 {{(pid=91722) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 16:50:13.517491 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron_lib.callbacks.manager [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Subscribe: > security_group after_create 55550000 {{(pid=91722) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 16:50:13.517785 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron_lib.callbacks.manager [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Subscribe: > security_group after_update 55550000 {{(pid=91722) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 16:50:13.518152 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron_lib.callbacks.manager [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Subscribe: > security_group after_delete 55550000 {{(pid=91722) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 16:50:13.518527 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron_lib.callbacks.manager [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Subscribe: > security_group_rule after_create 55550000 {{(pid=91722) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 16:50:13.518863 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron_lib.callbacks.manager [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Subscribe: > security_group_rule after_update 55550000 {{(pid=91722) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 16:50:13.519189 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron_lib.callbacks.manager [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Subscribe: > security_group_rule after_delete 55550000 {{(pid=91722) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 16:50:13.519554 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron_lib.callbacks.manager [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Subscribe: > address_group after_create 55550000 {{(pid=91722) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 16:50:13.519889 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron_lib.callbacks.manager [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Subscribe: > address_group after_update 55550000 {{(pid=91722) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 16:50:13.520218 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron_lib.callbacks.manager [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Subscribe: > address_group after_delete 55550000 {{(pid=91722) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 16:50:13.520547 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.plugins.ml2.ovo_rpc [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] ML2 OVO RPC backend initialized. {{(pid=91722) __init__ /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:160}} May 25 16:50:13.521259 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron_lib.callbacks.manager [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Subscribe: > router_interface after_create 55550000 {{(pid=91722) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 16:50:13.521611 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron_lib.callbacks.manager [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Subscribe: > router_interface after_delete 55550000 {{(pid=91722) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 16:50:13.522039 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron_lib.callbacks.manager [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Subscribe: > network before_response 55550000 {{(pid=91722) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 16:50:13.522380 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron_lib.callbacks.manager [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Subscribe: > networks before_response 55550000 {{(pid=91722) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 16:50:13.522717 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron_lib.callbacks.manager [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Subscribe: > port before_response 55550000 {{(pid=91722) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 16:50:13.523054 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron_lib.callbacks.manager [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Subscribe: > ports before_response 55550000 {{(pid=91722) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 16:50:13.523388 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron_lib.callbacks.manager [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Subscribe: > subnet before_response 55550000 {{(pid=91722) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 16:50:13.523717 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron_lib.callbacks.manager [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Subscribe: > subnets before_response 55550000 {{(pid=91722) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 16:50:13.524054 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron_lib.callbacks.manager [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Subscribe: > network after_create 55550000 {{(pid=91722) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 16:50:13.524390 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron_lib.callbacks.manager [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Subscribe: > network after_update 55550000 {{(pid=91722) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 16:50:13.524716 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron_lib.callbacks.manager [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Subscribe: > network after_delete 55550000 {{(pid=91722) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 16:50:13.525044 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron_lib.callbacks.manager [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Subscribe: > port after_create 55550000 {{(pid=91722) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 16:50:13.525374 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron_lib.callbacks.manager [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Subscribe: > port after_update 55550000 {{(pid=91722) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 16:50:13.525701 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron_lib.callbacks.manager [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Subscribe: > port after_delete 55550000 {{(pid=91722) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 16:50:13.526065 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron_lib.callbacks.manager [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Subscribe: > subnet after_create 55550000 {{(pid=91722) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 16:50:13.526393 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron_lib.callbacks.manager [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Subscribe: > subnet after_update 55550000 {{(pid=91722) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 16:50:13.526717 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron_lib.callbacks.manager [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Subscribe: > subnet after_delete 55550000 {{(pid=91722) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 16:50:13.527290 dv-cinder-790492-4-iscsi neutron-server[91722]: INFO neutron.plugins.ml2.plugin [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Modular L2 Plugin initialization complete May 25 16:50:13.527612 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.manager [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Loading services supported by the core plugin {{(pid=91722) _load_services_from_core_plugin /opt/stack/neutron/neutron/manager.py:168}} May 25 16:50:13.527937 dv-cinder-790492-4-iscsi neutron-server[91722]: INFO neutron.plugins.ml2.managers [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Got port-security extension from driver 'port_security' May 25 16:50:13.528393 dv-cinder-790492-4-iscsi neutron-server[91722]: INFO neutron.extensions.vlantransparent [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Disabled vlantransparent extension. May 25 16:50:13.528881 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.manager [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Loading service plugins: ['router', 'neutron.services.metering.metering_plugin.MeteringPlugin', 'auto_allocate', 'tag', 'timestamp', 'network_ip_availability', 'flavors', 'revisions'] {{(pid=91722) _load_service_plugins /opt/stack/neutron/neutron/manager.py:194}} May 25 16:50:13.529193 dv-cinder-790492-4-iscsi neutron-server[91722]: INFO neutron.manager [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Loading Plugin: router May 25 16:50:13.568302 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron_lib.callbacks.manager [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Subscribe: > router_interface before_create 55550000 {{(pid=91722) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 16:50:13.568691 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron_lib.callbacks.manager [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Subscribe: > router after_create 55549900 {{(pid=91722) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 16:50:13.569054 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron_lib.callbacks.manager [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Subscribe: > router before_create 55549900 {{(pid=91722) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 16:50:13.569417 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron_lib.callbacks.manager [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Subscribe: > router_interface before_delete 55550000 {{(pid=91722) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 16:50:13.569782 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron_lib.callbacks.manager [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Subscribe: > router_interface after_delete 55550000 {{(pid=91722) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 16:50:13.570153 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron_lib.callbacks.manager [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Subscribe: > router after_delete 55549900 {{(pid=91722) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 16:50:13.570512 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron_lib.callbacks.manager [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Subscribe: > floatingip after_update 55550000 {{(pid=91722) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 16:50:13.570867 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron_lib.callbacks.manager [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Subscribe: > router after_create 55549900 {{(pid=91722) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 16:50:13.571209 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron_lib.callbacks.manager [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Subscribe: > router after_update 55549900 {{(pid=91722) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 16:50:13.571573 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron_lib.callbacks.manager [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Subscribe: > router after_update 55549900 {{(pid=91722) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 16:50:13.571917 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron_lib.callbacks.manager [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Subscribe: > router_gateway after_delete 55550000 {{(pid=91722) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 16:50:13.572528 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron_lib.callbacks.manager [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Subscribe: > router after_update 55549900 {{(pid=91722) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 16:50:13.572927 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron_lib.callbacks.manager [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Subscribe: > router precommit_update 55549900 {{(pid=91722) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 16:50:13.573289 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron_lib.callbacks.manager [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Subscribe: port after_update 55550000 {{(pid=91722) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 16:50:13.573623 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron_lib.callbacks.manager [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Subscribe: port after_delete 55550000 {{(pid=91722) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 16:50:13.573988 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron_lib.callbacks.manager [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Subscribe: subnet after_update 55550000 {{(pid=91722) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 16:50:13.574331 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron_lib.callbacks.manager [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Subscribe: subnetpool_address_scope after_update 55550000 {{(pid=91722) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 16:50:13.574678 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron_lib.callbacks.manager [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Subscribe: > port precommit_delete 55550000 {{(pid=91722) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 16:50:13.575025 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron_lib.callbacks.manager [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Subscribe: > router precommit_create 55549900 {{(pid=91722) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 16:50:13.575366 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron_lib.callbacks.manager [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Subscribe: port before_delete 55550000 {{(pid=91722) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 16:50:13.575708 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron_lib.callbacks.manager [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Subscribe: > router precommit_create 55550000 {{(pid=91722) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 16:50:13.576059 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron_lib.callbacks.manager [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Subscribe: > router after_update 55549900 {{(pid=91722) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 16:50:13.576396 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron_lib.callbacks.manager [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Subscribe: > router precommit_delete 55549900 {{(pid=91722) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 16:50:13.576739 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron_lib.callbacks.manager [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Subscribe: > router precommit_create 55549900 {{(pid=91722) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 16:50:13.577115 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron_lib.callbacks.manager [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Subscribe: > router_interface after_create 55550000 {{(pid=91722) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 16:50:13.577474 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron_lib.callbacks.manager [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Subscribe: > router precommit_update 55549900 {{(pid=91722) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 16:50:13.577839 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron_lib.callbacks.manager [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Subscribe: > network after_delete 55550000 {{(pid=91722) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 16:50:13.578741 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.quota.resource_registry [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Tracking information for resource: router configured {{(pid=91722) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} May 25 16:50:13.579068 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.quota.resource_registry [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Tracking information for resource: floatingip configured {{(pid=91722) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} May 25 16:50:13.584790 dv-cinder-790492-4-iscsi neutron-server[91722]: INFO neutron.db.l3_agentschedulers_db [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Skipping period L3 agent status check because automatic router rescheduling is disabled. May 25 16:50:13.585375 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron_lib.callbacks.manager [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Subscribe: port after_update 55550000 {{(pid=91722) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 16:50:13.585737 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron_lib.callbacks.manager [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Subscribe: port after_create 55550000 {{(pid=91722) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 16:50:13.586110 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron_lib.callbacks.manager [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Subscribe: port after_delete 55550000 {{(pid=91722) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 16:50:13.586460 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron_lib.callbacks.manager [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Subscribe: port after_update 55550000 {{(pid=91722) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 16:50:13.587267 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron_lib.callbacks.manager [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Subscribe: > router before_create 55550100 {{(pid=91722) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 16:50:13.587627 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron_lib.callbacks.manager [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Subscribe: > router precommit_delete 55550100 {{(pid=91722) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 16:50:13.587983 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron_lib.callbacks.manager [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Subscribe: > router precommit_create 55550100 {{(pid=91722) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 16:50:13.588336 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron_lib.callbacks.manager [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Subscribe: > router precommit_update 55550100 {{(pid=91722) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 16:50:13.592828 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.services.provider_configuration [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Service providers = [] {{(pid=91722) parse_service_provider_opt /opt/stack/neutron/neutron/services/provider_configuration.py:171}} May 25 16:50:13.593186 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.db.servicetype_db [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Adding provider configuration for service L3_ROUTER_NAT {{(pid=91722) add_provider_configuration /opt/stack/neutron/neutron/db/servicetype_db.py:42}} May 25 16:50:13.596222 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.services.service_base [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Loaded 'neutron.services.l3_router.service_providers.dvrha.DvrHaDriver' provider for service L3_ROUTER_NAT {{(pid=91722) load_drivers /opt/stack/neutron/neutron/services/service_base.py:49}} May 25 16:50:13.596562 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.services.service_base [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Loaded 'neutron.services.l3_router.service_providers.dvr.DvrDriver' provider for service L3_ROUTER_NAT {{(pid=91722) load_drivers /opt/stack/neutron/neutron/services/service_base.py:49}} May 25 16:50:13.596896 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.services.service_base [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Loaded 'neutron.services.l3_router.service_providers.ha.HaDriver' provider for service L3_ROUTER_NAT {{(pid=91722) load_drivers /opt/stack/neutron/neutron/services/service_base.py:49}} May 25 16:50:13.597766 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.services.service_base [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Loaded 'neutron.services.l3_router.service_providers.single_node.SingleNodeDriver' provider for service L3_ROUTER_NAT {{(pid=91722) load_drivers /opt/stack/neutron/neutron/services/service_base.py:49}} May 25 16:50:13.598163 dv-cinder-790492-4-iscsi neutron-server[91722]: INFO neutron.services.service_base [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Default provider is not specified for service type L3_ROUTER_NAT May 25 16:50:13.598712 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.manager [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Successfully loaded L3_ROUTER_NAT plugin. Description: L3 Router Service Plugin for basic L3 forwarding between (L2) Neutron networks and access to external networks via a NAT gateway. {{(pid=91722) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} May 25 16:50:13.599036 dv-cinder-790492-4-iscsi neutron-server[91722]: INFO neutron.manager [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Loading Plugin: neutron.services.metering.metering_plugin.MeteringPlugin May 25 16:50:13.609681 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.manager [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Successfully loaded METERING plugin. Description: METERING {{(pid=91722) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} May 25 16:50:13.610048 dv-cinder-790492-4-iscsi neutron-server[91722]: INFO neutron.manager [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Loading Plugin: auto_allocate May 25 16:50:13.615739 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron_lib.callbacks.manager [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Subscribe: network precommit_update 55550000 {{(pid=91722) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 16:50:13.616099 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron_lib.callbacks.manager [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Subscribe: network precommit_create 55550000 {{(pid=91722) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 16:50:13.616617 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.manager [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Successfully loaded auto-allocated-topology plugin. Description: Auto Allocated Topology - aka get me a network. {{(pid=91722) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} May 25 16:50:13.616929 dv-cinder-790492-4-iscsi neutron-server[91722]: INFO neutron.manager [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Loading Plugin: tag May 25 16:50:13.623701 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.manager [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Successfully loaded TAG plugin. Description: Tag support {{(pid=91722) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} May 25 16:50:13.624022 dv-cinder-790492-4-iscsi neutron-server[91722]: INFO neutron.manager [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Loading Plugin: timestamp May 25 16:50:13.628343 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.manager [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Successfully loaded timestamp plugin. Description: Adds timestamps to Neutron resources with standard attributes {{(pid=91722) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} May 25 16:50:13.628662 dv-cinder-790492-4-iscsi neutron-server[91722]: INFO neutron.manager [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Loading Plugin: network_ip_availability May 25 16:50:13.633880 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron_lib.callbacks.manager [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Subscribe: > rbac-policy before_create 55550000 {{(pid=91722) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 16:50:13.634269 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron_lib.callbacks.manager [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Subscribe: > rbac-policy before_update 55550000 {{(pid=91722) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 16:50:13.634618 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron_lib.callbacks.manager [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Subscribe: > rbac-policy before_delete 55550000 {{(pid=91722) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 16:50:13.635339 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.manager [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Successfully loaded network-ip-availability plugin. Description: Provides IP availability data for each network and subnet. {{(pid=91722) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} May 25 16:50:13.635652 dv-cinder-790492-4-iscsi neutron-server[91722]: INFO neutron.manager [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Loading Plugin: flavors May 25 16:50:13.640612 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.manager [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Successfully loaded FLAVORS plugin. Description: Neutron Flavors and Service Profiles manager plugin {{(pid=91722) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} May 25 16:50:13.640888 dv-cinder-790492-4-iscsi neutron-server[91722]: INFO neutron.manager [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Loading Plugin: revisions May 25 16:50:13.645695 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.manager [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Successfully loaded revision_plugin plugin. Description: Adds revision numbers to resources. {{(pid=91722) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} May 25 16:50:13.646120 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_concurrency.lockutils [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Lock "manager" released by "neutron.manager.NeutronManager._create_instance" :: held 1.647s {{(pid=91722) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:50:13.646862 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] get_extension_paths = OrderedDict([('/opt/stack/neutron/neutron/extensions', 1)]) {{(pid=91722) get_extensions_path /opt/stack/neutron/neutron/api/extensions.py:635}} May 25 16:50:13.647196 dv-cinder-790492-4-iscsi neutron-server[91722]: INFO neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Initializing extension manager. May 25 16:50:13.647694 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Loading extension file: __init__.py {{(pid=91722) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 16:50:13.648032 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Loading extension file: __pycache__ {{(pid=91722) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 16:50:13.648360 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Loading extension file: _standard_attr_segment_lib.py {{(pid=91722) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 16:50:13.648683 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Loading extension file: address_group.py {{(pid=91722) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 16:50:13.649443 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Ext name="Address group" alias="address-group" description="Support address group" updated="2020-07-15T10:00:00-00:00" {{(pid=91722) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 16:50:13.650040 dv-cinder-790492-4-iscsi neutron-server[91722]: INFO neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Loaded extension: address-group May 25 16:50:13.650402 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Loading extension file: address_scope.py {{(pid=91722) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 16:50:13.651101 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Ext name="Address scope" alias="address-scope" description="Address scopes extension." updated="2015-07-26T10:00:00-00:00" {{(pid=91722) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 16:50:13.651610 dv-cinder-790492-4-iscsi neutron-server[91722]: INFO neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Loaded extension: address-scope May 25 16:50:13.651924 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Loading extension file: admin_state_down_before_update.py {{(pid=91722) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 16:50:13.652842 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Ext name="Enforce Router's Admin State Down Before Update Extension" alias="router-admin-state-down-before-update" description="Ensure that the admin state of a router is DOWN (admin_state_up=False) before updating the distributed attribute" updated="2019-07-02T15:56:00" {{(pid=91722) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 16:50:13.653355 dv-cinder-790492-4-iscsi neutron-server[91722]: INFO neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Loaded extension: router-admin-state-down-before-update May 25 16:50:13.653670 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Loading extension file: agent.py {{(pid=91722) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 16:50:13.654387 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Ext name="agent" alias="agent" description="The agent management extension." updated="2013-02-03T10:00:00-00:00" {{(pid=91722) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 16:50:13.654891 dv-cinder-790492-4-iscsi neutron-server[91722]: INFO neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Loaded extension: agent May 25 16:50:13.655203 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Loading extension file: agent_resources_synced.py {{(pid=91722) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 16:50:13.656086 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Ext name="Agent's Resource View Synced to Placement" alias="agent-resources-synced" description="Stores success/failure of last sync to Placement" updated="2018-12-19T00:00:00-00:00" {{(pid=91722) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 16:50:13.656590 dv-cinder-790492-4-iscsi neutron-server[91722]: INFO neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Loaded extension: agent-resources-synced May 25 16:50:13.656902 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Loading extension file: allowedaddresspairs.py {{(pid=91722) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 16:50:13.658703 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Ext name="Allowed Address Pairs" alias="allowed-address-pairs" description="Provides allowed address pairs" updated="2013-07-23T10:00:00-00:00" {{(pid=91722) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 16:50:13.659230 dv-cinder-790492-4-iscsi neutron-server[91722]: INFO neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Loaded extension: allowed-address-pairs May 25 16:50:13.659547 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Loading extension file: auto_allocated_topology.py {{(pid=91722) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 16:50:13.660597 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Ext name="Auto Allocated Topology Services" alias="auto-allocated-topology" description="Auto Allocated Topology Services." updated="2016-01-01T00:00:00-00:00" {{(pid=91722) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 16:50:13.661110 dv-cinder-790492-4-iscsi neutron-server[91722]: INFO neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Loaded extension: auto-allocated-topology May 25 16:50:13.661430 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Loading extension file: availability_zone.py {{(pid=91722) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 16:50:13.662137 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Ext name="Availability Zone" alias="availability_zone" description="The availability zone extension." updated="2015-01-01T10:00:00-00:00" {{(pid=91722) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 16:50:13.662645 dv-cinder-790492-4-iscsi neutron-server[91722]: INFO neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Loaded extension: availability_zone May 25 16:50:13.662963 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Loading extension file: availability_zone_filter.py {{(pid=91722) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 16:50:13.663849 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Ext name="Availability Zone Filter Extension" alias="availability_zone_filter" description="Add filter parameters to AvailabilityZone resource" updated="2018-06-22T10:00:00-00:00" {{(pid=91722) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 16:50:13.664366 dv-cinder-790492-4-iscsi neutron-server[91722]: INFO neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Loaded extension: availability_zone_filter May 25 16:50:13.664878 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Loading extension file: data_plane_status.py {{(pid=91722) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 16:50:13.666286 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Ext name="Port data plane status extension" alias="data-plane-status" description="Expose status of underlying data plane" updated="2017-01-24T10:00:00-00:00" {{(pid=91722) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 16:50:13.667171 dv-cinder-790492-4-iscsi neutron-server[91722]: INFO neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Extension data-plane-status not supported by any of loaded plugins May 25 16:50:13.667687 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Loading extension file: default_subnetpools.py {{(pid=91722) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 16:50:13.669113 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Ext name="Default Subnetpools" alias="default-subnetpools" description="Provides ability to mark and use a subnetpool as the default." updated="2016-02-18T18:00:00-00:00" {{(pid=91722) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 16:50:13.669968 dv-cinder-790492-4-iscsi neutron-server[91722]: INFO neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Loaded extension: default-subnetpools May 25 16:50:13.670488 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Loading extension file: dhcpagentscheduler.py {{(pid=91722) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 16:50:13.671335 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Ext name="DHCP Agent Scheduler" alias="dhcp_agent_scheduler" description="Schedule networks among dhcp agents" updated="2013-02-07T10:00:00-00:00" {{(pid=91722) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 16:50:13.671852 dv-cinder-790492-4-iscsi neutron-server[91722]: INFO neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Loaded extension: dhcp_agent_scheduler May 25 16:50:13.672172 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Loading extension file: dns.py {{(pid=91722) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 16:50:13.673580 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Ext name="DNS Integration" alias="dns-integration" description="Provides integration with DNS." updated="2015-08-15T18:00:00-00:00" {{(pid=91722) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 16:50:13.674110 dv-cinder-790492-4-iscsi neutron-server[91722]: INFO neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Extension dns-integration not supported by any of loaded plugins May 25 16:50:13.674432 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Loading extension file: dns_domain_ports.py {{(pid=91722) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 16:50:13.675329 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Ext name="dns_domain for ports" alias="dns-domain-ports" description="Allows the DNS domain to be specified for a network port." updated="2017-04-24T10:00:00-00:00" {{(pid=91722) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 16:50:13.675830 dv-cinder-790492-4-iscsi neutron-server[91722]: INFO neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Extension dns-domain-ports not supported by any of loaded plugins May 25 16:50:13.676145 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Loading extension file: dvr.py {{(pid=91722) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 16:50:13.676797 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Ext name="Distributed Virtual Router" alias="dvr" description="Enables configuration of Distributed Virtual Routers." updated="2014-06-1T10:00:00-00:00" {{(pid=91722) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 16:50:13.677301 dv-cinder-790492-4-iscsi neutron-server[91722]: INFO neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Loaded extension: dvr May 25 16:50:13.677616 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Loading extension file: empty_string_filtering.py {{(pid=91722) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 16:50:13.678531 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Ext name="Empty String Filtering Extension" alias="empty-string-filtering" description="Allow filtering by attributes with empty string value" updated="2018-05-01T10:00:00-00:00" {{(pid=91722) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 16:50:13.679037 dv-cinder-790492-4-iscsi neutron-server[91722]: INFO neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Loaded extension: empty-string-filtering May 25 16:50:13.679354 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Loading extension file: expose_l3_conntrack_helper.py {{(pid=91722) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 16:50:13.680237 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Ext name="Expose CT target rules for conntrack helper" alias="expose-l3-conntrack-helper" description="Expose allow adding CT target rules for conntrack helper" updated="2019-04-04T10:00:00-00:00" {{(pid=91722) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 16:50:13.680743 dv-cinder-790492-4-iscsi neutron-server[91722]: INFO neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Extension expose-l3-conntrack-helper not supported by any of loaded plugins May 25 16:50:13.681059 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Loading extension file: expose_port_forwarding_in_fip.py {{(pid=91722) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 16:50:13.681961 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Ext name="Expose Floating IP port forwardings" alias="expose-port-forwarding-in-fip" description="Expose port forwarding fields in floating IP response" updated="2018-06-28T16:00:00-00:00" {{(pid=91722) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 16:50:13.682468 dv-cinder-790492-4-iscsi neutron-server[91722]: INFO neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Extension expose-port-forwarding-in-fip not supported by any of loaded plugins May 25 16:50:13.682787 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Loading extension file: external_net.py {{(pid=91722) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 16:50:13.683709 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Ext name="Neutron external network" alias="external-net" description="Adds external network attribute to network resource." updated="2013-01-14T10:00:00-00:00" {{(pid=91722) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 16:50:13.684219 dv-cinder-790492-4-iscsi neutron-server[91722]: INFO neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Loaded extension: external-net May 25 16:50:13.684538 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Loading extension file: extra_dhcp_opt.py {{(pid=91722) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 16:50:13.685439 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Ext name="Neutron Extra DHCP options" alias="extra_dhcp_opt" description="Extra options configuration for DHCP. For example PXE boot options to DHCP clients can be specified (e.g. tftp-server, server-ip-address, bootfile-name)" updated="2013-03-17T12:00:00-00:00" {{(pid=91722) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 16:50:13.685980 dv-cinder-790492-4-iscsi neutron-server[91722]: INFO neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Loaded extension: extra_dhcp_opt May 25 16:50:13.686300 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Loading extension file: extraroute.py {{(pid=91722) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 16:50:13.687183 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Ext name="Neutron Extra Route" alias="extraroute" description="Extra routes configuration for L3 router" updated="2013-02-01T10:00:00-00:00" {{(pid=91722) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 16:50:13.687694 dv-cinder-790492-4-iscsi neutron-server[91722]: INFO neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Loaded extension: extraroute May 25 16:50:13.688008 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Loading extension file: extraroute_atomic.py {{(pid=91722) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 16:50:13.689073 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Ext name="Atomically add/remove extra routes" alias="extraroute-atomic" description="Edit extra routes of a router on server side by atomically adding/removing extra routes" updated="2019-07-10T00:00:00+00:00" {{(pid=91722) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 16:50:13.689586 dv-cinder-790492-4-iscsi neutron-server[91722]: INFO neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Loaded extension: extraroute-atomic May 25 16:50:13.689902 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Loading extension file: filter_validation.py {{(pid=91722) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 16:50:13.690581 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Ext name="Filter parameters validation" alias="filter-validation" description="Provides validation on filter parameters." updated="2018-07-04T10:00:00-00:00" {{(pid=91722) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 16:50:13.691086 dv-cinder-790492-4-iscsi neutron-server[91722]: INFO neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Loaded extension: filter-validation May 25 16:50:13.691398 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Loading extension file: fip_pf_description.py {{(pid=91722) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 16:50:13.692504 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Ext name="Floating IP Port Forwarding new attribute description" alias="floating-ip-port-forwarding-description" description="Add a description field to Port Forwarding rules" updated="2019-11-01T10:00:00-00:00" {{(pid=91722) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 16:50:13.693012 dv-cinder-790492-4-iscsi neutron-server[91722]: INFO neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Extension floating-ip-port-forwarding-description not supported by any of loaded plugins May 25 16:50:13.693326 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Loading extension file: fip_port_details.py {{(pid=91722) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 16:50:13.694247 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Ext name="Floating IP Port Details Extension" alias="fip-port-details" description="Add port_details attribute to Floating IP resource" updated="2018-04-09T10:00:00-00:00" {{(pid=91722) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 16:50:13.694757 dv-cinder-790492-4-iscsi neutron-server[91722]: INFO neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Loaded extension: fip-port-details May 25 16:50:13.695068 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Loading extension file: flavors.py {{(pid=91722) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 16:50:13.696302 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Ext name="Neutron Service Flavors" alias="flavors" description="Flavor specification for Neutron advanced services." updated="2015-09-17T10:00:00-00:00" {{(pid=91722) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 16:50:13.696819 dv-cinder-790492-4-iscsi neutron-server[91722]: INFO neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Loaded extension: flavors May 25 16:50:13.697406 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Loading extension file: floating_ip_port_forwarding.py {{(pid=91722) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 16:50:13.699096 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Ext name="Floating IP Port Forwarding" alias="floating-ip-port-forwarding" description="Allow port forwarding from floating IP port to an internal port" updated="2018-01-19T10:00:00-00:00" {{(pid=91722) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 16:50:13.699602 dv-cinder-790492-4-iscsi neutron-server[91722]: INFO neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Extension floating-ip-port-forwarding not supported by any of loaded plugins May 25 16:50:13.699926 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Loading extension file: floatingip_pools.py {{(pid=91722) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 16:50:13.700609 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Ext name="Floating IP Pools Extension" alias="floatingip-pools" description="Provides a floating IP pools API." updated="2018-03-21T10:00:00-00:00" {{(pid=91722) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 16:50:13.701119 dv-cinder-790492-4-iscsi neutron-server[91722]: INFO neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Loaded extension: floatingip-pools May 25 16:50:13.701437 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Loading extension file: ip_allocation.py {{(pid=91722) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 16:50:13.702374 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Ext name="IP Allocation" alias="ip_allocation" description="IP allocation extension." updated="2016-06-10T23:00:00-00:00" {{(pid=91722) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 16:50:13.702880 dv-cinder-790492-4-iscsi neutron-server[91722]: INFO neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Extension ip_allocation not supported by any of loaded plugins May 25 16:50:13.703200 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Loading extension file: ip_substring_port_filtering.py {{(pid=91722) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 16:50:13.704632 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Ext name="IP address substring filtering" alias="ip-substring-filtering" description="Provides IP address substring filtering when listing ports" updated="2017-11-28T09:00:00-00:00" {{(pid=91722) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 16:50:13.705125 dv-cinder-790492-4-iscsi neutron-server[91722]: INFO neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Loaded extension: ip-substring-filtering May 25 16:50:13.705448 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Loading extension file: l2_adjacency.py {{(pid=91722) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 16:50:13.706394 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Ext name="L2 Adjacency" alias="l2_adjacency" description="Display L2 Adjacency for Neutron Networks." updated="2016-04-12T16:00:00-00:00" {{(pid=91722) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 16:50:13.706894 dv-cinder-790492-4-iscsi neutron-server[91722]: INFO neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Extension l2_adjacency not supported by any of loaded plugins May 25 16:50:13.707212 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Loading extension file: l3.py {{(pid=91722) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 16:50:13.708195 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Ext name="Neutron L3 Router" alias="router" description="Router abstraction for basic L3 forwarding between L2 Neutron networks and access to external networks via a NAT gateway." updated="2012-07-20T10:00:00-00:00" {{(pid=91722) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 16:50:13.708716 dv-cinder-790492-4-iscsi neutron-server[91722]: INFO neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Loaded extension: router May 25 16:50:13.709037 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Loading extension file: l3_conntrack_helper.py {{(pid=91722) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 16:50:13.711322 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Ext name="L3 Conntrack helper" alias="l3-conntrack-helper" description="Allow adding CT target rules for conntrack helper" updated="2019-04-04T10:00:00-00:00" {{(pid=91722) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 16:50:13.711862 dv-cinder-790492-4-iscsi neutron-server[91722]: INFO neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Extension l3-conntrack-helper not supported by any of loaded plugins May 25 16:50:13.712214 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Loading extension file: l3_ext_gw_mode.py {{(pid=91722) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 16:50:13.713123 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Ext name="Neutron L3 Configurable external gateway mode" alias="ext-gw-mode" description="Extension of the router abstraction for specifying whether SNAT should occur on the external gateway" updated="2013-03-28T10:00:00-00:00" {{(pid=91722) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 16:50:13.713642 dv-cinder-790492-4-iscsi neutron-server[91722]: INFO neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Loaded extension: ext-gw-mode May 25 16:50:13.713995 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Loading extension file: l3_ext_ha_mode.py {{(pid=91722) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 16:50:13.714881 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Ext name="HA Router extension" alias="l3-ha" description="Adds HA capability to routers." updated="2014-04-26T00:00:00-00:00" {{(pid=91722) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 16:50:13.715399 dv-cinder-790492-4-iscsi neutron-server[91722]: INFO neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Loaded extension: l3-ha May 25 16:50:13.715717 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Loading extension file: l3_flavors.py {{(pid=91722) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 16:50:13.716686 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Ext name="Router Flavor Extension" alias="l3-flavors" description="Flavor support for routers." updated="2016-05-17T00:00:00-00:00" {{(pid=91722) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 16:50:13.717111 dv-cinder-790492-4-iscsi neutron-server[91722]: INFO neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Loaded extension: l3-flavors May 25 16:50:13.717433 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Loading extension file: l3_port_ip_change_not_allowed.py {{(pid=91722) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 16:50:13.718356 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Ext name="Prevent L3 router ports IP address change extension" alias="l3-port-ip-change-not-allowed" description="Prevent change of IP address for some L3 router ports" updated="2018-10-09T10:00:00-00:00" {{(pid=91722) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 16:50:13.718867 dv-cinder-790492-4-iscsi neutron-server[91722]: INFO neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Loaded extension: l3-port-ip-change-not-allowed May 25 16:50:13.719179 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Loading extension file: l3agentscheduler.py {{(pid=91722) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 16:50:13.720785 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Ext name="L3 Agent Scheduler" alias="l3_agent_scheduler" description="Schedule routers among l3 agents" updated="2013-02-07T10:00:00-00:00" {{(pid=91722) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 16:50:13.721297 dv-cinder-790492-4-iscsi neutron-server[91722]: INFO neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Loaded extension: l3_agent_scheduler May 25 16:50:13.721617 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Loading extension file: logging.py {{(pid=91722) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 16:50:13.723151 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Ext name="Logging API Extension" alias="logging" description="Provides a logging API for resources such as security group and firewall." updated="2017-01-01T10:00:00-00:00" {{(pid=91722) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 16:50:13.723672 dv-cinder-790492-4-iscsi neutron-server[91722]: INFO neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Extension logging not supported by any of loaded plugins May 25 16:50:13.723997 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Loading extension file: metering.py {{(pid=91722) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 16:50:13.724723 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Ext name="Neutron Metering" alias="metering" description="Neutron Metering extension." updated="2013-06-12T10:00:00-00:00" {{(pid=91722) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 16:50:13.725301 dv-cinder-790492-4-iscsi neutron-server[91722]: INFO neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Loaded extension: metering May 25 16:50:13.725627 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Loading extension file: metering_source_and_destination_fields.py {{(pid=91722) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 16:50:13.726754 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Ext name="Neutron Metering with source and destination filtering" alias="metering_source_and_destination_fields" description="Neutron Metering extension that enables the use of source and destination IP prefixes to create metering label rules." updated="2020-08-21T08:12:00-00:00" {{(pid=91722) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 16:50:13.727267 dv-cinder-790492-4-iscsi neutron-server[91722]: INFO neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Loaded extension: metering_source_and_destination_fields May 25 16:50:13.727586 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Loading extension file: multiprovidernet.py {{(pid=91722) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 16:50:13.728639 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Ext name="Multi Provider Network" alias="multi-provider" description="Expose mapping of virtual networks to multiple physical networks" updated="2013-06-27T10:00:00-00:00" {{(pid=91722) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 16:50:13.729150 dv-cinder-790492-4-iscsi neutron-server[91722]: INFO neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Loaded extension: multi-provider May 25 16:50:13.729468 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Loading extension file: netmtu.py {{(pid=91722) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 16:50:13.730377 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Ext name="Network MTU" alias="net-mtu" description="Provides MTU attribute for a network resource." updated="2015-03-25T10:00:00-00:00" {{(pid=91722) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 16:50:13.730884 dv-cinder-790492-4-iscsi neutron-server[91722]: INFO neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Loaded extension: net-mtu May 25 16:50:13.731198 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Loading extension file: netmtu_writable.py {{(pid=91722) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 16:50:13.732087 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Ext name="Network MTU (writable)" alias="net-mtu-writable" description="Provides a writable MTU attribute for a network resource." updated="2017-07-12T00:00:00-00:00" {{(pid=91722) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 16:50:13.732595 dv-cinder-790492-4-iscsi neutron-server[91722]: INFO neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Loaded extension: net-mtu-writable May 25 16:50:13.732913 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Loading extension file: network_availability_zone.py {{(pid=91722) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 16:50:13.733564 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Ext name="Network Availability Zone" alias="network_availability_zone" description="Availability zone support for network." updated="2015-01-01T10:00:00-00:00" {{(pid=91722) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 16:50:13.734090 dv-cinder-790492-4-iscsi neutron-server[91722]: INFO neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Loaded extension: network_availability_zone May 25 16:50:13.734404 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Loading extension file: network_ip_availability.py {{(pid=91722) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 16:50:13.735494 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Ext name="Network IP Availability" alias="network-ip-availability" description="Provides IP availability data for each network and subnet." updated="2015-09-24T00:00:00-00:00" {{(pid=91722) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 16:50:13.736011 dv-cinder-790492-4-iscsi neutron-server[91722]: INFO neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Loaded extension: network-ip-availability May 25 16:50:13.736328 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Loading extension file: network_segment_range.py {{(pid=91722) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 16:50:13.737080 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Ext name="Neutron Network Segment Range" alias="network-segment-range" description="Provides support for the network segment range management" updated="2018-11-29T00:00:00-00:00" {{(pid=91722) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 16:50:13.737587 dv-cinder-790492-4-iscsi neutron-server[91722]: INFO neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Extension network-segment-range not supported by any of loaded plugins May 25 16:50:13.737912 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Loading extension file: pagination.py {{(pid=91722) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 16:50:13.738881 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Ext name="Pagination support" alias="pagination" description="Extension that indicates that pagination is enabled." updated="2016-06-12T00:00:00-00:00" {{(pid=91722) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 16:50:13.739206 dv-cinder-790492-4-iscsi neutron-server[91722]: INFO neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Loaded extension: pagination May 25 16:50:13.739521 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Loading extension file: port_device_profile.py {{(pid=91722) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 16:50:13.740403 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Ext name="Port device profile" alias="port-device-profile" description="Expose the port device profile (Cyborg)" updated="2020-12-17T10:00:00-00:00" {{(pid=91722) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 16:50:13.740918 dv-cinder-790492-4-iscsi neutron-server[91722]: INFO neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Loaded extension: port-device-profile May 25 16:50:13.741228 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Loading extension file: port_mac_address_regenerate.py {{(pid=91722) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 16:50:13.742140 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Ext name="Neutron Port MAC address regenerate" alias="port-mac-address-regenerate" description="Network port MAC address regenerate" updated="2018-05-03T10:00:00-00:00" {{(pid=91722) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 16:50:13.742671 dv-cinder-790492-4-iscsi neutron-server[91722]: INFO neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Loaded extension: port-mac-address-regenerate May 25 16:50:13.743004 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Loading extension file: port_numa_affinity_policy.py {{(pid=91722) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 16:50:13.743900 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Ext name="Port NUMA affinity policy" alias="port-numa-affinity-policy" description="Expose the port NUMA affinity policy" updated="2020-07-08T10:00:00-00:00" {{(pid=91722) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 16:50:13.744404 dv-cinder-790492-4-iscsi neutron-server[91722]: INFO neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Loaded extension: port-numa-affinity-policy May 25 16:50:13.744718 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Loading extension file: port_resource_request.py {{(pid=91722) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 16:50:13.745605 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Ext name="Port Resource Request" alias="port-resource-request" description="Expose resource request to Port" updated="2018-05-08T10:00:00-00:00" {{(pid=91722) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 16:50:13.746134 dv-cinder-790492-4-iscsi neutron-server[91722]: INFO neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Extension port-resource-request not supported by any of loaded plugins May 25 16:50:13.746452 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Loading extension file: portbindings.py {{(pid=91722) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 16:50:13.747350 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Ext name="Port Binding" alias="binding" description="Expose port bindings of a virtual port to external application" updated="2014-02-03T10:00:00-00:00" {{(pid=91722) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 16:50:13.747855 dv-cinder-790492-4-iscsi neutron-server[91722]: INFO neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Loaded extension: binding May 25 16:50:13.748170 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Loading extension file: portbindings_extended.py {{(pid=91722) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 16:50:13.749414 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Ext name="Port Bindings Extended" alias="binding-extended" description="Expose port bindings of a virtual port to external application" updated="2017-07-17T10:00:00-00:00" {{(pid=91722) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 16:50:13.749943 dv-cinder-790492-4-iscsi neutron-server[91722]: INFO neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Loaded extension: binding-extended May 25 16:50:13.750265 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Loading extension file: portsecurity.py {{(pid=91722) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 16:50:13.751174 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Ext name="Port Security" alias="port-security" description="Provides port security" updated="2012-07-23T10:00:00-00:00" {{(pid=91722) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 16:50:13.751685 dv-cinder-790492-4-iscsi neutron-server[91722]: INFO neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Loaded extension: port-security May 25 16:50:13.752001 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Loading extension file: project_id.py {{(pid=91722) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 16:50:13.752945 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Ext name="project_id field enabled" alias="project-id" description="Extension that indicates that project_id field is enabled." updated="2016-09-09T09:09:09-09:09" {{(pid=91722) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 16:50:13.753267 dv-cinder-790492-4-iscsi neutron-server[91722]: INFO neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Loaded extension: project-id May 25 16:50:13.753580 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Loading extension file: providernet.py {{(pid=91722) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 16:50:13.754499 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Ext name="Provider Network" alias="provider" description="Expose mapping of virtual networks to physical networks" updated="2012-09-07T10:00:00-00:00" {{(pid=91722) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 16:50:13.755028 dv-cinder-790492-4-iscsi neutron-server[91722]: INFO neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Loaded extension: provider May 25 16:50:13.755315 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Loading extension file: qos.py {{(pid=91722) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 16:50:13.758923 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Ext name="Quality of Service" alias="qos" description="The Quality of Service extension." updated="2015-06-08T10:00:00-00:00" {{(pid=91722) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 16:50:13.759476 dv-cinder-790492-4-iscsi neutron-server[91722]: INFO neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Extension qos not supported by any of loaded plugins May 25 16:50:13.759973 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Loading extension file: qos_bw_limit_direction.py {{(pid=91722) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 16:50:13.761513 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Ext name="Direction for QoS bandwidth limit rule" alias="qos-bw-limit-direction" description="Allow to configure QoS bandwidth limit rule with specific direction: ingress or egress" updated="2017-04-10T10:00:00-00:00" {{(pid=91722) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 16:50:13.762309 dv-cinder-790492-4-iscsi neutron-server[91722]: INFO neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Extension qos-bw-limit-direction not supported by any of loaded plugins May 25 16:50:13.762637 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Loading extension file: qos_bw_minimum_ingress.py {{(pid=91722) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 16:50:13.763758 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Ext name="Ingress direction for QoS minimum bandwidth rule" alias="qos-bw-minimum-ingress" description="Allow to configure QoS minumum bandwidth rule with ingress direction." updated="2018-07-09T10:00:00-00:00" {{(pid=91722) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 16:50:13.764437 dv-cinder-790492-4-iscsi neutron-server[91722]: INFO neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Extension qos-bw-minimum-ingress not supported by any of loaded plugins May 25 16:50:13.764766 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Loading extension file: qos_default.py {{(pid=91722) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 16:50:13.766027 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Ext name="QoS default policy" alias="qos-default" description="Expose the QoS default policy per project" updated="2017-041-06T10:00:00-00:00" {{(pid=91722) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 16:50:13.767167 dv-cinder-790492-4-iscsi neutron-server[91722]: INFO neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Extension qos-default not supported by any of loaded plugins May 25 16:50:13.767578 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Loading extension file: qos_fip.py {{(pid=91722) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 16:50:13.768373 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Ext name="Floating IP QoS" alias="qos-fip" description="The floating IP Quality of Service extension" updated="2017-07-20T00:00:00-00:00" {{(pid=91722) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 16:50:13.769028 dv-cinder-790492-4-iscsi neutron-server[91722]: INFO neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Extension qos-fip not supported by any of loaded plugins May 25 16:50:13.769413 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Loading extension file: qos_gateway_ip.py {{(pid=91722) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 16:50:13.770598 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Ext name="Router gateway IP QoS" alias="qos-gateway-ip" description="The Router gateway IP Quality of Service extension" updated="2018-02-24T00:00:00-00:00" {{(pid=91722) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 16:50:13.771224 dv-cinder-790492-4-iscsi neutron-server[91722]: INFO neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Extension qos-gateway-ip not supported by any of loaded plugins May 25 16:50:13.771608 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Loading extension file: qos_port_network_policy.py {{(pid=91722) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 16:50:13.772779 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Ext name="QoS port network policy ID" alias="qos-port-network-policy" description="Adds a the QoS network ID to the port definition" updated="2019-11-01T10:00:00-00:00" {{(pid=91722) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 16:50:13.773413 dv-cinder-790492-4-iscsi neutron-server[91722]: INFO neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Extension qos-port-network-policy not supported by any of loaded plugins May 25 16:50:13.773715 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Loading extension file: qos_rule_type_details.py {{(pid=91722) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 16:50:13.774900 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Ext name="Details of QoS rule types" alias="qos-rule-type-details" description="Expose details about QoS rule types supported by loaded backend drivers" updated="2017-06-22T10:00:00-00:00" {{(pid=91722) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 16:50:13.775558 dv-cinder-790492-4-iscsi neutron-server[91722]: INFO neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Extension qos-rule-type-details not supported by any of loaded plugins May 25 16:50:13.775871 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Loading extension file: qos_rules_alias.py {{(pid=91722) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 16:50:13.777285 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Ext name="Quality of Service rules alias API" alias="qos-rules-alias" description="API to enable GET, PUT and DELETE operations on QoS policy rules without specifying policy ID" updated="2018-10-07T10:00:00-00:00" {{(pid=91722) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 16:50:13.777980 dv-cinder-790492-4-iscsi neutron-server[91722]: INFO neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Extension qos-rules-alias not supported by any of loaded plugins May 25 16:50:13.778423 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Loading extension file: quotasv2.py {{(pid=91722) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 16:50:13.779760 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Ext name="Quota management support" alias="quotas" description="Expose functions for quotas management per tenant" updated="2012-07-29T10:00:00-00:00" {{(pid=91722) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 16:50:13.780265 dv-cinder-790492-4-iscsi neutron-server[91722]: INFO neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Loaded extension: quotas May 25 16:50:13.780696 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Loading extension file: quotasv2_detail.py {{(pid=91722) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 16:50:13.782927 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Ext name="Quota details management support" alias="quota_details" description="Expose functions for quotas usage statistics per project" updated="2017-02-10T10:00:00-00:00" {{(pid=91722) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 16:50:13.783259 dv-cinder-790492-4-iscsi neutron-server[91722]: INFO neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Loaded extension: quota_details May 25 16:50:13.783578 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Loading extension file: rbac.py {{(pid=91722) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 16:50:13.784632 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Ext name="RBAC Policies" alias="rbac-policies" description="Allows creation and modification of policies that control tenant access to resources." updated="2015-06-17T12:15:12-00:00" {{(pid=91722) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 16:50:13.785164 dv-cinder-790492-4-iscsi neutron-server[91722]: INFO neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Loaded extension: rbac-policies May 25 16:50:13.785486 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Loading extension file: rbac_address_group.py {{(pid=91722) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 16:50:13.786416 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Ext name="Add address_group type to RBAC" alias="rbac-address-group" description="Add address_group type to network RBAC" updated="2021-01-20T00:00:00-00:00" {{(pid=91722) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 16:50:13.786933 dv-cinder-790492-4-iscsi neutron-server[91722]: INFO neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Loaded extension: rbac-address-group May 25 16:50:13.787252 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Loading extension file: rbac_address_scope.py {{(pid=91722) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 16:50:13.788147 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Ext name="Add address_scope type to RBAC" alias="rbac-address-scope" description="Add address_scope type to RBAC" updated="2020-02-12T00:00:00-00:00" {{(pid=91722) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 16:50:13.788661 dv-cinder-790492-4-iscsi neutron-server[91722]: INFO neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Loaded extension: rbac-address-scope May 25 16:50:13.788977 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Loading extension file: rbac_security_groups.py {{(pid=91722) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 16:50:13.789863 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Ext name="Add security_group type to network RBAC" alias="rbac-security-groups" description="Add security_group type to network RBAC" updated="2019-02-14T00:00:00-00:00" {{(pid=91722) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 16:50:13.790397 dv-cinder-790492-4-iscsi neutron-server[91722]: INFO neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Loaded extension: rbac-security-groups May 25 16:50:13.790712 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Loading extension file: rbac_subnetpool.py {{(pid=91722) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 16:50:13.791612 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Ext name="Add subnetpool type to RBAC" alias="rbac-subnetpool" description="Add subnetpool type to RBAC" updated="2020-02-05T00:00:00-00:00" {{(pid=91722) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 16:50:13.792124 dv-cinder-790492-4-iscsi neutron-server[91722]: INFO neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Loaded extension: rbac-subnetpool May 25 16:50:13.792436 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Loading extension file: revisionifmatch.py {{(pid=91722) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 16:50:13.793323 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Ext name="If-Match constraints based on revision_number" alias="revision-if-match" description="Extension indicating that If-Match based on revision_number is supported." updated="2016-12-11T00:00:00-00:00" {{(pid=91722) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 16:50:13.793837 dv-cinder-790492-4-iscsi neutron-server[91722]: INFO neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Loaded extension: revision-if-match May 25 16:50:13.794188 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Loading extension file: revisions.py {{(pid=91722) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 16:50:13.795282 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Ext name="Resource revision numbers" alias="standard-attr-revisions" description="This extension will display the revision number of neutron resources." updated="2016-04-11T10:00:00-00:00" {{(pid=91722) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 16:50:13.795794 dv-cinder-790492-4-iscsi neutron-server[91722]: INFO neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Loaded extension: standard-attr-revisions May 25 16:50:13.796244 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Loading extension file: router_availability_zone.py {{(pid=91722) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 16:50:13.796906 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Ext name="Router Availability Zone" alias="router_availability_zone" description="Availability zone support for router." updated="2015-01-01T10:00:00-00:00" {{(pid=91722) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 16:50:13.797424 dv-cinder-790492-4-iscsi neutron-server[91722]: INFO neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Loaded extension: router_availability_zone May 25 16:50:13.797779 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Loading extension file: routerservicetype.py {{(pid=91722) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 16:50:13.798695 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Ext name="Router Service Type" alias="router-service-type" description="Provides router service type" updated="2013-01-29T00:00:00-00:00" {{(pid=91722) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 16:50:13.799211 dv-cinder-790492-4-iscsi neutron-server[91722]: INFO neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Extension router-service-type not supported by any of loaded plugins May 25 16:50:13.799527 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Loading extension file: security_groups_normalized_cidr.py {{(pid=91722) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 16:50:13.800419 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Ext name="Normalized CIDR field for security group rules" alias="security-groups-normalized-cidr" description="Add new field with normalized remote_ip_prefix cidr in SG rule" updated="2020-07-28T10:00:00-00:00" {{(pid=91722) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 16:50:13.800932 dv-cinder-790492-4-iscsi neutron-server[91722]: INFO neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Loaded extension: security-groups-normalized-cidr May 25 16:50:13.801246 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Loading extension file: security_groups_port_filtering.py {{(pid=91722) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 16:50:13.802176 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Ext name="Port filtering on security groups" alias="port-security-groups-filtering" description="Provides security groups filtering when listing ports" updated="2018-01-09T09:00:00-00:00" {{(pid=91722) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 16:50:13.802684 dv-cinder-790492-4-iscsi neutron-server[91722]: INFO neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Loaded extension: port-security-groups-filtering May 25 16:50:13.802999 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Loading extension file: security_groups_remote_address_group.py {{(pid=91722) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 16:50:13.803886 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Ext name="Remote address group id field for security group rules" alias="security-groups-remote-address-group" description="Add new field of remote address group id in SG rules" updated="2020-08-25T10:00:00-00:00" {{(pid=91722) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 16:50:13.804395 dv-cinder-790492-4-iscsi neutron-server[91722]: INFO neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Loaded extension: security-groups-remote-address-group May 25 16:50:13.804709 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Loading extension file: securitygroup.py {{(pid=91722) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 16:50:13.814443 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Ext name="security-group" alias="security-group" description="The security groups extension." updated="2012-10-05T10:00:00-00:00" {{(pid=91722) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 16:50:13.814986 dv-cinder-790492-4-iscsi neutron-server[91722]: INFO neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Loaded extension: security-group May 25 16:50:13.815311 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Loading extension file: segment.py {{(pid=91722) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 16:50:13.816106 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Ext name="Segment" alias="segment" description="Segments extension." updated="2016-02-24T17:00:00-00:00" {{(pid=91722) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 16:50:13.816622 dv-cinder-790492-4-iscsi neutron-server[91722]: INFO neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Extension segment not supported by any of loaded plugins May 25 16:50:13.816950 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Loading extension file: segments_peer_subnet_host_routes.py {{(pid=91722) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 16:50:13.817892 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Ext name="Segments peer-subnet host routes" alias="segments-peer-subnet-host-routes" description="Add host routes to subnets on a routed network (segments)" updated="2018-06-12T10:00:00-00:00" {{(pid=91722) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 16:50:13.818436 dv-cinder-790492-4-iscsi neutron-server[91722]: INFO neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Extension segments-peer-subnet-host-routes not supported by any of loaded plugins May 25 16:50:13.818755 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Loading extension file: servicetype.py {{(pid=91722) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 16:50:13.819840 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Ext name="Neutron Service Type Management" alias="service-type" description="API for retrieving service providers for Neutron advanced services" updated="2013-01-20T00:00:00-00:00" {{(pid=91722) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 16:50:13.820358 dv-cinder-790492-4-iscsi neutron-server[91722]: INFO neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Loaded extension: service-type May 25 16:50:13.820674 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Loading extension file: sorting.py {{(pid=91722) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 16:50:13.821628 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Ext name="Sorting support" alias="sorting" description="Extension that indicates that sorting is enabled." updated="2016-06-12T00:00:00-00:00" {{(pid=91722) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 16:50:13.821977 dv-cinder-790492-4-iscsi neutron-server[91722]: INFO neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Loaded extension: sorting May 25 16:50:13.822548 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Loading extension file: standard_attr_segment.py {{(pid=91722) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 16:50:13.823426 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Ext name="Standard Attribute Segment Extension" alias="standard-attr-segment" description="Add standard attributes to Segment resource" updated="2018-04-09T10:00:00-00:00" {{(pid=91722) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 16:50:13.823945 dv-cinder-790492-4-iscsi neutron-server[91722]: INFO neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Extension standard-attr-segment not supported by any of loaded plugins May 25 16:50:13.824256 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Loading extension file: standardattrdescription.py {{(pid=91722) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 16:50:13.824885 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Ext name="standard-attr-description" alias="standard-attr-description" description="Extension to add descriptions to standard attributes" updated="2016-02-10T10:00:00-00:00" {{(pid=91722) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 16:50:13.825398 dv-cinder-790492-4-iscsi neutron-server[91722]: INFO neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Loaded extension: standard-attr-description May 25 16:50:13.825714 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Loading extension file: stateful_security_group.py {{(pid=91722) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 16:50:13.826644 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Ext name="Stateful security group" alias="stateful-security-group" description="Indicates if the security group is stateful or not" updated="2019-11-26T09:00:00-00:00" {{(pid=91722) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 16:50:13.827151 dv-cinder-790492-4-iscsi neutron-server[91722]: INFO neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Loaded extension: stateful-security-group May 25 16:50:13.827466 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Loading extension file: stdattrs_common.py {{(pid=91722) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 16:50:13.828022 dv-cinder-790492-4-iscsi neutron-server[91722]: WARNING neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Did not find expected name "Stdattrs_common" in /opt/stack/neutron/neutron/extensions/stdattrs_common.py May 25 16:50:13.828332 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Loading extension file: subnet_dns_publish_fixed_ip.py {{(pid=91722) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 16:50:13.829819 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Ext name="Subnet DNS publish fixed IP" alias="subnet-dns-publish-fixed-ip" description="Support choosing to publish DNS records for IPs from a subnet" updated="2019-05-24T10:00:00-00:00" {{(pid=91722) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 16:50:13.830372 dv-cinder-790492-4-iscsi neutron-server[91722]: INFO neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Extension subnet-dns-publish-fixed-ip not supported by any of loaded plugins May 25 16:50:13.830687 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Loading extension file: subnet_onboard.py {{(pid=91722) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 16:50:13.831736 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Ext name="Subnet Onboard" alias="subnet_onboard" description="Provides support for onboarding subnets into subnet pools" updated="2018-12-18T09:00:00-00:00" {{(pid=91722) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 16:50:13.832257 dv-cinder-790492-4-iscsi neutron-server[91722]: INFO neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Loaded extension: subnet_onboard May 25 16:50:13.832573 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Loading extension file: subnet_segmentid_writable.py {{(pid=91722) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 16:50:13.833480 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Ext name="Subnet SegmentID (writable)" alias="subnet-segmentid-writable" description="Provides a writable segment_id attribute for a subnet resource." updated="2018-03-12T00:00:00-00:00" {{(pid=91722) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 16:50:13.834121 dv-cinder-790492-4-iscsi neutron-server[91722]: INFO neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Extension subnet-segmentid-writable not supported by any of loaded plugins May 25 16:50:13.834440 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Loading extension file: subnet_service_types.py {{(pid=91722) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 16:50:13.835339 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Ext name="Subnet service types" alias="subnet-service-types" description="Provides ability to set the subnet service_types field" updated="2016-03-15T18:00:00-00:00" {{(pid=91722) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 16:50:13.835859 dv-cinder-790492-4-iscsi neutron-server[91722]: INFO neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Loaded extension: subnet-service-types May 25 16:50:13.836177 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Loading extension file: subnetallocation.py {{(pid=91722) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 16:50:13.837242 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Ext name="Subnet Allocation" alias="subnet_allocation" description="Enables allocation of subnets from a subnet pool" updated="2015-03-30T10:00:00-00:00" {{(pid=91722) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 16:50:13.837824 dv-cinder-790492-4-iscsi neutron-server[91722]: INFO neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Loaded extension: subnet_allocation May 25 16:50:13.838167 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Loading extension file: subnetpool_prefix_ops.py {{(pid=91722) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 16:50:13.838821 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Ext name="Subnet Pool Prefix Operations" alias="subnetpool-prefix-ops" description="Provides support for adjusting the prefix list of subnet pools" updated="2019-02-08T10:00:00-00:00" {{(pid=91722) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 16:50:13.839333 dv-cinder-790492-4-iscsi neutron-server[91722]: INFO neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Loaded extension: subnetpool-prefix-ops May 25 16:50:13.839646 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Loading extension file: tag_ports_during_bulk_creation.py {{(pid=91722) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 16:50:13.840559 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Ext name="Tag Ports During Bulk Creation" alias="tag-ports-during-bulk-creation" description="Allow to tag ports during bulk creation" updated="2019-12-29T19:00:00-00:00" {{(pid=91722) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 16:50:13.841068 dv-cinder-790492-4-iscsi neutron-server[91722]: INFO neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Extension tag-ports-during-bulk-creation not supported by any of loaded plugins May 25 16:50:13.841381 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Loading extension file: tagging.py {{(pid=91722) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 16:50:13.842481 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Ext name="Tag support for resources with standard attribute: port, subnet, subnetpool, network, security_group, router, floatingip, policy, trunk, network_segment_range" alias="standard-attr-tag" description="Enables to set tag on resources with standard attribute." updated="2017-01-01T00:00:00-00:00" {{(pid=91722) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 16:50:13.843018 dv-cinder-790492-4-iscsi neutron-server[91722]: INFO neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Loaded extension: standard-attr-tag May 25 16:50:13.843335 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Loading extension file: timestamp.py {{(pid=91722) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 16:50:13.844537 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Ext name="Resource timestamps" alias="standard-attr-timestamp" description="Adds created_at and updated_at fields to all Neutron resources that have Neutron standard attributes." updated="2016-09-12T10:00:00-00:00" {{(pid=91722) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 16:50:13.845642 dv-cinder-790492-4-iscsi neutron-server[91722]: INFO neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Loaded extension: standard-attr-timestamp May 25 16:50:13.845991 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Loading extension file: trunk.py {{(pid=91722) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 16:50:13.847005 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Ext name="Trunk Extension" alias="trunk" description="Provides support for trunk ports" updated="2016-01-01T10:00:00-00:00" {{(pid=91722) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 16:50:13.847523 dv-cinder-790492-4-iscsi neutron-server[91722]: INFO neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Extension trunk not supported by any of loaded plugins May 25 16:50:13.847844 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Loading extension file: trunk_details.py {{(pid=91722) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 16:50:13.848830 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Ext name="Trunk port details" alias="trunk-details" description="Expose trunk port details" updated="2016-01-01T10:00:00-00:00" {{(pid=91722) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 16:50:13.849433 dv-cinder-790492-4-iscsi neutron-server[91722]: INFO neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Extension trunk-details not supported by any of loaded plugins May 25 16:50:13.849748 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Loading extension file: uplink_status_propagation.py {{(pid=91722) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 16:50:13.850685 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Ext name="Uplink status propagation extension" alias="uplink-status-propagation" description="Provides ability to propagate port uplink status." updated="2018-05-31T18:00:00-00:00" {{(pid=91722) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 16:50:13.851196 dv-cinder-790492-4-iscsi neutron-server[91722]: INFO neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Extension uplink-status-propagation not supported by any of loaded plugins May 25 16:50:13.851513 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Loading extension file: vlantransparent.py {{(pid=91722) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:445}} May 25 16:50:13.852171 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Ext name="Vlantransparent" alias="vlan-transparent" description="Provides Vlan Transparent Networks" updated="2015-03-23T09:00:00-00:00" {{(pid=91722) _check_extension /opt/stack/neutron/neutron/api/extensions.py:411}} May 25 16:50:13.852676 dv-cinder-790492-4-iscsi neutron-server[91722]: INFO neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Extension vlan-transparent not supported by any of loaded plugins May 25 16:50:13.855246 dv-cinder-790492-4-iscsi neutron-server[91722]: INFO neutron.quota.resource_registry [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Creating instance of TrackedResource for resource:network May 25 16:50:13.855997 dv-cinder-790492-4-iscsi neutron-server[91722]: INFO neutron.quota.resource_registry [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Creating instance of TrackedResource for resource:subnet May 25 16:50:13.857988 dv-cinder-790492-4-iscsi neutron-server[91722]: INFO neutron.quota.resource_registry [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Creating instance of TrackedResource for resource:subnetpool May 25 16:50:13.858552 dv-cinder-790492-4-iscsi neutron-server[91722]: INFO neutron.quota.resource_registry [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Creating instance of TrackedResource for resource:port May 25 16:50:13.859839 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.api.v2.resource_helper [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=91722) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} May 25 16:50:13.860299 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.api.v2.resource_helper [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Service FLAVORS assigned prefix: {{(pid=91722) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} May 25 16:50:13.860918 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.api.v2.resource_helper [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=91722) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} May 25 16:50:13.861354 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.api.v2.resource_helper [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=91722) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} May 25 16:50:13.861679 dv-cinder-790492-4-iscsi neutron-server[91722]: INFO neutron.quota.resource_registry [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Creating instance of TrackedResource for resource:router May 25 16:50:13.862362 dv-cinder-790492-4-iscsi neutron-server[91722]: INFO neutron.quota.resource_registry [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Creating instance of TrackedResource for resource:floatingip May 25 16:50:13.863050 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.api.v2.resource_helper [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Service METERING assigned prefix: /metering {{(pid=91722) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} May 25 16:50:13.864477 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron_lib.callbacks.manager [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Subscribe: > rbac-policy before_create 55550000 {{(pid=91722) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 16:50:13.864847 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron_lib.callbacks.manager [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Subscribe: > rbac-policy before_update 55550000 {{(pid=91722) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 16:50:13.865196 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron_lib.callbacks.manager [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Subscribe: > rbac-policy before_delete 55550000 {{(pid=91722) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 16:50:13.866359 dv-cinder-790492-4-iscsi neutron-server[91722]: INFO neutron.quota.resource_registry [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Creating instance of CountableResource for resource:rbac_policy May 25 16:50:13.866799 dv-cinder-790492-4-iscsi neutron-server[91722]: INFO neutron.quota.resource_registry [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Creating instance of TrackedResource for resource:security_group May 25 16:50:13.867460 dv-cinder-790492-4-iscsi neutron-server[91722]: INFO neutron.quota.resource_registry [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Creating instance of TrackedResource for resource:security_group_rule May 25 16:50:13.868188 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.api.v2.resource_helper [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Service CORE assigned prefix: {{(pid=91722) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} May 25 16:50:13.868510 dv-cinder-790492-4-iscsi neutron-server[91722]: INFO neutron.quota.resource_registry [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Creating instance of TrackedResource for resource:subnetpool May 25 16:50:13.868840 dv-cinder-790492-4-iscsi neutron-server[91722]: WARNING neutron.quota.resource_registry [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] subnetpool is already registered May 25 16:50:13.869429 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.api.v2.resource_helper [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Service CORE assigned prefix: {{(pid=91722) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} May 25 16:50:13.869752 dv-cinder-790492-4-iscsi neutron-server[91722]: INFO neutron.quota.resource_registry [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Creating instance of TrackedResource for resource:subnetpool May 25 16:50:13.870098 dv-cinder-790492-4-iscsi neutron-server[91722]: WARNING neutron.quota.resource_registry [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] subnetpool is already registered May 25 16:50:13.872675 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.api.v2.resource_helper [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=91722) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} May 25 16:50:13.873102 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.api.v2.resource_helper [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Service FLAVORS assigned prefix: {{(pid=91722) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} May 25 16:50:13.873691 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.api.v2.resource_helper [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=91722) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} May 25 16:50:13.874141 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.api.v2.resource_helper [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=91722) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} May 25 16:50:13.874466 dv-cinder-790492-4-iscsi neutron-server[91722]: INFO neutron.quota.resource_registry [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Creating instance of TrackedResource for resource:router May 25 16:50:13.874789 dv-cinder-790492-4-iscsi neutron-server[91722]: WARNING neutron.quota.resource_registry [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] router is already registered May 25 16:50:13.875373 dv-cinder-790492-4-iscsi neutron-server[91722]: INFO neutron.quota.resource_registry [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Creating instance of TrackedResource for resource:floatingip May 25 16:50:13.875694 dv-cinder-790492-4-iscsi neutron-server[91722]: WARNING neutron.quota.resource_registry [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] floatingip is already registered May 25 16:50:13.876336 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.api.v2.resource_helper [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Service METERING assigned prefix: /metering {{(pid=91722) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} May 25 16:50:13.877003 dv-cinder-790492-4-iscsi neutron-server[91722]: INFO neutron.quota.resource_registry [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Creating instance of CountableResource for resource:rbac_policy May 25 16:50:13.877323 dv-cinder-790492-4-iscsi neutron-server[91722]: WARNING neutron.quota.resource_registry [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] rbac_policy is already registered May 25 16:50:13.877852 dv-cinder-790492-4-iscsi neutron-server[91722]: INFO neutron.quota.resource_registry [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Creating instance of TrackedResource for resource:security_group May 25 16:50:13.878198 dv-cinder-790492-4-iscsi neutron-server[91722]: WARNING neutron.quota.resource_registry [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] security_group is already registered May 25 16:50:13.878785 dv-cinder-790492-4-iscsi neutron-server[91722]: INFO neutron.quota.resource_registry [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Creating instance of TrackedResource for resource:security_group_rule May 25 16:50:13.879120 dv-cinder-790492-4-iscsi neutron-server[91722]: WARNING neutron.quota.resource_registry [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] security_group_rule is already registered May 25 16:50:13.879777 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.api.v2.resource_helper [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Service CORE assigned prefix: {{(pid=91722) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} May 25 16:50:13.880098 dv-cinder-790492-4-iscsi neutron-server[91722]: INFO neutron.quota.resource_registry [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Creating instance of TrackedResource for resource:subnetpool May 25 16:50:13.880418 dv-cinder-790492-4-iscsi neutron-server[91722]: WARNING neutron.quota.resource_registry [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] subnetpool is already registered May 25 16:50:13.881018 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.api.v2.resource_helper [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Service CORE assigned prefix: {{(pid=91722) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} May 25 16:50:13.881336 dv-cinder-790492-4-iscsi neutron-server[91722]: INFO neutron.quota.resource_registry [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Creating instance of TrackedResource for resource:subnetpool May 25 16:50:13.881651 dv-cinder-790492-4-iscsi neutron-server[91722]: WARNING neutron.quota.resource_registry [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] subnetpool is already registered May 25 16:50:13.882305 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Extended resource: extensions {{(pid=91722) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 25 16:50:13.883799 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Extended resource: address-groups {{(pid=91722) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 25 16:50:13.885394 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Extended resource: address-scopes {{(pid=91722) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 25 16:50:13.886623 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Extended resource: agents {{(pid=91722) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 25 16:50:13.887763 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Extended resource: auto-allocated-topology {{(pid=91722) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 25 16:50:13.888984 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Extended resource: availability_zones {{(pid=91722) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 25 16:50:13.890306 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Extended resource: dhcp-networks {{(pid=91722) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 25 16:50:13.892337 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Extended resource: dhcp-agents {{(pid=91722) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 25 16:50:13.893674 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Extended resource: routers {{(pid=91722) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 25 16:50:13.895476 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Extended resource: flavors {{(pid=91722) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 25 16:50:13.896631 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Extended resource: service_profiles {{(pid=91722) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 25 16:50:13.897824 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Extended resource: next_providers {{(pid=91722) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 25 16:50:13.899336 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Extended resource: service_profiles {{(pid=91722) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 25 16:50:13.900757 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Extended resource: floatingip-pools {{(pid=91722) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 25 16:50:13.901968 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Extended resource: routers {{(pid=91722) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 25 16:50:13.903749 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Extended resource: floatingips {{(pid=91722) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 25 16:50:13.904917 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Extended resource: l3-routers {{(pid=91722) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 25 16:50:13.906302 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Extended resource: l3-agents {{(pid=91722) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 25 16:50:13.907832 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Extended resource: metering-labels {{(pid=91722) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 25 16:50:13.909159 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Extended resource: metering-label-rules {{(pid=91722) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 25 16:50:13.910453 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Extended resource: network-ip-availabilities {{(pid=91722) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 25 16:50:13.911676 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Extended resource: bindings {{(pid=91722) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 25 16:50:13.913325 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Extended resource: quotas {{(pid=91722) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 25 16:50:13.914760 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Extended resource: quotas {{(pid=91722) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 25 16:50:13.916137 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Extended resource: rbac-policies {{(pid=91722) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 25 16:50:13.917402 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Extended resource: security-groups {{(pid=91722) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 25 16:50:13.918627 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Extended resource: security-group-rules {{(pid=91722) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 25 16:50:13.919853 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Extended resource: service-providers {{(pid=91722) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 25 16:50:13.921054 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Extended resource: subnetpools {{(pid=91722) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 25 16:50:13.923958 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Extended resource: subnetpools {{(pid=91722) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 25 16:50:13.925384 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Extended resource: tags {{(pid=91722) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 25 16:50:13.927099 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Extended resource: tags {{(pid=91722) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 25 16:50:14.041128 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Extended resource: tags {{(pid=91722) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 25 16:50:14.042943 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Extended resource: tags {{(pid=91722) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 25 16:50:14.044688 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Extended resource: tags {{(pid=91722) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 25 16:50:14.046566 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Extended resource: tags {{(pid=91722) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 25 16:50:14.048753 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Extended resource: tags {{(pid=91722) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 25 16:50:14.050674 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Extended resource: tags {{(pid=91722) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 25 16:50:14.052419 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Extended resource: tags {{(pid=91722) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 25 16:50:14.054286 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron.api.extensions [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Extended resource: tags {{(pid=91722) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} May 25 16:50:14.060154 dv-cinder-790492-4-iscsi neutron-server[91722]: WARNING keystonemiddleware.auth_token [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 25 16:50:14.065458 dv-cinder-790492-4-iscsi neutron-server[91722]: WARNING keystonemiddleware.auth_token [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 25 16:50:14.074096 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_concurrency.lockutils [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Acquired lock "singleton_lock" {{(pid=91722) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:266}} May 25 16:50:14.074571 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_concurrency.lockutils [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Releasing lock "singleton_lock" {{(pid=91722) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:282}} May 25 16:50:14.075203 dv-cinder-790492-4-iscsi neutron-server[91722]: INFO oslo_service.service [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Starting 2 workers May 25 16:50:14.079998 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Started child 91829 {{(pid=91722) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:576}} May 25 16:50:14.084418 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Started child 91830 {{(pid=91722) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:576}} May 25 16:50:14.085477 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [-] Notify callbacks [] for process, after_init {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:50:14.086143 dv-cinder-790492-4-iscsi neutron-server[91722]: INFO neutron.service [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Neutron service started, listening on 0.0.0.0:9696 May 25 16:50:14.086687 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron_lib.callbacks.manager [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Notify callbacks [] for process, before_spawn {{(pid=91722) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:50:14.087099 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [-] (91829) wsgi starting up on http://0.0.0.0:9696 May 25 16:50:14.089215 dv-cinder-790492-4-iscsi neutron-server[91722]: INFO oslo_service.service [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Starting 1 workers May 25 16:50:14.090034 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [-] Notify callbacks [] for process, after_init {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:50:14.091444 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [-] (91830) wsgi starting up on http://0.0.0.0:9696 May 25 16:50:14.094413 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Started child 91831 {{(pid=91722) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:576}} May 25 16:50:14.095462 dv-cinder-790492-4-iscsi neutron-server[91722]: INFO oslo_service.service [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Starting 1 workers May 25 16:50:14.098591 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.service [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] calling RpcWorker wait() {{(pid=91831) _wait /opt/stack/neutron/neutron/service.py:128}} May 25 16:50:14.099175 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.service [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] returning from RpcWorker wait() {{(pid=91831) _wait /opt/stack/neutron/neutron/service.py:135}} May 25 16:50:14.099913 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Started child 91832 {{(pid=91722) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:576}} May 25 16:50:14.100423 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [-] Notify callbacks [] for process, after_init {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:50:14.100705 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG neutron_lib.callbacks.manager [None req-2eb0af5c-74bc-45cc-bee2-b64ce83f7c01 None None] Notify callbacks [] for process, after_spawn {{(pid=91722) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:50:14.100872 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.plugin [-] neutron.plugins.ml2.plugin.Ml2Plugin method start_rpc_listeners called with arguments () {} {{(pid=91831) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 16:50:14.102633 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] Full set of CONF: {{(pid=91722) wait /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:650}} May 25 16:50:14.102843 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] ******************************************************************************** {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 25 16:50:14.103191 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] Configuration options gathered from: {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 25 16:50:14.103413 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 25 16:50:14.103744 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 25 16:50:14.103901 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] ================================================================================ {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 25 16:50:14.104551 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] agent_down_time = 75 {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:14.104826 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] allow_automatic_dhcp_failover = True {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:14.105037 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron_lib.callbacks.manager [-] Notify callbacks [] for process, after_init {{(pid=91832) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:50:14.105530 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] allow_automatic_l3agent_failover = False {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:14.105530 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] allow_bulk = True {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:14.105677 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] allow_overlapping_ips = True {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:14.106154 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.services.l3_router.l3_router_plugin [-] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method start_rpc_listeners called with arguments () {} {{(pid=91832) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 16:50:14.106270 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] allowed_conntrack_helpers = [{'amanda': 'tcp'}, {'ftp': 'tcp'}, {'h323': 'udp'}, {'h323': 'tcp'}, {'irc': 'tcp'}, {'netbios-ns': 'udp'}, {'pptp': 'tcp'}, {'sane': 'tcp'}, {'sip': 'udp'}, {'sip': 'tcp'}, {'snmp': 'udp'}, {'tftp': 'udp'}] {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:14.106515 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] api_extensions_path = {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:14.106780 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] api_paste_config = api-paste.ini {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:14.107059 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] api_workers = 2 {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:14.107319 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] auth_strategy = keystone {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:14.107494 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] backdoor_port = None {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:14.107655 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] backdoor_socket = None {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:14.108068 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] backlog = 4096 {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:14.108302 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] base_mac = fa:16:3e:00:00:00 {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:14.108623 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] bind_host = 0.0.0.0 {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:14.108883 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] bind_port = 9696 {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:14.109118 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] client_socket_timeout = 900 {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:14.109393 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] config_dir = [] {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:14.109565 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] config_file = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:14.109815 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] config_source = [] {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:14.110105 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] control_exchange = neutron {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:14.110942 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] core_plugin = ml2 {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:14.111216 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] debug = True {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:14.111434 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] default_availability_zones = [] {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:14.111919 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:14.112143 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] dhcp_agent_notification = True {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:14.112391 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] dhcp_agents_per_network = 1 {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:14.112608 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] dhcp_lease_duration = 86400 {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:14.112895 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] dhcp_load_type = networks {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:14.113121 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] dns_domain = openstacklocal {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:14.113427 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] dvr_base_mac = fa:16:3f:00:00:00 {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:14.113647 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] enable_dvr = True {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:14.113857 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] enable_new_agents = True {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:14.114097 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] enable_services_on_agents_with_admin_state_down = False {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:14.114359 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] enable_snat_by_default = True {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:14.114596 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] enable_traditional_dhcp = True {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:14.114783 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] external_dns_driver = None {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:14.115018 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] filter_validation = True {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:14.115284 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] global_physnet_mtu = 1500 {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:14.115542 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] graceful_shutdown_timeout = 60 {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:14.116018 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] host = dv-cinder-790492-4-iscsi {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:14.116239 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] host_dvr_for_dhcp = True {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:14.116458 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] http_retries = 3 {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:14.116701 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] instance_format = [instance: %(uuid)s] {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:14.116953 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:14.117177 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] ipam_driver = internal {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:14.117408 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] ipv6_pd_enabled = False {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:14.117662 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] l3_ha = False {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:14.117920 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] l3_ha_net_cidr = 169.254.192.0/18 {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:14.118170 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] l3_ha_network_physical_name = {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:14.118377 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] l3_ha_network_type = {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:14.118630 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] log_config_append = None {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:14.118857 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:14.119101 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] log_dir = None {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:14.119337 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] log_file = None {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:14.119491 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] log_options = True {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:14.119718 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] log_rotate_interval = 1 {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:14.120022 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] log_rotate_interval_type = days {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:14.120284 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] log_rotation_type = none {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:14.120469 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:14.120626 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:14.120799 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:14.121052 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:14.121206 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:14.121455 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] max_allowed_address_pair = 10 {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:14.121670 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] max_dns_nameservers = 5 {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:14.121882 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] max_header_line = 16384 {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:14.122128 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] max_l3_agents_per_router = 3 {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:14.122363 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] max_logfile_count = 30 {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:14.122575 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] max_logfile_size_mb = 200 {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:14.122824 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] max_routes = 30 {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:14.123053 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] max_subnet_host_routes = 20 {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:14.123294 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] network_auto_schedule = True {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:14.123501 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] network_link_prefix = None {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:14.123743 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] network_scheduler_driver = neutron.scheduler.dhcp_agent_scheduler.WeightScheduler {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:14.123967 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] notify_nova_on_port_data_changes = True {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:14.124206 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] notify_nova_on_port_status_changes = True {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:14.124448 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] pagination_max_limit = -1 {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:14.124702 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] periodic_fuzzy_delay = 5 {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:14.124934 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] periodic_interval = 40 {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:14.125143 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] publish_errors = False {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:14.125352 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] rate_limit_burst = 0 {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:14.125660 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] rate_limit_except_level = CRITICAL {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:14.125828 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] rate_limit_interval = 0 {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:14.126097 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] retry_until_window = 30 {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:14.126307 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] router_auto_schedule = True {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:14.126516 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] router_distributed = False {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:14.126778 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] router_scheduler_driver = neutron.scheduler.l3_agent_scheduler.LeastRoutersScheduler {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:14.127029 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] rpc_response_max_timeout = 600 {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:14.127366 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] rpc_response_timeout = 60 {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:14.127915 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] rpc_state_report_workers = 0 {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:14.128074 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] rpc_workers = None {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:14.128285 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] send_events_interval = 2 {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:14.128551 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] service_plugins = ['router', 'neutron.services.metering.metering_plugin.MeteringPlugin'] {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:14.129942 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] setproctitle = on {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:14.129942 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] state_path = /opt/stack/data/neutron {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:14.129942 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] syslog_log_facility = LOG_USER {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:14.129942 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] tcp_keepidle = 600 {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:14.130245 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] transport_url = **** {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:14.130547 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] use_eventlog = False {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:14.131284 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] use_journal = False {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:14.131284 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] use_json = False {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:14.131560 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] use_ssl = False {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:14.131822 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] use_stderr = False {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:14.132258 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] use_syslog = False {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:14.132652 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] vlan_transparent = False {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:14.132900 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] watch_log_file = False {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:14.133117 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] wsgi_default_pool_size = 100 {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:14.133961 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] wsgi_keep_alive = True {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:14.133961 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:14.134263 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] oslo_concurrency.disable_process_locking = False {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.134901 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] oslo_concurrency.lock_path = /opt/stack/data/neutron/lock {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.134901 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] profiler.connection_string = messaging:// {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.134901 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] profiler.enabled = False {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.136142 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] profiler.es_doc_type = notification {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.136142 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] profiler.es_scroll_size = 10000 {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.136142 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] profiler.es_scroll_time = 2m {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.136142 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] profiler.filter_error_trace = False {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.136142 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] profiler.hmac_keys = SECRET_KEY {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.137987 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] profiler.sentinel_service_name = mymaster {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.137987 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] profiler.socket_timeout = 0.1 {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.137987 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] profiler.trace_sqlalchemy = False {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.137987 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] oslo_policy.enforce_new_defaults = False {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.137987 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] oslo_policy.enforce_scope = False {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.137987 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] oslo_policy.policy_default_rule = default {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.137987 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.137987 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] oslo_policy.policy_file = /etc/neutron/policy.json {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.139042 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.139042 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.139042 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.139042 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.140471 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.140471 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] nova.auth_section = None {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.140471 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] nova.auth_type = password {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.140471 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] nova.auth_url = http://10.222.0.62/identity {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.140471 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.140471 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] nova.certfile = None {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.144185 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] nova.collect_timing = False {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.144185 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] nova.default_domain_id = None {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.144185 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] nova.default_domain_name = None {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.144185 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] nova.domain_id = None {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.144185 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] nova.domain_name = None {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.144185 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] nova.endpoint_type = public {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.144185 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] nova.insecure = False {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.144185 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] nova.keyfile = None {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.144185 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] nova.live_migration_events = False {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.148001 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] nova.password = **** {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.148001 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] nova.project_domain_id = None {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.148001 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] nova.project_domain_name = Default {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.148001 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] nova.project_id = None {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.148001 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] nova.project_name = service {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.148001 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] nova.region_name = RegionOne {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.148001 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] nova.split_loggers = False {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.148001 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] nova.system_scope = None {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.148001 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] nova.timeout = None {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.148623 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] nova.trust_id = None {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.148623 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] nova.user_domain_id = None {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.148623 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] nova.user_domain_name = Default {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.148623 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] nova.user_id = None {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.148623 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] nova.username = nova {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.148623 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] placement.auth_section = None {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.148623 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] placement.auth_type = None {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.148623 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] placement.cafile = None {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.148623 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] placement.certfile = None {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.149375 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] placement.collect_timing = False {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.149375 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] placement.endpoint_type = public {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.149375 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] placement.insecure = False {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.149375 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] placement.keyfile = None {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.149375 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] placement.region_name = None {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.149375 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] placement.split_loggers = False {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.149375 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] placement.timeout = None {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.149375 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] ironic.auth_section = None {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.149375 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] ironic.auth_type = None {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.150049 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] ironic.cafile = None {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.150049 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] ironic.certfile = None {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.150049 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] ironic.collect_timing = False {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.150049 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] ironic.connect_retries = None {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.150341 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] ironic.connect_retry_delay = None {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.150494 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] ironic.enable_notifications = False {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.150711 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] ironic.endpoint_override = None {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.150923 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] ironic.insecure = False {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.151300 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] ironic.interface = None {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.151690 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] ironic.keyfile = None {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.152058 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] ironic.max_version = None {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.152296 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] ironic.min_version = None {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.152510 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] ironic.region_name = None {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.152799 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] ironic.service_name = None {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.153018 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] ironic.service_type = None {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.153238 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] ironic.split_loggers = False {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.153454 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] ironic.status_code_retries = None {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.153667 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] ironic.status_code_retry_delay = None {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.153879 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] ironic.timeout = None {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.154150 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] ironic.valid_interfaces = None {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.154382 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] ironic.version = None {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.154686 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] service_providers.service_provider = [] {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.155057 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.155305 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.155557 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.155801 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.156060 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.156296 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.156554 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.156768 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.156988 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.157756 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.158048 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.158297 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.158547 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.158793 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.159034 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.159276 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.159495 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.159955 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.160257 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.160654 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.160823 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.161119 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl = False {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.161550 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.161901 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.162334 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.162701 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_version = {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.163175 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] oslo_messaging_notifications.driver = [] {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.163624 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] oslo_messaging_notifications.retry = -1 {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.163899 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.164122 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] oslo_messaging_notifications.transport_url = **** {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.164396 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.164691 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] QUOTAS.default_quota = -1 {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.164978 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] QUOTAS.quota_driver = neutron.db.quota.driver.DbQuotaDriver {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.165238 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] QUOTAS.quota_floatingip = 50 {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.165493 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] QUOTAS.quota_network = 100 {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.165758 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] QUOTAS.quota_port = 500 {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.166166 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] QUOTAS.quota_rbac_policy = 10 {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.166413 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] QUOTAS.quota_router = 100 {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.166664 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] QUOTAS.quota_security_group = 100 {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.166899 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] QUOTAS.quota_security_group_rule = 100 {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.167141 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] QUOTAS.quota_subnet = 100 {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.167374 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] QUOTAS.track_quota_usage = True {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.167952 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] oslo_middleware.enable_proxy_headers_parsing = False {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.167952 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] healthcheck.backends = ['disable_by_file'] {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.168133 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] healthcheck.detailed = False {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.168612 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] healthcheck.disable_by_file_path = None {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.168612 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] healthcheck.path = /healthcheck {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.168856 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] keystone_authtoken.admin_password = **** {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.169082 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] keystone_authtoken.admin_tenant_name = admin {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.169547 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] keystone_authtoken.admin_token = **** {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.169924 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] keystone_authtoken.admin_user = None {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.170253 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] keystone_authtoken.auth_admin_prefix = {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.170480 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.170725 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] keystone_authtoken.auth_port = 35357 {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.170987 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] keystone_authtoken.auth_protocol = https {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.171232 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] keystone_authtoken.auth_section = None {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.171465 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] keystone_authtoken.auth_type = password {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.171716 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] keystone_authtoken.auth_uri = None {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.171946 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] keystone_authtoken.auth_url = http://10.222.0.62/identity {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.172158 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] keystone_authtoken.auth_version = None {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.172403 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] keystone_authtoken.cache = None {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.172869 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.173513 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] keystone_authtoken.certfile = None {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.174746 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] keystone_authtoken.default_domain_id = None {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.175148 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] keystone_authtoken.default_domain_name = None {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.175541 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] keystone_authtoken.delay_auth_decision = False {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.175964 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] keystone_authtoken.domain_id = None {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.176367 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] keystone_authtoken.domain_name = None {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.176811 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.177175 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] keystone_authtoken.http_connect_timeout = None {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.177401 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.177640 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] keystone_authtoken.identity_uri = None {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.177866 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] keystone_authtoken.include_service_catalog = True {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.178106 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] keystone_authtoken.insecure = False {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.178360 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] keystone_authtoken.interface = public {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.178593 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] keystone_authtoken.keyfile = None {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.178833 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.179072 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.179299 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.179704 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.179919 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.180278 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_secret_key = **** {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.180670 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_security_strategy = None {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.181032 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_use_advanced_pool = False {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.181456 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.181851 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] keystone_authtoken.password = **** {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.182257 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] keystone_authtoken.project_domain_id = None {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.182639 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] keystone_authtoken.project_domain_name = Default {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.183055 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] keystone_authtoken.project_id = None {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.183437 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] keystone_authtoken.project_name = service {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.183813 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] keystone_authtoken.region_name = None {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.184061 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.184303 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] keystone_authtoken.service_token_roles_required = False {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.184527 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] keystone_authtoken.service_type = None {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.184736 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] keystone_authtoken.system_scope = None {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.184978 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] keystone_authtoken.token_cache_time = 300 {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.185183 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] keystone_authtoken.trust_id = None {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.185554 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] keystone_authtoken.user_domain_id = None {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.185983 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] keystone_authtoken.user_domain_name = Default {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.186357 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] keystone_authtoken.user_id = None {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.186746 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] keystone_authtoken.username = neutron {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.187156 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] keystone_authtoken.www_authenticate_uri = None {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.187487 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] cache.backend = dogpile.cache.null {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.187741 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] cache.backend_argument = **** {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.187967 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] cache.config_prefix = cache.oslo {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.188391 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] cache.debug_cache_backend = False {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.188610 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] cache.enabled = False {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.188860 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] cache.expiration_time = 600 {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.189099 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] cache.memcache_dead_retry = 300 {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.189317 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.189551 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.189760 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] cache.memcache_pool_maxsize = 10 {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.190003 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] cache.memcache_pool_unused_timeout = 60 {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.190259 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] cache.memcache_servers = ['localhost:11211'] {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.190500 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] cache.memcache_socket_timeout = 1.0 {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.190739 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] cache.proxies = [] {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.190949 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] cache.tls_allowed_ciphers = None {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.191168 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] cache.tls_cafile = None {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.191394 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] cache.tls_certfile = None {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.191611 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] cache.tls_enabled = False {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.191838 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] cache.tls_keyfile = None {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.192131 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] privsep.capabilities = [21, 12, 1, 2, 19] {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.192372 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] privsep.group = None {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.192596 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] privsep.helper_command = None {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.192832 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] privsep.thread_pool_size = 4 {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.193067 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] privsep.user = None {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.193292 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] privsep_dhcp_release.capabilities = [21, 12] {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.193499 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] privsep_dhcp_release.group = None {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.193706 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] privsep_dhcp_release.helper_command = None {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.193940 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] privsep_dhcp_release.thread_pool_size = 4 {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.194151 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] privsep_dhcp_release.user = None {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.194398 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.capabilities = [21, 12] {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.194605 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.group = None {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.194814 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.helper_command = None {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.195047 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.thread_pool_size = 4 {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.195259 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.user = None {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.195606 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] privsep_namespace.capabilities = [21] {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.195802 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] privsep_namespace.group = None {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.196011 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] privsep_namespace.helper_command = None {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.196224 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] privsep_namespace.thread_pool_size = 4 {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.196430 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] privsep_namespace.user = None {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.196657 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] privsep_conntrack.capabilities = [12] {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.196863 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] privsep_conntrack.group = None {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.197069 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] privsep_conntrack.helper_command = None {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.197550 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] privsep_conntrack.thread_pool_size = 4 {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.197758 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] privsep_conntrack.user = None {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.198109 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] AGENT.root_helper = sudo /usr/local/bin/neutron-rootwrap /etc/neutron/rootwrap.conf {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.198369 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] AGENT.root_helper_daemon = sudo /usr/local/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.198587 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] AGENT.use_helper_for_ns_read = True {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.198876 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] SECURITYGROUP.enable_ipset = True {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.199103 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] SECURITYGROUP.enable_security_group = True {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.199329 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] SECURITYGROUP.firewall_driver = openvswitch {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.199591 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] SECURITYGROUP.permitted_ethertypes = [] {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.199930 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] ml2.extension_drivers = ['port_security'] {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.200134 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] ml2.external_network_type = None {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.200373 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] ml2.mechanism_drivers = ['openvswitch', 'hyperv'] {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.200588 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] ml2.overlay_ip_version = 4 {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.200803 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] ml2.path_mtu = 0 {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.201019 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] ml2.physical_network_mtus = [] {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.201272 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] ml2.tenant_network_types = ['vlan'] {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.201580 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] ml2.type_drivers = ['local', 'flat', 'vlan', 'gre', 'vxlan', 'geneve'] {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.201878 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] ml2_type_flat.flat_networks = ['physnet1'] {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.202182 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] ml2_type_geneve.max_header_size = 30 {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.202421 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] ml2_type_geneve.vni_ranges = ['1:1000'] {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.202691 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] ml2_type_gre.tunnel_id_ranges = ['1:1000'] {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.202990 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] ml2_type_vlan.network_vlan_ranges = ['physnet1:650:699'] {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.203249 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] ml2_type_vxlan.vni_ranges = ['1:1000'] {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.203479 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] ml2_type_vxlan.vxlan_group = None {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.203785 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] OVS_DRIVER.vnic_type_prohibit_list = [] {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.204151 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] database.backend = sqlalchemy {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.204420 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] database.connection = **** {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.204771 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] database.connection_debug = 0 {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.205093 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] database.connection_parameters = {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.205401 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] database.connection_recycle_time = 3600 {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.205807 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] database.connection_trace = False {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.206230 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] database.db_inc_retry_interval = True {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.206792 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] database.db_max_retries = 20 {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.207046 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] database.db_max_retry_interval = 10 {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.207269 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] database.db_retry_interval = 1 {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.207512 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] database.max_overflow = 50 {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.207741 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] database.max_pool_size = 50 {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.207965 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] database.max_retries = 10 {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.208179 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] database.mysql_enable_ndb = False {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.208422 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] database.mysql_sql_mode = TRADITIONAL {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.208662 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] database.pool_timeout = None {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.209008 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] database.retry_interval = 10 {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.209141 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] database.slave_connection = **** {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.209463 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] database.sqlite_synchronous = True {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.209578 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] database.use_db_reconnect = False {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.209738 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] ******************************************************************************** {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 25 16:50:14.210357 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] Full set of CONF: {{(pid=91722) wait /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:650}} May 25 16:50:14.210514 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] ******************************************************************************** {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 25 16:50:14.210666 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] Configuration options gathered from: {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 25 16:50:14.210831 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 25 16:50:14.210997 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 25 16:50:14.211147 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] ================================================================================ {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 25 16:50:14.211373 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] agent_down_time = 75 {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:14.211566 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] allow_automatic_dhcp_failover = True {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:14.211685 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] allow_automatic_l3agent_failover = False {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:14.211844 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] allow_bulk = True {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:14.211998 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] allow_overlapping_ips = True {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:14.212176 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] allowed_conntrack_helpers = [{'amanda': 'tcp'}, {'ftp': 'tcp'}, {'h323': 'udp'}, {'h323': 'tcp'}, {'irc': 'tcp'}, {'netbios-ns': 'udp'}, {'pptp': 'tcp'}, {'sane': 'tcp'}, {'sip': 'udp'}, {'sip': 'tcp'}, {'snmp': 'udp'}, {'tftp': 'udp'}] {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:14.212340 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] api_extensions_path = {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:14.212500 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] api_paste_config = api-paste.ini {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:14.212658 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] api_workers = 2 {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:14.212815 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] auth_strategy = keystone {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:14.212970 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] backdoor_port = None {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:14.213126 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] backdoor_socket = None {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:14.213281 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] backlog = 4096 {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:14.213436 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] base_mac = fa:16:3e:00:00:00 {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:14.213594 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] bind_host = 0.0.0.0 {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:14.213735 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] bind_port = 9696 {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:14.213886 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] client_socket_timeout = 900 {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:14.214073 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] config_dir = [] {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:14.214230 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] config_file = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:14.214390 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] config_source = [] {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:14.214544 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] control_exchange = neutron {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:14.214699 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] core_plugin = ml2 {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:14.214854 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] debug = True {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:14.215010 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] default_availability_zones = [] {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:14.215201 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:14.215361 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] dhcp_agent_notification = True {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:14.215517 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] dhcp_agents_per_network = 1 {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:14.215674 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] dhcp_lease_duration = 86400 {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:14.216142 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] dhcp_load_type = networks {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:14.216142 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] dns_domain = openstacklocal {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:14.216142 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] dvr_base_mac = fa:16:3f:00:00:00 {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:14.216381 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] enable_dvr = True {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:14.216459 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] enable_new_agents = True {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:14.216559 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] enable_services_on_agents_with_admin_state_down = False {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:14.216714 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] enable_snat_by_default = True {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:14.216868 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] enable_traditional_dhcp = True {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:14.217023 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] external_dns_driver = None {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:14.217182 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] filter_validation = True {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:14.217342 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] global_physnet_mtu = 1500 {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:14.217499 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] graceful_shutdown_timeout = 60 {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:14.217652 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] host = dv-cinder-790492-4-iscsi {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:14.217981 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] host_dvr_for_dhcp = True {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:14.218128 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] http_retries = 3 {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:14.218284 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] instance_format = [instance: %(uuid)s] {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:14.218441 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:14.218597 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] ipam_driver = internal {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:14.218752 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] ipv6_pd_enabled = False {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:14.218907 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] l3_ha = False {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:14.219065 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] l3_ha_net_cidr = 169.254.192.0/18 {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:14.219220 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] l3_ha_network_physical_name = {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:14.219374 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] l3_ha_network_type = {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:14.219552 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] log_config_append = None {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:14.220201 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:14.220356 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] log_dir = None {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:14.220513 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] log_file = None {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:14.220668 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] log_options = True {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:14.220823 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] log_rotate_interval = 1 {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:14.220979 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] log_rotate_interval_type = days {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:14.221134 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] log_rotation_type = none {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:14.221306 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:14.221493 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:14.221619 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:14.221776 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:14.222007 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:14.222090 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] max_allowed_address_pair = 10 {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:14.222242 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] max_dns_nameservers = 5 {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:14.222549 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] max_header_line = 16384 {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:14.222692 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] max_l3_agents_per_router = 3 {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:14.222852 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] max_logfile_count = 30 {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:14.223009 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] max_logfile_size_mb = 200 {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:14.223167 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] max_routes = 30 {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:14.223345 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] max_subnet_host_routes = 20 {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:14.223466 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] network_auto_schedule = True {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:14.223623 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] network_link_prefix = None {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:14.223765 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] network_scheduler_driver = neutron.scheduler.dhcp_agent_scheduler.WeightScheduler {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:14.223922 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] notify_nova_on_port_data_changes = True {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:14.224077 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] notify_nova_on_port_status_changes = True {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:14.224233 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] pagination_max_limit = -1 {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:14.224392 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] periodic_fuzzy_delay = 5 {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:14.224543 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] periodic_interval = 40 {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:14.224847 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] publish_errors = False {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:14.225008 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] rate_limit_burst = 0 {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:14.226169 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] rate_limit_except_level = CRITICAL {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:14.226169 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] rate_limit_interval = 0 {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:14.226169 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] retry_until_window = 30 {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:14.226169 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] router_auto_schedule = True {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:14.226169 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] router_distributed = False {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:14.226169 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] router_scheduler_driver = neutron.scheduler.l3_agent_scheduler.LeastRoutersScheduler {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:14.226169 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] rpc_response_max_timeout = 600 {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:14.226169 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] rpc_response_timeout = 60 {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:14.226719 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] rpc_state_report_workers = 0 {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:14.226719 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] rpc_workers = None {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:14.226719 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] send_events_interval = 2 {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:14.226893 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] service_plugins = ['router', 'neutron.services.metering.metering_plugin.MeteringPlugin'] {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:14.226964 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] setproctitle = on {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:14.227065 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] state_path = /opt/stack/data/neutron {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:14.227262 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] syslog_log_facility = LOG_USER {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:14.227367 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] tcp_keepidle = 600 {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:14.227514 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] transport_url = **** {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:14.227614 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.services.l3_router.l3_router_plugin [-] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method start_rpc_listeners called with arguments () {} {{(pid=91831) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 16:50:14.227705 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] use_eventlog = False {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:14.227796 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] use_journal = False {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:14.227955 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] use_json = False {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:14.228109 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] use_ssl = False {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:14.228264 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] use_stderr = False {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:14.228419 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] use_syslog = False {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:14.228574 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] vlan_transparent = False {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:14.228730 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] watch_log_file = False {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:14.228885 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] wsgi_default_pool_size = 100 {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:14.229040 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] wsgi_keep_alive = True {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:14.229196 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 16:50:14.229375 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] oslo_concurrency.disable_process_locking = False {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.229534 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] oslo_concurrency.lock_path = /opt/stack/data/neutron/lock {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.229701 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] profiler.connection_string = messaging:// {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.229859 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] profiler.enabled = False {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.230042 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] profiler.es_doc_type = notification {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.230201 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] profiler.es_scroll_size = 10000 {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.230358 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] profiler.es_scroll_time = 2m {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.230515 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] profiler.filter_error_trace = False {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.230672 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] profiler.hmac_keys = SECRET_KEY {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.230831 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] profiler.sentinel_service_name = mymaster {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.230997 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] profiler.socket_timeout = 0.1 {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.231155 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] profiler.trace_sqlalchemy = False {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.231323 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] oslo_policy.enforce_new_defaults = False {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.231480 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] oslo_policy.enforce_scope = False {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.231641 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] oslo_policy.policy_default_rule = default {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.231805 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.231960 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] oslo_policy.policy_file = /etc/neutron/policy.json {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.232118 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.232275 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.232437 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.232595 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.232752 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.232925 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] nova.auth_section = None {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.233083 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] nova.auth_type = password {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.233241 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] nova.auth_url = http://10.222.0.62/identity {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.233398 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.233556 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] nova.certfile = None {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.233713 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] nova.collect_timing = False {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.233873 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] nova.default_domain_id = None {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.234055 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] nova.default_domain_name = None {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.234214 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] nova.domain_id = None {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.234373 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] nova.domain_name = None {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.234532 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] nova.endpoint_type = public {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.234690 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] nova.insecure = False {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.234847 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] nova.keyfile = None {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.235027 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] nova.live_migration_events = False {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.235169 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] nova.password = **** {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.235862 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] nova.project_domain_id = None {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.236026 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] nova.project_domain_name = Default {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.236185 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] nova.project_id = None {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.236344 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] nova.project_name = service {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.236501 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] nova.region_name = RegionOne {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.236659 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] nova.split_loggers = False {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.236817 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] nova.system_scope = None {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.236979 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] nova.timeout = None {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.237157 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] nova.trust_id = None {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.237321 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] nova.user_domain_id = None {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.237482 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] nova.user_domain_name = Default {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.237657 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] nova.user_id = None {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.237796 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] nova.username = nova {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.237988 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] placement.auth_section = None {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.238148 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] placement.auth_type = None {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.238306 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] placement.cafile = None {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.238463 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] placement.certfile = None {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.238622 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] placement.collect_timing = False {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.238780 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] placement.endpoint_type = public {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.238937 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] placement.insecure = False {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.239177 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] placement.keyfile = None {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.239343 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] placement.region_name = None {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.240994 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] placement.split_loggers = False {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.240994 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] placement.timeout = None {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.240994 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] ironic.auth_section = None {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.240994 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] ironic.auth_type = None {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.240994 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] ironic.cafile = None {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.240994 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] ironic.certfile = None {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.240994 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] ironic.collect_timing = False {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.240994 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] ironic.connect_retries = None {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.243276 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] ironic.connect_retry_delay = None {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.243276 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] ironic.enable_notifications = False {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.243276 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] ironic.endpoint_override = None {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.243276 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] ironic.insecure = False {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.243276 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] ironic.interface = None {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.243276 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] ironic.keyfile = None {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.243276 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] ironic.max_version = None {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.243276 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] ironic.min_version = None {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.243276 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] ironic.region_name = None {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.243899 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] ironic.service_name = None {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.243899 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] ironic.service_type = None {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.243899 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] ironic.split_loggers = False {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.243899 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] ironic.status_code_retries = None {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.243899 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] ironic.status_code_retry_delay = None {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.243899 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] ironic.timeout = None {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.243899 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] ironic.valid_interfaces = None {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.243899 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] ironic.version = None {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.243899 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] service_providers.service_provider = [] {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.244501 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.244501 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.244501 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.244501 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.244501 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.244501 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.244911 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.244911 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.245055 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.245134 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.245250 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.245410 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.245570 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.245728 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.245891 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.246073 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.246232 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.246391 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.247026 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.247026 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.247026 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.247026 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl = False {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.247393 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.247393 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.247562 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.247642 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_version = {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.247744 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] oslo_messaging_notifications.driver = [] {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.247903 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] oslo_messaging_notifications.retry = -1 {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.248065 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.249005 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] oslo_messaging_notifications.transport_url = **** {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.249005 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.249005 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] QUOTAS.default_quota = -1 {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.249005 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] QUOTAS.quota_driver = neutron.db.quota.driver.DbQuotaDriver {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.249005 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] QUOTAS.quota_floatingip = 50 {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.249005 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] QUOTAS.quota_network = 100 {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.249438 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] QUOTAS.quota_port = 500 {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.249438 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] QUOTAS.quota_rbac_policy = 10 {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.249438 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] QUOTAS.quota_router = 100 {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.249662 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] QUOTAS.quota_security_group = 100 {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.249742 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] QUOTAS.quota_security_group_rule = 100 {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.249851 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] QUOTAS.quota_subnet = 100 {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.250039 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] QUOTAS.track_quota_usage = True {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.251765 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] oslo_middleware.enable_proxy_headers_parsing = False {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.251765 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] healthcheck.backends = ['disable_by_file'] {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.251765 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] healthcheck.detailed = False {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.251765 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] healthcheck.disable_by_file_path = None {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.251765 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] healthcheck.path = /healthcheck {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.251765 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] keystone_authtoken.admin_password = **** {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.251765 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] keystone_authtoken.admin_tenant_name = admin {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.251765 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] keystone_authtoken.admin_token = **** {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.253991 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] keystone_authtoken.admin_user = None {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.253991 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] keystone_authtoken.auth_admin_prefix = {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.253991 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.253991 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] keystone_authtoken.auth_port = 35357 {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.253991 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] keystone_authtoken.auth_protocol = https {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.253991 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] keystone_authtoken.auth_section = None {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.253991 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] keystone_authtoken.auth_type = password {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.253991 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] keystone_authtoken.auth_uri = None {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.254485 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] keystone_authtoken.auth_url = http://10.222.0.62/identity {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.254485 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] keystone_authtoken.auth_version = None {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.254485 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] keystone_authtoken.cache = None {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.254485 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.254485 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] keystone_authtoken.certfile = None {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.254485 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] keystone_authtoken.default_domain_id = None {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.254485 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] keystone_authtoken.default_domain_name = None {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.254485 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] keystone_authtoken.delay_auth_decision = False {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.255024 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] keystone_authtoken.domain_id = None {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.255024 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] keystone_authtoken.domain_name = None {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.255024 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.255024 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] keystone_authtoken.http_connect_timeout = None {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.255024 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.255024 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] keystone_authtoken.identity_uri = None {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.255024 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] keystone_authtoken.include_service_catalog = True {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.255024 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] keystone_authtoken.insecure = False {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.255485 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] keystone_authtoken.interface = public {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.255485 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] keystone_authtoken.keyfile = None {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.255485 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.255485 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.255705 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.255769 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.255934 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.256265 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_secret_key = **** {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.256265 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_security_strategy = None {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.256474 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_use_advanced_pool = False {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.256562 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.256676 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] keystone_authtoken.password = **** {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.256840 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] keystone_authtoken.project_domain_id = None {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.257001 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] keystone_authtoken.project_domain_name = Default {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.257161 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] keystone_authtoken.project_id = None {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.257321 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] keystone_authtoken.project_name = service {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.257476 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] keystone_authtoken.region_name = None {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.257633 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.257833 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] keystone_authtoken.service_token_roles_required = False {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.257954 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] keystone_authtoken.service_type = None {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.258119 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] keystone_authtoken.system_scope = None {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.258278 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] keystone_authtoken.token_cache_time = 300 {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.258436 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] keystone_authtoken.trust_id = None {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.258595 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] keystone_authtoken.user_domain_id = None {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.258753 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] keystone_authtoken.user_domain_name = Default {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.258912 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] keystone_authtoken.user_id = None {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.259071 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] keystone_authtoken.username = neutron {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.259228 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] keystone_authtoken.www_authenticate_uri = None {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.259402 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] cache.backend = dogpile.cache.null {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.259559 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] cache.backend_argument = **** {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.259720 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] cache.config_prefix = cache.oslo {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.259867 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] cache.debug_cache_backend = False {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.260019 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] cache.enabled = False {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.260178 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] cache.expiration_time = 600 {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.260338 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] cache.memcache_dead_retry = 300 {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.260498 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.260656 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.260814 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] cache.memcache_pool_maxsize = 10 {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.260972 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] cache.memcache_pool_unused_timeout = 60 {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.261144 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] cache.memcache_servers = ['localhost:11211'] {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.261309 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] cache.memcache_socket_timeout = 1.0 {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.261451 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] cache.proxies = [] {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.261592 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] cache.tls_allowed_ciphers = None {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.261732 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] cache.tls_cafile = None {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.261885 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] cache.tls_certfile = None {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.262050 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] cache.tls_enabled = False {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.262219 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] cache.tls_keyfile = None {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.262382 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] privsep.capabilities = [21, 12, 1, 2, 19] {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.262526 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] privsep.group = None {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.262682 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] privsep.helper_command = None {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.262822 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] privsep.thread_pool_size = 4 {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.262978 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] privsep.user = None {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.263144 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] privsep_dhcp_release.capabilities = [21, 12] {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.263292 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] privsep_dhcp_release.group = None {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.263446 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] privsep_dhcp_release.helper_command = None {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.263602 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] privsep_dhcp_release.thread_pool_size = 4 {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.263759 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] privsep_dhcp_release.user = None {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.263926 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.capabilities = [21, 12] {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.264083 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.group = None {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.264240 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.helper_command = None {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.264397 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.thread_pool_size = 4 {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.264554 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.user = None {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.264721 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] privsep_namespace.capabilities = [21] {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.264865 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] privsep_namespace.group = None {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.265022 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] privsep_namespace.helper_command = None {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.265180 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] privsep_namespace.thread_pool_size = 4 {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.265337 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] privsep_namespace.user = None {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.265503 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] privsep_conntrack.capabilities = [12] {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.265661 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] privsep_conntrack.group = None {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.265818 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] privsep_conntrack.helper_command = None {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.265989 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] privsep_conntrack.thread_pool_size = 4 {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.266145 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] privsep_conntrack.user = None {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.266313 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] AGENT.root_helper = sudo /usr/local/bin/neutron-rootwrap /etc/neutron/rootwrap.conf {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.266985 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] AGENT.root_helper_daemon = sudo /usr/local/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.266985 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] AGENT.use_helper_for_ns_read = True {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.266985 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] SECURITYGROUP.enable_ipset = True {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.266985 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] SECURITYGROUP.enable_security_group = True {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.267351 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] SECURITYGROUP.firewall_driver = openvswitch {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.267351 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] SECURITYGROUP.permitted_ethertypes = [] {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.267518 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] ml2.extension_drivers = ['port_security'] {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.267707 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] ml2.external_network_type = None {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.267707 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] ml2.mechanism_drivers = ['openvswitch', 'hyperv'] {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.267894 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] ml2.overlay_ip_version = 4 {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.267993 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] ml2.path_mtu = 0 {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.268165 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] ml2.physical_network_mtus = [] {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.268304 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] ml2.tenant_network_types = ['vlan'] {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.268463 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] ml2.type_drivers = ['local', 'flat', 'vlan', 'gre', 'vxlan', 'geneve'] {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.268631 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] ml2_type_flat.flat_networks = ['physnet1'] {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.268800 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] ml2_type_geneve.max_header_size = 30 {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.268960 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] ml2_type_geneve.vni_ranges = ['1:1000'] {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.269127 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] ml2_type_gre.tunnel_id_ranges = ['1:1000'] {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.269300 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] ml2_type_vlan.network_vlan_ranges = ['physnet1:650:699'] {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.269466 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] ml2_type_vxlan.vni_ranges = ['1:1000'] {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.269627 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] ml2_type_vxlan.vxlan_group = None {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.269797 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] OVS_DRIVER.vnic_type_prohibit_list = [] {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.269998 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] database.backend = sqlalchemy {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.270141 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] database.connection = **** {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.270275 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] database.connection_debug = 0 {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.270519 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] database.connection_parameters = {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.270762 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] database.connection_recycle_time = 3600 {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.270964 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] database.connection_trace = False {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.271206 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] database.db_inc_retry_interval = True {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.271403 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] database.db_max_retries = 20 {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.271537 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] database.db_max_retry_interval = 10 {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.271668 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] database.db_retry_interval = 1 {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.271826 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] database.max_overflow = 50 {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.271965 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] database.max_pool_size = 50 {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.272128 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] database.max_retries = 10 {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.272284 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] database.mysql_enable_ndb = False {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.272450 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] database.mysql_sql_mode = TRADITIONAL {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.272590 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] database.pool_timeout = None {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.272753 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] database.retry_interval = 10 {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.272910 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] database.slave_connection = **** {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.273071 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] database.sqlite_synchronous = True {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.273230 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] database.use_db_reconnect = False {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 16:50:14.273684 dv-cinder-790492-4-iscsi neutron-server[91722]: DEBUG oslo_service.service [-] ******************************************************************************** {{(pid=91722) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 25 16:50:14.302277 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.wsgi [-] (91830) accepted ('10.222.0.62', 52652) {{(pid=91830) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:50:14.310670 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [-] 10.222.0.62 "GET / HTTP/1.1" status: 200 len: 253 time: 0.0063381 May 25 16:50:25.305714 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-46d83294-001b-4f24-a689-fffff9452858 None None] get_active_networks_info from dv-cinder-790492-4-iscsi {{(pid=91831) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:158}} May 25 16:50:25.401115 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-46d83294-001b-4f24-a689-fffff9452858 None None] No non-hosted networks {{(pid=91831) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:60}} May 25 16:50:25.411569 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-573305c9-27cc-4c56-a895-25dc89e10185 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510'] for agent, after_create {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:50:27.646552 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-db0ae051-de87-4219-98a9-8ef3c965b481 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510'] for agent, after_create {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:50:27.706128 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-fb239fed-4d21-41ce-a44e-3cea7dc4a9f3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:50:27.832315 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510'] for agent, after_create {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:50:27.832954 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91831) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:50:27.833356 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91831) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:50:27.833797 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91831) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:50:27.834109 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91831) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:50:27.834503 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91831) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:50:27.834832 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91831) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:50:27.835156 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91831) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:50:27.835503 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91831) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:50:27.835828 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91831) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:50:27.836167 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91831) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:50:27.836532 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91831) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:50:27.836870 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91831) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:50:27.837250 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] neutron.api.rpc.handlers.resources_rpc.ResourcesPushToServersRpcApi method report_agent_resource_versions called with arguments (, 'Open vSwitch agent', 'dv-cinder-790492-4-iscsi', {'QosPolicy': '1.8', 'Trunk': '1.1', 'SubPort': '1.0', 'Port': '1.7', 'Subnet': '1.1', 'Network': '1.1', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'Log': '1.0', 'PortForwarding': '1.2', 'ConntrackHelper': '1.0', 'AddressGroup': '1.2'}) {} {{(pid=91831) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 16:50:27.848065 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] neutron.api.rpc.handlers.resources_rpc.ResourcesPushToServerRpcCallback method report_agent_resource_versions called with arguments (,) {'agent_type': 'Open vSwitch agent', 'agent_host': 'dv-cinder-790492-4-iscsi', 'version_map': {'QosPolicy': '1.8', 'Trunk': '1.1', 'SubPort': '1.0', 'Port': '1.7', 'Subnet': '1.1', 'Network': '1.1', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'Log': '1.0', 'PortForwarding': '1.2', 'ConntrackHelper': '1.0', 'AddressGroup': '1.2'}} {{(pid=91831) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 16:50:28.597147 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-0a55eb4a-8b57-4233-84d6-6b423b4ed6db None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510'] for agent, after_create {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:50:30.182493 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-57f11b47-1f51-4191-b7c9-af248a48372c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510'] for agent, after_create {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:50:30.775201 dv-cinder-790492-4-iscsi neutron-server[91831]: INFO neutron.db.l3_hamode_db [None req-9f937776-4dfc-4668-86d7-00da15093b61 None None] Number of active agents lower than max_l3_agents_per_router. L3 agents available: 1 May 25 16:50:30.860276 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9f937776-4dfc-4668-86d7-00da15093b61 None None] Routers set() bound to L3 agent in host dv-cinder-790492-4-iscsi {{(pid=91831) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 16:50:30.860657 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9f937776-4dfc-4668-86d7-00da15093b61 None None] Router IDs set() for agent in host dv-cinder-790492-4-iscsi {{(pid=91831) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:464}} May 25 16:50:31.847631 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.wsgi [-] (91829) accepted ('10.222.0.62', 52744) {{(pid=91829) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:50:32.441692 dv-cinder-790492-4-iscsi neutron-server[91829]: WARNING oslo_policy.policy [None req-2dfb169e-5c5b-4028-bd73-3e1793804c0b admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. May 25 16:50:32.442327 dv-cinder-790492-4-iscsi neutron-server[91829]: WARNING oslo_policy.policy [None req-2dfb169e-5c5b-4028-bd73-3e1793804c0b admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. May 25 16:50:32.659211 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.wsgi [None req-2dfb169e-5c5b-4028-bd73-3e1793804c0b admin admin] http://10.222.0.62:9696/v2.0/extensions returned with HTTP 200 {{(pid=91829) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} May 25 16:50:32.660416 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [None req-2dfb169e-5c5b-4028-bd73-3e1793804c0b admin admin] 10.222.0.62 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 13640 time: 0.8108058 May 25 16:50:34.964856 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.wsgi [-] (91829) accepted ('10.222.0.62', 52758) {{(pid=91829) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:50:35.331137 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.v2.base [None req-3fbc7d8e-e136-452e-a06b-42f49e6004da admin admin] Request body: {'subnetpool': {'default_prefixlen': 26, 'shared': True, 'prefixes': ['172.20.0.0/16'], 'is_default': True, 'name': 'shared-default-subnetpool-v4'}} {{(pid=91829) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 16:50:35.431451 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.policy [None req-3fbc7d8e-e136-452e-a06b-42f49e6004da admin admin] Loaded default policies from ['neutron'] under neutron.policies entry points {{(pid=91829) register_rules /opt/stack/neutron/neutron/policy.py:73}} May 25 16:50:35.476270 dv-cinder-790492-4-iscsi neutron-server[91829]: WARNING oslo_policy.policy [None req-3fbc7d8e-e136-452e-a06b-42f49e6004da admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. May 25 16:50:35.476640 dv-cinder-790492-4-iscsi neutron-server[91829]: WARNING oslo_policy.policy [None req-3fbc7d8e-e136-452e-a06b-42f49e6004da admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. May 25 16:50:35.485000 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.quota [None req-3fbc7d8e-e136-452e-a06b-42f49e6004da admin admin] Loaded quota_driver: . May 25 16:50:35.500752 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.quota.driver [None req-3fbc7d8e-e136-452e-a06b-42f49e6004da admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91829) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 16:50:35.561359 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-3fbc7d8e-e136-452e-a06b-42f49e6004da admin admin] Notify callbacks ['neutron.objects.securitygroup.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8757892128382', 'neutron.objects.address_group.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8757892121055', 'neutron.objects.network.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8757892131656', 'neutron.objects.qos.policy.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8757892137188', 'neutron.objects.subnetpool.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8757892147583', 'neutron.objects.address_scope.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8757892154333', 'neutron.plugins.ml2.plugin.External_net_db_mixin._process_ext_policy_create-3867289', 'neutron.plugins.ml2.plugin.NeutronDbPluginV2.validate_network_rbac_policy_change-3890203', 'neutron.services.network_ip_availability.plugin.NeutronDbPluginV2.validate_network_rbac_policy_change-727557', 'neutron.services.network_ip_availability.plugin.NeutronDbPluginV2.validate_network_rbac_policy_change-539122'] for rbac-policy, before_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:50:35.622496 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-3fbc7d8e-e136-452e-a06b-42f49e6004da admin admin] Notify callbacks [] for subnetpool, before_response {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:50:35.623668 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [None req-3fbc7d8e-e136-452e-a06b-42f49e6004da admin admin] 10.222.0.62 "POST /v2.0/subnetpools HTTP/1.1" status: 201 len: 739 time: 0.6578619 May 25 16:50:38.279301 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.wsgi [-] (91829) accepted ('10.222.0.62', 52772) {{(pid=91829) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:50:38.635463 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.v2.base [None req-33fb6f24-3558-4f6c-bf7d-31ab684fc17a admin admin] Request body: {'network': {'name': 'private', 'project_id': 'e708cc9a159640b7a90f6edd2dc210bc', 'tenant_id': 'e708cc9a159640b7a90f6edd2dc210bc', 'admin_state_up': True}} {{(pid=91829) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 16:50:38.640166 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.quota.driver [None req-33fb6f24-3558-4f6c-bf7d-31ab684fc17a admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91829) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 16:50:38.644600 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.quota.resource [None req-33fb6f24-3558-4f6c-bf7d-31ab684fc17a admin admin] Usage tracker for resource:network and tenant:e708cc9a159640b7a90f6edd2dc210bc is out of sync, need to count used quota {{(pid=91829) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 16:50:38.649048 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.quota.resource [None req-33fb6f24-3558-4f6c-bf7d-31ab684fc17a admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=91829) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 16:50:38.655423 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.quota.driver [None req-33fb6f24-3558-4f6c-bf7d-31ab684fc17a admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91829) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 16:50:38.664576 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-33fb6f24-3558-4f6c-bf7d-31ab684fc17a admin admin] Made reservation on behalf of e708cc9a159640b7a90f6edd2dc210bc for: {'network': 1} {{(pid=91829) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 25 16:50:38.668364 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-33fb6f24-3558-4f6c-bf7d-31ab684fc17a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-3832077'] for network, before_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:50:38.685944 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-33fb6f24-3558-4f6c-bf7d-31ab684fc17a admin admin] Notify callbacks [] for security_group, before_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:50:38.700528 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.quota.driver [None req-33fb6f24-3558-4f6c-bf7d-31ab684fc17a admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91829) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 16:50:38.704056 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.quota.resource [None req-33fb6f24-3558-4f6c-bf7d-31ab684fc17a admin admin] Usage tracker for resource:security_group_rule and tenant:e708cc9a159640b7a90f6edd2dc210bc is out of sync, need to count used quota {{(pid=91829) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 16:50:38.708817 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.quota.resource [None req-33fb6f24-3558-4f6c-bf7d-31ab684fc17a admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91829) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 16:50:38.714259 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.quota.driver [None req-33fb6f24-3558-4f6c-bf7d-31ab684fc17a admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91829) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 16:50:38.817048 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-33fb6f24-3558-4f6c-bf7d-31ab684fc17a admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:50:38.821713 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-33fb6f24-3558-4f6c-bf7d-31ab684fc17a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-640836'] for security_group, after_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:50:38.827148 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:50:38.844616 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-33fb6f24-3558-4f6c-bf7d-31ab684fc17a admin admin] vlan segment allocate from pool success with {'vlan_id': 688, 'physical_network': 'physnet1'} {{(pid=91829) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 25 16:50:38.871069 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-33fb6f24-3558-4f6c-bf7d-31ab684fc17a admin admin] Notify callbacks ['neutron.services.segments.db._add_segment_host_mapping_for_segment-8757892982501', 'neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3809789'] for segment, precommit_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:50:38.871604 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-33fb6f24-3558-4f6c-bf7d-31ab684fc17a admin admin] Unsubscribe: segment precommit_create {{(pid=91829) unsubscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:83}} May 25 16:50:38.872079 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.db.segments_db [None req-33fb6f24-3558-4f6c-bf7d-31ab684fc17a admin admin] Added segment f3e77295-958a-4567-812e-5e129968a4d1 of type vlan for network e759ce39-c6fd-47ae-81a9-86c152dee864 May 25 16:50:38.920192 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-33fb6f24-3558-4f6c-bf7d-31ab684fc17a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=5e3299e0-b5b2-4321-9608-9827c104593f,revision_number=1']} {{(pid=91829) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:50:38.941054 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-33fb6f24-3558-4f6c-bf7d-31ab684fc17a admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91829) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:50:38.941408 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-33fb6f24-3558-4f6c-bf7d-31ab684fc17a admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91829) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:50:38.941737 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-33fb6f24-3558-4f6c-bf7d-31ab684fc17a admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91829) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:50:38.942100 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-33fb6f24-3558-4f6c-bf7d-31ab684fc17a admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91829) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:50:38.942421 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-33fb6f24-3558-4f6c-bf7d-31ab684fc17a admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91829) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:50:38.942751 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-33fb6f24-3558-4f6c-bf7d-31ab684fc17a admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91829) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:50:38.943065 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-33fb6f24-3558-4f6c-bf7d-31ab684fc17a admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91829) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:50:38.943376 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-33fb6f24-3558-4f6c-bf7d-31ab684fc17a admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91829) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:50:38.943699 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-33fb6f24-3558-4f6c-bf7d-31ab684fc17a admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91829) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:50:38.944009 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-33fb6f24-3558-4f6c-bf7d-31ab684fc17a admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91829) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:50:38.944315 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-33fb6f24-3558-4f6c-bf7d-31ab684fc17a admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91829) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:50:38.944618 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-33fb6f24-3558-4f6c-bf7d-31ab684fc17a admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91829) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:50:38.945652 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-33fb6f24-3558-4f6c-bf7d-31ab684fc17a admin admin] Tracked resource versions report: May 25 16:50:38.945652 dv-cinder-790492-4-iscsi neutron-server[91829]: pushed versions: May 25 16:50:38.945652 dv-cinder-790492-4-iscsi neutron-server[91829]: { 'AddressGroup': {'1.2'}, May 25 16:50:38.945652 dv-cinder-790492-4-iscsi neutron-server[91829]: 'ConntrackHelper': {'1.0'}, May 25 16:50:38.945652 dv-cinder-790492-4-iscsi neutron-server[91829]: 'Log': {'1.0'}, May 25 16:50:38.945652 dv-cinder-790492-4-iscsi neutron-server[91829]: 'Network': {'1.1'}, May 25 16:50:38.945652 dv-cinder-790492-4-iscsi neutron-server[91829]: 'Port': {'1.7'}, May 25 16:50:38.945652 dv-cinder-790492-4-iscsi neutron-server[91829]: 'PortForwarding': {'1.2'}, May 25 16:50:38.945652 dv-cinder-790492-4-iscsi neutron-server[91829]: 'QosPolicy': {'1.8'}, May 25 16:50:38.945652 dv-cinder-790492-4-iscsi neutron-server[91829]: 'SecurityGroup': {'1.4'}, May 25 16:50:38.945652 dv-cinder-790492-4-iscsi neutron-server[91829]: 'SecurityGroupRule': {'1.2'}, May 25 16:50:38.945652 dv-cinder-790492-4-iscsi neutron-server[91829]: 'SubPort': {'1.0'}, May 25 16:50:38.945652 dv-cinder-790492-4-iscsi neutron-server[91829]: 'Subnet': {'1.1'}, May 25 16:50:38.945652 dv-cinder-790492-4-iscsi neutron-server[91829]: 'Trunk': {'1.1'}} May 25 16:50:38.945652 dv-cinder-790492-4-iscsi neutron-server[91829]: consumer versions: May 25 16:50:38.945652 dv-cinder-790492-4-iscsi neutron-server[91829]: { DHCP agent@dv-cinder-790492-4-iscsi: {}, May 25 16:50:38.945652 dv-cinder-790492-4-iscsi neutron-server[91829]: L3 agent@dv-cinder-790492-4-iscsi: {}, May 25 16:50:38.945652 dv-cinder-790492-4-iscsi neutron-server[91829]: Metadata agent@dv-cinder-790492-4-iscsi: {}, May 25 16:50:38.945652 dv-cinder-790492-4-iscsi neutron-server[91829]: Metering agent@dv-cinder-790492-4-iscsi: {}, May 25 16:50:38.945652 dv-cinder-790492-4-iscsi neutron-server[91829]: Open vSwitch agent@dv-cinder-790492-4-iscsi: { 'AddressGroup': '1.2', May 25 16:50:38.945652 dv-cinder-790492-4-iscsi neutron-server[91829]: 'ConntrackHelper': '1.0', May 25 16:50:38.945652 dv-cinder-790492-4-iscsi neutron-server[91829]: 'Log': '1.0', May 25 16:50:38.945652 dv-cinder-790492-4-iscsi neutron-server[91829]: 'Network': '1.1', May 25 16:50:38.945652 dv-cinder-790492-4-iscsi neutron-server[91829]: 'Port': '1.7', May 25 16:50:38.945652 dv-cinder-790492-4-iscsi neutron-server[91829]: 'PortForwarding': '1.2', May 25 16:50:38.945652 dv-cinder-790492-4-iscsi neutron-server[91829]: 'QosPolicy': '1.8', May 25 16:50:38.945652 dv-cinder-790492-4-iscsi neutron-server[91829]: 'SecurityGroup': '1.4', May 25 16:50:38.945652 dv-cinder-790492-4-iscsi neutron-server[91829]: 'SecurityGroupRule': '1.2', May 25 16:50:38.945652 dv-cinder-790492-4-iscsi neutron-server[91829]: 'SubPort': '1.0', May 25 16:50:38.945652 dv-cinder-790492-4-iscsi neutron-server[91829]: 'Subnet': '1.1', May 25 16:50:38.945652 dv-cinder-790492-4-iscsi neutron-server[91829]: 'Trunk': '1.1'}} May 25 16:50:38.945652 dv-cinder-790492-4-iscsi neutron-server[91829]: {{(pid=91829) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} May 25 16:50:38.990247 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-33fb6f24-3558-4f6c-bf7d-31ab684fc17a admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8757892541013'] for network, precommit_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:50:38.995653 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-33fb6f24-3558-4f6c-bf7d-31ab684fc17a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.168s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:50:39.031408 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-33fb6f24-3558-4f6c-bf7d-31ab684fc17a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-640806', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-551400'] for network, after_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:50:39.032882 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-33fb6f24-3558-4f6c-bf7d-31ab684fc17a admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:50:39.033531 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-33fb6f24-3558-4f6c-bf7d-31ab684fc17a admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-551373'] for network, before_response {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:50:39.038385 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:50:39.139205 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [None req-33fb6f24-3558-4f6c-bf7d-31ab684fc17a admin admin] 10.222.0.62 "POST /v2.0/networks HTTP/1.1" status: 201 len: 849 time: 0.8587663 May 25 16:50:39.141609 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-33fb6f24-3558-4f6c-bf7d-31ab684fc17a admin admin] Pushing event updated for resources: {'Network': ['ID=e759ce39-c6fd-47ae-81a9-86c152dee864,revision_number=1']} {{(pid=91829) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:50:39.144958 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-33fb6f24-3558-4f6c-bf7d-31ab684fc17a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.107s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:50:39.153941 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.rpc [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Network e759ce39-c6fd-47ae-81a9-86c152dee864 details requested by agent ovs-agent-dv-cinder-790492-4-iscsi with host dv-cinder-790492-4-iscsi {{(pid=91831) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 25 16:50:41.787215 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.wsgi [-] (91829) accepted ('10.222.0.62', 52788) {{(pid=91829) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:50:42.235081 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3b539d3c-56d9-499b-b4ca-e39c5d4f00c9 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:50:42.236840 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [None req-3b539d3c-56d9-499b-b4ca-e39c5d4f00c9 admin admin] 10.222.0.62 "GET /v2.0/networks/e759ce39-c6fd-47ae-81a9-86c152dee864 HTTP/1.1" status: 200 len: 825 time: 0.4481115 May 25 16:50:42.262978 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [None req-e292a82e-f781-44b6-a5eb-e073117bda8c admin admin] 10.222.0.62 "GET /v2.0/subnetpools/0e78b268-0e3f-41be-bb2c-52cff96d5779 HTTP/1.1" status: 200 len: 734 time: 0.0208108 May 25 16:50:42.271054 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.v2.base [None req-b972495b-cdea-4f8f-839a-d8a1651d2894 admin admin] Request body: {'subnet': {'network_id': 'e759ce39-c6fd-47ae-81a9-86c152dee864', 'gateway_ip': '172.20.0.1', 'tenant_id': 'e708cc9a159640b7a90f6edd2dc210bc', 'ip_version': 4, 'subnetpool_id': '0e78b268-0e3f-41be-bb2c-52cff96d5779', 'name': 'private-subnet'}} {{(pid=91829) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 16:50:42.275142 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.quota.driver [None req-b972495b-cdea-4f8f-839a-d8a1651d2894 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91829) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 16:50:42.278716 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.quota.resource [None req-b972495b-cdea-4f8f-839a-d8a1651d2894 admin admin] Usage tracker for resource:subnet and tenant:e708cc9a159640b7a90f6edd2dc210bc is out of sync, need to count used quota {{(pid=91829) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 16:50:42.281437 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.quota.resource [None req-b972495b-cdea-4f8f-839a-d8a1651d2894 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=91829) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 16:50:42.286946 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.quota.driver [None req-b972495b-cdea-4f8f-839a-d8a1651d2894 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91829) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 16:50:42.296414 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-b972495b-cdea-4f8f-839a-d8a1651d2894 admin admin] Made reservation on behalf of e708cc9a159640b7a90f6edd2dc210bc for: {'subnet': 1} {{(pid=91829) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 25 16:50:42.299244 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-b972495b-cdea-4f8f-839a-d8a1651d2894 admin admin] Notify callbacks [] for subnet, before_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:50:42.765796 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-b972495b-cdea-4f8f-839a-d8a1651d2894 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55886', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411'] for subnet, after_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:50:42.770972 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:50:42.852448 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b972495b-cdea-4f8f-839a-d8a1651d2894 admin admin] Checking segment: {'id': 'f3e77295-958a-4567-812e-5e129968a4d1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 688, 'network_id': 'e759ce39-c6fd-47ae-81a9-86c152dee864'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91829) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 25 16:50:42.853082 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b972495b-cdea-4f8f-839a-d8a1651d2894 admin admin] Network hostable DHCP agents. Network: e759ce39-c6fd-47ae-81a9-86c152dee864, hostable agents: ['8d7401c6-8951-4f2b-ace4-208761782bfc'], hosted agents: [] {{(pid=91829) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 25 16:50:42.856349 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b972495b-cdea-4f8f-839a-d8a1651d2894 admin admin] Pushing event updated for resources: {'Subnet': ['ID=899ea1be-5424-4fa8-8997-675ed0cdbe9c,revision_number=0']} {{(pid=91829) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:50:42.863880 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-b972495b-cdea-4f8f-839a-d8a1651d2894 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.092s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:50:42.874376 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b972495b-cdea-4f8f-839a-d8a1651d2894 admin admin] Network e759ce39-c6fd-47ae-81a9-86c152dee864 is scheduled to be hosted by DHCP agent 8d7401c6-8951-4f2b-ace4-208761782bfc with binding_index 1 {{(pid=91829) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 25 16:50:42.884760 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.scheduler.base_scheduler [None req-b972495b-cdea-4f8f-839a-d8a1651d2894 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-790492-4-iscsi, e759ce39-c6fd-47ae-81a9-86c152dee864) {{(pid=91829) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 16:50:42.889456 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b972495b-cdea-4f8f-839a-d8a1651d2894 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:50:42.890049 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-b972495b-cdea-4f8f-839a-d8a1651d2894 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-551373'] for subnet, before_response {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:50:42.895786 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8f2dbd3a-6f56-4a3b-88bd-2e345d935da2 None None] Network e759ce39-c6fd-47ae-81a9-86c152dee864 requested from dv-cinder-790492-4-iscsi {{(pid=91831) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} May 25 16:50:42.922650 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [None req-b972495b-cdea-4f8f-839a-d8a1651d2894 admin admin] 10.222.0.62 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 854 time: 0.6545770 May 25 16:50:43.210022 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-97c801aa-6515-4ffb-a2ee-9c2387c3a579 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp6d7ebc81-b6b5-52ec-b8f5-10a9de34bf46-e759ce39-c6fd-47ae-81a9-86c152dee864', 'network_id': 'e759ce39-c6fd-47ae-81a9-86c152dee864', 'tenant_id': 'e708cc9a159640b7a90f6edd2dc210bc', 'fixed_ips': [{'subnet_id': '899ea1be-5424-4fa8-8997-675ed0cdbe9c'}]}} from dv-cinder-790492-4-iscsi. {{(pid=91831) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} May 25 16:50:43.211281 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-97c801aa-6515-4ffb-a2ee-9c2387c3a579 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3832070'] for port, before_create {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:50:43.395184 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.db_base_plugin_common [None req-97c801aa-6515-4ffb-a2ee-9c2387c3a579 None None] Allocated IP 172.20.0.2 (e759ce39-c6fd-47ae-81a9-86c152dee864/899ea1be-5424-4fa8-8997-675ed0cdbe9c/b84bd82d-378d-4e57-85a6-b4fe6cb09112) {{(pid=91831) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 25 16:50:43.623044 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-97c801aa-6515-4ffb-a2ee-9c2387c3a579 None None] Notify callbacks [] for port, precommit_create {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:50:43.635891 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.provisioning_blocks [None req-97c801aa-6515-4ffb-a2ee-9c2387c3a579 None None] Transition to ACTIVE for port object b84bd82d-378d-4e57-85a6-b4fe6cb09112 will not be triggered until provisioned by entity L2. {{(pid=91831) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 25 16:50:43.657041 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.provisioning_blocks [None req-97c801aa-6515-4ffb-a2ee-9c2387c3a579 None None] Transition to ACTIVE for port object b84bd82d-378d-4e57-85a6-b4fe6cb09112 will not be triggered until provisioned by entity DHCP. {{(pid=91831) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 25 16:50:43.664420 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-97c801aa-6515-4ffb-a2ee-9c2387c3a579 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8757892520915'] for port, after_create {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:50:43.668679 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:50:43.730648 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-97c801aa-6515-4ffb-a2ee-9c2387c3a579 None None] Network e759ce39-c6fd-47ae-81a9-86c152dee864 is already hosted by enough agents. {{(pid=91831) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 25 16:50:43.733162 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.scheduler.base_scheduler [None req-97c801aa-6515-4ffb-a2ee-9c2387c3a579 None None] Resources bound (agent type, host, resource id): {{(pid=91831) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 16:50:43.740254 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.l3_dvrscheduler_db [None req-97c801aa-6515-4ffb-a2ee-9c2387c3a579 None None] Received port after_create {{(pid=91831) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 25 16:50:43.742434 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-97c801aa-6515-4ffb-a2ee-9c2387c3a579 None None] Pushing event updated for resources: {'Port': ['ID=b84bd82d-378d-4e57-85a6-b4fe6cb09112,revision_number=1']} {{(pid=91831) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:50:43.778349 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-97c801aa-6515-4ffb-a2ee-9c2387c3a579 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91831) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:50:43.778685 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-97c801aa-6515-4ffb-a2ee-9c2387c3a579 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91831) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:50:43.779014 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-97c801aa-6515-4ffb-a2ee-9c2387c3a579 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91831) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:50:43.779337 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-97c801aa-6515-4ffb-a2ee-9c2387c3a579 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91831) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:50:43.779655 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-97c801aa-6515-4ffb-a2ee-9c2387c3a579 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91831) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:50:43.779972 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-97c801aa-6515-4ffb-a2ee-9c2387c3a579 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91831) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:50:43.780286 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-97c801aa-6515-4ffb-a2ee-9c2387c3a579 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91831) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:50:43.780600 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-97c801aa-6515-4ffb-a2ee-9c2387c3a579 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91831) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:50:43.780927 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-97c801aa-6515-4ffb-a2ee-9c2387c3a579 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91831) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:50:43.781240 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-97c801aa-6515-4ffb-a2ee-9c2387c3a579 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91831) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:50:43.781549 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-97c801aa-6515-4ffb-a2ee-9c2387c3a579 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91831) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:50:43.781853 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-97c801aa-6515-4ffb-a2ee-9c2387c3a579 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91831) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:50:43.782931 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-97c801aa-6515-4ffb-a2ee-9c2387c3a579 None None] Tracked resource versions report: May 25 16:50:43.782931 dv-cinder-790492-4-iscsi neutron-server[91831]: pushed versions: May 25 16:50:43.782931 dv-cinder-790492-4-iscsi neutron-server[91831]: { 'AddressGroup': {'1.2'}, May 25 16:50:43.782931 dv-cinder-790492-4-iscsi neutron-server[91831]: 'ConntrackHelper': {'1.0'}, May 25 16:50:43.782931 dv-cinder-790492-4-iscsi neutron-server[91831]: 'Log': {'1.0'}, May 25 16:50:43.782931 dv-cinder-790492-4-iscsi neutron-server[91831]: 'Network': {'1.1'}, May 25 16:50:43.782931 dv-cinder-790492-4-iscsi neutron-server[91831]: 'Port': {'1.7'}, May 25 16:50:43.782931 dv-cinder-790492-4-iscsi neutron-server[91831]: 'PortForwarding': {'1.2'}, May 25 16:50:43.782931 dv-cinder-790492-4-iscsi neutron-server[91831]: 'QosPolicy': {'1.8'}, May 25 16:50:43.782931 dv-cinder-790492-4-iscsi neutron-server[91831]: 'SecurityGroup': {'1.4'}, May 25 16:50:43.782931 dv-cinder-790492-4-iscsi neutron-server[91831]: 'SecurityGroupRule': {'1.2'}, May 25 16:50:43.782931 dv-cinder-790492-4-iscsi neutron-server[91831]: 'SubPort': {'1.0'}, May 25 16:50:43.782931 dv-cinder-790492-4-iscsi neutron-server[91831]: 'Subnet': {'1.1'}, May 25 16:50:43.782931 dv-cinder-790492-4-iscsi neutron-server[91831]: 'Trunk': {'1.1'}} May 25 16:50:43.782931 dv-cinder-790492-4-iscsi neutron-server[91831]: consumer versions: May 25 16:50:43.782931 dv-cinder-790492-4-iscsi neutron-server[91831]: { DHCP agent@dv-cinder-790492-4-iscsi: {}, May 25 16:50:43.782931 dv-cinder-790492-4-iscsi neutron-server[91831]: L3 agent@dv-cinder-790492-4-iscsi: {}, May 25 16:50:43.782931 dv-cinder-790492-4-iscsi neutron-server[91831]: Metadata agent@dv-cinder-790492-4-iscsi: {}, May 25 16:50:43.782931 dv-cinder-790492-4-iscsi neutron-server[91831]: Metering agent@dv-cinder-790492-4-iscsi: {}, May 25 16:50:43.782931 dv-cinder-790492-4-iscsi neutron-server[91831]: Open vSwitch agent@dv-cinder-790492-4-iscsi: { 'AddressGroup': '1.2', May 25 16:50:43.782931 dv-cinder-790492-4-iscsi neutron-server[91831]: 'ConntrackHelper': '1.0', May 25 16:50:43.782931 dv-cinder-790492-4-iscsi neutron-server[91831]: 'Log': '1.0', May 25 16:50:43.782931 dv-cinder-790492-4-iscsi neutron-server[91831]: 'Network': '1.1', May 25 16:50:43.782931 dv-cinder-790492-4-iscsi neutron-server[91831]: 'Port': '1.7', May 25 16:50:43.782931 dv-cinder-790492-4-iscsi neutron-server[91831]: 'PortForwarding': '1.2', May 25 16:50:43.782931 dv-cinder-790492-4-iscsi neutron-server[91831]: 'QosPolicy': '1.8', May 25 16:50:43.782931 dv-cinder-790492-4-iscsi neutron-server[91831]: 'SecurityGroup': '1.4', May 25 16:50:43.782931 dv-cinder-790492-4-iscsi neutron-server[91831]: 'SecurityGroupRule': '1.2', May 25 16:50:43.782931 dv-cinder-790492-4-iscsi neutron-server[91831]: 'SubPort': '1.0', May 25 16:50:43.782931 dv-cinder-790492-4-iscsi neutron-server[91831]: 'Subnet': '1.1', May 25 16:50:43.782931 dv-cinder-790492-4-iscsi neutron-server[91831]: 'Trunk': '1.1'}} May 25 16:50:43.782931 dv-cinder-790492-4-iscsi neutron-server[91831]: {{(pid=91831) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} May 25 16:50:43.790489 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [None req-97c801aa-6515-4ffb-a2ee-9c2387c3a579 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.122s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:50:43.846660 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.managers [None req-97c801aa-6515-4ffb-a2ee-9c2387c3a579 None None] Attempting to bind port b84bd82d-378d-4e57-85a6-b4fe6cb09112 on host dv-cinder-790492-4-iscsi for vnic_type normal with profile {{(pid=91831) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 25 16:50:43.847047 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.managers [None req-97c801aa-6515-4ffb-a2ee-9c2387c3a579 None None] Attempting to bind port b84bd82d-378d-4e57-85a6-b4fe6cb09112 by drivers openvswitch,hyperv on host dv-cinder-790492-4-iscsi at level 0 using segments [{'id': 'f3e77295-958a-4567-812e-5e129968a4d1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 688, 'network_id': 'e759ce39-c6fd-47ae-81a9-86c152dee864'}] {{(pid=91831) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 25 16:50:43.847490 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-97c801aa-6515-4ffb-a2ee-9c2387c3a579 None None] Attempting to bind port b84bd82d-378d-4e57-85a6-b4fe6cb09112 on network e759ce39-c6fd-47ae-81a9-86c152dee864 {{(pid=91831) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 25 16:50:43.852687 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-97c801aa-6515-4ffb-a2ee-9c2387c3a579 None None] Checking agent: {'id': 'fc8251e1-071c-49f7-bc10-1337f1d37d1b', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-790492-4-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 25, 16, 50, 28), 'started_at': datetime.datetime(2021, 5, 25, 16, 50, 28), 'heartbeat_timestamp': datetime.datetime(2021, 5, 25, 16, 50, 28), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-790492-4-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=91831) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 25 16:50:43.853084 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-97c801aa-6515-4ffb-a2ee-9c2387c3a579 None None] Checking segment: {'id': 'f3e77295-958a-4567-812e-5e129968a4d1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 688, 'network_id': 'e759ce39-c6fd-47ae-81a9-86c152dee864'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91831) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 25 16:50:43.853554 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-97c801aa-6515-4ffb-a2ee-9c2387c3a579 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:50:43.853964 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-97c801aa-6515-4ffb-a2ee-9c2387c3a579 None None] Bound using segment: {'id': 'f3e77295-958a-4567-812e-5e129968a4d1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 688, 'network_id': 'e759ce39-c6fd-47ae-81a9-86c152dee864'} {{(pid=91831) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 25 16:50:43.854507 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.managers [None req-97c801aa-6515-4ffb-a2ee-9c2387c3a579 None None] Bound port: b84bd82d-378d-4e57-85a6-b4fe6cb09112, host: dv-cinder-790492-4-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'f3e77295-958a-4567-812e-5e129968a4d1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 688, 'network_id': 'e759ce39-c6fd-47ae-81a9-86c152dee864'}}] {{(pid=91831) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 25 16:50:43.854873 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-97c801aa-6515-4ffb-a2ee-9c2387c3a579 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3832070'] for port, before_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:50:43.939154 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.db [None req-97c801aa-6515-4ffb-a2ee-9c2387c3a579 None None] For port b84bd82d-378d-4e57-85a6-b4fe6cb09112, host dv-cinder-790492-4-iscsi, cleared binding levels {{(pid=91831) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 25 16:50:43.942944 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.db [None req-97c801aa-6515-4ffb-a2ee-9c2387c3a579 None None] For port b84bd82d-378d-4e57-85a6-b4fe6cb09112, host dv-cinder-790492-4-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-790492-4-iscsi',level=0,port_id=b84bd82d-378d-4e57-85a6-b4fe6cb09112,segment=NetworkSegment(f3e77295-958a-4567-812e-5e129968a4d1),segment_id=f3e77295-958a-4567-812e-5e129968a4d1)] {{(pid=91831) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 25 16:50:43.947596 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-97c801aa-6515-4ffb-a2ee-9c2387c3a579 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8757892955028', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8757892520933', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8757892521750'] for port, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:50:43.951574 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [None req-97c801aa-6515-4ffb-a2ee-9c2387c3a579 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:50:44.038404 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-97c801aa-6515-4ffb-a2ee-9c2387c3a579 None None] Pushing event updated for resources: {'Port': ['ID=b84bd82d-378d-4e57-85a6-b4fe6cb09112,revision_number=2']} {{(pid=91831) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:50:44.041277 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [None req-97c801aa-6515-4ffb-a2ee-9c2387c3a579 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.090s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:50:45.322628 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.wsgi [-] (91829) accepted ('10.222.0.62', 52798) {{(pid=91829) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:50:45.691343 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.wsgi [None req-dd473d64-7312-481b-b5f8-e5c3aed27445 admin admin] http://10.222.0.62:9696/v2.0/extensions returned with HTTP 200 {{(pid=91829) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} May 25 16:50:45.692375 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [None req-dd473d64-7312-481b-b5f8-e5c3aed27445 admin admin] 10.222.0.62 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 13640 time: 0.3687634 May 25 16:50:48.094018 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.wsgi [-] (91830) accepted ('10.222.0.62', 52808) {{(pid=91830) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:50:48.709418 dv-cinder-790492-4-iscsi neutron-server[91830]: WARNING oslo_policy.policy [None req-f782763c-b2dd-4cfd-8989-c69aa80da160 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. May 25 16:50:48.710083 dv-cinder-790492-4-iscsi neutron-server[91830]: WARNING oslo_policy.policy [None req-f782763c-b2dd-4cfd-8989-c69aa80da160 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. May 25 16:50:48.930331 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.wsgi [None req-f782763c-b2dd-4cfd-8989-c69aa80da160 admin admin] http://10.222.0.62:9696/v2.0/extensions returned with HTTP 200 {{(pid=91830) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} May 25 16:50:48.931449 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [None req-f782763c-b2dd-4cfd-8989-c69aa80da160 admin admin] 10.222.0.62 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 13640 time: 0.8365328 May 25 16:50:49.508505 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1e1de7a7-dac2-4acb-800d-73e4b1a5e285 None None] Network e759ce39-c6fd-47ae-81a9-86c152dee864 requested from dv-cinder-790492-4-iscsi {{(pid=91831) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} May 25 16:50:49.603057 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.provisioning_blocks [None req-db914d8b-f044-4e62-856c-75134dce1cf9 None None] Provisioning for port b84bd82d-378d-4e57-85a6-b4fe6cb09112 completed by entity DHCP. {{(pid=91831) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 25 16:50:49.780263 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.rpc [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Device b84bd82d-378d-4e57-85a6-b4fe6cb09112 up at agent ovs-agent-dv-cinder-790492-4-iscsi {{(pid=91831) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 25 16:50:49.850988 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.provisioning_blocks [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Provisioning for port b84bd82d-378d-4e57-85a6-b4fe6cb09112 completed by entity L2. {{(pid=91831) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 25 16:50:49.856418 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.provisioning_blocks [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Provisioning complete for port b84bd82d-378d-4e57-85a6-b4fe6cb09112 triggered by entity L2. {{(pid=91831) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 16:50:49.856937 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3854128'] for port, provisioning_complete {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:50:49.979951 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3832070'] for port, before_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:50:50.013631 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.db [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] For port b84bd82d-378d-4e57-85a6-b4fe6cb09112, host dv-cinder-790492-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-790492-4-iscsi',level=0,port_id=b84bd82d-378d-4e57-85a6-b4fe6cb09112,segment=NetworkSegment(f3e77295-958a-4567-812e-5e129968a4d1),segment_id=f3e77295-958a-4567-812e-5e129968a4d1)] {{(pid=91831) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 16:50:50.017553 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8757892955028', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8757892520933', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8757892521750'] for port, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:50:50.019728 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [None req-97c801aa-6515-4ffb-a2ee-9c2387c3a579 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:50:50.093302 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.provisioning_blocks [None req-bb8df16d-ff5e-4cc0-a1c3-3cc39078ac5c None None] Provisioning complete for port b84bd82d-378d-4e57-85a6-b4fe6cb09112 triggered by entity DHCP. {{(pid=91831) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 16:50:50.093675 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-bb8df16d-ff5e-4cc0-a1c3-3cc39078ac5c None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3854128'] for port, provisioning_complete {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:50:50.135400 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Pushing event updated for resources: {'Port': ['ID=b84bd82d-378d-4e57-85a6-b4fe6cb09112,revision_number=3']} {{(pid=91831) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:50:50.140523 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.121s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:50:51.548811 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.wsgi [-] (91829) accepted ('10.222.0.62', 52828) {{(pid=91829) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:50:51.741381 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.rpc [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Device b84bd82d-378d-4e57-85a6-b4fe6cb09112 up at agent ovs-agent-dv-cinder-790492-4-iscsi {{(pid=91831) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 25 16:50:51.809492 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.provisioning_blocks [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Provisioning complete for port b84bd82d-378d-4e57-85a6-b4fe6cb09112 triggered by entity L2. {{(pid=91831) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 16:50:51.809947 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3854128'] for port, provisioning_complete {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:50:51.905082 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.v2.base [None req-f189c7f6-959a-4e69-95e2-7a8de9812d16 admin admin] Request body: {'router': {'admin_state_up': True, 'tenant_id': 'e708cc9a159640b7a90f6edd2dc210bc', 'name': 'router1'}} {{(pid=91829) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 16:50:51.909832 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.quota.driver [None req-f189c7f6-959a-4e69-95e2-7a8de9812d16 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91829) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 16:50:51.913455 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.quota.resource [None req-f189c7f6-959a-4e69-95e2-7a8de9812d16 admin admin] Usage tracker for resource:router and tenant:e708cc9a159640b7a90f6edd2dc210bc is out of sync, need to count used quota {{(pid=91829) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 16:50:51.916980 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.quota.resource [None req-f189c7f6-959a-4e69-95e2-7a8de9812d16 admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=91829) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 16:50:51.922625 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.quota.driver [None req-f189c7f6-959a-4e69-95e2-7a8de9812d16 admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91829) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 16:50:51.933491 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-f189c7f6-959a-4e69-95e2-7a8de9812d16 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-684888', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-31042'] for router, before_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:50:51.935226 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-f189c7f6-959a-4e69-95e2-7a8de9812d16 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-684376', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-683143', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-647018', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-31049'] for router, precommit_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:50:51.957098 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-f189c7f6-959a-4e69-95e2-7a8de9812d16 admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:50:52.064509 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-f189c7f6-959a-4e69-95e2-7a8de9812d16 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-684881', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-683233'] for router, after_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:50:52.083396 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-f189c7f6-959a-4e69-95e2-7a8de9812d16 admin admin] Notify callbacks [] for router, before_response {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:50:52.084649 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [None req-f189c7f6-959a-4e69-95e2-7a8de9812d16 admin admin] 10.222.0.62 "POST /v2.0/routers HTTP/1.1" status: 201 len: 709 time: 0.5348718 May 25 16:50:54.444312 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.wsgi [-] (91829) accepted ('10.222.0.62', 52838) {{(pid=91829) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:50:54.807263 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.wsgi [None req-dccda790-abc7-48c6-bb66-16648bb751fb admin admin] http://10.222.0.62:9696/v2.0/extensions returned with HTTP 200 {{(pid=91829) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} May 25 16:50:54.808254 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [None req-dccda790-abc7-48c6-bb66-16648bb751fb admin admin] 10.222.0.62 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 13640 time: 0.3627458 May 25 16:50:55.269143 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-c8857e17-a548-47dc-804e-48ec1f127ae3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:50:57.174045 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.wsgi [-] (91829) accepted ('10.222.0.62', 52848) {{(pid=91829) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:50:57.532147 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.v2.base [None req-0c7e99cc-35d6-493b-a6ef-f8f30799d078 admin admin] Request body: {'network': {'is_default': True, 'name': 'public', 'router:external': True, 'provider:physical_network': 'physnet1', 'admin_state_up': True, 'provider:network_type': 'flat'}} {{(pid=91829) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 16:50:57.536913 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.quota.driver [None req-0c7e99cc-35d6-493b-a6ef-f8f30799d078 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91829) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 16:50:57.540590 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.quota.resource [None req-0c7e99cc-35d6-493b-a6ef-f8f30799d078 admin admin] Usage tracker for resource:network and tenant:f0f6b05e8a4341b3bf4899cd32c57785 is out of sync, need to count used quota {{(pid=91829) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 16:50:57.543619 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.quota.resource [None req-0c7e99cc-35d6-493b-a6ef-f8f30799d078 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=91829) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 16:50:57.549625 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.quota.driver [None req-0c7e99cc-35d6-493b-a6ef-f8f30799d078 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91829) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 16:50:57.559431 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-0c7e99cc-35d6-493b-a6ef-f8f30799d078 admin admin] Made reservation on behalf of f0f6b05e8a4341b3bf4899cd32c57785 for: {'network': 1} {{(pid=91829) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 25 16:50:57.561962 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-0c7e99cc-35d6-493b-a6ef-f8f30799d078 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-3832077'] for network, before_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:50:57.576124 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-0c7e99cc-35d6-493b-a6ef-f8f30799d078 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:50:57.589816 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.quota.driver [None req-0c7e99cc-35d6-493b-a6ef-f8f30799d078 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91829) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 16:50:57.593434 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.quota.resource [None req-0c7e99cc-35d6-493b-a6ef-f8f30799d078 admin admin] Usage tracker for resource:security_group_rule and tenant:f0f6b05e8a4341b3bf4899cd32c57785 is out of sync, need to count used quota {{(pid=91829) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 16:50:57.596675 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.quota.resource [None req-0c7e99cc-35d6-493b-a6ef-f8f30799d078 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91829) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 16:50:57.602366 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.quota.driver [None req-0c7e99cc-35d6-493b-a6ef-f8f30799d078 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91829) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 16:50:57.650807 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-4c0d0dd7-1303-4bd5-980f-930e7d112295 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:50:57.684311 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-0c7e99cc-35d6-493b-a6ef-f8f30799d078 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:50:57.687931 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-0c7e99cc-35d6-493b-a6ef-f8f30799d078 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-640836'] for security_group, after_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:50:57.691916 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-33fb6f24-3558-4f6c-bf7d-31ab684fc17a admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:50:57.706270 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.plugins.ml2.drivers.type_flat [None req-0c7e99cc-35d6-493b-a6ef-f8f30799d078 admin admin] Reserving flat network on physical network physnet1 {{(pid=91829) reserve_provider_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_flat.py:100}} May 25 16:50:57.729294 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0c7e99cc-35d6-493b-a6ef-f8f30799d078 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=e241d3ec-44e9-44da-8d1b-3c17c9668cbe,revision_number=1']} {{(pid=91829) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:50:57.732883 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-0c7e99cc-35d6-493b-a6ef-f8f30799d078 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.041s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:50:57.733859 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-0c7e99cc-35d6-493b-a6ef-f8f30799d078 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3809789'] for segment, precommit_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:50:57.734219 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.db.segments_db [None req-0c7e99cc-35d6-493b-a6ef-f8f30799d078 admin admin] Added segment 414a8468-1d66-4792-9e81-d8ac5ccf1512 of type flat for network 4364b6ab-4117-4a92-baeb-f5ee2f45bf74 May 25 16:50:57.765798 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-0c7e99cc-35d6-493b-a6ef-f8f30799d078 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8757892541013'] for network, precommit_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:50:57.805054 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-0c7e99cc-35d6-493b-a6ef-f8f30799d078 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-640806', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-551400'] for network, after_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:50:57.806366 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0c7e99cc-35d6-493b-a6ef-f8f30799d078 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:50:57.806940 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-0c7e99cc-35d6-493b-a6ef-f8f30799d078 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-551373'] for network, before_response {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:50:57.811586 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:50:57.821428 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:50:57.907743 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [None req-0c7e99cc-35d6-493b-a6ef-f8f30799d078 admin admin] 10.222.0.62 "POST /v2.0/networks HTTP/1.1" status: 201 len: 847 time: 0.7321055 May 25 16:50:57.912978 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0c7e99cc-35d6-493b-a6ef-f8f30799d078 admin admin] Pushing event updated for resources: {'Network': ['ID=4364b6ab-4117-4a92-baeb-f5ee2f45bf74,revision_number=1']} {{(pid=91829) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:50:57.915965 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-0c7e99cc-35d6-493b-a6ef-f8f30799d078 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.104s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:50:57.930136 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.rpc [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Network 4364b6ab-4117-4a92-baeb-f5ee2f45bf74 details requested by agent ovs-agent-dv-cinder-790492-4-iscsi with host dv-cinder-790492-4-iscsi {{(pid=91831) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 25 16:50:58.540199 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-0a55eb4a-8b57-4233-84d6-6b423b4ed6db None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:51:00.119780 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-57f11b47-1f51-4191-b7c9-af248a48372c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:51:00.222433 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.wsgi [-] (91829) accepted ('10.222.0.62', 52868) {{(pid=91829) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:51:00.429139 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-821b5e00-b66f-46bd-865e-558cf7f1480b admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:51:00.430455 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [None req-821b5e00-b66f-46bd-865e-558cf7f1480b admin admin] 10.222.0.62 "GET /v2.0/subnets/899ea1be-5424-4fa8-8997-675ed0cdbe9c HTTP/1.1" status: 200 len: 849 time: 0.2070856 May 25 16:51:00.572075 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [None req-a9b5eba1-863e-4c85-84fb-b8d5b8607f3c admin admin] 10.222.0.62 "GET /v2.0/routers/651e3eba-cca4-42bf-80c6-872a75cec99e HTTP/1.1" status: 200 len: 704 time: 0.1357706 May 25 16:51:01.070439 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-bb080e64-52ae-40e7-97d2-76d76a092ed5 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3832070'] for port, before_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:51:01.300126 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.db_base_plugin_common [None req-bb080e64-52ae-40e7-97d2-76d76a092ed5 admin admin] Allocated IP 172.20.0.1 (e759ce39-c6fd-47ae-81a9-86c152dee864/899ea1be-5424-4fa8-8997-675ed0cdbe9c/7d08e8da-622a-4f76-977c-d8354120044f) {{(pid=91829) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 25 16:51:01.452900 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-bb080e64-52ae-40e7-97d2-76d76a092ed5 admin admin] Notify callbacks [] for port, precommit_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:51:01.470099 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.provisioning_blocks [None req-bb080e64-52ae-40e7-97d2-76d76a092ed5 admin admin] Transition to ACTIVE for port object 7d08e8da-622a-4f76-977c-d8354120044f will not be triggered until provisioned by entity DHCP. {{(pid=91829) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 25 16:51:01.523541 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-bb080e64-52ae-40e7-97d2-76d76a092ed5 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8757892520915'] for port, after_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:51:01.528097 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:51:01.591117 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-bb080e64-52ae-40e7-97d2-76d76a092ed5 admin admin] Network e759ce39-c6fd-47ae-81a9-86c152dee864 is already hosted by enough agents. {{(pid=91829) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 25 16:51:01.592100 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.scheduler.base_scheduler [None req-bb080e64-52ae-40e7-97d2-76d76a092ed5 admin admin] Resources bound (agent type, host, resource id): {{(pid=91829) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 16:51:01.594637 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bb080e64-52ae-40e7-97d2-76d76a092ed5 admin admin] Received port after_create {{(pid=91829) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 25 16:51:01.595316 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-bb080e64-52ae-40e7-97d2-76d76a092ed5 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-680080'] for router_interface, before_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:51:01.739021 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bb080e64-52ae-40e7-97d2-76d76a092ed5 admin admin] Pushing event updated for resources: {'Port': ['ID=7d08e8da-622a-4f76-977c-d8354120044f,revision_number=1']} {{(pid=91829) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:51:01.742592 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-bb080e64-52ae-40e7-97d2-76d76a092ed5 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.214s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:51:01.797597 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.provisioning_blocks [None req-ce2386fa-a47c-41bd-be02-931a0854d854 None None] Provisioning for port 7d08e8da-622a-4f76-977c-d8354120044f completed by entity DHCP. {{(pid=91831) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 25 16:51:01.802603 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.provisioning_blocks [None req-ce2386fa-a47c-41bd-be02-931a0854d854 None None] Provisioning complete for port 7d08e8da-622a-4f76-977c-d8354120044f triggered by entity DHCP. {{(pid=91831) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 16:51:01.802971 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-ce2386fa-a47c-41bd-be02-931a0854d854 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3854128'] for port, provisioning_complete {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:51:01.855292 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.plugin [None req-ce2386fa-a47c-41bd-be02-931a0854d854 None None] Port 7d08e8da-622a-4f76-977c-d8354120044f cannot update to ACTIVE because it is not bound. {{(pid=91831) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 25 16:51:01.865271 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-bb080e64-52ae-40e7-97d2-76d76a092ed5 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3832070'] for port, before_update {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:51:02.087017 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-bb080e64-52ae-40e7-97d2-76d76a092ed5 admin admin] Notify callbacks [] for port, precommit_update {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:51:02.091289 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-bb080e64-52ae-40e7-97d2-76d76a092ed5 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8757892955028', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8757892520933', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8757892521750'] for port, after_update {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:51:02.092448 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-bb080e64-52ae-40e7-97d2-76d76a092ed5 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-549138', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-679997'] for router_interface, after_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:51:02.096861 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-bb080e64-52ae-40e7-97d2-76d76a092ed5 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:51:02.223178 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bb080e64-52ae-40e7-97d2-76d76a092ed5 admin admin] Pushing event updated for resources: {'Port': ['ID=7d08e8da-622a-4f76-977c-d8354120044f,revision_number=2']} {{(pid=91829) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:51:02.225843 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-bb080e64-52ae-40e7-97d2-76d76a092ed5 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.130s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:51:02.283239 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-bb080e64-52ae-40e7-97d2-76d76a092ed5 admin admin] Network e759ce39-c6fd-47ae-81a9-86c152dee864 is already hosted by enough agents. {{(pid=91829) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 25 16:51:02.284803 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.scheduler.base_scheduler [None req-bb080e64-52ae-40e7-97d2-76d76a092ed5 admin admin] Resources bound (agent type, host, resource id): {{(pid=91829) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 16:51:02.477073 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.provisioning_blocks [None req-1ab8d461-10c5-4c08-8ce9-39d2a14ea574 None None] Provisioning complete for port 7d08e8da-622a-4f76-977c-d8354120044f triggered by entity DHCP. {{(pid=91831) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 16:51:02.477348 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-1ab8d461-10c5-4c08-8ce9-39d2a14ea574 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3854128'] for port, provisioning_complete {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:51:02.516130 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-bb080e64-52ae-40e7-97d2-76d76a092ed5 admin admin] Router 651e3eba-cca4-42bf-80c6-872a75cec99e is scheduled to L3 agent a2d427c1-2d07-43e8-afbe-218c9f7d0445 with binding_index 1 {{(pid=91829) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}} May 25 16:51:02.531151 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.plugin [None req-1ab8d461-10c5-4c08-8ce9-39d2a14ea574 None None] Port 7d08e8da-622a-4f76-977c-d8354120044f cannot update to ACTIVE because it is not bound. {{(pid=91831) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 25 16:51:02.666100 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-bb080e64-52ae-40e7-97d2-76d76a092ed5 admin admin] Notify agent at l3_agent.dv-cinder-790492-4-iscsi the message routers_updated {{(pid=91829) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 25 16:51:02.675229 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [None req-bb080e64-52ae-40e7-97d2-76d76a092ed5 admin admin] 10.222.0.62 "PUT /v2.0/routers/651e3eba-cca4-42bf-80c6-872a75cec99e/add_router_interface HTTP/1.1" status: 200 len: 508 time: 2.0978212 May 25 16:51:02.676047 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c15a858a-92cb-4f44-b707-d17b744a1623 None None] Sync routers for ids ['651e3eba-cca4-42bf-80c6-872a75cec99e'] in dv-cinder-790492-4-iscsi {{(pid=91832) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 25 16:51:02.686084 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c15a858a-92cb-4f44-b707-d17b744a1623 None None] Routers {'651e3eba-cca4-42bf-80c6-872a75cec99e'} bound to L3 agent in host dv-cinder-790492-4-iscsi {{(pid=91832) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 16:51:02.686945 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.db.l3_hamode_db [None req-c15a858a-92cb-4f44-b707-d17b744a1623 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-790492-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 0, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 0, "log_agent_heartbeats": false, "routers": 0},created_at=2021-05-25T16:50:28Z,description=,heartbeat_timestamp=2021-05-25T16:50:58Z,host='dv-cinder-790492-4-iscsi',id=a2d427c1-2d07-43e8-afbe-218c9f7d0445,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T16:50:28Z,topic='l3_agent')) {'router_ids': ['651e3eba-cca4-42bf-80c6-872a75cec99e'], 'active': True} {{(pid=91832) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 16:51:02.867345 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.db.l3_dvr_db [None req-c15a858a-92cb-4f44-b707-d17b744a1623 None None] Set router 651e3eba-cca4-42bf-80c6-872a75cec99e gateway port host: None {{(pid=91832) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 16:51:03.236845 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.db.l3_hamode_db [None req-c15a858a-92cb-4f44-b707-d17b744a1623 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '651e3eba-cca4-42bf-80c6-872a75cec99e', 'name': 'router1', 'tenant_id': 'e708cc9a159640b7a90f6edd2dc210bc', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T16:50:51Z', 'updated_at': '2021-05-25T16:51:01Z', 'revision_number': 2, 'project_id': 'e708cc9a159640b7a90f6edd2dc210bc', 'gw_port_host': None, '_interfaces': [{'id': '7d08e8da-622a-4f76-977c-d8354120044f', 'name': '', 'network_id': 'e759ce39-c6fd-47ae-81a9-86c152dee864', 'tenant_id': 'e708cc9a159640b7a90f6edd2dc210bc', 'mac_address': 'fa:16:3e:fa:29:b6', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '651e3eba-cca4-42bf-80c6-872a75cec99e', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': '899ea1be-5424-4fa8-8997-675ed0cdbe9c', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:51:01Z', 'updated_at': '2021-05-25T16:51:01Z', 'revision_number': 2, 'project_id': 'e708cc9a159640b7a90f6edd2dc210bc', 'subnets': [{'id': '899ea1be-5424-4fa8-8997-675ed0cdbe9c', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '0e78b268-0e3f-41be-bb2c-52cff96d5779'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-790492-4-iscsi', False) {} {{(pid=91832) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 16:51:03.241608 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c15a858a-92cb-4f44-b707-d17b744a1623 None None] Checking router: 651e3eba-cca4-42bf-80c6-872a75cec99e for host: dv-cinder-790492-4-iscsi {{(pid=91832) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 25 16:51:03.242004 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c15a858a-92cb-4f44-b707-d17b744a1623 None None] Updating router 651e3eba-cca4-42bf-80c6-872a75cec99e port 7d08e8da-622a-4f76-977c-d8354120044f binding host dv-cinder-790492-4-iscsi {{(pid=91832) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} May 25 16:51:03.293272 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron_lib.callbacks.manager [None req-c15a858a-92cb-4f44-b707-d17b744a1623 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3832070'] for port, before_update {{(pid=91832) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:51:03.666804 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron_lib.callbacks.manager [None req-c15a858a-92cb-4f44-b707-d17b744a1623 None None] Notify callbacks [] for port, precommit_update {{(pid=91832) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:51:03.681989 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.db.provisioning_blocks [None req-c15a858a-92cb-4f44-b707-d17b744a1623 None None] Transition to ACTIVE for port object 7d08e8da-622a-4f76-977c-d8354120044f will not be triggered until provisioned by entity L2. {{(pid=91832) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 25 16:51:03.688705 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron_lib.callbacks.manager [None req-c15a858a-92cb-4f44-b707-d17b744a1623 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8757892955028', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8757892520933', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8757892521750'] for port, after_update {{(pid=91832) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:51:03.695766 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:51:03.861314 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-11c8712f-97d6-4e3d-8763-22e23dcd42b0 None None] Pushing event updated for resources: {'Port': ['ID=7d08e8da-622a-4f76-977c-d8354120044f,revision_number=3']} {{(pid=91832) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:51:03.910525 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-11c8712f-97d6-4e3d-8763-22e23dcd42b0 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91832) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:51:03.910859 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-11c8712f-97d6-4e3d-8763-22e23dcd42b0 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91832) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:51:03.911182 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-11c8712f-97d6-4e3d-8763-22e23dcd42b0 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91832) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:51:03.911502 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-11c8712f-97d6-4e3d-8763-22e23dcd42b0 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91832) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:51:03.911815 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-11c8712f-97d6-4e3d-8763-22e23dcd42b0 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91832) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:51:03.912126 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-11c8712f-97d6-4e3d-8763-22e23dcd42b0 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91832) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:51:03.912432 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-11c8712f-97d6-4e3d-8763-22e23dcd42b0 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91832) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:51:03.912738 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-11c8712f-97d6-4e3d-8763-22e23dcd42b0 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91832) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:51:03.913058 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-11c8712f-97d6-4e3d-8763-22e23dcd42b0 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91832) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:51:03.913390 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-11c8712f-97d6-4e3d-8763-22e23dcd42b0 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91832) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:51:03.913694 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-11c8712f-97d6-4e3d-8763-22e23dcd42b0 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91832) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:51:03.914018 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-11c8712f-97d6-4e3d-8763-22e23dcd42b0 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91832) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:51:03.915076 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-11c8712f-97d6-4e3d-8763-22e23dcd42b0 None None] Tracked resource versions report: May 25 16:51:03.915076 dv-cinder-790492-4-iscsi neutron-server[91832]: pushed versions: May 25 16:51:03.915076 dv-cinder-790492-4-iscsi neutron-server[91832]: { 'AddressGroup': {'1.2'}, May 25 16:51:03.915076 dv-cinder-790492-4-iscsi neutron-server[91832]: 'ConntrackHelper': {'1.0'}, May 25 16:51:03.915076 dv-cinder-790492-4-iscsi neutron-server[91832]: 'Log': {'1.0'}, May 25 16:51:03.915076 dv-cinder-790492-4-iscsi neutron-server[91832]: 'Network': {'1.1'}, May 25 16:51:03.915076 dv-cinder-790492-4-iscsi neutron-server[91832]: 'Port': {'1.7'}, May 25 16:51:03.915076 dv-cinder-790492-4-iscsi neutron-server[91832]: 'PortForwarding': {'1.2'}, May 25 16:51:03.915076 dv-cinder-790492-4-iscsi neutron-server[91832]: 'QosPolicy': {'1.8'}, May 25 16:51:03.915076 dv-cinder-790492-4-iscsi neutron-server[91832]: 'SecurityGroup': {'1.4'}, May 25 16:51:03.915076 dv-cinder-790492-4-iscsi neutron-server[91832]: 'SecurityGroupRule': {'1.2'}, May 25 16:51:03.915076 dv-cinder-790492-4-iscsi neutron-server[91832]: 'SubPort': {'1.0'}, May 25 16:51:03.915076 dv-cinder-790492-4-iscsi neutron-server[91832]: 'Subnet': {'1.1'}, May 25 16:51:03.915076 dv-cinder-790492-4-iscsi neutron-server[91832]: 'Trunk': {'1.1'}} May 25 16:51:03.915076 dv-cinder-790492-4-iscsi neutron-server[91832]: consumer versions: May 25 16:51:03.915076 dv-cinder-790492-4-iscsi neutron-server[91832]: { DHCP agent@dv-cinder-790492-4-iscsi: {}, May 25 16:51:03.915076 dv-cinder-790492-4-iscsi neutron-server[91832]: L3 agent@dv-cinder-790492-4-iscsi: {}, May 25 16:51:03.915076 dv-cinder-790492-4-iscsi neutron-server[91832]: Metadata agent@dv-cinder-790492-4-iscsi: {}, May 25 16:51:03.915076 dv-cinder-790492-4-iscsi neutron-server[91832]: Metering agent@dv-cinder-790492-4-iscsi: {}, May 25 16:51:03.915076 dv-cinder-790492-4-iscsi neutron-server[91832]: Open vSwitch agent@dv-cinder-790492-4-iscsi: { 'AddressGroup': '1.2', May 25 16:51:03.915076 dv-cinder-790492-4-iscsi neutron-server[91832]: 'ConntrackHelper': '1.0', May 25 16:51:03.915076 dv-cinder-790492-4-iscsi neutron-server[91832]: 'Log': '1.0', May 25 16:51:03.915076 dv-cinder-790492-4-iscsi neutron-server[91832]: 'Network': '1.1', May 25 16:51:03.915076 dv-cinder-790492-4-iscsi neutron-server[91832]: 'Port': '1.7', May 25 16:51:03.915076 dv-cinder-790492-4-iscsi neutron-server[91832]: 'PortForwarding': '1.2', May 25 16:51:03.915076 dv-cinder-790492-4-iscsi neutron-server[91832]: 'QosPolicy': '1.8', May 25 16:51:03.915076 dv-cinder-790492-4-iscsi neutron-server[91832]: 'SecurityGroup': '1.4', May 25 16:51:03.915076 dv-cinder-790492-4-iscsi neutron-server[91832]: 'SecurityGroupRule': '1.2', May 25 16:51:03.915076 dv-cinder-790492-4-iscsi neutron-server[91832]: 'SubPort': '1.0', May 25 16:51:03.915076 dv-cinder-790492-4-iscsi neutron-server[91832]: 'Subnet': '1.1', May 25 16:51:03.915076 dv-cinder-790492-4-iscsi neutron-server[91832]: 'Trunk': '1.1'}} May 25 16:51:03.915076 dv-cinder-790492-4-iscsi neutron-server[91832]: {{(pid=91832) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} May 25 16:51:03.927186 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG oslo_concurrency.lockutils [None req-11c8712f-97d6-4e3d-8763-22e23dcd42b0 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.231s {{(pid=91832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:51:03.934063 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.plugins.ml2.managers [None req-c15a858a-92cb-4f44-b707-d17b744a1623 None None] Attempting to bind port 7d08e8da-622a-4f76-977c-d8354120044f on host dv-cinder-790492-4-iscsi for vnic_type normal with profile {{(pid=91832) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 25 16:51:03.934442 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.plugins.ml2.managers [None req-c15a858a-92cb-4f44-b707-d17b744a1623 None None] Attempting to bind port 7d08e8da-622a-4f76-977c-d8354120044f by drivers openvswitch,hyperv on host dv-cinder-790492-4-iscsi at level 0 using segments [{'id': 'f3e77295-958a-4567-812e-5e129968a4d1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 688, 'network_id': 'e759ce39-c6fd-47ae-81a9-86c152dee864'}] {{(pid=91832) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 25 16:51:03.934878 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c15a858a-92cb-4f44-b707-d17b744a1623 None None] Attempting to bind port 7d08e8da-622a-4f76-977c-d8354120044f on network e759ce39-c6fd-47ae-81a9-86c152dee864 {{(pid=91832) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 25 16:51:03.940158 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c15a858a-92cb-4f44-b707-d17b744a1623 None None] Checking agent: {'id': 'fc8251e1-071c-49f7-bc10-1337f1d37d1b', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-790492-4-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 25, 16, 50, 28), 'started_at': datetime.datetime(2021, 5, 25, 16, 50, 58), 'heartbeat_timestamp': datetime.datetime(2021, 5, 25, 16, 50, 58), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-790492-4-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=91832) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 25 16:51:03.940568 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c15a858a-92cb-4f44-b707-d17b744a1623 None None] Checking segment: {'id': 'f3e77295-958a-4567-812e-5e129968a4d1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 688, 'network_id': 'e759ce39-c6fd-47ae-81a9-86c152dee864'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91832) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 25 16:51:03.941036 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron_lib.callbacks.manager [None req-c15a858a-92cb-4f44-b707-d17b744a1623 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=91832) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:51:03.941418 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c15a858a-92cb-4f44-b707-d17b744a1623 None None] Bound using segment: {'id': 'f3e77295-958a-4567-812e-5e129968a4d1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 688, 'network_id': 'e759ce39-c6fd-47ae-81a9-86c152dee864'} {{(pid=91832) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 25 16:51:03.941980 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.plugins.ml2.managers [None req-c15a858a-92cb-4f44-b707-d17b744a1623 None None] Bound port: 7d08e8da-622a-4f76-977c-d8354120044f, host: dv-cinder-790492-4-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'f3e77295-958a-4567-812e-5e129968a4d1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 688, 'network_id': 'e759ce39-c6fd-47ae-81a9-86c152dee864'}}] {{(pid=91832) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 25 16:51:03.942342 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron_lib.callbacks.manager [None req-c15a858a-92cb-4f44-b707-d17b744a1623 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3832070'] for port, before_update {{(pid=91832) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:51:04.033247 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.plugins.ml2.db [None req-c15a858a-92cb-4f44-b707-d17b744a1623 None None] For port 7d08e8da-622a-4f76-977c-d8354120044f, host dv-cinder-790492-4-iscsi, cleared binding levels {{(pid=91832) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 25 16:51:04.038111 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.plugins.ml2.db [None req-c15a858a-92cb-4f44-b707-d17b744a1623 None None] For port 7d08e8da-622a-4f76-977c-d8354120044f, host dv-cinder-790492-4-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-790492-4-iscsi',level=0,port_id=7d08e8da-622a-4f76-977c-d8354120044f,segment=NetworkSegment(f3e77295-958a-4567-812e-5e129968a4d1),segment_id=f3e77295-958a-4567-812e-5e129968a4d1)] {{(pid=91832) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 25 16:51:04.043198 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron_lib.callbacks.manager [None req-c15a858a-92cb-4f44-b707-d17b744a1623 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8757892955028', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8757892520933', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8757892521750'] for port, after_update {{(pid=91832) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:51:04.047092 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:51:04.141669 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c15a858a-92cb-4f44-b707-d17b744a1623 None None] Routers {'651e3eba-cca4-42bf-80c6-872a75cec99e'} bound to L3 agent in host dv-cinder-790492-4-iscsi {{(pid=91832) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 16:51:04.142322 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.db.l3_hamode_db [None req-c15a858a-92cb-4f44-b707-d17b744a1623 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-790492-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 0, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 0, "log_agent_heartbeats": false, "routers": 0},created_at=2021-05-25T16:50:28Z,description=,heartbeat_timestamp=2021-05-25T16:50:58Z,host='dv-cinder-790492-4-iscsi',id=a2d427c1-2d07-43e8-afbe-218c9f7d0445,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T16:50:28Z,topic='l3_agent')) {'router_ids': ['651e3eba-cca4-42bf-80c6-872a75cec99e'], 'active': True} {{(pid=91832) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 16:51:04.281861 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-11c8712f-97d6-4e3d-8763-22e23dcd42b0 None None] Pushing event updated for resources: {'Port': ['ID=7d08e8da-622a-4f76-977c-d8354120044f,revision_number=4']} {{(pid=91832) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:51:04.285425 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG oslo_concurrency.lockutils [None req-11c8712f-97d6-4e3d-8763-22e23dcd42b0 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.238s {{(pid=91832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:51:04.311198 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.db.l3_dvr_db [None req-c15a858a-92cb-4f44-b707-d17b744a1623 None None] Set router 651e3eba-cca4-42bf-80c6-872a75cec99e gateway port host: None {{(pid=91832) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 16:51:04.628204 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.db.l3_hamode_db [None req-c15a858a-92cb-4f44-b707-d17b744a1623 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '651e3eba-cca4-42bf-80c6-872a75cec99e', 'name': 'router1', 'tenant_id': 'e708cc9a159640b7a90f6edd2dc210bc', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T16:50:51Z', 'updated_at': '2021-05-25T16:51:01Z', 'revision_number': 2, 'project_id': 'e708cc9a159640b7a90f6edd2dc210bc', 'gw_port_host': None, '_interfaces': [{'id': '7d08e8da-622a-4f76-977c-d8354120044f', 'name': '', 'network_id': 'e759ce39-c6fd-47ae-81a9-86c152dee864', 'tenant_id': 'e708cc9a159640b7a90f6edd2dc210bc', 'mac_address': 'fa:16:3e:fa:29:b6', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '651e3eba-cca4-42bf-80c6-872a75cec99e', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': '899ea1be-5424-4fa8-8997-675ed0cdbe9c', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790492-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:51:01Z', 'updated_at': '2021-05-25T16:51:04Z', 'revision_number': 4, 'project_id': 'e708cc9a159640b7a90f6edd2dc210bc', 'subnets': [{'id': '899ea1be-5424-4fa8-8997-675ed0cdbe9c', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '0e78b268-0e3f-41be-bb2c-52cff96d5779'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-790492-4-iscsi', False) {} {{(pid=91832) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 16:51:04.632162 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c15a858a-92cb-4f44-b707-d17b744a1623 None None] The sync data for ids ['651e3eba-cca4-42bf-80c6-872a75cec99e'] in dv-cinder-790492-4-iscsi is: [{'id': '651e3eba-cca4-42bf-80c6-872a75cec99e', 'name': 'router1', 'tenant_id': 'e708cc9a159640b7a90f6edd2dc210bc', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T16:50:51Z', 'updated_at': '2021-05-25T16:51:01Z', 'revision_number': 2, 'project_id': 'e708cc9a159640b7a90f6edd2dc210bc', 'gw_port_host': None, '_interfaces': [{'id': '7d08e8da-622a-4f76-977c-d8354120044f', 'name': '', 'network_id': 'e759ce39-c6fd-47ae-81a9-86c152dee864', 'tenant_id': 'e708cc9a159640b7a90f6edd2dc210bc', 'mac_address': 'fa:16:3e:fa:29:b6', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '651e3eba-cca4-42bf-80c6-872a75cec99e', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': '899ea1be-5424-4fa8-8997-675ed0cdbe9c', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790492-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:51:01Z', 'updated_at': '2021-05-25T16:51:04Z', 'revision_number': 4, 'project_id': 'e708cc9a159640b7a90f6edd2dc210bc', 'subnets': [{'id': '899ea1be-5424-4fa8-8997-675ed0cdbe9c', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '0e78b268-0e3f-41be-bb2c-52cff96d5779'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=91832) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 25 16:51:04.879005 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.wsgi [-] (91829) accepted ('10.222.0.62', 52890) {{(pid=91829) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:51:05.026129 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ad088b99-ae2a-43e7-86de-b727bde23f13 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:51:05.026689 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.quota.resource [None req-ad088b99-ae2a-43e7-86de-b727bde23f13 admin admin] Synchronizing usage tracker for tenant:f0f6b05e8a4341b3bf4899cd32c57785 on resource:network {{(pid=91829) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 25 16:51:05.044262 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.quota.resource [None req-ad088b99-ae2a-43e7-86de-b727bde23f13 admin admin] Unset dirty status for tenant:f0f6b05e8a4341b3bf4899cd32c57785 on resource:network {{(pid=91829) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 25 16:51:05.050329 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [None req-ad088b99-ae2a-43e7-86de-b727bde23f13 admin admin] 10.222.0.62 "GET /v2.0/networks/4364b6ab-4117-4a92-baeb-f5ee2f45bf74 HTTP/1.1" status: 200 len: 842 time: 0.1702919 May 25 16:51:05.055142 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.v2.base [None req-c1062242-ea6d-4dd9-b298-07bd3191dcc2 admin admin] Request body: {'subnet': {'name': 'public-subnet', 'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'enable_dhcp': False, 'gateway_ip': '172.27.2.1', 'cidr': '172.27.2.0/24', 'ip_version': 4}} {{(pid=91829) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 16:51:05.060293 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.quota.driver [None req-c1062242-ea6d-4dd9-b298-07bd3191dcc2 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91829) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 16:51:05.064002 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.quota.resource [None req-c1062242-ea6d-4dd9-b298-07bd3191dcc2 admin admin] Usage tracker for resource:subnet and tenant:f0f6b05e8a4341b3bf4899cd32c57785 is out of sync, need to count used quota {{(pid=91829) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 16:51:05.067399 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.quota.resource [None req-c1062242-ea6d-4dd9-b298-07bd3191dcc2 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=91829) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 16:51:05.077079 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.quota.driver [None req-c1062242-ea6d-4dd9-b298-07bd3191dcc2 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91829) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 16:51:05.087057 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-c1062242-ea6d-4dd9-b298-07bd3191dcc2 admin admin] Made reservation on behalf of f0f6b05e8a4341b3bf4899cd32c57785 for: {'subnet': 1} {{(pid=91829) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 25 16:51:05.089512 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-c1062242-ea6d-4dd9-b298-07bd3191dcc2 admin admin] Notify callbacks [] for subnet, before_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:51:05.497300 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.objects.ports [None req-c1062242-ea6d-4dd9-b298-07bd3191dcc2 admin admin] Time-cost: Fetching 0 ports in 0 security groups {{(pid=91829) get_objects /opt/stack/neutron/neutron/objects/ports.py:443}} May 25 16:51:05.497723 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-c1062242-ea6d-4dd9-b298-07bd3191dcc2 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55886', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411'] for subnet, after_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:51:05.502102 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-b972495b-cdea-4f8f-839a-d8a1651d2894 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:51:05.571689 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c1062242-ea6d-4dd9-b298-07bd3191dcc2 admin admin] Pushing event updated for resources: {'Subnet': ['ID=b947e790-d731-4b63-afc4-4aa112afe0f6,revision_number=0']} {{(pid=91829) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:51:05.574298 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-c1062242-ea6d-4dd9-b298-07bd3191dcc2 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.072s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:51:05.581304 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c1062242-ea6d-4dd9-b298-07bd3191dcc2 admin admin] Checking segment: {'id': '414a8468-1d66-4792-9e81-d8ac5ccf1512', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91829) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 25 16:51:05.581656 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c1062242-ea6d-4dd9-b298-07bd3191dcc2 admin admin] Network hostable DHCP agents. Network: 4364b6ab-4117-4a92-baeb-f5ee2f45bf74, hostable agents: ['8d7401c6-8951-4f2b-ace4-208761782bfc'], hosted agents: [] {{(pid=91829) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 25 16:51:05.598700 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c1062242-ea6d-4dd9-b298-07bd3191dcc2 admin admin] Network 4364b6ab-4117-4a92-baeb-f5ee2f45bf74 is scheduled to be hosted by DHCP agent 8d7401c6-8951-4f2b-ace4-208761782bfc with binding_index 1 {{(pid=91829) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 25 16:51:05.608091 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.scheduler.base_scheduler [None req-c1062242-ea6d-4dd9-b298-07bd3191dcc2 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-790492-4-iscsi, 4364b6ab-4117-4a92-baeb-f5ee2f45bf74) {{(pid=91829) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 16:51:05.612139 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c1062242-ea6d-4dd9-b298-07bd3191dcc2 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:51:05.612919 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-c1062242-ea6d-4dd9-b298-07bd3191dcc2 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-551373'] for subnet, before_response {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:51:05.618224 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b83e5a82-8e49-47ac-b73a-8c1db13a2773 None None] Network 4364b6ab-4117-4a92-baeb-f5ee2f45bf74 requested from dv-cinder-790492-4-iscsi {{(pid=91831) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} May 25 16:51:05.634189 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [None req-c1062242-ea6d-4dd9-b298-07bd3191dcc2 admin admin] 10.222.0.62 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 821 time: 0.5825145 May 25 16:51:05.832025 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2e300c78-0491-4343-b672-f0bcba984591 None None] Network 4364b6ab-4117-4a92-baeb-f5ee2f45bf74 requested from dv-cinder-790492-4-iscsi {{(pid=91831) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} May 25 16:51:07.773175 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.rpc [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Device 7d08e8da-622a-4f76-977c-d8354120044f up at agent ovs-agent-dv-cinder-790492-4-iscsi {{(pid=91831) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 25 16:51:07.842696 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.provisioning_blocks [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Provisioning for port 7d08e8da-622a-4f76-977c-d8354120044f completed by entity L2. {{(pid=91831) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 25 16:51:07.847281 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.provisioning_blocks [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Provisioning complete for port 7d08e8da-622a-4f76-977c-d8354120044f triggered by entity L2. {{(pid=91831) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 16:51:07.847652 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3854128'] for port, provisioning_complete {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:51:07.873507 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.wsgi [-] (91829) accepted ('10.222.0.62', 52904) {{(pid=91829) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:51:07.965598 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3832070'] for port, before_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:51:08.002767 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.db [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] For port 7d08e8da-622a-4f76-977c-d8354120044f, host dv-cinder-790492-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-790492-4-iscsi',level=0,port_id=7d08e8da-622a-4f76-977c-d8354120044f,segment=NetworkSegment(f3e77295-958a-4567-812e-5e129968a4d1),segment_id=f3e77295-958a-4567-812e-5e129968a4d1)] {{(pid=91831) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 16:51:08.006467 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8757892955028', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8757892520933', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8757892521750'] for port, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:51:08.009136 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:51:08.074780 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Pushing event updated for resources: {'Port': ['ID=7d08e8da-622a-4f76-977c-d8354120044f,revision_number=5']} {{(pid=91831) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:51:08.078210 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.070s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:51:08.080890 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [None req-c0fd63ba-9de0-49b2-94b1-f121ac9f890c admin admin] 10.222.0.62 "GET /v2.0/routers/651e3eba-cca4-42bf-80c6-872a75cec99e HTTP/1.1" status: 200 len: 710 time: 0.2061820 May 25 16:51:08.207900 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-40d11ba9-639e-436c-96ae-375184a61837 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:51:08.209162 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [None req-40d11ba9-639e-436c-96ae-375184a61837 admin admin] 10.222.0.62 "GET /v2.0/networks/4364b6ab-4117-4a92-baeb-f5ee2f45bf74 HTTP/1.1" status: 200 len: 886 time: 0.1251409 May 25 16:51:08.218450 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.v2.base [None req-32f6c65c-8179-4466-8c05-98168076c0bc admin admin] Request body: {'router': {'external_gateway_info': {'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74'}}} {{(pid=91829) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 16:51:08.701804 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-32f6c65c-8179-4466-8c05-98168076c0bc admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-683170', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-684906', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-31039'] for router, precommit_update {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:51:09.034607 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-32f6c65c-8179-4466-8c05-98168076c0bc admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:51:09.089194 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-32f6c65c-8179-4466-8c05-98168076c0bc admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3832070'] for port, before_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:51:09.221342 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.db_base_plugin_common [None req-32f6c65c-8179-4466-8c05-98168076c0bc admin admin] Allocated IP 172.27.2.246 (4364b6ab-4117-4a92-baeb-f5ee2f45bf74/b947e790-d731-4b63-afc4-4aa112afe0f6/9777381e-6c0a-4381-925e-edb8e5521455) {{(pid=91829) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 25 16:51:09.363636 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-32f6c65c-8179-4466-8c05-98168076c0bc admin admin] Notify callbacks [] for port, precommit_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:51:09.393465 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-32f6c65c-8179-4466-8c05-98168076c0bc admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8757892520915'] for port, after_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:51:09.397962 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:51:09.462241 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-32f6c65c-8179-4466-8c05-98168076c0bc admin admin] Network 4364b6ab-4117-4a92-baeb-f5ee2f45bf74 is already hosted by enough agents. {{(pid=91829) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 25 16:51:09.465009 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.scheduler.base_scheduler [None req-32f6c65c-8179-4466-8c05-98168076c0bc admin admin] Resources bound (agent type, host, resource id): {{(pid=91829) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 16:51:09.470341 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.l3_dvrscheduler_db [None req-32f6c65c-8179-4466-8c05-98168076c0bc admin admin] Received port after_create {{(pid=91829) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 25 16:51:09.525229 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-32f6c65c-8179-4466-8c05-98168076c0bc admin admin] Pushing event updated for resources: {'Port': ['ID=9777381e-6c0a-4381-925e-edb8e5521455,revision_number=1']} {{(pid=91829) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:51:09.534645 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-32f6c65c-8179-4466-8c05-98168076c0bc admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.137s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:51:09.756327 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.rpc [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Device 7d08e8da-622a-4f76-977c-d8354120044f up at agent ovs-agent-dv-cinder-790492-4-iscsi {{(pid=91831) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 25 16:51:09.826416 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.provisioning_blocks [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Provisioning complete for port 7d08e8da-622a-4f76-977c-d8354120044f triggered by entity L2. {{(pid=91831) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 16:51:09.826784 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3854128'] for port, provisioning_complete {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:51:09.902777 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-32f6c65c-8179-4466-8c05-98168076c0bc admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:51:10.237323 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-32f6c65c-8179-4466-8c05-98168076c0bc admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-683170', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-684906', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-31039'] for router, precommit_update {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:51:10.240604 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-32f6c65c-8179-4466-8c05-98168076c0bc admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-683233', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_distributed_port_bindings_after_change-683177', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_snat_interfaces_after_change-683240', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._reconfigure_ha_resources-684924'] for router, after_update {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:51:10.416126 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-32f6c65c-8179-4466-8c05-98168076c0bc admin admin] Router 651e3eba-cca4-42bf-80c6-872a75cec99e has already been hosted by L3 agent a2d427c1-2d07-43e8-afbe-218c9f7d0445 {{(pid=91829) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 25 16:51:10.587539 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-32f6c65c-8179-4466-8c05-98168076c0bc admin admin] Notify agent at l3_agent.dv-cinder-790492-4-iscsi the message routers_updated {{(pid=91829) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 25 16:51:10.595957 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-32f6c65c-8179-4466-8c05-98168076c0bc admin admin] Notify callbacks [] for router, before_response {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:51:10.597192 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d28258cd-6a65-4271-8e23-0f568bdf97fc None None] Sync routers for ids ['651e3eba-cca4-42bf-80c6-872a75cec99e'] in dv-cinder-790492-4-iscsi {{(pid=91831) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 25 16:51:10.597968 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [None req-32f6c65c-8179-4466-8c05-98168076c0bc admin admin] 10.222.0.62 "PUT /v2.0/routers/651e3eba-cca4-42bf-80c6-872a75cec99e HTTP/1.1" status: 200 len: 890 time: 2.3824792 May 25 16:51:10.607363 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d28258cd-6a65-4271-8e23-0f568bdf97fc None None] Routers {'651e3eba-cca4-42bf-80c6-872a75cec99e'} bound to L3 agent in host dv-cinder-790492-4-iscsi {{(pid=91831) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 16:51:10.608041 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.l3_hamode_db [None req-d28258cd-6a65-4271-8e23-0f568bdf97fc None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-790492-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 0, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 0, "log_agent_heartbeats": false, "routers": 0},created_at=2021-05-25T16:50:28Z,description=,heartbeat_timestamp=2021-05-25T16:50:58Z,host='dv-cinder-790492-4-iscsi',id=a2d427c1-2d07-43e8-afbe-218c9f7d0445,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T16:50:28Z,topic='l3_agent')) {'router_ids': ['651e3eba-cca4-42bf-80c6-872a75cec99e'], 'active': True} {{(pid=91831) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 16:51:10.800245 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.l3_dvr_db [None req-d28258cd-6a65-4271-8e23-0f568bdf97fc None None] Set router 651e3eba-cca4-42bf-80c6-872a75cec99e gateway port host: dv-cinder-790492-4-iscsi {{(pid=91831) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 16:51:11.162448 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.l3_hamode_db [None req-d28258cd-6a65-4271-8e23-0f568bdf97fc None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '651e3eba-cca4-42bf-80c6-872a75cec99e', 'name': 'router1', 'tenant_id': 'e708cc9a159640b7a90f6edd2dc210bc', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'external_fixed_ips': [{'subnet_id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'ip_address': '172.27.2.246'}], 'enable_snat': True}, 'gw_port_id': '9777381e-6c0a-4381-925e-edb8e5521455', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T16:50:51Z', 'updated_at': '2021-05-25T16:51:09Z', 'revision_number': 4, 'project_id': 'e708cc9a159640b7a90f6edd2dc210bc', 'gw_port': {'id': '9777381e-6c0a-4381-925e-edb8e5521455', 'name': '', 'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'tenant_id': '', 'mac_address': 'fa:16:3e:39:5a:d1', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '651e3eba-cca4-42bf-80c6-872a75cec99e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 21, 'fixed_ips': [{'subnet_id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'ip_address': '172.27.2.246', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:51:09Z', 'updated_at': '2021-05-25T16:51:09Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-790492-4-iscsi', '_interfaces': [{'id': '7d08e8da-622a-4f76-977c-d8354120044f', 'name': '', 'network_id': 'e759ce39-c6fd-47ae-81a9-86c152dee864', 'tenant_id': 'e708cc9a159640b7a90f6edd2dc210bc', 'mac_address': 'fa:16:3e:fa:29:b6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '651e3eba-cca4-42bf-80c6-872a75cec99e', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': '899ea1be-5424-4fa8-8997-675ed0cdbe9c', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790492-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:51:01Z', 'updated_at': '2021-05-25T16:51:07Z', 'revision_number': 5, 'project_id': 'e708cc9a159640b7a90f6edd2dc210bc', 'subnets': [{'id': '899ea1be-5424-4fa8-8997-675ed0cdbe9c', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '0e78b268-0e3f-41be-bb2c-52cff96d5779'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-790492-4-iscsi', False) {} {{(pid=91831) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 16:51:11.167283 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d28258cd-6a65-4271-8e23-0f568bdf97fc None None] Checking router: 651e3eba-cca4-42bf-80c6-872a75cec99e for host: dv-cinder-790492-4-iscsi {{(pid=91831) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 25 16:51:11.167639 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d28258cd-6a65-4271-8e23-0f568bdf97fc None None] Updating router 651e3eba-cca4-42bf-80c6-872a75cec99e port 9777381e-6c0a-4381-925e-edb8e5521455 binding host dv-cinder-790492-4-iscsi {{(pid=91831) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} May 25 16:51:11.218139 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-d28258cd-6a65-4271-8e23-0f568bdf97fc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3832070'] for port, before_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:51:11.542001 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-d28258cd-6a65-4271-8e23-0f568bdf97fc None None] Notify callbacks [] for port, precommit_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:51:11.553882 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.provisioning_blocks [None req-d28258cd-6a65-4271-8e23-0f568bdf97fc None None] Transition to ACTIVE for port object 9777381e-6c0a-4381-925e-edb8e5521455 will not be triggered until provisioned by entity L2. {{(pid=91831) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 25 16:51:11.562658 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-d28258cd-6a65-4271-8e23-0f568bdf97fc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8757892955028', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8757892520933', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8757892521750'] for port, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:51:11.567122 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:51:11.643701 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.managers [None req-d28258cd-6a65-4271-8e23-0f568bdf97fc None None] Attempting to bind port 9777381e-6c0a-4381-925e-edb8e5521455 on host dv-cinder-790492-4-iscsi for vnic_type normal with profile {{(pid=91831) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 25 16:51:11.644077 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.managers [None req-d28258cd-6a65-4271-8e23-0f568bdf97fc None None] Attempting to bind port 9777381e-6c0a-4381-925e-edb8e5521455 by drivers openvswitch,hyperv on host dv-cinder-790492-4-iscsi at level 0 using segments [{'id': '414a8468-1d66-4792-9e81-d8ac5ccf1512', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74'}] {{(pid=91831) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 25 16:51:11.644444 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d28258cd-6a65-4271-8e23-0f568bdf97fc None None] Attempting to bind port 9777381e-6c0a-4381-925e-edb8e5521455 on network 4364b6ab-4117-4a92-baeb-f5ee2f45bf74 {{(pid=91831) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 25 16:51:11.653324 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d28258cd-6a65-4271-8e23-0f568bdf97fc None None] Checking agent: {'id': 'fc8251e1-071c-49f7-bc10-1337f1d37d1b', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-790492-4-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 25, 16, 50, 28), 'started_at': datetime.datetime(2021, 5, 25, 16, 50, 58), 'heartbeat_timestamp': datetime.datetime(2021, 5, 25, 16, 50, 58), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-790492-4-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=91831) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 25 16:51:11.653696 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d28258cd-6a65-4271-8e23-0f568bdf97fc None None] Checking segment: {'id': '414a8468-1d66-4792-9e81-d8ac5ccf1512', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91831) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 25 16:51:11.654117 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-d28258cd-6a65-4271-8e23-0f568bdf97fc None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:51:11.654512 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d28258cd-6a65-4271-8e23-0f568bdf97fc None None] Bound using segment: {'id': '414a8468-1d66-4792-9e81-d8ac5ccf1512', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74'} {{(pid=91831) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 25 16:51:11.654976 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.managers [None req-d28258cd-6a65-4271-8e23-0f568bdf97fc None None] Bound port: 9777381e-6c0a-4381-925e-edb8e5521455, host: dv-cinder-790492-4-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '414a8468-1d66-4792-9e81-d8ac5ccf1512', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74'}}] {{(pid=91831) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 25 16:51:11.655347 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-d28258cd-6a65-4271-8e23-0f568bdf97fc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3832070'] for port, before_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:51:11.682235 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-22acd9b5-6f41-42bb-ab6b-eb244f9b39da None None] Pushing event updated for resources: {'Port': ['ID=9777381e-6c0a-4381-925e-edb8e5521455,revision_number=2']} {{(pid=91831) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:51:11.685227 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [None req-22acd9b5-6f41-42bb-ab6b-eb244f9b39da None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.118s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:51:11.728627 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.db [None req-d28258cd-6a65-4271-8e23-0f568bdf97fc None None] For port 9777381e-6c0a-4381-925e-edb8e5521455, host dv-cinder-790492-4-iscsi, cleared binding levels {{(pid=91831) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 25 16:51:11.731657 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.db [None req-d28258cd-6a65-4271-8e23-0f568bdf97fc None None] For port 9777381e-6c0a-4381-925e-edb8e5521455, host dv-cinder-790492-4-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-790492-4-iscsi',level=0,port_id=9777381e-6c0a-4381-925e-edb8e5521455,segment=NetworkSegment(414a8468-1d66-4792-9e81-d8ac5ccf1512),segment_id=414a8468-1d66-4792-9e81-d8ac5ccf1512)] {{(pid=91831) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 25 16:51:11.735939 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-d28258cd-6a65-4271-8e23-0f568bdf97fc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8757892955028', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8757892520933', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8757892521750'] for port, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:51:11.740426 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:51:11.817026 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d28258cd-6a65-4271-8e23-0f568bdf97fc None None] Routers {'651e3eba-cca4-42bf-80c6-872a75cec99e'} bound to L3 agent in host dv-cinder-790492-4-iscsi {{(pid=91831) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 16:51:11.817644 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.l3_hamode_db [None req-d28258cd-6a65-4271-8e23-0f568bdf97fc None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-790492-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 0, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 0, "log_agent_heartbeats": false, "routers": 0},created_at=2021-05-25T16:50:28Z,description=,heartbeat_timestamp=2021-05-25T16:50:58Z,host='dv-cinder-790492-4-iscsi',id=a2d427c1-2d07-43e8-afbe-218c9f7d0445,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T16:50:28Z,topic='l3_agent')) {'router_ids': ['651e3eba-cca4-42bf-80c6-872a75cec99e'], 'active': True} {{(pid=91831) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 16:51:11.870842 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-22acd9b5-6f41-42bb-ab6b-eb244f9b39da None None] Pushing event updated for resources: {'Port': ['ID=9777381e-6c0a-4381-925e-edb8e5521455,revision_number=3']} {{(pid=91831) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:51:11.880386 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [None req-22acd9b5-6f41-42bb-ab6b-eb244f9b39da None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.140s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:51:11.998578 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.l3_dvr_db [None req-d28258cd-6a65-4271-8e23-0f568bdf97fc None None] Set router 651e3eba-cca4-42bf-80c6-872a75cec99e gateway port host: dv-cinder-790492-4-iscsi {{(pid=91831) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 16:51:12.321742 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.l3_hamode_db [None req-d28258cd-6a65-4271-8e23-0f568bdf97fc None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '651e3eba-cca4-42bf-80c6-872a75cec99e', 'name': 'router1', 'tenant_id': 'e708cc9a159640b7a90f6edd2dc210bc', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'external_fixed_ips': [{'subnet_id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'ip_address': '172.27.2.246'}], 'enable_snat': True}, 'gw_port_id': '9777381e-6c0a-4381-925e-edb8e5521455', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T16:50:51Z', 'updated_at': '2021-05-25T16:51:09Z', 'revision_number': 4, 'project_id': 'e708cc9a159640b7a90f6edd2dc210bc', 'gw_port': {'id': '9777381e-6c0a-4381-925e-edb8e5521455', 'name': '', 'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'tenant_id': '', 'mac_address': 'fa:16:3e:39:5a:d1', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '651e3eba-cca4-42bf-80c6-872a75cec99e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 21, 'fixed_ips': [{'subnet_id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'ip_address': '172.27.2.246', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790492-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:51:09Z', 'updated_at': '2021-05-25T16:51:11Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-790492-4-iscsi', '_interfaces': [{'id': '7d08e8da-622a-4f76-977c-d8354120044f', 'name': '', 'network_id': 'e759ce39-c6fd-47ae-81a9-86c152dee864', 'tenant_id': 'e708cc9a159640b7a90f6edd2dc210bc', 'mac_address': 'fa:16:3e:fa:29:b6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '651e3eba-cca4-42bf-80c6-872a75cec99e', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': '899ea1be-5424-4fa8-8997-675ed0cdbe9c', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790492-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:51:01Z', 'updated_at': '2021-05-25T16:51:07Z', 'revision_number': 5, 'project_id': 'e708cc9a159640b7a90f6edd2dc210bc', 'subnets': [{'id': '899ea1be-5424-4fa8-8997-675ed0cdbe9c', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '0e78b268-0e3f-41be-bb2c-52cff96d5779'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-790492-4-iscsi', False) {} {{(pid=91831) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 16:51:12.325583 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d28258cd-6a65-4271-8e23-0f568bdf97fc None None] The sync data for ids ['651e3eba-cca4-42bf-80c6-872a75cec99e'] in dv-cinder-790492-4-iscsi is: [{'id': '651e3eba-cca4-42bf-80c6-872a75cec99e', 'name': 'router1', 'tenant_id': 'e708cc9a159640b7a90f6edd2dc210bc', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'external_fixed_ips': [{'subnet_id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'ip_address': '172.27.2.246'}], 'enable_snat': True}, 'gw_port_id': '9777381e-6c0a-4381-925e-edb8e5521455', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T16:50:51Z', 'updated_at': '2021-05-25T16:51:09Z', 'revision_number': 4, 'project_id': 'e708cc9a159640b7a90f6edd2dc210bc', 'gw_port': {'id': '9777381e-6c0a-4381-925e-edb8e5521455', 'name': '', 'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'tenant_id': '', 'mac_address': 'fa:16:3e:39:5a:d1', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '651e3eba-cca4-42bf-80c6-872a75cec99e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 21, 'fixed_ips': [{'subnet_id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'ip_address': '172.27.2.246', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790492-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:51:09Z', 'updated_at': '2021-05-25T16:51:11Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-790492-4-iscsi', '_interfaces': [{'id': '7d08e8da-622a-4f76-977c-d8354120044f', 'name': '', 'network_id': 'e759ce39-c6fd-47ae-81a9-86c152dee864', 'tenant_id': 'e708cc9a159640b7a90f6edd2dc210bc', 'mac_address': 'fa:16:3e:fa:29:b6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '651e3eba-cca4-42bf-80c6-872a75cec99e', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': '899ea1be-5424-4fa8-8997-675ed0cdbe9c', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790492-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:51:01Z', 'updated_at': '2021-05-25T16:51:07Z', 'revision_number': 5, 'project_id': 'e708cc9a159640b7a90f6edd2dc210bc', 'subnets': [{'id': '899ea1be-5424-4fa8-8997-675ed0cdbe9c', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '0e78b268-0e3f-41be-bb2c-52cff96d5779'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=91831) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 25 16:51:12.938993 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.wsgi [-] (91829) accepted ('10.222.0.62', 52914) {{(pid=91829) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:51:13.059585 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [None req-49f2e1dc-64f3-4dfd-aa12-c6c208a47e72 admin admin] 10.222.0.62 "GET /v2.0/ports?device_owner=network%3Arouter_gateway&fields=id&fields=name&fields=mac_address&fields=fixed_ips&fields=status HTTP/1.1" status: 200 len: 411 time: 0.1194439 May 25 16:51:13.791583 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.rpc [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Device 9777381e-6c0a-4381-925e-edb8e5521455 up at agent ovs-agent-dv-cinder-790492-4-iscsi {{(pid=91831) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 25 16:51:13.897656 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.provisioning_blocks [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Provisioning for port 9777381e-6c0a-4381-925e-edb8e5521455 completed by entity L2. {{(pid=91831) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 25 16:51:13.902757 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.provisioning_blocks [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Provisioning complete for port 9777381e-6c0a-4381-925e-edb8e5521455 triggered by entity L2. {{(pid=91831) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 16:51:13.903130 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3854128'] for port, provisioning_complete {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:51:14.020237 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3832070'] for port, before_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:51:14.033558 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.db [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] For port 9777381e-6c0a-4381-925e-edb8e5521455, host dv-cinder-790492-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-790492-4-iscsi',level=0,port_id=9777381e-6c0a-4381-925e-edb8e5521455,segment=NetworkSegment(414a8468-1d66-4792-9e81-d8ac5ccf1512),segment_id=414a8468-1d66-4792-9e81-d8ac5ccf1512)] {{(pid=91831) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 16:51:14.038035 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8757892955028', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8757892520933', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8757892521750'] for port, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:51:14.040665 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:51:14.106875 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Pushing event updated for resources: {'Port': ['ID=9777381e-6c0a-4381-925e-edb8e5521455,revision_number=4']} {{(pid=91831) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:51:14.109880 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.069s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:51:15.774515 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.rpc [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Device 9777381e-6c0a-4381-925e-edb8e5521455 up at agent ovs-agent-dv-cinder-790492-4-iscsi {{(pid=91831) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 25 16:51:15.842425 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.provisioning_blocks [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Provisioning complete for port 9777381e-6c0a-4381-925e-edb8e5521455 triggered by entity L2. {{(pid=91831) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 16:51:15.842808 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3854128'] for port, provisioning_complete {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:51:20.155100 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.db.agents_db [None req-504cb04f-4543-46c1-8db7-349e21db7634 None None] Agent healthcheck: found 5 active agents {{(pid=91832) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} May 25 16:51:25.243521 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-efdc0f50-078d-4bef-ac85-8f97fd3c18e4 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:51:27.654900 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-13aa0788-f2da-4310-a8a9-cb503d9bcf0d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:51:27.828658 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:51:28.545005 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-0a55eb4a-8b57-4233-84d6-6b423b4ed6db None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:51:30.144995 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-57f11b47-1f51-4191-b7c9-af248a48372c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:51:55.247794 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-cdfd08c3-3147-4ac7-bfdc-e027b0a30b7b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:51:57.152726 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.db.agents_db [None req-504cb04f-4543-46c1-8db7-349e21db7634 None None] Agent healthcheck: found 5 active agents {{(pid=91832) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} May 25 16:51:57.659593 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-b150fb33-2041-4410-8ed0-6eb9ab6e5ca7 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:51:57.823503 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:51:58.548186 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-0a55eb4a-8b57-4233-84d6-6b423b4ed6db None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:52:00.147886 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-57f11b47-1f51-4191-b7c9-af248a48372c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:52:25.252867 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-caea634d-3451-4877-8592-402c8c4b7765 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:52:27.662020 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-3b46867d-9133-45b3-9584-ebd15c517dc8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:52:27.826504 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:52:28.549775 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-0a55eb4a-8b57-4233-84d6-6b423b4ed6db None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:52:30.148459 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-57f11b47-1f51-4191-b7c9-af248a48372c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:52:34.154385 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.db.agents_db [None req-504cb04f-4543-46c1-8db7-349e21db7634 None None] Agent healthcheck: found 5 active agents {{(pid=91832) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} May 25 16:52:47.373456 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.wsgi [-] (91829) accepted ('10.222.0.62', 53484) {{(pid=91829) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:52:47.439466 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.pecan_wsgi.hooks.translation [None req-54b6335f-4ec6-45eb-92a5-32a3e91c9066 admin admin] GET failed (client error): The resource could not be found. May 25 16:52:47.440703 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [None req-54b6335f-4ec6-45eb-92a5-32a3e91c9066 admin admin] 10.222.0.62 "GET /v2.0/networks/private HTTP/1.1" status: 404 len: 315 time: 0.0662887 May 25 16:52:47.572991 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f5034b28-7795-42ed-a56f-880de2a52e8f admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:52:47.574383 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [None req-f5034b28-7795-42ed-a56f-880de2a52e8f admin admin] 10.222.0.62 "GET /v2.0/networks?name=private HTTP/1.1" status: 200 len: 872 time: 0.1298993 May 25 16:52:49.715659 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.wsgi [-] (91829) accepted ('10.222.0.62', 53494) {{(pid=91829) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:52:49.822400 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ee717cae-ad9f-4848-805e-bbfaf763319a admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:52:49.822952 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.quota.resource [None req-ee717cae-ad9f-4848-805e-bbfaf763319a admin admin] Synchronizing usage tracker for tenant:f0f6b05e8a4341b3bf4899cd32c57785 on resource:subnet {{(pid=91829) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 25 16:52:49.839328 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.quota.resource [None req-ee717cae-ad9f-4848-805e-bbfaf763319a admin admin] Unset dirty status for tenant:f0f6b05e8a4341b3bf4899cd32c57785 on resource:subnet {{(pid=91829) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 25 16:52:49.840579 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [None req-ee717cae-ad9f-4848-805e-bbfaf763319a admin admin] 10.222.0.62 "GET /v2.0/subnets/899ea1be-5424-4fa8-8997-675ed0cdbe9c HTTP/1.1" status: 200 len: 849 time: 0.1239610 May 25 16:52:49.850258 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.v2.base [None req-5d1a0334-c7d6-49ca-92c6-41e9e62f8842 admin admin] Request body: {'subnet': {'dns_nameservers': ['8.8.8.8', '8.8.4.4']}} {{(pid=91829) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 16:52:49.970206 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-5d1a0334-c7d6-49ca-92c6-41e9e62f8842 admin admin] Notify callbacks [] for subnet, before_update {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:52:50.201545 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-5d1a0334-c7d6-49ca-92c6-41e9e62f8842 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55886', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_subnet_gateway_ip_update-8757892955037'] for subnet, after_update {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:52:50.205105 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-c1062242-ea6d-4dd9-b298-07bd3191dcc2 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:52:50.249750 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5d1a0334-c7d6-49ca-92c6-41e9e62f8842 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:52:50.249750 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-5d1a0334-c7d6-49ca-92c6-41e9e62f8842 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-551373'] for subnet, before_response {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:52:50.251219 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [None req-5d1a0334-c7d6-49ca-92c6-41e9e62f8842 admin admin] 10.222.0.62 "PUT /v2.0/subnets/899ea1be-5424-4fa8-8997-675ed0cdbe9c HTTP/1.1" status: 200 len: 868 time: 0.4052401 May 25 16:52:50.253301 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5492afc2-013e-4173-a631-433f1a82d9d3 None None] Network e759ce39-c6fd-47ae-81a9-86c152dee864 requested from dv-cinder-790492-4-iscsi {{(pid=91831) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} May 25 16:52:50.274897 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5d1a0334-c7d6-49ca-92c6-41e9e62f8842 admin admin] Pushing event updated for resources: {'Subnet': ['ID=899ea1be-5424-4fa8-8997-675ed0cdbe9c,revision_number=1']} {{(pid=91829) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:52:50.282883 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5d1a0334-c7d6-49ca-92c6-41e9e62f8842 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91829) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:52:50.283250 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5d1a0334-c7d6-49ca-92c6-41e9e62f8842 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91829) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:52:50.283600 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5d1a0334-c7d6-49ca-92c6-41e9e62f8842 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91829) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:52:50.283905 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5d1a0334-c7d6-49ca-92c6-41e9e62f8842 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91829) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:52:50.284221 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5d1a0334-c7d6-49ca-92c6-41e9e62f8842 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91829) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:52:50.284555 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5d1a0334-c7d6-49ca-92c6-41e9e62f8842 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91829) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:52:50.284871 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5d1a0334-c7d6-49ca-92c6-41e9e62f8842 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91829) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:52:50.285182 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5d1a0334-c7d6-49ca-92c6-41e9e62f8842 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91829) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:52:50.285507 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5d1a0334-c7d6-49ca-92c6-41e9e62f8842 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91829) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:52:50.286207 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5d1a0334-c7d6-49ca-92c6-41e9e62f8842 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91829) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:52:50.286207 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5d1a0334-c7d6-49ca-92c6-41e9e62f8842 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91829) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:52:50.286471 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5d1a0334-c7d6-49ca-92c6-41e9e62f8842 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91829) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:52:50.290532 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-5d1a0334-c7d6-49ca-92c6-41e9e62f8842 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.085s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:52:50.690909 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.provisioning_blocks [None req-c0a638b4-a04c-46e5-af3b-14a6821197f6 None None] Provisioning complete for port 7d08e8da-622a-4f76-977c-d8354120044f triggered by entity DHCP. {{(pid=91831) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 16:52:50.691285 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-c0a638b4-a04c-46e5-af3b-14a6821197f6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3854128'] for port, provisioning_complete {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:52:50.816283 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.provisioning_blocks [None req-c0a638b4-a04c-46e5-af3b-14a6821197f6 None None] Provisioning complete for port b84bd82d-378d-4e57-85a6-b4fe6cb09112 triggered by entity DHCP. {{(pid=91831) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 16:52:50.816840 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-c0a638b4-a04c-46e5-af3b-14a6821197f6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3854128'] for port, provisioning_complete {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:52:52.345619 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.wsgi [-] (91829) accepted ('10.222.0.62', 53504) {{(pid=91829) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:52:52.522550 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3cfec0da-3603-426a-a962-4ef37377a05c admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:52:52.522971 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3cfec0da-3603-426a-a962-4ef37377a05c admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:52:52.524471 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [None req-3cfec0da-3603-426a-a962-4ef37377a05c admin admin] 10.222.0.62 "GET /v2.0/networks HTTP/1.1" status: 200 len: 1549 time: 0.1778753 May 25 16:52:54.633601 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.wsgi [-] (91829) accepted ('10.222.0.62', 53514) {{(pid=91829) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:52:54.809764 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e75e8d60-bc58-4dc3-b580-aeea14fdbe8f admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:52:54.810302 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e75e8d60-bc58-4dc3-b580-aeea14fdbe8f admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:52:54.811991 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [None req-e75e8d60-bc58-4dc3-b580-aeea14fdbe8f admin admin] 10.222.0.62 "GET /v2.0/networks HTTP/1.1" status: 200 len: 1549 time: 0.1773856 May 25 16:52:55.255390 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-ec385cbc-6336-477f-b2b3-57dfcab2468c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:52:56.942243 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.wsgi [-] (91829) accepted ('10.222.0.62', 53524) {{(pid=91829) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:52:57.106001 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-525df280-ef0c-4e35-b84c-fda765ec1bea admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:52:57.107318 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [None req-525df280-ef0c-4e35-b84c-fda765ec1bea admin admin] 10.222.0.62 "GET /v2.0/networks/4364b6ab-4117-4a92-baeb-f5ee2f45bf74 HTTP/1.1" status: 200 len: 886 time: 0.1641495 May 25 16:52:57.664165 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-31740c9e-d6a9-46b9-aa18-67f31039d87c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:52:57.828779 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:52:58.552869 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-0a55eb4a-8b57-4233-84d6-6b423b4ed6db None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:52:59.216836 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.wsgi [-] (91829) accepted ('10.222.0.62', 53534) {{(pid=91829) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:52:59.390678 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b84a75f8-09d8-4379-9735-373098e5d061 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:52:59.392052 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [None req-b84a75f8-09d8-4379-9735-373098e5d061 admin admin] 10.222.0.62 "GET /v2.0/networks/e759ce39-c6fd-47ae-81a9-86c152dee864 HTTP/1.1" status: 200 len: 869 time: 0.1742663 May 25 16:53:00.155067 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-57f11b47-1f51-4191-b7c9-af248a48372c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:53:01.503297 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.wsgi [-] (91829) accepted ('10.222.0.62', 53544) {{(pid=91829) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:53:01.607184 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-befed835-f5b4-4ca2-8e76-93eb118fa694 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:53:01.607636 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-befed835-f5b4-4ca2-8e76-93eb118fa694 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:53:01.609087 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [None req-befed835-f5b4-4ca2-8e76-93eb118fa694 admin admin] 10.222.0.62 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 1479 time: 0.1048644 May 25 16:53:03.726515 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.wsgi [-] (91829) accepted ('10.222.0.62', 53554) {{(pid=91829) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:53:03.837049 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3525157b-a0aa-48a1-b134-521e7de80848 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:53:03.837504 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3525157b-a0aa-48a1-b134-521e7de80848 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:53:03.839098 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [None req-3525157b-a0aa-48a1-b134-521e7de80848 admin admin] 10.222.0.62 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 1479 time: 0.1116662 May 25 16:53:05.985237 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.wsgi [-] (91829) accepted ('10.222.0.62', 53564) {{(pid=91829) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:53:06.103897 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-08789eac-a07f-4813-9792-8dfc97154751 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:53:06.105120 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [None req-08789eac-a07f-4813-9792-8dfc97154751 admin admin] 10.222.0.62 "GET /v2.0/subnets/899ea1be-5424-4fa8-8997-675ed0cdbe9c HTTP/1.1" status: 200 len: 868 time: 0.1189361 May 25 16:53:08.334174 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.wsgi [-] (91829) accepted ('10.222.0.62', 53574) {{(pid=91829) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:53:08.461274 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-edf4ee05-6131-40b5-95c0-2adf2b0dce0f admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:53:08.462612 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [None req-edf4ee05-6131-40b5-95c0-2adf2b0dce0f admin admin] 10.222.0.62 "GET /v2.0/subnets/b947e790-d731-4b63-afc4-4aa112afe0f6 HTTP/1.1" status: 200 len: 816 time: 0.1275213 May 25 16:53:11.152622 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.db.agents_db [None req-504cb04f-4543-46c1-8db7-349e21db7634 None None] Agent healthcheck: found 5 active agents {{(pid=91832) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} May 25 16:53:25.258967 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-325d7c83-77ee-4b40-9f9d-98ee665ed4c1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:53:27.665559 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-6bab9f09-885a-4fd9-94e4-4c72603851a5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:53:27.832973 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:53:28.555464 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-0a55eb4a-8b57-4233-84d6-6b423b4ed6db None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:53:30.158212 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-57f11b47-1f51-4191-b7c9-af248a48372c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:53:31.635885 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.wsgi [-] (91829) accepted ('10.222.0.62', 53618) {{(pid=91829) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:53:31.682654 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.wsgi [None req-5738969c-e267-4860-855c-bfdb785b2476 admin admin] http://10.222.0.62:9696/v2.0/extensions returned with HTTP 200 {{(pid=91829) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} May 25 16:53:31.683609 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [None req-5738969c-e267-4860-855c-bfdb785b2476 admin admin] 10.222.0.62 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 13640 time: 0.0467997 May 25 16:53:33.886611 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.wsgi [-] (91829) accepted ('10.222.0.62', 53628) {{(pid=91829) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:53:33.952633 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.pecan_wsgi.hooks.translation [None req-24738caf-c763-4438-9edb-c34d02a6ee24 admin admin] GET failed (client error): The resource could not be found. May 25 16:53:33.953951 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [None req-24738caf-c763-4438-9edb-c34d02a6ee24 admin admin] 10.222.0.62 "GET /v2.0/networks/public HTTP/1.1" status: 404 len: 314 time: 0.0663645 May 25 16:53:34.084536 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1969803c-62e6-4009-9c54-edeeee849693 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:53:34.086806 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [None req-1969803c-62e6-4009-9c54-edeeee849693 admin admin] 10.222.0.62 "GET /v2.0/networks?name=public HTTP/1.1" status: 200 len: 889 time: 0.1290665 May 25 16:53:36.220835 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.wsgi [-] (91829) accepted ('10.222.0.62', 53638) {{(pid=91829) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:53:36.269285 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.v2.base [None req-47deb4eb-af69-4fcd-a423-8eb887a7a61d admin admin] Request body: {'network': {'name': 'shared', 'shared': True, 'admin_state_up': True}} {{(pid=91829) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 16:53:36.273630 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.quota.driver [None req-47deb4eb-af69-4fcd-a423-8eb887a7a61d admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91829) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 16:53:36.283035 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.quota.driver [None req-47deb4eb-af69-4fcd-a423-8eb887a7a61d admin admin] Attempting to reserve 1 items for resource network. Total usage: 1; quota limit: 100; headroom:99 {{(pid=91829) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 16:53:36.292671 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-47deb4eb-af69-4fcd-a423-8eb887a7a61d admin admin] Made reservation on behalf of f0f6b05e8a4341b3bf4899cd32c57785 for: {'network': 1} {{(pid=91829) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 25 16:53:36.294934 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-47deb4eb-af69-4fcd-a423-8eb887a7a61d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-3832077'] for network, before_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:53:36.383559 dv-cinder-790492-4-iscsi neutron-server[91829]: WARNING neutron.services.revisions.revision_plugin [None req-47deb4eb-af69-4fcd-a423-8eb887a7a61d admin admin] Could not find related network for resource to bump revision. May 25 16:53:36.394646 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-47deb4eb-af69-4fcd-a423-8eb887a7a61d admin admin] vlan segment allocate from pool success with {'vlan_id': 684, 'physical_network': 'physnet1'} {{(pid=91829) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 25 16:53:36.404486 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-47deb4eb-af69-4fcd-a423-8eb887a7a61d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3809789'] for segment, precommit_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:53:36.404802 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.db.segments_db [None req-47deb4eb-af69-4fcd-a423-8eb887a7a61d admin admin] Added segment 015e8123-0c21-4358-ae8e-caf4f629a10c of type vlan for network 1ce76c3b-1539-44c4-b658-5acf80c14e4c May 25 16:53:36.429248 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-47deb4eb-af69-4fcd-a423-8eb887a7a61d admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8757892541013'] for network, precommit_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:53:36.456940 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-47deb4eb-af69-4fcd-a423-8eb887a7a61d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-640806', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-551400'] for network, after_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:53:36.458201 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-47deb4eb-af69-4fcd-a423-8eb887a7a61d admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:53:36.458777 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-47deb4eb-af69-4fcd-a423-8eb887a7a61d admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-551373'] for network, before_response {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:53:36.463977 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:53:36.561805 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [None req-47deb4eb-af69-4fcd-a423-8eb887a7a61d admin admin] 10.222.0.62 "POST /v2.0/networks HTTP/1.1" status: 201 len: 847 time: 0.3395212 May 25 16:53:36.562661 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-47deb4eb-af69-4fcd-a423-8eb887a7a61d admin admin] Pushing event updated for resources: {'Network': ['ID=1ce76c3b-1539-44c4-b658-5acf80c14e4c,revision_number=1']} {{(pid=91829) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:53:36.565326 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-47deb4eb-af69-4fcd-a423-8eb887a7a61d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.101s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:53:36.573179 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.rpc [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Network 1ce76c3b-1539-44c4-b658-5acf80c14e4c details requested by agent ovs-agent-dv-cinder-790492-4-iscsi with host dv-cinder-790492-4-iscsi {{(pid=91831) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 25 16:53:38.708969 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.wsgi [-] (91830) accepted ('10.222.0.62', 53648) {{(pid=91830) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:53:38.803958 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.pecan_wsgi.hooks.translation [None req-12a11374-41a3-4647-8a34-ab88ed2776d5 admin admin] GET failed (client error): The resource could not be found. May 25 16:53:38.805584 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [None req-12a11374-41a3-4647-8a34-ab88ed2776d5 admin admin] 10.222.0.62 "GET /v2.0/networks/shared HTTP/1.1" status: 404 len: 314 time: 0.0956821 May 25 16:53:39.008768 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.policy [None req-f71ebd78-17b1-4d8e-9438-243383097a35 admin admin] Loaded default policies from ['neutron'] under neutron.policies entry points {{(pid=91830) register_rules /opt/stack/neutron/neutron/policy.py:73}} May 25 16:53:39.053646 dv-cinder-790492-4-iscsi neutron-server[91830]: WARNING oslo_policy.policy [None req-f71ebd78-17b1-4d8e-9438-243383097a35 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. May 25 16:53:39.054067 dv-cinder-790492-4-iscsi neutron-server[91830]: WARNING oslo_policy.policy [None req-f71ebd78-17b1-4d8e-9438-243383097a35 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. May 25 16:53:39.062705 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f71ebd78-17b1-4d8e-9438-243383097a35 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91830) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:53:39.064375 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [None req-f71ebd78-17b1-4d8e-9438-243383097a35 admin admin] 10.222.0.62 "GET /v2.0/networks?name=shared HTTP/1.1" status: 200 len: 826 time: 0.2549646 May 25 16:53:39.075080 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.v2.base [None req-5fb380d4-f086-4ac1-978a-87fb36dc52be admin admin] Request body: {'subnet': {'ip_version': 4, 'cidr': '192.168.233.0/24', 'description': 'shared-subnet', 'network_id': '1ce76c3b-1539-44c4-b658-5acf80c14e4c', 'name': 'shared-subnet'}} {{(pid=91830) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 16:53:39.076883 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.quota [None req-5fb380d4-f086-4ac1-978a-87fb36dc52be admin admin] Loaded quota_driver: . May 25 16:53:39.083115 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.quota.driver [None req-5fb380d4-f086-4ac1-978a-87fb36dc52be admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91830) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 16:53:39.096176 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.quota.driver [None req-5fb380d4-f086-4ac1-978a-87fb36dc52be admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 1; quota limit: 100; headroom:99 {{(pid=91830) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 16:53:39.109522 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-5fb380d4-f086-4ac1-978a-87fb36dc52be admin admin] Made reservation on behalf of f0f6b05e8a4341b3bf4899cd32c57785 for: {'subnet': 1} {{(pid=91830) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 25 16:53:39.112243 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-5fb380d4-f086-4ac1-978a-87fb36dc52be admin admin] Notify callbacks [] for subnet, before_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:53:39.538038 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-5fb380d4-f086-4ac1-978a-87fb36dc52be admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55886', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411'] for subnet, after_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:53:39.543966 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:53:39.622700 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5fb380d4-f086-4ac1-978a-87fb36dc52be admin admin] Checking segment: {'id': '015e8123-0c21-4358-ae8e-caf4f629a10c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 684, 'network_id': '1ce76c3b-1539-44c4-b658-5acf80c14e4c'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91830) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 25 16:53:39.623113 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5fb380d4-f086-4ac1-978a-87fb36dc52be admin admin] Network hostable DHCP agents. Network: 1ce76c3b-1539-44c4-b658-5acf80c14e4c, hostable agents: ['8d7401c6-8951-4f2b-ace4-208761782bfc'], hosted agents: [] {{(pid=91830) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 25 16:53:39.626961 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5fb380d4-f086-4ac1-978a-87fb36dc52be admin admin] Pushing event updated for resources: {'Subnet': ['ID=391b1700-d90b-420a-b57e-7924e6bb1e75,revision_number=0']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:53:39.638860 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5fb380d4-f086-4ac1-978a-87fb36dc52be admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91830) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:53:39.639200 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5fb380d4-f086-4ac1-978a-87fb36dc52be admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91830) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:53:39.639522 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5fb380d4-f086-4ac1-978a-87fb36dc52be admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91830) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:53:39.639839 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5fb380d4-f086-4ac1-978a-87fb36dc52be admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91830) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:53:39.640155 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5fb380d4-f086-4ac1-978a-87fb36dc52be admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91830) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:53:39.640478 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5fb380d4-f086-4ac1-978a-87fb36dc52be admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91830) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:53:39.640780 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5fb380d4-f086-4ac1-978a-87fb36dc52be admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91830) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:53:39.641087 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5fb380d4-f086-4ac1-978a-87fb36dc52be admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91830) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:53:39.641412 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5fb380d4-f086-4ac1-978a-87fb36dc52be admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91830) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:53:39.641720 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5fb380d4-f086-4ac1-978a-87fb36dc52be admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91830) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:53:39.642058 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5fb380d4-f086-4ac1-978a-87fb36dc52be admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91830) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:53:39.642364 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5fb380d4-f086-4ac1-978a-87fb36dc52be admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91830) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:53:39.643396 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5fb380d4-f086-4ac1-978a-87fb36dc52be admin admin] Tracked resource versions report: May 25 16:53:39.643396 dv-cinder-790492-4-iscsi neutron-server[91830]: pushed versions: May 25 16:53:39.643396 dv-cinder-790492-4-iscsi neutron-server[91830]: { 'AddressGroup': {'1.2'}, May 25 16:53:39.643396 dv-cinder-790492-4-iscsi neutron-server[91830]: 'ConntrackHelper': {'1.0'}, May 25 16:53:39.643396 dv-cinder-790492-4-iscsi neutron-server[91830]: 'Log': {'1.0'}, May 25 16:53:39.643396 dv-cinder-790492-4-iscsi neutron-server[91830]: 'Network': {'1.1'}, May 25 16:53:39.643396 dv-cinder-790492-4-iscsi neutron-server[91830]: 'Port': {'1.7'}, May 25 16:53:39.643396 dv-cinder-790492-4-iscsi neutron-server[91830]: 'PortForwarding': {'1.2'}, May 25 16:53:39.643396 dv-cinder-790492-4-iscsi neutron-server[91830]: 'QosPolicy': {'1.8'}, May 25 16:53:39.643396 dv-cinder-790492-4-iscsi neutron-server[91830]: 'SecurityGroup': {'1.4'}, May 25 16:53:39.643396 dv-cinder-790492-4-iscsi neutron-server[91830]: 'SecurityGroupRule': {'1.2'}, May 25 16:53:39.643396 dv-cinder-790492-4-iscsi neutron-server[91830]: 'SubPort': {'1.0'}, May 25 16:53:39.643396 dv-cinder-790492-4-iscsi neutron-server[91830]: 'Subnet': {'1.1'}, May 25 16:53:39.643396 dv-cinder-790492-4-iscsi neutron-server[91830]: 'Trunk': {'1.1'}} May 25 16:53:39.643396 dv-cinder-790492-4-iscsi neutron-server[91830]: consumer versions: May 25 16:53:39.643396 dv-cinder-790492-4-iscsi neutron-server[91830]: { DHCP agent@dv-cinder-790492-4-iscsi: {}, May 25 16:53:39.643396 dv-cinder-790492-4-iscsi neutron-server[91830]: L3 agent@dv-cinder-790492-4-iscsi: {}, May 25 16:53:39.643396 dv-cinder-790492-4-iscsi neutron-server[91830]: Metadata agent@dv-cinder-790492-4-iscsi: {}, May 25 16:53:39.643396 dv-cinder-790492-4-iscsi neutron-server[91830]: Metering agent@dv-cinder-790492-4-iscsi: {}, May 25 16:53:39.643396 dv-cinder-790492-4-iscsi neutron-server[91830]: Open vSwitch agent@dv-cinder-790492-4-iscsi: { 'AddressGroup': '1.2', May 25 16:53:39.643396 dv-cinder-790492-4-iscsi neutron-server[91830]: 'ConntrackHelper': '1.0', May 25 16:53:39.643396 dv-cinder-790492-4-iscsi neutron-server[91830]: 'Log': '1.0', May 25 16:53:39.643396 dv-cinder-790492-4-iscsi neutron-server[91830]: 'Network': '1.1', May 25 16:53:39.643396 dv-cinder-790492-4-iscsi neutron-server[91830]: 'Port': '1.7', May 25 16:53:39.643396 dv-cinder-790492-4-iscsi neutron-server[91830]: 'PortForwarding': '1.2', May 25 16:53:39.643396 dv-cinder-790492-4-iscsi neutron-server[91830]: 'QosPolicy': '1.8', May 25 16:53:39.643396 dv-cinder-790492-4-iscsi neutron-server[91830]: 'SecurityGroup': '1.4', May 25 16:53:39.643396 dv-cinder-790492-4-iscsi neutron-server[91830]: 'SecurityGroupRule': '1.2', May 25 16:53:39.643396 dv-cinder-790492-4-iscsi neutron-server[91830]: 'SubPort': '1.0', May 25 16:53:39.643396 dv-cinder-790492-4-iscsi neutron-server[91830]: 'Subnet': '1.1', May 25 16:53:39.643396 dv-cinder-790492-4-iscsi neutron-server[91830]: 'Trunk': '1.1'}} May 25 16:53:39.643396 dv-cinder-790492-4-iscsi neutron-server[91830]: {{(pid=91830) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} May 25 16:53:39.675006 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5fb380d4-f086-4ac1-978a-87fb36dc52be admin admin] Network 1ce76c3b-1539-44c4-b658-5acf80c14e4c is scheduled to be hosted by DHCP agent 8d7401c6-8951-4f2b-ace4-208761782bfc with binding_index 1 {{(pid=91830) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 25 16:53:39.684348 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-5fb380d4-f086-4ac1-978a-87fb36dc52be admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.140s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:53:39.686273 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.scheduler.base_scheduler [None req-5fb380d4-f086-4ac1-978a-87fb36dc52be admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-790492-4-iscsi, 1ce76c3b-1539-44c4-b658-5acf80c14e4c) {{(pid=91830) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 16:53:39.692678 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5fb380d4-f086-4ac1-978a-87fb36dc52be admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=91830) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:53:39.693476 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-5fb380d4-f086-4ac1-978a-87fb36dc52be admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-551373'] for subnet, before_response {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:53:39.695124 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ab1705a6-9c29-461b-964a-9d7c8786e4c4 None None] Network 1ce76c3b-1539-44c4-b658-5acf80c14e4c requested from dv-cinder-790492-4-iscsi {{(pid=91831) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} May 25 16:53:39.721614 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [None req-5fb380d4-f086-4ac1-978a-87fb36dc52be admin admin] 10.222.0.62 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 845 time: 0.6510489 May 25 16:53:39.942463 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f399796c-18b1-40a1-9b3b-7652a1e298bd None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp6d7ebc81-b6b5-52ec-b8f5-10a9de34bf46-1ce76c3b-1539-44c4-b658-5acf80c14e4c', 'network_id': '1ce76c3b-1539-44c4-b658-5acf80c14e4c', 'tenant_id': 'f0f6b05e8a4341b3bf4899cd32c57785', 'fixed_ips': [{'subnet_id': '391b1700-d90b-420a-b57e-7924e6bb1e75'}]}} from dv-cinder-790492-4-iscsi. {{(pid=91831) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} May 25 16:53:39.943274 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-f399796c-18b1-40a1-9b3b-7652a1e298bd None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3832070'] for port, before_create {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:53:40.102943 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.db_base_plugin_common [None req-f399796c-18b1-40a1-9b3b-7652a1e298bd None None] Allocated IP 192.168.233.2 (1ce76c3b-1539-44c4-b658-5acf80c14e4c/391b1700-d90b-420a-b57e-7924e6bb1e75/03ea806f-652c-42db-8636-5e1304329445) {{(pid=91831) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 25 16:53:40.313516 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-f399796c-18b1-40a1-9b3b-7652a1e298bd None None] Notify callbacks [] for port, precommit_create {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:53:40.324008 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.provisioning_blocks [None req-f399796c-18b1-40a1-9b3b-7652a1e298bd None None] Transition to ACTIVE for port object 03ea806f-652c-42db-8636-5e1304329445 will not be triggered until provisioned by entity L2. {{(pid=91831) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 25 16:53:40.342735 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.provisioning_blocks [None req-f399796c-18b1-40a1-9b3b-7652a1e298bd None None] Transition to ACTIVE for port object 03ea806f-652c-42db-8636-5e1304329445 will not be triggered until provisioned by entity DHCP. {{(pid=91831) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 25 16:53:40.349116 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-f399796c-18b1-40a1-9b3b-7652a1e298bd None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8757892520915'] for port, after_create {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:53:40.358512 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [None req-22acd9b5-6f41-42bb-ab6b-eb244f9b39da None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:53:40.417363 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f399796c-18b1-40a1-9b3b-7652a1e298bd None None] Network 1ce76c3b-1539-44c4-b658-5acf80c14e4c is already hosted by enough agents. {{(pid=91831) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 25 16:53:40.420274 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.scheduler.base_scheduler [None req-f399796c-18b1-40a1-9b3b-7652a1e298bd None None] Resources bound (agent type, host, resource id): {{(pid=91831) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 16:53:40.423973 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f399796c-18b1-40a1-9b3b-7652a1e298bd None None] Received port after_create {{(pid=91831) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 25 16:53:40.432951 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f399796c-18b1-40a1-9b3b-7652a1e298bd None None] Pushing event updated for resources: {'Port': ['ID=03ea806f-652c-42db-8636-5e1304329445,revision_number=1']} {{(pid=91831) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:53:40.464045 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f399796c-18b1-40a1-9b3b-7652a1e298bd None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91831) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:53:40.464392 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f399796c-18b1-40a1-9b3b-7652a1e298bd None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91831) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:53:40.464728 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f399796c-18b1-40a1-9b3b-7652a1e298bd None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91831) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:53:40.465060 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f399796c-18b1-40a1-9b3b-7652a1e298bd None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91831) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:53:40.465389 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f399796c-18b1-40a1-9b3b-7652a1e298bd None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91831) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:53:40.465716 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f399796c-18b1-40a1-9b3b-7652a1e298bd None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91831) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:53:40.466071 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f399796c-18b1-40a1-9b3b-7652a1e298bd None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91831) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:53:40.466394 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f399796c-18b1-40a1-9b3b-7652a1e298bd None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91831) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:53:40.466736 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f399796c-18b1-40a1-9b3b-7652a1e298bd None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91831) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:53:40.467059 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f399796c-18b1-40a1-9b3b-7652a1e298bd None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91831) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:53:40.467380 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f399796c-18b1-40a1-9b3b-7652a1e298bd None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91831) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:53:40.467712 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f399796c-18b1-40a1-9b3b-7652a1e298bd None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91831) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:53:40.475938 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [None req-f399796c-18b1-40a1-9b3b-7652a1e298bd None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.118s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:53:40.532784 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.managers [None req-f399796c-18b1-40a1-9b3b-7652a1e298bd None None] Attempting to bind port 03ea806f-652c-42db-8636-5e1304329445 on host dv-cinder-790492-4-iscsi for vnic_type normal with profile {{(pid=91831) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 25 16:53:40.533156 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.managers [None req-f399796c-18b1-40a1-9b3b-7652a1e298bd None None] Attempting to bind port 03ea806f-652c-42db-8636-5e1304329445 by drivers openvswitch,hyperv on host dv-cinder-790492-4-iscsi at level 0 using segments [{'id': '015e8123-0c21-4358-ae8e-caf4f629a10c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 684, 'network_id': '1ce76c3b-1539-44c4-b658-5acf80c14e4c'}] {{(pid=91831) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 25 16:53:40.533515 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f399796c-18b1-40a1-9b3b-7652a1e298bd None None] Attempting to bind port 03ea806f-652c-42db-8636-5e1304329445 on network 1ce76c3b-1539-44c4-b658-5acf80c14e4c {{(pid=91831) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 25 16:53:40.538843 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f399796c-18b1-40a1-9b3b-7652a1e298bd None None] Checking agent: {'id': 'fc8251e1-071c-49f7-bc10-1337f1d37d1b', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-790492-4-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 25, 16, 50, 28), 'started_at': datetime.datetime(2021, 5, 25, 16, 50, 58), 'heartbeat_timestamp': datetime.datetime(2021, 5, 25, 16, 53, 28), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-790492-4-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=91831) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 25 16:53:40.539757 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f399796c-18b1-40a1-9b3b-7652a1e298bd None None] Checking segment: {'id': '015e8123-0c21-4358-ae8e-caf4f629a10c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 684, 'network_id': '1ce76c3b-1539-44c4-b658-5acf80c14e4c'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91831) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 25 16:53:40.540159 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-f399796c-18b1-40a1-9b3b-7652a1e298bd None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:53:40.540558 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f399796c-18b1-40a1-9b3b-7652a1e298bd None None] Bound using segment: {'id': '015e8123-0c21-4358-ae8e-caf4f629a10c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 684, 'network_id': '1ce76c3b-1539-44c4-b658-5acf80c14e4c'} {{(pid=91831) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 25 16:53:40.541022 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.managers [None req-f399796c-18b1-40a1-9b3b-7652a1e298bd None None] Bound port: 03ea806f-652c-42db-8636-5e1304329445, host: dv-cinder-790492-4-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '015e8123-0c21-4358-ae8e-caf4f629a10c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 684, 'network_id': '1ce76c3b-1539-44c4-b658-5acf80c14e4c'}}] {{(pid=91831) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 25 16:53:40.541389 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-f399796c-18b1-40a1-9b3b-7652a1e298bd None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3832070'] for port, before_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:53:40.628372 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.db [None req-f399796c-18b1-40a1-9b3b-7652a1e298bd None None] For port 03ea806f-652c-42db-8636-5e1304329445, host dv-cinder-790492-4-iscsi, cleared binding levels {{(pid=91831) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 25 16:53:40.631513 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.db [None req-f399796c-18b1-40a1-9b3b-7652a1e298bd None None] For port 03ea806f-652c-42db-8636-5e1304329445, host dv-cinder-790492-4-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-790492-4-iscsi',level=0,port_id=03ea806f-652c-42db-8636-5e1304329445,segment=NetworkSegment(015e8123-0c21-4358-ae8e-caf4f629a10c),segment_id=015e8123-0c21-4358-ae8e-caf4f629a10c)] {{(pid=91831) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 25 16:53:40.635607 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-f399796c-18b1-40a1-9b3b-7652a1e298bd None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8757892955028', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8757892520933', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8757892521750'] for port, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:53:40.639677 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:53:40.716677 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f399796c-18b1-40a1-9b3b-7652a1e298bd None None] Pushing event updated for resources: {'Port': ['ID=03ea806f-652c-42db-8636-5e1304329445,revision_number=2']} {{(pid=91831) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:53:40.722759 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [None req-f399796c-18b1-40a1-9b3b-7652a1e298bd None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.083s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:53:41.535258 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-fdb701b4-5802-47d4-8ccc-43e4fc331361 None None] Network 1ce76c3b-1539-44c4-b658-5acf80c14e4c requested from dv-cinder-790492-4-iscsi {{(pid=91831) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} May 25 16:53:41.643309 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.provisioning_blocks [None req-4f91e28a-efc4-4c7b-af79-fa48f3e9cd6f None None] Provisioning for port 03ea806f-652c-42db-8636-5e1304329445 completed by entity DHCP. {{(pid=91831) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 25 16:53:41.944630 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.rpc [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Device 03ea806f-652c-42db-8636-5e1304329445 up at agent ovs-agent-dv-cinder-790492-4-iscsi {{(pid=91831) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 25 16:53:42.028183 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.provisioning_blocks [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Provisioning for port 03ea806f-652c-42db-8636-5e1304329445 completed by entity L2. {{(pid=91831) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 25 16:53:42.032763 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.provisioning_blocks [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Provisioning complete for port 03ea806f-652c-42db-8636-5e1304329445 triggered by entity L2. {{(pid=91831) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 16:53:42.033076 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3854128'] for port, provisioning_complete {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:53:42.153749 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3832070'] for port, before_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:53:42.186826 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.db [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] For port 03ea806f-652c-42db-8636-5e1304329445, host dv-cinder-790492-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-790492-4-iscsi',level=0,port_id=03ea806f-652c-42db-8636-5e1304329445,segment=NetworkSegment(015e8123-0c21-4358-ae8e-caf4f629a10c),segment_id=015e8123-0c21-4358-ae8e-caf4f629a10c)] {{(pid=91831) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 16:53:42.191237 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8757892955028', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8757892520933', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8757892521750'] for port, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:53:42.193407 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [None req-f399796c-18b1-40a1-9b3b-7652a1e298bd None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:53:42.261873 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Pushing event updated for resources: {'Port': ['ID=03ea806f-652c-42db-8636-5e1304329445,revision_number=3']} {{(pid=91831) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:53:42.265612 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.072s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:53:43.907175 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.rpc [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Device 03ea806f-652c-42db-8636-5e1304329445 up at agent ovs-agent-dv-cinder-790492-4-iscsi {{(pid=91831) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 25 16:53:43.980093 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.provisioning_blocks [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Provisioning complete for port 03ea806f-652c-42db-8636-5e1304329445 triggered by entity L2. {{(pid=91831) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 16:53:43.980093 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3854128'] for port, provisioning_complete {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:53:48.151085 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.db.agents_db [None req-504cb04f-4543-46c1-8db7-349e21db7634 None None] Agent healthcheck: found 5 active agents {{(pid=91832) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} May 25 16:53:55.260937 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-90d92cb8-5ff7-46f5-865f-9bcb0c52ff80 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:53:57.668092 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-71f33db4-c6f3-4f35-ada5-987f66e756fc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:53:57.835078 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:53:58.560013 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-0a55eb4a-8b57-4233-84d6-6b423b4ed6db None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:54:00.161438 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-57f11b47-1f51-4191-b7c9-af248a48372c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:54:25.149284 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.db.agents_db [None req-504cb04f-4543-46c1-8db7-349e21db7634 None None] Agent healthcheck: found 5 active agents {{(pid=91832) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} May 25 16:54:25.263990 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-714cbd92-0346-4590-8e2e-98050620da9e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:54:27.676506 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-62237673-cb6f-462d-9cf8-a8ad522e5675 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:54:27.842394 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:54:28.561529 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-0a55eb4a-8b57-4233-84d6-6b423b4ed6db None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:54:30.165889 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-57f11b47-1f51-4191-b7c9-af248a48372c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:54:49.174564 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.wsgi [-] (91830) accepted ('10.222.0.62', 53704) {{(pid=91830) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:54:49.180548 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.wsgi [None req-62f5a65a-42d0-4d8e-8bf6-e3a98e9b0c31 tempest-verify_tempest_config-130923283 tempest-verify_tempest_config-130923283-project] http://10.222.0.62:9696/v2.0/extensions returned with HTTP 200 {{(pid=91830) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} May 25 16:54:49.181878 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [None req-62f5a65a-42d0-4d8e-8bf6-e3a98e9b0c31 tempest-verify_tempest_config-130923283 tempest-verify_tempest_config-130923283-project] 10.222.0.62 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 13635 time: 0.0061431 May 25 16:54:49.479871 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.wsgi [-] (91829) accepted ('10.222.0.62', 53722) {{(pid=91829) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:54:49.594352 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-082a08b7-5cb3-452c-a7ea-69ed3e269b4c admin admin] Notify callbacks [] for security_group, before_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:54:49.607903 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.quota.driver [None req-082a08b7-5cb3-452c-a7ea-69ed3e269b4c admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91829) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 16:54:49.611491 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.quota.resource [None req-082a08b7-5cb3-452c-a7ea-69ed3e269b4c admin admin] Usage tracker for resource:security_group_rule and tenant:9189eb9e09fb444586f640d1db2ad3ab is out of sync, need to count used quota {{(pid=91829) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 16:54:49.614156 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.quota.resource [None req-082a08b7-5cb3-452c-a7ea-69ed3e269b4c admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91829) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 16:54:49.620146 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.quota.driver [None req-082a08b7-5cb3-452c-a7ea-69ed3e269b4c admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91829) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 16:54:49.704726 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-082a08b7-5cb3-452c-a7ea-69ed3e269b4c admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:54:49.708369 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-082a08b7-5cb3-452c-a7ea-69ed3e269b4c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-640836'] for security_group, after_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:54:49.717935 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:54:49.754697 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.quota.resource [None req-082a08b7-5cb3-452c-a7ea-69ed3e269b4c admin admin] Synchronizing usage tracker for tenant:f0f6b05e8a4341b3bf4899cd32c57785 on resource:security_group {{(pid=91829) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 25 16:54:49.758518 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-082a08b7-5cb3-452c-a7ea-69ed3e269b4c admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b79127bf-1731-4e24-b9d6-51470ba3abe1,revision_number=1']} {{(pid=91829) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:54:49.769620 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-082a08b7-5cb3-452c-a7ea-69ed3e269b4c admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91829) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:54:49.770021 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-082a08b7-5cb3-452c-a7ea-69ed3e269b4c admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91829) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:54:49.770361 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-082a08b7-5cb3-452c-a7ea-69ed3e269b4c admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91829) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:54:49.770684 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-082a08b7-5cb3-452c-a7ea-69ed3e269b4c admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91829) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:54:49.771004 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-082a08b7-5cb3-452c-a7ea-69ed3e269b4c admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91829) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:54:49.771336 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-082a08b7-5cb3-452c-a7ea-69ed3e269b4c admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91829) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:54:49.771656 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-082a08b7-5cb3-452c-a7ea-69ed3e269b4c admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91829) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:54:49.771986 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-082a08b7-5cb3-452c-a7ea-69ed3e269b4c admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91829) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:54:49.772932 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-082a08b7-5cb3-452c-a7ea-69ed3e269b4c admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91829) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:54:49.773480 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-082a08b7-5cb3-452c-a7ea-69ed3e269b4c admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91829) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:54:49.773938 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-082a08b7-5cb3-452c-a7ea-69ed3e269b4c admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91829) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:54:49.774253 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-082a08b7-5cb3-452c-a7ea-69ed3e269b4c admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91829) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:54:49.779510 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-082a08b7-5cb3-452c-a7ea-69ed3e269b4c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.062s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:54:49.786057 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.quota.resource [None req-082a08b7-5cb3-452c-a7ea-69ed3e269b4c admin admin] Unset dirty status for tenant:f0f6b05e8a4341b3bf4899cd32c57785 on resource:security_group {{(pid=91829) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 25 16:54:49.787275 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [None req-082a08b7-5cb3-452c-a7ea-69ed3e269b4c admin admin] 10.222.0.62 "GET /v2.0/security-groups?tenant_id=9189eb9e09fb444586f640d1db2ad3ab&name=default HTTP/1.1" status: 200 len: 2975 time: 0.3064442 May 25 16:54:49.789877 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.wsgi [-] (91829) accepted ('10.222.0.62', 53728) {{(pid=91829) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:54:49.902370 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-a4941583-3207-498d-92b5-e58b25b681e3 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:54:49.926959 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-a4941583-3207-498d-92b5-e58b25b681e3 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:54:50.024166 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-a4941583-3207-498d-92b5-e58b25b681e3 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-640836'] for security_group, after_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:54:50.029534 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:54:50.039445 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a4941583-3207-498d-92b5-e58b25b681e3 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b79127bf-1731-4e24-b9d6-51470ba3abe1,revision_number=None']} {{(pid=91829) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:54:50.042733 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-a4941583-3207-498d-92b5-e58b25b681e3 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.013s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:54:50.045698 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-a4941583-3207-498d-92b5-e58b25b681e3 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:54:50.046823 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [None req-a4941583-3207-498d-92b5-e58b25b681e3 admin admin] 10.222.0.62 "DELETE /v2.0/security-groups/b79127bf-1731-4e24-b9d6-51470ba3abe1 HTTP/1.1" status: 204 len: 168 time: 0.2560165 May 25 16:54:55.267965 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-c254dc0a-12f6-4a50-9b3f-38f1fe56fbc3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:54:57.667547 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-0cb14ac1-bc18-493f-8f11-51cb48ace2c4 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:54:57.835592 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:54:58.564543 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-0a55eb4a-8b57-4233-84d6-6b423b4ed6db None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:55:00.173038 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-57f11b47-1f51-4191-b7c9-af248a48372c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:55:02.148472 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.db.agents_db [None req-504cb04f-4543-46c1-8db7-349e21db7634 None None] Agent healthcheck: found 5 active agents {{(pid=91832) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} May 25 16:55:25.270103 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-ee5194ad-60ce-4528-b0c7-eefcb5bbf3aa None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:55:27.668727 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-72f98958-0cf2-4dee-bb15-e14245299768 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:55:27.837637 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:55:28.565398 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-0a55eb4a-8b57-4233-84d6-6b423b4ed6db None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:55:30.170738 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-57f11b47-1f51-4191-b7c9-af248a48372c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:55:39.148800 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.db.agents_db [None req-504cb04f-4543-46c1-8db7-349e21db7634 None None] Agent healthcheck: found 5 active agents {{(pid=91832) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} May 25 16:55:55.273290 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-37e52c99-8ed0-444b-875f-be65d926018d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:55:57.671174 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-76fa7dac-30cf-4fa5-a4e9-5008615a3dbe None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:55:57.838933 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:55:58.568400 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-0a55eb4a-8b57-4233-84d6-6b423b4ed6db None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:56:00.173679 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-57f11b47-1f51-4191-b7c9-af248a48372c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:56:16.147978 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.db.agents_db [None req-504cb04f-4543-46c1-8db7-349e21db7634 None None] Agent healthcheck: found 5 active agents {{(pid=91832) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} May 25 16:56:25.274993 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-ce7ef5cc-032f-4e68-831d-0f1349947e19 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:56:27.673211 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-f683415b-5801-4801-b17d-d72af766b868 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:56:27.840670 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:56:28.573274 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-0a55eb4a-8b57-4233-84d6-6b423b4ed6db None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:56:30.176399 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-57f11b47-1f51-4191-b7c9-af248a48372c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:56:32.183593 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510'] for agent, after_create {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:56:36.004375 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.wsgi [-] (91829) accepted ('10.222.0.62', 53780) {{(pid=91829) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:56:36.115601 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [None req-2c20548a-920c-40a5-984b-02a677754d2f admin admin] 10.222.0.62 "GET /v2.0/agents HTTP/1.1" status: 200 len: 4303 time: 0.1101458 May 25 16:56:38.263762 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.wsgi [-] (91829) accepted ('10.222.0.62', 53790) {{(pid=91829) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:56:38.317779 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [None req-0c00bd8f-9afa-4658-bf37-8ac0be304f62 admin admin] 10.222.0.62 "GET /v2.0/agents HTTP/1.1" status: 200 len: 4303 time: 0.0529399 May 25 16:56:53.147410 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.db.agents_db [None req-504cb04f-4543-46c1-8db7-349e21db7634 None None] Agent healthcheck: found 6 active agents {{(pid=91832) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} May 25 16:56:55.276128 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-3b80da96-0dec-48b2-90e2-c96fd8a6f1d0 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:56:57.674586 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-692a5cc2-a381-4892-affd-65ee3ea6f5e2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:56:57.842511 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:56:58.573875 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-0a55eb4a-8b57-4233-84d6-6b423b4ed6db None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:57:00.179788 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-57f11b47-1f51-4191-b7c9-af248a48372c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:57:02.161895 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:57:25.277633 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-84dd66b1-92c3-4be9-b764-ffa31d8d80ea None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:57:27.678039 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-4d291c00-5bbb-47f7-9b2a-6cd47b781782 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:57:27.844359 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:57:28.578294 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-0a55eb4a-8b57-4233-84d6-6b423b4ed6db None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:57:30.146660 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.db.agents_db [None req-504cb04f-4543-46c1-8db7-349e21db7634 None None] Agent healthcheck: found 6 active agents {{(pid=91832) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} May 25 16:57:30.185299 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-57f11b47-1f51-4191-b7c9-af248a48372c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:57:32.161070 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:57:55.281308 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-963f8089-45a2-4e3c-8404-e79ca7e39520 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:57:57.680612 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-a0b866b5-26ef-4709-833f-2e013c2c4879 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:57:57.846161 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:57:58.581352 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-0a55eb4a-8b57-4233-84d6-6b423b4ed6db None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:00.189354 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-57f11b47-1f51-4191-b7c9-af248a48372c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:02.168320 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:07.147701 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.db.agents_db [None req-504cb04f-4543-46c1-8db7-349e21db7634 None None] Agent healthcheck: found 6 active agents {{(pid=91832) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} May 25 16:58:07.157511 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.wsgi [-] (91829) accepted ('10.222.0.62', 53916) {{(pid=91829) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:58:07.416626 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.v2.base [None req-2714ef29-2cff-4111-a072-19281e281870 admin admin] Request body: {'network': {'name': 'tempest-ServerRescueNegativeTestJSON-116675553-network', 'tenant_id': '734df673f8b3484d80f35a45fbce9d5e'}} {{(pid=91829) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 16:58:07.422322 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.quota.driver [None req-2714ef29-2cff-4111-a072-19281e281870 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91829) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 16:58:07.426572 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.quota.resource [None req-2714ef29-2cff-4111-a072-19281e281870 admin admin] Usage tracker for resource:network and tenant:734df673f8b3484d80f35a45fbce9d5e is out of sync, need to count used quota {{(pid=91829) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 16:58:07.430220 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.quota.resource [None req-2714ef29-2cff-4111-a072-19281e281870 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=91829) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 16:58:07.436971 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.quota.driver [None req-2714ef29-2cff-4111-a072-19281e281870 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91829) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 16:58:07.450787 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-2714ef29-2cff-4111-a072-19281e281870 admin admin] Made reservation on behalf of 734df673f8b3484d80f35a45fbce9d5e for: {'network': 1} {{(pid=91829) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 25 16:58:07.453857 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-2714ef29-2cff-4111-a072-19281e281870 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-3832077'] for network, before_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:07.467441 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-2714ef29-2cff-4111-a072-19281e281870 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:07.480879 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.quota.driver [None req-2714ef29-2cff-4111-a072-19281e281870 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91829) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 16:58:07.484887 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.quota.resource [None req-2714ef29-2cff-4111-a072-19281e281870 admin admin] Usage tracker for resource:security_group_rule and tenant:734df673f8b3484d80f35a45fbce9d5e is out of sync, need to count used quota {{(pid=91829) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 16:58:07.488090 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.quota.resource [None req-2714ef29-2cff-4111-a072-19281e281870 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91829) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 16:58:07.494385 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.quota.driver [None req-2714ef29-2cff-4111-a072-19281e281870 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91829) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 16:58:07.582588 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-2714ef29-2cff-4111-a072-19281e281870 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:07.586829 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-2714ef29-2cff-4111-a072-19281e281870 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-640836'] for security_group, after_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:07.590013 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-0c7e99cc-35d6-493b-a6ef-f8f30799d078 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:58:07.619510 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2714ef29-2cff-4111-a072-19281e281870 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=8ee5c4ed-9c60-4e39-9185-7e283704a7dc,revision_number=1']} {{(pid=91829) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:58:07.630863 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-2714ef29-2cff-4111-a072-19281e281870 admin admin] vlan segment allocate from pool success with {'vlan_id': 697, 'physical_network': 'physnet1'} {{(pid=91829) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 25 16:58:07.633872 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2714ef29-2cff-4111-a072-19281e281870 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91829) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:58:07.634231 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2714ef29-2cff-4111-a072-19281e281870 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91829) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:58:07.634834 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2714ef29-2cff-4111-a072-19281e281870 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91829) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:58:07.634953 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2714ef29-2cff-4111-a072-19281e281870 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91829) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:58:07.635184 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2714ef29-2cff-4111-a072-19281e281870 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91829) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:58:07.635501 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2714ef29-2cff-4111-a072-19281e281870 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91829) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:58:07.635812 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2714ef29-2cff-4111-a072-19281e281870 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91829) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:58:07.636121 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2714ef29-2cff-4111-a072-19281e281870 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91829) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:58:07.636480 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2714ef29-2cff-4111-a072-19281e281870 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91829) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:58:07.636753 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2714ef29-2cff-4111-a072-19281e281870 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91829) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:58:07.637063 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2714ef29-2cff-4111-a072-19281e281870 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91829) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:58:07.637365 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2714ef29-2cff-4111-a072-19281e281870 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91829) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:58:07.638387 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2714ef29-2cff-4111-a072-19281e281870 admin admin] Tracked resource versions report: May 25 16:58:07.638387 dv-cinder-790492-4-iscsi neutron-server[91829]: pushed versions: May 25 16:58:07.638387 dv-cinder-790492-4-iscsi neutron-server[91829]: { 'AddressGroup': {'1.2'}, May 25 16:58:07.638387 dv-cinder-790492-4-iscsi neutron-server[91829]: 'ConntrackHelper': {'1.0'}, May 25 16:58:07.638387 dv-cinder-790492-4-iscsi neutron-server[91829]: 'Log': {'1.0'}, May 25 16:58:07.638387 dv-cinder-790492-4-iscsi neutron-server[91829]: 'Network': {'1.1'}, May 25 16:58:07.638387 dv-cinder-790492-4-iscsi neutron-server[91829]: 'Port': {'1.7'}, May 25 16:58:07.638387 dv-cinder-790492-4-iscsi neutron-server[91829]: 'PortForwarding': {'1.2'}, May 25 16:58:07.638387 dv-cinder-790492-4-iscsi neutron-server[91829]: 'QosPolicy': {'1.8'}, May 25 16:58:07.638387 dv-cinder-790492-4-iscsi neutron-server[91829]: 'SecurityGroup': {'1.4'}, May 25 16:58:07.638387 dv-cinder-790492-4-iscsi neutron-server[91829]: 'SecurityGroupRule': {'1.2'}, May 25 16:58:07.638387 dv-cinder-790492-4-iscsi neutron-server[91829]: 'SubPort': {'1.0'}, May 25 16:58:07.638387 dv-cinder-790492-4-iscsi neutron-server[91829]: 'Subnet': {'1.1'}, May 25 16:58:07.638387 dv-cinder-790492-4-iscsi neutron-server[91829]: 'Trunk': {'1.1'}} May 25 16:58:07.638387 dv-cinder-790492-4-iscsi neutron-server[91829]: consumer versions: May 25 16:58:07.638387 dv-cinder-790492-4-iscsi neutron-server[91829]: { DHCP agent@dv-cinder-790492-4-iscsi: {}, May 25 16:58:07.638387 dv-cinder-790492-4-iscsi neutron-server[91829]: HyperV agent@hv-cinder-79049: {}, May 25 16:58:07.638387 dv-cinder-790492-4-iscsi neutron-server[91829]: L3 agent@dv-cinder-790492-4-iscsi: {}, May 25 16:58:07.638387 dv-cinder-790492-4-iscsi neutron-server[91829]: Metadata agent@dv-cinder-790492-4-iscsi: {}, May 25 16:58:07.638387 dv-cinder-790492-4-iscsi neutron-server[91829]: Metering agent@dv-cinder-790492-4-iscsi: {}, May 25 16:58:07.638387 dv-cinder-790492-4-iscsi neutron-server[91829]: Open vSwitch agent@dv-cinder-790492-4-iscsi: { 'AddressGroup': '1.2', May 25 16:58:07.638387 dv-cinder-790492-4-iscsi neutron-server[91829]: 'ConntrackHelper': '1.0', May 25 16:58:07.638387 dv-cinder-790492-4-iscsi neutron-server[91829]: 'Log': '1.0', May 25 16:58:07.638387 dv-cinder-790492-4-iscsi neutron-server[91829]: 'Network': '1.1', May 25 16:58:07.638387 dv-cinder-790492-4-iscsi neutron-server[91829]: 'Port': '1.7', May 25 16:58:07.638387 dv-cinder-790492-4-iscsi neutron-server[91829]: 'PortForwarding': '1.2', May 25 16:58:07.638387 dv-cinder-790492-4-iscsi neutron-server[91829]: 'QosPolicy': '1.8', May 25 16:58:07.638387 dv-cinder-790492-4-iscsi neutron-server[91829]: 'SecurityGroup': '1.4', May 25 16:58:07.638387 dv-cinder-790492-4-iscsi neutron-server[91829]: 'SecurityGroupRule': '1.2', May 25 16:58:07.638387 dv-cinder-790492-4-iscsi neutron-server[91829]: 'SubPort': '1.0', May 25 16:58:07.638387 dv-cinder-790492-4-iscsi neutron-server[91829]: 'Subnet': '1.1', May 25 16:58:07.638387 dv-cinder-790492-4-iscsi neutron-server[91829]: 'Trunk': '1.1'}} May 25 16:58:07.638387 dv-cinder-790492-4-iscsi neutron-server[91829]: {{(pid=91829) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} May 25 16:58:07.641574 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-2714ef29-2cff-4111-a072-19281e281870 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.052s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:58:07.650527 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-2714ef29-2cff-4111-a072-19281e281870 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3809789'] for segment, precommit_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:07.650782 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.db.segments_db [None req-2714ef29-2cff-4111-a072-19281e281870 admin admin] Added segment f672477b-47fb-432c-acc9-dc57201d80de of type vlan for network 55a46372-d583-4435-a0f6-b9397668217d May 25 16:58:07.680687 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-2714ef29-2cff-4111-a072-19281e281870 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8757892541013'] for network, precommit_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:07.711320 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-2714ef29-2cff-4111-a072-19281e281870 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-640806', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-551400'] for network, after_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:07.712954 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2714ef29-2cff-4111-a072-19281e281870 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:58:07.714142 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-2714ef29-2cff-4111-a072-19281e281870 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-551373'] for network, before_response {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:07.723105 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:58:07.755480 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [None req-2714ef29-2cff-4111-a072-19281e281870 admin admin] 10.222.0.62 "POST /v2.0/networks HTTP/1.1" status: 201 len: 891 time: 0.5968685 May 25 16:58:07.758518 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.wsgi [-] (91830) accepted ('10.222.0.62', 53950) {{(pid=91830) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:58:07.764961 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.v2.base [None req-2bb9ba87-0e92-4d58-931f-57e79ccee942 admin admin] Request body: {'subnet': {'network_id': '55a46372-d583-4435-a0f6-b9397668217d', 'cidr': '172.20.0.0/28', 'name': 'tempest-ServerRescueNegativeTestJSON-116675553-subnet', 'tenant_id': '734df673f8b3484d80f35a45fbce9d5e', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=91830) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 16:58:07.769814 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.quota.driver [None req-2bb9ba87-0e92-4d58-931f-57e79ccee942 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91830) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 16:58:07.774153 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [None req-2bb9ba87-0e92-4d58-931f-57e79ccee942 admin admin] Usage tracker for resource:subnet and tenant:734df673f8b3484d80f35a45fbce9d5e is out of sync, need to count used quota {{(pid=91830) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 16:58:07.777353 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [None req-2bb9ba87-0e92-4d58-931f-57e79ccee942 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=91830) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 16:58:07.784714 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.quota.driver [None req-2bb9ba87-0e92-4d58-931f-57e79ccee942 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91830) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 16:58:07.796463 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-2bb9ba87-0e92-4d58-931f-57e79ccee942 admin admin] Made reservation on behalf of 734df673f8b3484d80f35a45fbce9d5e for: {'subnet': 1} {{(pid=91830) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 25 16:58:07.801097 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-2bb9ba87-0e92-4d58-931f-57e79ccee942 admin admin] Notify callbacks [] for subnet, before_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:07.835068 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2714ef29-2cff-4111-a072-19281e281870 admin admin] Pushing event updated for resources: {'Network': ['ID=55a46372-d583-4435-a0f6-b9397668217d,revision_number=1']} {{(pid=91829) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:58:07.838653 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-2714ef29-2cff-4111-a072-19281e281870 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.115s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:58:07.848592 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.rpc [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Network 55a46372-d583-4435-a0f6-b9397668217d details requested by agent ovs-agent-dv-cinder-790492-4-iscsi with host dv-cinder-790492-4-iscsi {{(pid=91831) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 25 16:58:08.261841 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-2bb9ba87-0e92-4d58-931f-57e79ccee942 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55886', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411'] for subnet, after_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:08.265603 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:58:08.346801 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2bb9ba87-0e92-4d58-931f-57e79ccee942 admin admin] Checking segment: {'id': 'f672477b-47fb-432c-acc9-dc57201d80de', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 697, 'network_id': '55a46372-d583-4435-a0f6-b9397668217d'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91830) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 25 16:58:08.347155 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2bb9ba87-0e92-4d58-931f-57e79ccee942 admin admin] Network hostable DHCP agents. Network: 55a46372-d583-4435-a0f6-b9397668217d, hostable agents: ['8d7401c6-8951-4f2b-ace4-208761782bfc'], hosted agents: [] {{(pid=91830) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 25 16:58:08.350341 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2bb9ba87-0e92-4d58-931f-57e79ccee942 admin admin] Pushing event updated for resources: {'Subnet': ['ID=927bd65a-c4de-491b-b501-302852f4c784,revision_number=0']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:58:08.362457 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2bb9ba87-0e92-4d58-931f-57e79ccee942 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91830) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:58:08.362815 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2bb9ba87-0e92-4d58-931f-57e79ccee942 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91830) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:58:08.363148 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2bb9ba87-0e92-4d58-931f-57e79ccee942 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91830) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:58:08.363466 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2bb9ba87-0e92-4d58-931f-57e79ccee942 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91830) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:58:08.363969 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2bb9ba87-0e92-4d58-931f-57e79ccee942 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91830) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:58:08.364309 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2bb9ba87-0e92-4d58-931f-57e79ccee942 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91830) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:58:08.364623 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2bb9ba87-0e92-4d58-931f-57e79ccee942 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91830) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:58:08.364937 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2bb9ba87-0e92-4d58-931f-57e79ccee942 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91830) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:58:08.365280 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2bb9ba87-0e92-4d58-931f-57e79ccee942 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91830) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:58:08.365587 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2bb9ba87-0e92-4d58-931f-57e79ccee942 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91830) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:58:08.365894 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2bb9ba87-0e92-4d58-931f-57e79ccee942 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91830) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:58:08.366223 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2bb9ba87-0e92-4d58-931f-57e79ccee942 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91830) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:58:08.367207 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2bb9ba87-0e92-4d58-931f-57e79ccee942 admin admin] Tracked resource versions report: May 25 16:58:08.367207 dv-cinder-790492-4-iscsi neutron-server[91830]: pushed versions: May 25 16:58:08.367207 dv-cinder-790492-4-iscsi neutron-server[91830]: { 'AddressGroup': {'1.2'}, May 25 16:58:08.367207 dv-cinder-790492-4-iscsi neutron-server[91830]: 'ConntrackHelper': {'1.0'}, May 25 16:58:08.367207 dv-cinder-790492-4-iscsi neutron-server[91830]: 'Log': {'1.0'}, May 25 16:58:08.367207 dv-cinder-790492-4-iscsi neutron-server[91830]: 'Network': {'1.1'}, May 25 16:58:08.367207 dv-cinder-790492-4-iscsi neutron-server[91830]: 'Port': {'1.7'}, May 25 16:58:08.367207 dv-cinder-790492-4-iscsi neutron-server[91830]: 'PortForwarding': {'1.2'}, May 25 16:58:08.367207 dv-cinder-790492-4-iscsi neutron-server[91830]: 'QosPolicy': {'1.8'}, May 25 16:58:08.367207 dv-cinder-790492-4-iscsi neutron-server[91830]: 'SecurityGroup': {'1.4'}, May 25 16:58:08.367207 dv-cinder-790492-4-iscsi neutron-server[91830]: 'SecurityGroupRule': {'1.2'}, May 25 16:58:08.367207 dv-cinder-790492-4-iscsi neutron-server[91830]: 'SubPort': {'1.0'}, May 25 16:58:08.367207 dv-cinder-790492-4-iscsi neutron-server[91830]: 'Subnet': {'1.1'}, May 25 16:58:08.367207 dv-cinder-790492-4-iscsi neutron-server[91830]: 'Trunk': {'1.1'}} May 25 16:58:08.367207 dv-cinder-790492-4-iscsi neutron-server[91830]: consumer versions: May 25 16:58:08.367207 dv-cinder-790492-4-iscsi neutron-server[91830]: { DHCP agent@dv-cinder-790492-4-iscsi: {}, May 25 16:58:08.367207 dv-cinder-790492-4-iscsi neutron-server[91830]: HyperV agent@hv-cinder-79049: {}, May 25 16:58:08.367207 dv-cinder-790492-4-iscsi neutron-server[91830]: L3 agent@dv-cinder-790492-4-iscsi: {}, May 25 16:58:08.367207 dv-cinder-790492-4-iscsi neutron-server[91830]: Metadata agent@dv-cinder-790492-4-iscsi: {}, May 25 16:58:08.367207 dv-cinder-790492-4-iscsi neutron-server[91830]: Metering agent@dv-cinder-790492-4-iscsi: {}, May 25 16:58:08.367207 dv-cinder-790492-4-iscsi neutron-server[91830]: Open vSwitch agent@dv-cinder-790492-4-iscsi: { 'AddressGroup': '1.2', May 25 16:58:08.367207 dv-cinder-790492-4-iscsi neutron-server[91830]: 'ConntrackHelper': '1.0', May 25 16:58:08.367207 dv-cinder-790492-4-iscsi neutron-server[91830]: 'Log': '1.0', May 25 16:58:08.367207 dv-cinder-790492-4-iscsi neutron-server[91830]: 'Network': '1.1', May 25 16:58:08.367207 dv-cinder-790492-4-iscsi neutron-server[91830]: 'Port': '1.7', May 25 16:58:08.367207 dv-cinder-790492-4-iscsi neutron-server[91830]: 'PortForwarding': '1.2', May 25 16:58:08.367207 dv-cinder-790492-4-iscsi neutron-server[91830]: 'QosPolicy': '1.8', May 25 16:58:08.367207 dv-cinder-790492-4-iscsi neutron-server[91830]: 'SecurityGroup': '1.4', May 25 16:58:08.367207 dv-cinder-790492-4-iscsi neutron-server[91830]: 'SecurityGroupRule': '1.2', May 25 16:58:08.367207 dv-cinder-790492-4-iscsi neutron-server[91830]: 'SubPort': '1.0', May 25 16:58:08.367207 dv-cinder-790492-4-iscsi neutron-server[91830]: 'Subnet': '1.1', May 25 16:58:08.367207 dv-cinder-790492-4-iscsi neutron-server[91830]: 'Trunk': '1.1'}} May 25 16:58:08.367207 dv-cinder-790492-4-iscsi neutron-server[91830]: {{(pid=91830) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} May 25 16:58:08.369995 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-2bb9ba87-0e92-4d58-931f-57e79ccee942 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.104s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:58:08.380804 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2bb9ba87-0e92-4d58-931f-57e79ccee942 admin admin] Network 55a46372-d583-4435-a0f6-b9397668217d is scheduled to be hosted by DHCP agent 8d7401c6-8951-4f2b-ace4-208761782bfc with binding_index 1 {{(pid=91830) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 25 16:58:08.390842 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.scheduler.base_scheduler [None req-2bb9ba87-0e92-4d58-931f-57e79ccee942 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-790492-4-iscsi, 55a46372-d583-4435-a0f6-b9397668217d) {{(pid=91830) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 16:58:08.395961 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2bb9ba87-0e92-4d58-931f-57e79ccee942 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=91830) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:58:08.397183 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-2bb9ba87-0e92-4d58-931f-57e79ccee942 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-551373'] for subnet, before_response {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:08.401493 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b4b140f0-9ec4-4a8b-9567-99f69861b398 None None] Network 55a46372-d583-4435-a0f6-b9397668217d requested from dv-cinder-790492-4-iscsi {{(pid=91831) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} May 25 16:58:08.422618 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [None req-2bb9ba87-0e92-4d58-931f-57e79ccee942 admin admin] 10.222.0.62 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 855 time: 0.6628466 May 25 16:58:08.423664 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.wsgi [-] (91829) accepted ('10.222.0.62', 53996) {{(pid=91829) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:58:08.431225 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.v2.base [None req-19a928e1-aee0-48ed-9b26-5420c6279036 admin admin] Request body: {'router': {'name': 'tempest-ServerRescueNegativeTestJSON-116675553-router', 'tenant_id': '734df673f8b3484d80f35a45fbce9d5e', 'external_gateway_info': {'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74'}}} {{(pid=91829) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 16:58:08.437044 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.quota.driver [None req-19a928e1-aee0-48ed-9b26-5420c6279036 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91829) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 16:58:08.442254 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.quota.resource [None req-19a928e1-aee0-48ed-9b26-5420c6279036 admin admin] Usage tracker for resource:router and tenant:734df673f8b3484d80f35a45fbce9d5e is out of sync, need to count used quota {{(pid=91829) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 16:58:08.445635 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.quota.resource [None req-19a928e1-aee0-48ed-9b26-5420c6279036 admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=91829) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 16:58:08.452812 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.quota.driver [None req-19a928e1-aee0-48ed-9b26-5420c6279036 admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91829) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 16:58:08.465224 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-19a928e1-aee0-48ed-9b26-5420c6279036 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-684888', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-31042'] for router, before_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:08.466261 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-19a928e1-aee0-48ed-9b26-5420c6279036 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-684376', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-683143', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-647018', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-31049'] for router, precommit_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:08.485705 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-19a928e1-aee0-48ed-9b26-5420c6279036 admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:08.638547 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-eb4a4f4c-a542-4c9c-b2e7-7a99469c4534 None None] Network 55a46372-d583-4435-a0f6-b9397668217d requested from dv-cinder-790492-4-iscsi {{(pid=91831) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} May 25 16:58:08.787005 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-19a928e1-aee0-48ed-9b26-5420c6279036 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-683170', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-684906', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-31039'] for router, precommit_update {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:09.111742 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.wsgi [-] (91830) accepted ('10.222.0.62', 54020) {{(pid=91830) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:58:09.157029 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-19a928e1-aee0-48ed-9b26-5420c6279036 admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:09.189939 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-19a928e1-aee0-48ed-9b26-5420c6279036 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3832070'] for port, before_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:09.307383 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.wsgi [-] (91830) accepted ('10.222.0.62', 54038) {{(pid=91830) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:58:09.312993 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.wsgi [-] (91830) accepted ('10.222.0.62', 54042) {{(pid=91830) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:58:09.335574 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.db_base_plugin_common [None req-19a928e1-aee0-48ed-9b26-5420c6279036 admin admin] Allocated IP 172.27.2.115 (4364b6ab-4117-4a92-baeb-f5ee2f45bf74/b947e790-d731-4b63-afc4-4aa112afe0f6/37da5a3a-087e-4df7-9900-7e680c1f0064) {{(pid=91829) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 25 16:58:09.420727 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.v2.base [None req-9e2413d5-881d-4569-b499-9197a165fc26 admin admin] Request body: {'network': {'name': 'tempest-EncryptedVolumesExtendAttachedTest-120380895-network', 'tenant_id': 'c0689c9a1e32481ca8ee3f0877f82c24'}} {{(pid=91830) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 16:58:09.425592 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.quota.driver [None req-9e2413d5-881d-4569-b499-9197a165fc26 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91830) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 16:58:09.430170 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [None req-9e2413d5-881d-4569-b499-9197a165fc26 admin admin] Usage tracker for resource:network and tenant:c0689c9a1e32481ca8ee3f0877f82c24 is out of sync, need to count used quota {{(pid=91830) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 16:58:09.434017 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [None req-9e2413d5-881d-4569-b499-9197a165fc26 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=91830) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 16:58:09.440546 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.quota.driver [None req-9e2413d5-881d-4569-b499-9197a165fc26 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91830) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 16:58:09.452295 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-9e2413d5-881d-4569-b499-9197a165fc26 admin admin] Made reservation on behalf of c0689c9a1e32481ca8ee3f0877f82c24 for: {'network': 1} {{(pid=91830) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 25 16:58:09.456615 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-9e2413d5-881d-4569-b499-9197a165fc26 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-3832077'] for network, before_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:09.482967 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-9e2413d5-881d-4569-b499-9197a165fc26 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:09.497713 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.quota.driver [None req-9e2413d5-881d-4569-b499-9197a165fc26 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91830) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 16:58:09.501554 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [None req-9e2413d5-881d-4569-b499-9197a165fc26 admin admin] Usage tracker for resource:security_group_rule and tenant:c0689c9a1e32481ca8ee3f0877f82c24 is out of sync, need to count used quota {{(pid=91830) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 16:58:09.502965 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-19a928e1-aee0-48ed-9b26-5420c6279036 admin admin] Notify callbacks [] for port, precommit_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:09.505082 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [None req-9e2413d5-881d-4569-b499-9197a165fc26 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91830) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 16:58:09.511856 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.quota.driver [None req-9e2413d5-881d-4569-b499-9197a165fc26 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91830) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 16:58:09.542060 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-19a928e1-aee0-48ed-9b26-5420c6279036 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8757892520915'] for port, after_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:09.546898 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:58:09.609733 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-19a928e1-aee0-48ed-9b26-5420c6279036 admin admin] Network 4364b6ab-4117-4a92-baeb-f5ee2f45bf74 is already hosted by enough agents. {{(pid=91829) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 25 16:58:09.612572 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.scheduler.base_scheduler [None req-19a928e1-aee0-48ed-9b26-5420c6279036 admin admin] Resources bound (agent type, host, resource id): {{(pid=91829) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 16:58:09.616655 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.l3_dvrscheduler_db [None req-19a928e1-aee0-48ed-9b26-5420c6279036 admin admin] Received port after_create {{(pid=91829) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 25 16:58:09.652123 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.v2.base [None req-dea2f965-5743-4fd9-9f3e-e50867f6b6ba admin admin] Request body: {'network': {'name': 'tempest-AttachVolumeNegativeTest-321358947-network', 'tenant_id': '04e8022f24e3464ab1ab7726d6a07e08'}} {{(pid=91830) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 16:58:09.661790 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-9e2413d5-881d-4569-b499-9197a165fc26 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:09.663887 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.quota.driver [None req-dea2f965-5743-4fd9-9f3e-e50867f6b6ba admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91830) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 16:58:09.671831 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [None req-dea2f965-5743-4fd9-9f3e-e50867f6b6ba admin admin] Usage tracker for resource:network and tenant:04e8022f24e3464ab1ab7726d6a07e08 is out of sync, need to count used quota {{(pid=91830) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 16:58:09.675186 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-9e2413d5-881d-4569-b499-9197a165fc26 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-640836'] for security_group, after_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:09.676336 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [None req-dea2f965-5743-4fd9-9f3e-e50867f6b6ba admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=91830) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 16:58:09.696891 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-9e2413d5-881d-4569-b499-9197a165fc26 admin admin] vlan segment allocate from pool success with {'vlan_id': 678, 'physical_network': 'physnet1'} {{(pid=91830) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 25 16:58:09.711866 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-9e2413d5-881d-4569-b499-9197a165fc26 admin admin] Notify callbacks ['neutron.services.segments.db._add_segment_host_mapping_for_segment-8757892982501', 'neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3809789'] for segment, precommit_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:09.712388 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-9e2413d5-881d-4569-b499-9197a165fc26 admin admin] Unsubscribe: segment precommit_create {{(pid=91830) unsubscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:83}} May 25 16:58:09.713109 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.db.segments_db [None req-9e2413d5-881d-4569-b499-9197a165fc26 admin admin] Added segment 9d9bb4c2-7532-4af6-9ccc-e15b90feb851 of type vlan for network c5a5a647-3069-401d-8a5f-11a0c258615c May 25 16:58:09.755057 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-9e2413d5-881d-4569-b499-9197a165fc26 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8757892541013'] for network, precommit_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:09.776961 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:58:09.794238 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.quota.driver [None req-dea2f965-5743-4fd9-9f3e-e50867f6b6ba admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91830) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 16:58:09.806193 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.v2.base [None req-0c33b2c5-6ae5-4569-a433-e17f5696809c admin admin] Request body: {'network': {'name': 'tempest-DeleteServersTestJSON-170518949-network', 'tenant_id': '00ab1bb5f5df49f08ef4b15635754b71'}} {{(pid=91830) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 16:58:09.816877 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-19a928e1-aee0-48ed-9b26-5420c6279036 admin admin] Pushing event updated for resources: {'Port': ['ID=37da5a3a-087e-4df7-9900-7e680c1f0064,revision_number=1']} {{(pid=91829) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:58:09.827361 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-19a928e1-aee0-48ed-9b26-5420c6279036 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.280s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:58:09.852542 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.quota.driver [None req-0c33b2c5-6ae5-4569-a433-e17f5696809c admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91830) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 16:58:09.857481 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [None req-0c33b2c5-6ae5-4569-a433-e17f5696809c admin admin] Usage tracker for resource:network and tenant:00ab1bb5f5df49f08ef4b15635754b71 is out of sync, need to count used quota {{(pid=91830) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 16:58:09.860364 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [None req-0c33b2c5-6ae5-4569-a433-e17f5696809c admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=91830) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 16:58:09.868305 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.quota.driver [None req-0c33b2c5-6ae5-4569-a433-e17f5696809c admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91830) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 16:58:09.894199 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-9e2413d5-881d-4569-b499-9197a165fc26 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-640806', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-551400'] for network, after_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:09.894890 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-0c33b2c5-6ae5-4569-a433-e17f5696809c admin admin] Made reservation on behalf of 00ab1bb5f5df49f08ef4b15635754b71 for: {'network': 1} {{(pid=91830) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 25 16:58:09.897381 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-0c33b2c5-6ae5-4569-a433-e17f5696809c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-3832077'] for network, before_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:09.911622 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-dea2f965-5743-4fd9-9f3e-e50867f6b6ba admin admin] Made reservation on behalf of 04e8022f24e3464ab1ab7726d6a07e08 for: {'network': 1} {{(pid=91830) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 25 16:58:09.914329 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-dea2f965-5743-4fd9-9f3e-e50867f6b6ba admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-3832077'] for network, before_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:09.929707 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9e2413d5-881d-4569-b499-9197a165fc26 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91830) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:58:09.930317 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-9e2413d5-881d-4569-b499-9197a165fc26 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-551373'] for network, before_response {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:09.958660 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-0c33b2c5-6ae5-4569-a433-e17f5696809c admin admin] Notify callbacks [] for security_group, before_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:09.987298 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-dea2f965-5743-4fd9-9f3e-e50867f6b6ba admin admin] Notify callbacks [] for security_group, before_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:09.997352 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9e2413d5-881d-4569-b499-9197a165fc26 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=6220201c-bb58-4da7-aa49-5214501844fb,revision_number=1']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:58:10.040748 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-9e2413d5-881d-4569-b499-9197a165fc26 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.255s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:58:10.044951 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.087s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:58:10.062780 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.quota.driver [None req-0c33b2c5-6ae5-4569-a433-e17f5696809c admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91830) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 16:58:10.091498 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [None req-9e2413d5-881d-4569-b499-9197a165fc26 admin admin] 10.222.0.62 "POST /v2.0/networks HTTP/1.1" status: 201 len: 897 time: 0.9777417 May 25 16:58:10.093218 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [None req-0c33b2c5-6ae5-4569-a433-e17f5696809c admin admin] Usage tracker for resource:security_group_rule and tenant:00ab1bb5f5df49f08ef4b15635754b71 is out of sync, need to count used quota {{(pid=91830) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 16:58:10.102176 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.quota.driver [None req-dea2f965-5743-4fd9-9f3e-e50867f6b6ba admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91830) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 16:58:10.110634 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.wsgi [-] (91829) accepted ('10.222.0.62', 54082) {{(pid=91829) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:58:10.116689 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.v2.base [None req-47151435-c3df-4eb0-8424-671a986b3a72 admin admin] Request body: {'subnet': {'network_id': 'c5a5a647-3069-401d-8a5f-11a0c258615c', 'cidr': '172.20.0.0/28', 'name': 'tempest-EncryptedVolumesExtendAttachedTest-120380895-subnet', 'tenant_id': 'c0689c9a1e32481ca8ee3f0877f82c24', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=91829) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 16:58:10.126121 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.quota.driver [None req-47151435-c3df-4eb0-8424-671a986b3a72 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91829) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 16:58:10.133833 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.quota.resource [None req-47151435-c3df-4eb0-8424-671a986b3a72 admin admin] Usage tracker for resource:subnet and tenant:c0689c9a1e32481ca8ee3f0877f82c24 is out of sync, need to count used quota {{(pid=91829) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 16:58:10.138303 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.quota.resource [None req-47151435-c3df-4eb0-8424-671a986b3a72 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=91829) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 16:58:10.141268 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-19a928e1-aee0-48ed-9b26-5420c6279036 admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:10.217744 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.quota.driver [None req-47151435-c3df-4eb0-8424-671a986b3a72 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91829) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 16:58:10.254311 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [None req-0c33b2c5-6ae5-4569-a433-e17f5696809c admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91830) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 16:58:10.270782 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [None req-dea2f965-5743-4fd9-9f3e-e50867f6b6ba admin admin] Usage tracker for resource:security_group_rule and tenant:04e8022f24e3464ab1ab7726d6a07e08 is out of sync, need to count used quota {{(pid=91830) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 16:58:10.303657 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9e2413d5-881d-4569-b499-9197a165fc26 admin admin] Pushing event updated for resources: {'Network': ['ID=c5a5a647-3069-401d-8a5f-11a0c258615c,revision_number=1']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:58:10.304251 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.quota.driver [None req-0c33b2c5-6ae5-4569-a433-e17f5696809c admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91830) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 16:58:10.306595 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [None req-dea2f965-5743-4fd9-9f3e-e50867f6b6ba admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91830) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 16:58:10.318106 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-47151435-c3df-4eb0-8424-671a986b3a72 admin admin] Made reservation on behalf of c0689c9a1e32481ca8ee3f0877f82c24 for: {'subnet': 1} {{(pid=91829) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 25 16:58:10.322846 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-9e2413d5-881d-4569-b499-9197a165fc26 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.278s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:58:10.324327 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.quota.driver [None req-dea2f965-5743-4fd9-9f3e-e50867f6b6ba admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91830) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 16:58:10.344771 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.rpc [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Network c5a5a647-3069-401d-8a5f-11a0c258615c details requested by agent ovs-agent-dv-cinder-790492-4-iscsi with host dv-cinder-790492-4-iscsi {{(pid=91831) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 25 16:58:10.366869 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-47151435-c3df-4eb0-8424-671a986b3a72 admin admin] Notify callbacks [] for subnet, before_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:10.501102 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-0c33b2c5-6ae5-4569-a433-e17f5696809c admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:10.530018 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-0c33b2c5-6ae5-4569-a433-e17f5696809c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-640836'] for security_group, after_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:10.546986 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-dea2f965-5743-4fd9-9f3e-e50867f6b6ba admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:10.550088 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-9e2413d5-881d-4569-b499-9197a165fc26 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:58:10.628835 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0c33b2c5-6ae5-4569-a433-e17f5696809c admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=ec198040-29f5-4dbf-8437-e486f3fb935b,revision_number=1']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:58:10.632941 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-dea2f965-5743-4fd9-9f3e-e50867f6b6ba admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-640836'] for security_group, after_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:10.633853 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-0c33b2c5-6ae5-4569-a433-e17f5696809c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.084s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:58:10.659097 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-0c33b2c5-6ae5-4569-a433-e17f5696809c admin admin] vlan segment allocate from pool success with {'vlan_id': 672, 'physical_network': 'physnet1'} {{(pid=91830) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 25 16:58:10.661342 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:58:10.694832 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dea2f965-5743-4fd9-9f3e-e50867f6b6ba admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=f73b90a2-df48-48fb-99e0-5dd4d6a63a15,revision_number=1']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:58:10.699957 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-dea2f965-5743-4fd9-9f3e-e50867f6b6ba admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.039s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:58:10.708171 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-dea2f965-5743-4fd9-9f3e-e50867f6b6ba admin admin] vlan segment allocate from pool success with {'vlan_id': 651, 'physical_network': 'physnet1'} {{(pid=91830) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 25 16:58:10.711184 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-0c33b2c5-6ae5-4569-a433-e17f5696809c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3809789'] for segment, precommit_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:10.711510 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.db.segments_db [None req-0c33b2c5-6ae5-4569-a433-e17f5696809c admin admin] Added segment 8721f8e7-e59f-46c5-9d87-1b6cc08601ef of type vlan for network ca95b136-0269-430f-b450-69ee5473ae7d May 25 16:58:10.727337 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-dea2f965-5743-4fd9-9f3e-e50867f6b6ba admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3809789'] for segment, precommit_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:10.727681 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.db.segments_db [None req-dea2f965-5743-4fd9-9f3e-e50867f6b6ba admin admin] Added segment 7d7273c2-c6dd-43fe-83a8-cb776d48dc70 of type vlan for network 63b1f335-e2c4-48dd-886b-6be853f8a2fc May 25 16:58:10.752235 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-0c33b2c5-6ae5-4569-a433-e17f5696809c admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8757892541013'] for network, precommit_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:10.775766 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-dea2f965-5743-4fd9-9f3e-e50867f6b6ba admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8757892541013'] for network, precommit_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:10.818776 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-0c33b2c5-6ae5-4569-a433-e17f5696809c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-640806', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-551400'] for network, after_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:10.820350 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0c33b2c5-6ae5-4569-a433-e17f5696809c admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91830) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:58:10.820944 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-0c33b2c5-6ae5-4569-a433-e17f5696809c admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-551373'] for network, before_response {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:10.827085 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:58:10.836146 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-19a928e1-aee0-48ed-9b26-5420c6279036 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-684881', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-683233'] for router, after_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:10.894415 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-dea2f965-5743-4fd9-9f3e-e50867f6b6ba admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-640806', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-551400'] for network, after_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:10.957366 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-dea2f965-5743-4fd9-9f3e-e50867f6b6ba admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91830) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:58:10.958292 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-dea2f965-5743-4fd9-9f3e-e50867f6b6ba admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-551373'] for network, before_response {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:10.976097 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [None req-0c33b2c5-6ae5-4569-a433-e17f5696809c admin admin] 10.222.0.62 "POST /v2.0/networks HTTP/1.1" status: 201 len: 884 time: 1.6546404 May 25 16:58:10.985045 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.wsgi [-] (91829) accepted ('10.222.0.62', 54104) {{(pid=91829) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:58:10.993140 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.v2.base [None req-e34ce3ce-8eb2-4d71-81b0-2cf1839b21ac admin admin] Request body: {'subnet': {'network_id': 'ca95b136-0269-430f-b450-69ee5473ae7d', 'cidr': '172.20.0.0/28', 'name': 'tempest-DeleteServersTestJSON-170518949-subnet', 'tenant_id': '00ab1bb5f5df49f08ef4b15635754b71', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=91829) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 16:58:11.013363 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [None req-dea2f965-5743-4fd9-9f3e-e50867f6b6ba admin admin] 10.222.0.62 "POST /v2.0/networks HTTP/1.1" status: 201 len: 887 time: 1.7043443 May 25 16:58:11.022265 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.wsgi [-] (91830) accepted ('10.222.0.62', 54116) {{(pid=91830) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:58:11.036088 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.v2.base [None req-ec184a5e-a2a8-426b-a2f1-162ad256f17b admin admin] Request body: {'subnet': {'network_id': '63b1f335-e2c4-48dd-886b-6be853f8a2fc', 'cidr': '172.20.0.0/28', 'name': 'tempest-AttachVolumeNegativeTest-321358947-subnet', 'tenant_id': '04e8022f24e3464ab1ab7726d6a07e08', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=91830) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 16:58:11.040786 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.quota.driver [None req-ec184a5e-a2a8-426b-a2f1-162ad256f17b admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91830) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 16:58:11.044851 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [None req-ec184a5e-a2a8-426b-a2f1-162ad256f17b admin admin] Usage tracker for resource:subnet and tenant:04e8022f24e3464ab1ab7726d6a07e08 is out of sync, need to count used quota {{(pid=91830) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 16:58:11.047736 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [None req-ec184a5e-a2a8-426b-a2f1-162ad256f17b admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=91830) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 16:58:11.053973 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.quota.driver [None req-ec184a5e-a2a8-426b-a2f1-162ad256f17b admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91830) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 16:58:11.062657 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0c33b2c5-6ae5-4569-a433-e17f5696809c admin admin] Pushing event updated for resources: {'Network': ['ID=ca95b136-0269-430f-b450-69ee5473ae7d,revision_number=1']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:58:11.066528 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-0c33b2c5-6ae5-4569-a433-e17f5696809c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.239s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:58:11.066999 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-9e2413d5-881d-4569-b499-9197a165fc26 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.074s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:58:11.073786 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.rpc [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Network ca95b136-0269-430f-b450-69ee5473ae7d details requested by agent ovs-agent-dv-cinder-790492-4-iscsi with host dv-cinder-790492-4-iscsi {{(pid=91831) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 25 16:58:11.167185 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.quota.driver [None req-e34ce3ce-8eb2-4d71-81b0-2cf1839b21ac admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91829) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 16:58:11.180911 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.quota.resource [None req-e34ce3ce-8eb2-4d71-81b0-2cf1839b21ac admin admin] Usage tracker for resource:subnet and tenant:00ab1bb5f5df49f08ef4b15635754b71 is out of sync, need to count used quota {{(pid=91829) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 16:58:11.199654 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.quota.resource [None req-e34ce3ce-8eb2-4d71-81b0-2cf1839b21ac admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=91829) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 16:58:11.212183 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.quota.driver [None req-e34ce3ce-8eb2-4d71-81b0-2cf1839b21ac admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91829) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 16:58:11.239030 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dea2f965-5743-4fd9-9f3e-e50867f6b6ba admin admin] Pushing event updated for resources: {'Network': ['ID=63b1f335-e2c4-48dd-886b-6be853f8a2fc,revision_number=1']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:58:11.246665 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-ec184a5e-a2a8-426b-a2f1-162ad256f17b admin admin] Made reservation on behalf of 04e8022f24e3464ab1ab7726d6a07e08 for: {'subnet': 1} {{(pid=91830) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 25 16:58:11.251900 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-ec184a5e-a2a8-426b-a2f1-162ad256f17b admin admin] Notify callbacks [] for subnet, before_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:11.288830 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-dea2f965-5743-4fd9-9f3e-e50867f6b6ba admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.222s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:58:11.292957 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-e34ce3ce-8eb2-4d71-81b0-2cf1839b21ac admin admin] Made reservation on behalf of 00ab1bb5f5df49f08ef4b15635754b71 for: {'subnet': 1} {{(pid=91829) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 25 16:58:11.297190 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-e34ce3ce-8eb2-4d71-81b0-2cf1839b21ac admin admin] Notify callbacks [] for subnet, before_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:11.353375 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.rpc [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Network 63b1f335-e2c4-48dd-886b-6be853f8a2fc details requested by agent ovs-agent-dv-cinder-790492-4-iscsi with host dv-cinder-790492-4-iscsi {{(pid=91831) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 25 16:58:11.565039 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-19a928e1-aee0-48ed-9b26-5420c6279036 admin admin] Router 84b3a1b2-10cf-465f-ae5c-ffc9b189ed05 is scheduled to L3 agent a2d427c1-2d07-43e8-afbe-218c9f7d0445 with binding_index 1 {{(pid=91829) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}} May 25 16:58:11.792498 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-ec184a5e-a2a8-426b-a2f1-162ad256f17b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55886', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411'] for subnet, after_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:11.798522 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-5fb380d4-f086-4ac1-978a-87fb36dc52be admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:58:11.887127 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ec184a5e-a2a8-426b-a2f1-162ad256f17b admin admin] Checking segment: {'id': '7d7273c2-c6dd-43fe-83a8-cb776d48dc70', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 651, 'network_id': '63b1f335-e2c4-48dd-886b-6be853f8a2fc'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91830) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 25 16:58:11.888469 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ec184a5e-a2a8-426b-a2f1-162ad256f17b admin admin] Network hostable DHCP agents. Network: 63b1f335-e2c4-48dd-886b-6be853f8a2fc, hostable agents: ['8d7401c6-8951-4f2b-ace4-208761782bfc'], hosted agents: [] {{(pid=91830) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 25 16:58:11.890308 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ec184a5e-a2a8-426b-a2f1-162ad256f17b admin admin] Pushing event updated for resources: {'Subnet': ['ID=b0baa944-cafe-48a4-861a-dae28947b9f0,revision_number=0']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:58:11.892976 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-ec184a5e-a2a8-426b-a2f1-162ad256f17b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.095s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:58:11.910596 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ec184a5e-a2a8-426b-a2f1-162ad256f17b admin admin] Network 63b1f335-e2c4-48dd-886b-6be853f8a2fc is scheduled to be hosted by DHCP agent 8d7401c6-8951-4f2b-ace4-208761782bfc with binding_index 1 {{(pid=91830) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 25 16:58:11.922623 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.scheduler.base_scheduler [None req-ec184a5e-a2a8-426b-a2f1-162ad256f17b admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-790492-4-iscsi, 63b1f335-e2c4-48dd-886b-6be853f8a2fc) {{(pid=91830) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 16:58:11.935296 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b8ad63a0-b9dd-4832-8b10-f4173a2014ff None None] Network 63b1f335-e2c4-48dd-886b-6be853f8a2fc requested from dv-cinder-790492-4-iscsi {{(pid=91831) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} May 25 16:58:11.952580 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ec184a5e-a2a8-426b-a2f1-162ad256f17b admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=91830) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:58:11.953204 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-ec184a5e-a2a8-426b-a2f1-162ad256f17b admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-551373'] for subnet, before_response {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:12.001239 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [None req-ec184a5e-a2a8-426b-a2f1-162ad256f17b admin admin] 10.222.0.62 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 851 time: 0.9778514 May 25 16:58:12.136700 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-19a928e1-aee0-48ed-9b26-5420c6279036 admin admin] Notify agent at l3_agent.dv-cinder-790492-4-iscsi the message routers_updated {{(pid=91829) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 25 16:58:12.149161 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4e227730-4d47-4fec-92f7-7417035cf0d7 None None] Sync routers for ids ['84b3a1b2-10cf-465f-ae5c-ffc9b189ed05'] in dv-cinder-790492-4-iscsi {{(pid=91832) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 25 16:58:12.169938 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4e227730-4d47-4fec-92f7-7417035cf0d7 None None] Routers {'84b3a1b2-10cf-465f-ae5c-ffc9b189ed05'} bound to L3 agent in host dv-cinder-790492-4-iscsi {{(pid=91832) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 16:58:12.170565 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.db.l3_hamode_db [None req-4e227730-4d47-4fec-92f7-7417035cf0d7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-790492-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-05-25T16:50:28Z,description=,heartbeat_timestamp=2021-05-25T16:57:58Z,host='dv-cinder-790492-4-iscsi',id=a2d427c1-2d07-43e8-afbe-218c9f7d0445,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T16:50:28Z,topic='l3_agent')) {'router_ids': ['84b3a1b2-10cf-465f-ae5c-ffc9b189ed05'], 'active': True} {{(pid=91832) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 16:58:12.301857 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0a199a16-c81a-4f17-a894-29c466f68447 None None] Network 63b1f335-e2c4-48dd-886b-6be853f8a2fc requested from dv-cinder-790492-4-iscsi {{(pid=91831) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} May 25 16:58:12.351062 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-19a928e1-aee0-48ed-9b26-5420c6279036 admin admin] Notify callbacks [] for router, before_response {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:12.352341 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [None req-19a928e1-aee0-48ed-9b26-5420c6279036 admin admin] 10.222.0.62 "POST /v2.0/routers HTTP/1.1" status: 201 len: 930 time: 3.9266131 May 25 16:58:12.355530 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.wsgi [-] (91830) accepted ('10.222.0.62', 54174) {{(pid=91830) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:58:12.482109 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.db.l3_dvr_db [None req-4e227730-4d47-4fec-92f7-7417035cf0d7 None None] Set router 84b3a1b2-10cf-465f-ae5c-ffc9b189ed05 gateway port host: dv-cinder-790492-4-iscsi {{(pid=91832) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 16:58:12.596343 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.wsgi [-] (91829) accepted ('10.222.0.62', 54200) {{(pid=91829) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:58:12.611996 dv-cinder-790492-4-iscsi neutron-server[91829]: WARNING keystonemiddleware.auth_token [-] A valid token was submitted as a service token, but it was not a valid service token. This is incorrect but backwards compatible behaviour. This will be removed in future releases. May 25 16:58:12.674014 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-47151435-c3df-4eb0-8424-671a986b3a72 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55886', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411'] for subnet, after_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:12.737225 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:58:12.773743 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.wsgi [-] (91830) accepted ('10.222.0.62', 54210) {{(pid=91830) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:58:12.894688 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-640ac1a9-5581-4f73-9a9e-7ba94abe500f req-571edc9b-1f60-4a61-aed9-854f2873b8c2 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:58:12.896991 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-640ac1a9-5581-4f73-9a9e-7ba94abe500f req-571edc9b-1f60-4a61-aed9-854f2873b8c2 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] 10.222.0.62 "GET /v2.0/networks?id=63b1f335-e2c4-48dd-886b-6be853f8a2fc HTTP/1.1" status: 200 len: 814 time: 0.2981908 May 25 16:58:12.922448 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-640ac1a9-5581-4f73-9a9e-7ba94abe500f req-9fe60c23-96d7-4c25-963e-5b4630a780a5 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] 10.222.0.62 "GET /v2.0/quotas/04e8022f24e3464ab1ab7726d6a07e08 HTTP/1.1" status: 200 len: 375 time: 0.0155032 May 25 16:58:12.923156 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-47151435-c3df-4eb0-8424-671a986b3a72 admin admin] Checking segment: {'id': '9d9bb4c2-7532-4af6-9ccc-e15b90feb851', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 678, 'network_id': 'c5a5a647-3069-401d-8a5f-11a0c258615c'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91829) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 25 16:58:12.923512 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-47151435-c3df-4eb0-8424-671a986b3a72 admin admin] Network hostable DHCP agents. Network: c5a5a647-3069-401d-8a5f-11a0c258615c, hostable agents: ['8d7401c6-8951-4f2b-ace4-208761782bfc'], hosted agents: [] {{(pid=91829) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 25 16:58:12.979740 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-8a1aa840-85db-4a61-9b00-717d53415572 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:13.003115 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.db.l3_hamode_db [None req-4e227730-4d47-4fec-92f7-7417035cf0d7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '84b3a1b2-10cf-465f-ae5c-ffc9b189ed05', 'name': 'tempest-ServerRescueNegativeTestJSON-116675553-router', 'tenant_id': '734df673f8b3484d80f35a45fbce9d5e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'external_fixed_ips': [{'subnet_id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'ip_address': '172.27.2.115'}], 'enable_snat': True}, 'gw_port_id': '37da5a3a-087e-4df7-9900-7e680c1f0064', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T16:58:08Z', 'updated_at': '2021-05-25T16:58:09Z', 'revision_number': 3, 'project_id': '734df673f8b3484d80f35a45fbce9d5e', 'gw_port': {'id': '37da5a3a-087e-4df7-9900-7e680c1f0064', 'name': '', 'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'tenant_id': '', 'mac_address': 'fa:16:3e:1e:d4:9c', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '84b3a1b2-10cf-465f-ae5c-ffc9b189ed05', 'device_owner': 'network:router_gateway', 'standard_attr_id': 40, 'fixed_ips': [{'subnet_id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'ip_address': '172.27.2.115', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:58:09Z', 'updated_at': '2021-05-25T16:58:09Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-790492-4-iscsi'}], 'dv-cinder-790492-4-iscsi', False) {} {{(pid=91832) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 16:58:13.008730 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4e227730-4d47-4fec-92f7-7417035cf0d7 None None] Checking router: 84b3a1b2-10cf-465f-ae5c-ffc9b189ed05 for host: dv-cinder-790492-4-iscsi {{(pid=91832) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 25 16:58:13.008920 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4e227730-4d47-4fec-92f7-7417035cf0d7 None None] Updating router 84b3a1b2-10cf-465f-ae5c-ffc9b189ed05 port 37da5a3a-087e-4df7-9900-7e680c1f0064 binding host dv-cinder-790492-4-iscsi {{(pid=91832) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} May 25 16:58:13.033400 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-640ac1a9-5581-4f73-9a9e-7ba94abe500f req-e5b8f05b-42ed-447d-b675-a661343691f3 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] 10.222.0.62 "GET /v2.0/ports?tenant_id=04e8022f24e3464ab1ab7726d6a07e08&fields=id HTTP/1.1" status: 200 len: 210 time: 0.1039588 May 25 16:58:13.075514 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-47151435-c3df-4eb0-8424-671a986b3a72 admin admin] Network c5a5a647-3069-401d-8a5f-11a0c258615c is scheduled to be hosted by DHCP agent 8d7401c6-8951-4f2b-ace4-208761782bfc with binding_index 1 {{(pid=91829) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 25 16:58:13.077006 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron_lib.callbacks.manager [None req-4e227730-4d47-4fec-92f7-7417035cf0d7 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3832070'] for port, before_update {{(pid=91832) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:13.091983 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.scheduler.base_scheduler [None req-47151435-c3df-4eb0-8424-671a986b3a72 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-790492-4-iscsi, c5a5a647-3069-401d-8a5f-11a0c258615c) {{(pid=91829) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 16:58:13.101747 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5343b685-5399-4720-866a-c4e1dea62bbb None None] Network c5a5a647-3069-401d-8a5f-11a0c258615c requested from dv-cinder-790492-4-iscsi {{(pid=91831) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} May 25 16:58:13.112280 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-47151435-c3df-4eb0-8424-671a986b3a72 admin admin] Pushing event updated for resources: {'Subnet': ['ID=05557e0e-b248-41c2-be98-1e8558f4e2cd,revision_number=0']} {{(pid=91829) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:58:13.138575 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-47151435-c3df-4eb0-8424-671a986b3a72 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:58:13.139961 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-47151435-c3df-4eb0-8424-671a986b3a72 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-551373'] for subnet, before_response {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:13.165555 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.quota.driver [None req-8a1aa840-85db-4a61-9b00-717d53415572 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91830) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 16:58:13.184164 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [None req-8a1aa840-85db-4a61-9b00-717d53415572 admin admin] Usage tracker for resource:security_group_rule and tenant:cb2ae4ca259546d6b8c0ba331b9c5c75 is out of sync, need to count used quota {{(pid=91830) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 16:58:13.194578 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [None req-8a1aa840-85db-4a61-9b00-717d53415572 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91830) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 16:58:13.216057 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.quota.driver [None req-8a1aa840-85db-4a61-9b00-717d53415572 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91830) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 16:58:13.247482 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-47151435-c3df-4eb0-8424-671a986b3a72 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.510s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:58:13.274277 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-e34ce3ce-8eb2-4d71-81b0-2cf1839b21ac admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55886', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411'] for subnet, after_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:13.300652 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [None req-47151435-c3df-4eb0-8424-671a986b3a72 admin admin] 10.222.0.62 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 861 time: 3.1886525 May 25 16:58:13.305638 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:58:13.460784 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-dd688b49-3b2c-4770-985b-564e88d108d3 None None] Network c5a5a647-3069-401d-8a5f-11a0c258615c requested from dv-cinder-790492-4-iscsi {{(pid=91831) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} May 25 16:58:13.507471 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.wsgi [req-640ac1a9-5581-4f73-9a9e-7ba94abe500f req-063cce1e-1567-484d-ba5d-890b1abce8ec service neutron] http://10.222.0.62:9696/v2.0/extensions returned with HTTP 200 {{(pid=91829) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} May 25 16:58:13.522572 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-640ac1a9-5581-4f73-9a9e-7ba94abe500f req-063cce1e-1567-484d-ba5d-890b1abce8ec service neutron] 10.222.0.62 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 13640 time: 0.2594533 May 25 16:58:13.675192 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e34ce3ce-8eb2-4d71-81b0-2cf1839b21ac admin admin] Checking segment: {'id': '8721f8e7-e59f-46c5-9d87-1b6cc08601ef', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 672, 'network_id': 'ca95b136-0269-430f-b450-69ee5473ae7d'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91829) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 25 16:58:13.676484 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e34ce3ce-8eb2-4d71-81b0-2cf1839b21ac admin admin] Network hostable DHCP agents. Network: ca95b136-0269-430f-b450-69ee5473ae7d, hostable agents: ['8d7401c6-8951-4f2b-ace4-208761782bfc'], hosted agents: [] {{(pid=91829) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 25 16:58:13.687226 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e34ce3ce-8eb2-4d71-81b0-2cf1839b21ac admin admin] Pushing event updated for resources: {'Subnet': ['ID=34034d6a-51f1-4e15-aa5b-0f79437d26f5,revision_number=0']} {{(pid=91829) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:58:13.760167 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron_lib.callbacks.manager [None req-4e227730-4d47-4fec-92f7-7417035cf0d7 None None] Notify callbacks [] for port, precommit_update {{(pid=91832) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:13.792588 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.db.provisioning_blocks [None req-4e227730-4d47-4fec-92f7-7417035cf0d7 None None] Transition to ACTIVE for port object 37da5a3a-087e-4df7-9900-7e680c1f0064 will not be triggered until provisioned by entity L2. {{(pid=91832) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 25 16:58:13.801942 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-e34ce3ce-8eb2-4d71-81b0-2cf1839b21ac admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.496s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:58:13.803677 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron_lib.callbacks.manager [None req-4e227730-4d47-4fec-92f7-7417035cf0d7 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8757892955028', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8757892520933', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8757892521750'] for port, after_update {{(pid=91832) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:13.808822 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG oslo_concurrency.lockutils [None req-11c8712f-97d6-4e3d-8763-22e23dcd42b0 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:58:13.858655 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e34ce3ce-8eb2-4d71-81b0-2cf1839b21ac admin admin] Network ca95b136-0269-430f-b450-69ee5473ae7d is scheduled to be hosted by DHCP agent 8d7401c6-8951-4f2b-ace4-208761782bfc with binding_index 1 {{(pid=91829) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 25 16:58:13.939024 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.plugins.ml2.managers [None req-4e227730-4d47-4fec-92f7-7417035cf0d7 None None] Attempting to bind port 37da5a3a-087e-4df7-9900-7e680c1f0064 on host dv-cinder-790492-4-iscsi for vnic_type normal with profile {{(pid=91832) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 25 16:58:13.939429 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.plugins.ml2.managers [None req-4e227730-4d47-4fec-92f7-7417035cf0d7 None None] Attempting to bind port 37da5a3a-087e-4df7-9900-7e680c1f0064 by drivers openvswitch,hyperv on host dv-cinder-790492-4-iscsi at level 0 using segments [{'id': '414a8468-1d66-4792-9e81-d8ac5ccf1512', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74'}] {{(pid=91832) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 25 16:58:13.939796 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4e227730-4d47-4fec-92f7-7417035cf0d7 None None] Attempting to bind port 37da5a3a-087e-4df7-9900-7e680c1f0064 on network 4364b6ab-4117-4a92-baeb-f5ee2f45bf74 {{(pid=91832) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 25 16:58:13.951420 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4e227730-4d47-4fec-92f7-7417035cf0d7 None None] Checking agent: {'id': 'fc8251e1-071c-49f7-bc10-1337f1d37d1b', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-790492-4-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 25, 16, 50, 28), 'started_at': datetime.datetime(2021, 5, 25, 16, 50, 58), 'heartbeat_timestamp': datetime.datetime(2021, 5, 25, 16, 57, 58), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-790492-4-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=91832) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 25 16:58:13.951420 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4e227730-4d47-4fec-92f7-7417035cf0d7 None None] Checking segment: {'id': '414a8468-1d66-4792-9e81-d8ac5ccf1512', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91832) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 25 16:58:13.951802 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron_lib.callbacks.manager [None req-4e227730-4d47-4fec-92f7-7417035cf0d7 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=91832) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:13.952124 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4e227730-4d47-4fec-92f7-7417035cf0d7 None None] Bound using segment: {'id': '414a8468-1d66-4792-9e81-d8ac5ccf1512', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74'} {{(pid=91832) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 25 16:58:13.952596 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.plugins.ml2.managers [None req-4e227730-4d47-4fec-92f7-7417035cf0d7 None None] Bound port: 37da5a3a-087e-4df7-9900-7e680c1f0064, host: dv-cinder-790492-4-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '414a8468-1d66-4792-9e81-d8ac5ccf1512', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74'}}] {{(pid=91832) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 25 16:58:13.952965 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron_lib.callbacks.manager [None req-4e227730-4d47-4fec-92f7-7417035cf0d7 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3832070'] for port, before_update {{(pid=91832) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:13.954435 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.scheduler.base_scheduler [None req-e34ce3ce-8eb2-4d71-81b0-2cf1839b21ac admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-790492-4-iscsi, ca95b136-0269-430f-b450-69ee5473ae7d) {{(pid=91829) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 16:58:13.970847 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-797b9ed3-a102-4b49-b60e-5c23dd1ee970 None None] Network ca95b136-0269-430f-b450-69ee5473ae7d requested from dv-cinder-790492-4-iscsi {{(pid=91831) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} May 25 16:58:13.991321 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e34ce3ce-8eb2-4d71-81b0-2cf1839b21ac admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:58:13.994396 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-e34ce3ce-8eb2-4d71-81b0-2cf1839b21ac admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-551373'] for subnet, before_response {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:13.994559 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-51357222-7415-4581-9103-dae32eea8cff None None] Pushing event updated for resources: {'Port': ['ID=37da5a3a-087e-4df7-9900-7e680c1f0064,revision_number=2']} {{(pid=91832) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:58:14.045131 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-51357222-7415-4581-9103-dae32eea8cff None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91832) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:58:14.045285 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-51357222-7415-4581-9103-dae32eea8cff None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91832) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:58:14.045619 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-51357222-7415-4581-9103-dae32eea8cff None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91832) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:58:14.045989 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-51357222-7415-4581-9103-dae32eea8cff None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91832) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:58:14.046284 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-51357222-7415-4581-9103-dae32eea8cff None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91832) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:58:14.046728 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-51357222-7415-4581-9103-dae32eea8cff None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91832) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:58:14.047042 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-51357222-7415-4581-9103-dae32eea8cff None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91832) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:58:14.047470 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-51357222-7415-4581-9103-dae32eea8cff None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91832) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:58:14.047847 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-51357222-7415-4581-9103-dae32eea8cff None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91832) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:58:14.048204 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-51357222-7415-4581-9103-dae32eea8cff None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91832) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:58:14.050057 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-51357222-7415-4581-9103-dae32eea8cff None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91832) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:58:14.051381 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-51357222-7415-4581-9103-dae32eea8cff None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91832) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:58:14.052564 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-51357222-7415-4581-9103-dae32eea8cff None None] Tracked resource versions report: May 25 16:58:14.052564 dv-cinder-790492-4-iscsi neutron-server[91832]: pushed versions: May 25 16:58:14.052564 dv-cinder-790492-4-iscsi neutron-server[91832]: { 'AddressGroup': {'1.2'}, May 25 16:58:14.052564 dv-cinder-790492-4-iscsi neutron-server[91832]: 'ConntrackHelper': {'1.0'}, May 25 16:58:14.052564 dv-cinder-790492-4-iscsi neutron-server[91832]: 'Log': {'1.0'}, May 25 16:58:14.052564 dv-cinder-790492-4-iscsi neutron-server[91832]: 'Network': {'1.1'}, May 25 16:58:14.052564 dv-cinder-790492-4-iscsi neutron-server[91832]: 'Port': {'1.7'}, May 25 16:58:14.052564 dv-cinder-790492-4-iscsi neutron-server[91832]: 'PortForwarding': {'1.2'}, May 25 16:58:14.052564 dv-cinder-790492-4-iscsi neutron-server[91832]: 'QosPolicy': {'1.8'}, May 25 16:58:14.052564 dv-cinder-790492-4-iscsi neutron-server[91832]: 'SecurityGroup': {'1.4'}, May 25 16:58:14.052564 dv-cinder-790492-4-iscsi neutron-server[91832]: 'SecurityGroupRule': {'1.2'}, May 25 16:58:14.052564 dv-cinder-790492-4-iscsi neutron-server[91832]: 'SubPort': {'1.0'}, May 25 16:58:14.052564 dv-cinder-790492-4-iscsi neutron-server[91832]: 'Subnet': {'1.1'}, May 25 16:58:14.052564 dv-cinder-790492-4-iscsi neutron-server[91832]: 'Trunk': {'1.1'}} May 25 16:58:14.052564 dv-cinder-790492-4-iscsi neutron-server[91832]: consumer versions: May 25 16:58:14.052564 dv-cinder-790492-4-iscsi neutron-server[91832]: { DHCP agent@dv-cinder-790492-4-iscsi: {}, May 25 16:58:14.052564 dv-cinder-790492-4-iscsi neutron-server[91832]: HyperV agent@hv-cinder-79049: {}, May 25 16:58:14.052564 dv-cinder-790492-4-iscsi neutron-server[91832]: L3 agent@dv-cinder-790492-4-iscsi: {}, May 25 16:58:14.052564 dv-cinder-790492-4-iscsi neutron-server[91832]: Metadata agent@dv-cinder-790492-4-iscsi: {}, May 25 16:58:14.052564 dv-cinder-790492-4-iscsi neutron-server[91832]: Metering agent@dv-cinder-790492-4-iscsi: {}, May 25 16:58:14.052564 dv-cinder-790492-4-iscsi neutron-server[91832]: Open vSwitch agent@dv-cinder-790492-4-iscsi: { 'AddressGroup': '1.2', May 25 16:58:14.052564 dv-cinder-790492-4-iscsi neutron-server[91832]: 'ConntrackHelper': '1.0', May 25 16:58:14.052564 dv-cinder-790492-4-iscsi neutron-server[91832]: 'Log': '1.0', May 25 16:58:14.052564 dv-cinder-790492-4-iscsi neutron-server[91832]: 'Network': '1.1', May 25 16:58:14.052564 dv-cinder-790492-4-iscsi neutron-server[91832]: 'Port': '1.7', May 25 16:58:14.052564 dv-cinder-790492-4-iscsi neutron-server[91832]: 'PortForwarding': '1.2', May 25 16:58:14.052564 dv-cinder-790492-4-iscsi neutron-server[91832]: 'QosPolicy': '1.8', May 25 16:58:14.052564 dv-cinder-790492-4-iscsi neutron-server[91832]: 'SecurityGroup': '1.4', May 25 16:58:14.052564 dv-cinder-790492-4-iscsi neutron-server[91832]: 'SecurityGroupRule': '1.2', May 25 16:58:14.052564 dv-cinder-790492-4-iscsi neutron-server[91832]: 'SubPort': '1.0', May 25 16:58:14.052564 dv-cinder-790492-4-iscsi neutron-server[91832]: 'Subnet': '1.1', May 25 16:58:14.052564 dv-cinder-790492-4-iscsi neutron-server[91832]: 'Trunk': '1.1'}} May 25 16:58:14.052564 dv-cinder-790492-4-iscsi neutron-server[91832]: {{(pid=91832) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} May 25 16:58:14.057821 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG oslo_concurrency.lockutils [None req-51357222-7415-4581-9103-dae32eea8cff None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.249s {{(pid=91832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:58:14.103797 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.plugins.ml2.db [None req-4e227730-4d47-4fec-92f7-7417035cf0d7 None None] For port 37da5a3a-087e-4df7-9900-7e680c1f0064, host dv-cinder-790492-4-iscsi, cleared binding levels {{(pid=91832) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 25 16:58:14.108193 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.plugins.ml2.db [None req-4e227730-4d47-4fec-92f7-7417035cf0d7 None None] For port 37da5a3a-087e-4df7-9900-7e680c1f0064, host dv-cinder-790492-4-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-790492-4-iscsi',level=0,port_id=37da5a3a-087e-4df7-9900-7e680c1f0064,segment=NetworkSegment(414a8468-1d66-4792-9e81-d8ac5ccf1512),segment_id=414a8468-1d66-4792-9e81-d8ac5ccf1512)] {{(pid=91832) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 25 16:58:14.109407 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-640ac1a9-5581-4f73-9a9e-7ba94abe500f req-5638d20b-95a6-4969-9935-4efc578235df service neutron] 10.222.0.62 "GET /v2.0/networks/63b1f335-e2c4-48dd-886b-6be853f8a2fc?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.5827122 May 25 16:58:14.119225 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron_lib.callbacks.manager [None req-4e227730-4d47-4fec-92f7-7417035cf0d7 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8757892955028', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8757892520933', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8757892521750'] for port, after_update {{(pid=91832) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:14.151018 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:58:14.280171 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4e227730-4d47-4fec-92f7-7417035cf0d7 None None] Routers {'84b3a1b2-10cf-465f-ae5c-ffc9b189ed05'} bound to L3 agent in host dv-cinder-790492-4-iscsi {{(pid=91832) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 16:58:14.280890 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.db.l3_hamode_db [None req-4e227730-4d47-4fec-92f7-7417035cf0d7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-790492-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-05-25T16:50:28Z,description=,heartbeat_timestamp=2021-05-25T16:57:58Z,host='dv-cinder-790492-4-iscsi',id=a2d427c1-2d07-43e8-afbe-218c9f7d0445,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T16:50:28Z,topic='l3_agent')) {'router_ids': ['84b3a1b2-10cf-465f-ae5c-ffc9b189ed05'], 'active': True} {{(pid=91832) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 16:58:14.322644 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-8a1aa840-85db-4a61-9b00-717d53415572 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:14.338016 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-8a1aa840-85db-4a61-9b00-717d53415572 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-640836'] for security_group, after_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:14.339946 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [None req-e34ce3ce-8eb2-4d71-81b0-2cf1839b21ac admin admin] 10.222.0.62 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 848 time: 3.3513403 May 25 16:58:14.368064 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:58:14.442503 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-640ac1a9-5581-4f73-9a9e-7ba94abe500f req-d06ac6ed-5efb-473a-9b1d-7d627946d0a1 service neutron] 10.222.0.62 "GET /v2.0/networks/63b1f335-e2c4-48dd-886b-6be853f8a2fc?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3043892 May 25 16:58:14.465308 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-51357222-7415-4581-9103-dae32eea8cff None None] Pushing event updated for resources: {'Port': ['ID=37da5a3a-087e-4df7-9900-7e680c1f0064,revision_number=3']} {{(pid=91832) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:58:14.503512 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-950b4827-a709-43f5-a23c-fd8d66e4811a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3832070'] for port, before_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:14.563621 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [None req-8a1aa840-85db-4a61-9b00-717d53415572 admin admin] 10.222.0.62 "GET /v2.0/security-groups?tenant_id=cb2ae4ca259546d6b8c0ba331b9c5c75&name=default HTTP/1.1" status: 200 len: 2975 time: 1.7885115 May 25 16:58:14.565227 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.wsgi [-] (91829) accepted ('10.222.0.62', 54286) {{(pid=91829) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:58:14.582924 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a1aa840-85db-4a61-9b00-717d53415572 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=a252a14e-ee81-432f-9bd9-29f8bf0444be,revision_number=1']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:58:14.588768 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-fa176893-8dd5-4ef5-b144-92173d3465e0 None None] Network ca95b136-0269-430f-b450-69ee5473ae7d requested from dv-cinder-790492-4-iscsi {{(pid=91831) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} May 25 16:58:14.597725 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG oslo_concurrency.lockutils [None req-51357222-7415-4581-9103-dae32eea8cff None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.447s {{(pid=91832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:58:14.691260 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.db.l3_dvr_db [None req-4e227730-4d47-4fec-92f7-7417035cf0d7 None None] Set router 84b3a1b2-10cf-465f-ae5c-ffc9b189ed05 gateway port host: dv-cinder-790492-4-iscsi {{(pid=91832) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 16:58:14.713741 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-e54887f5-6e73-4b61-9031-3b983e7b355a admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:14.788597 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-e54887f5-6e73-4b61-9031-3b983e7b355a admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:14.816818 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.wsgi [-] (91829) accepted ('10.222.0.62', 54300) {{(pid=91829) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:58:14.829035 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.wsgi [-] (91829) accepted ('10.222.0.62', 54306) {{(pid=91829) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:58:14.976186 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-e54887f5-6e73-4b61-9031-3b983e7b355a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-640836'] for security_group, after_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:14.994373 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-883331be-1a2e-4130-a272-d03abcc013e9 req-a401f809-6f8b-4cee-94cf-60eeebc95b1d tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] 10.222.0.62 "GET /v2.0/ports?device_id=bca36110-0b4f-419a-92ef-46cbb9d6215e HTTP/1.1" status: 200 len: 210 time: 0.1607637 May 25 16:58:14.996975 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.wsgi [-] (91829) accepted ('10.222.0.62', 54320) {{(pid=91829) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:58:15.010433 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.v2.base [None req-c782518b-460a-4ee1-bf39-d008796d4efa admin admin] Request body: {'network': {'name': 'tempest-EncryptedVolumesExtendAttachedTest-303075218-network', 'tenant_id': 'c0eb4b8dd7674c61bad9a1b5a4db5542'}} {{(pid=91829) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 16:58:15.018690 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:58:15.028840 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.db_base_plugin_common [None req-950b4827-a709-43f5-a23c-fd8d66e4811a admin admin] Allocated IP 172.20.0.1 (55a46372-d583-4435-a0f6-b9397668217d/927bd65a-c4de-491b-b501-302852f4c784/c201e735-51e1-4301-a2d9-d3c9ffbbd910) {{(pid=91830) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 25 16:58:15.034526 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.quota.driver [None req-c782518b-460a-4ee1-bf39-d008796d4efa admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91829) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 16:58:15.040953 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e54887f5-6e73-4b61-9031-3b983e7b355a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=a252a14e-ee81-432f-9bd9-29f8bf0444be,revision_number=None']} {{(pid=91829) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:58:15.055145 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-e54887f5-6e73-4b61-9031-3b983e7b355a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.037s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:58:15.063763 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.quota.resource [None req-c782518b-460a-4ee1-bf39-d008796d4efa admin admin] Usage tracker for resource:network and tenant:c0eb4b8dd7674c61bad9a1b5a4db5542 is out of sync, need to count used quota {{(pid=91829) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 16:58:15.068870 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.quota.resource [None req-c782518b-460a-4ee1-bf39-d008796d4efa admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=91829) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 16:58:15.084104 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-e54887f5-6e73-4b61-9031-3b983e7b355a admin admin] Notify callbacks [] for security_group, before_response {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:15.085221 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [None req-e54887f5-6e73-4b61-9031-3b983e7b355a admin admin] 10.222.0.62 "DELETE /v2.0/security-groups/a252a14e-ee81-432f-9bd9-29f8bf0444be HTTP/1.1" status: 204 len: 168 time: 0.5190341 May 25 16:58:15.089682 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.quota.driver [None req-c782518b-460a-4ee1-bf39-d008796d4efa admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91829) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 16:58:15.101396 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-c782518b-460a-4ee1-bf39-d008796d4efa admin admin] Made reservation on behalf of c0eb4b8dd7674c61bad9a1b5a4db5542 for: {'network': 1} {{(pid=91829) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 25 16:58:15.103994 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-c782518b-460a-4ee1-bf39-d008796d4efa admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-3832077'] for network, before_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:15.125830 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-c782518b-460a-4ee1-bf39-d008796d4efa admin admin] Notify callbacks [] for security_group, before_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:15.141780 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-8a1aa840-85db-4a61-9b00-717d53415572 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.774s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:58:15.154211 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.quota.driver [None req-c782518b-460a-4ee1-bf39-d008796d4efa admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91829) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 16:58:15.162043 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.quota.resource [None req-c782518b-460a-4ee1-bf39-d008796d4efa admin admin] Usage tracker for resource:security_group_rule and tenant:c0eb4b8dd7674c61bad9a1b5a4db5542 is out of sync, need to count used quota {{(pid=91829) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 16:58:15.165069 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.quota.resource [None req-c782518b-460a-4ee1-bf39-d008796d4efa admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91829) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 16:58:15.171194 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.quota.driver [None req-c782518b-460a-4ee1-bf39-d008796d4efa admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91829) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 16:58:15.241937 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-950b4827-a709-43f5-a23c-fd8d66e4811a admin admin] Notify callbacks [] for port, precommit_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:15.260188 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.db.l3_hamode_db [None req-4e227730-4d47-4fec-92f7-7417035cf0d7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '84b3a1b2-10cf-465f-ae5c-ffc9b189ed05', 'name': 'tempest-ServerRescueNegativeTestJSON-116675553-router', 'tenant_id': '734df673f8b3484d80f35a45fbce9d5e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'external_fixed_ips': [{'subnet_id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'ip_address': '172.27.2.115'}], 'enable_snat': True}, 'gw_port_id': '37da5a3a-087e-4df7-9900-7e680c1f0064', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T16:58:08Z', 'updated_at': '2021-05-25T16:58:09Z', 'revision_number': 3, 'project_id': '734df673f8b3484d80f35a45fbce9d5e', 'gw_port': {'id': '37da5a3a-087e-4df7-9900-7e680c1f0064', 'name': '', 'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'tenant_id': '', 'mac_address': 'fa:16:3e:1e:d4:9c', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '84b3a1b2-10cf-465f-ae5c-ffc9b189ed05', 'device_owner': 'network:router_gateway', 'standard_attr_id': 40, 'fixed_ips': [{'subnet_id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'ip_address': '172.27.2.115', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790492-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:58:09Z', 'updated_at': '2021-05-25T16:58:14Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-790492-4-iscsi'}], 'dv-cinder-790492-4-iscsi', False) {} {{(pid=91832) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 16:58:15.270215 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4e227730-4d47-4fec-92f7-7417035cf0d7 None None] The sync data for ids ['84b3a1b2-10cf-465f-ae5c-ffc9b189ed05'] in dv-cinder-790492-4-iscsi is: [{'id': '84b3a1b2-10cf-465f-ae5c-ffc9b189ed05', 'name': 'tempest-ServerRescueNegativeTestJSON-116675553-router', 'tenant_id': '734df673f8b3484d80f35a45fbce9d5e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'external_fixed_ips': [{'subnet_id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'ip_address': '172.27.2.115'}], 'enable_snat': True}, 'gw_port_id': '37da5a3a-087e-4df7-9900-7e680c1f0064', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T16:58:08Z', 'updated_at': '2021-05-25T16:58:09Z', 'revision_number': 3, 'project_id': '734df673f8b3484d80f35a45fbce9d5e', 'gw_port': {'id': '37da5a3a-087e-4df7-9900-7e680c1f0064', 'name': '', 'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'tenant_id': '', 'mac_address': 'fa:16:3e:1e:d4:9c', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '84b3a1b2-10cf-465f-ae5c-ffc9b189ed05', 'device_owner': 'network:router_gateway', 'standard_attr_id': 40, 'fixed_ips': [{'subnet_id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'ip_address': '172.27.2.115', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790492-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:58:09Z', 'updated_at': '2021-05-25T16:58:14Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-790492-4-iscsi'}] {{(pid=91832) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 25 16:58:15.315741 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-c782518b-460a-4ee1-bf39-d008796d4efa admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:15.331950 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-c782518b-460a-4ee1-bf39-d008796d4efa admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-640836'] for security_group, after_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:15.333033 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-b0a5f1f2-4079-4cb9-b599-deb01adcbafb admin admin] Notify callbacks [] for security_group, before_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:15.335608 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-950b4827-a709-43f5-a23c-fd8d66e4811a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8757892520915'] for port, after_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:15.340905 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:58:15.357567 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-c782518b-460a-4ee1-bf39-d008796d4efa admin admin] vlan segment allocate from pool success with {'vlan_id': 671, 'physical_network': 'physnet1'} {{(pid=91829) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 25 16:58:15.367166 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-c782518b-460a-4ee1-bf39-d008796d4efa admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3809789'] for segment, precommit_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:15.367506 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.db.segments_db [None req-c782518b-460a-4ee1-bf39-d008796d4efa admin admin] Added segment 3e8beb4d-db01-4975-9049-1762d1db1921 of type vlan for network 6545658b-b670-4918-9a90-4574c32bc70a May 25 16:58:15.421467 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-c782518b-460a-4ee1-bf39-d008796d4efa admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8757892541013'] for network, precommit_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:15.436278 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:58:15.439682 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-950b4827-a709-43f5-a23c-fd8d66e4811a admin admin] Network 55a46372-d583-4435-a0f6-b9397668217d is already hosted by enough agents. {{(pid=91830) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 25 16:58:15.445675 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.scheduler.base_scheduler [None req-950b4827-a709-43f5-a23c-fd8d66e4811a admin admin] Resources bound (agent type, host, resource id): {{(pid=91830) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 16:58:15.450859 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.l3_dvrscheduler_db [None req-950b4827-a709-43f5-a23c-fd8d66e4811a admin admin] Received port after_create {{(pid=91830) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 25 16:58:15.451789 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-950b4827-a709-43f5-a23c-fd8d66e4811a admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-680080'] for router_interface, before_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:15.458985 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.quota.driver [None req-b0a5f1f2-4079-4cb9-b599-deb01adcbafb admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91829) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 16:58:15.475765 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.quota.resource [None req-b0a5f1f2-4079-4cb9-b599-deb01adcbafb admin admin] Usage tracker for resource:security_group_rule and tenant:e89887760271445b993d7b450dbb4c8b is out of sync, need to count used quota {{(pid=91829) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 16:58:15.496262 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.quota.resource [None req-b0a5f1f2-4079-4cb9-b599-deb01adcbafb admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91829) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 16:58:15.517523 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.quota.driver [None req-b0a5f1f2-4079-4cb9-b599-deb01adcbafb admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91829) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 16:58:15.554004 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c782518b-460a-4ee1-bf39-d008796d4efa admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=0980e1be-cc99-4423-b010-fb708b67980a,revision_number=1']} {{(pid=91829) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:58:15.598993 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-c782518b-460a-4ee1-bf39-d008796d4efa admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.163s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:58:15.651027 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-c782518b-460a-4ee1-bf39-d008796d4efa admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-640806', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-551400'] for network, after_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:15.653982 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c782518b-460a-4ee1-bf39-d008796d4efa admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:58:15.655035 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-c782518b-460a-4ee1-bf39-d008796d4efa admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-551373'] for network, before_response {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:15.821498 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-950b4827-a709-43f5-a23c-fd8d66e4811a admin admin] Pushing event updated for resources: {'Port': ['ID=c201e735-51e1-4301-a2d9-d3c9ffbbd910,revision_number=1']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:58:15.843689 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-950b4827-a709-43f5-a23c-fd8d66e4811a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.503s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:58:15.858477 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:58:15.885556 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [None req-c782518b-460a-4ee1-bf39-d008796d4efa admin admin] 10.222.0.62 "POST /v2.0/networks HTTP/1.1" status: 201 len: 897 time: 0.8847485 May 25 16:58:15.890255 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.wsgi [-] (91830) accepted ('10.222.0.62', 54356) {{(pid=91830) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:58:15.918144 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.v2.base [None req-b914d378-e633-47a1-9ae1-cf2386d4e4bd admin admin] Request body: {'subnet': {'network_id': '6545658b-b670-4918-9a90-4574c32bc70a', 'cidr': '172.20.0.0/28', 'name': 'tempest-EncryptedVolumesExtendAttachedTest-303075218-subnet', 'tenant_id': 'c0eb4b8dd7674c61bad9a1b5a4db5542', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=91830) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 16:58:15.994343 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.quota.driver [None req-b914d378-e633-47a1-9ae1-cf2386d4e4bd admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91830) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 16:58:16.002732 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [None req-b914d378-e633-47a1-9ae1-cf2386d4e4bd admin admin] Usage tracker for resource:subnet and tenant:c0eb4b8dd7674c61bad9a1b5a4db5542 is out of sync, need to count used quota {{(pid=91830) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 16:58:16.012924 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [None req-b914d378-e633-47a1-9ae1-cf2386d4e4bd admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=91830) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 16:58:16.029684 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.quota.driver [None req-b914d378-e633-47a1-9ae1-cf2386d4e4bd admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91830) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 16:58:16.049294 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.wsgi [-] (91830) accepted ('10.222.0.62', 54366) {{(pid=91830) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:58:16.152987 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-7ec1684d-62ff-4996-850a-92981776b4d1 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:16.168359 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.rpc [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Device 37da5a3a-087e-4df7-9900-7e680c1f0064 up at agent ovs-agent-dv-cinder-790492-4-iscsi {{(pid=91831) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 25 16:58:16.190443 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-b914d378-e633-47a1-9ae1-cf2386d4e4bd admin admin] Made reservation on behalf of c0eb4b8dd7674c61bad9a1b5a4db5542 for: {'subnet': 1} {{(pid=91830) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 25 16:58:16.191146 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-b0a5f1f2-4079-4cb9-b599-deb01adcbafb admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:16.195978 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-b914d378-e633-47a1-9ae1-cf2386d4e4bd admin admin] Notify callbacks [] for subnet, before_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:16.205111 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-b0a5f1f2-4079-4cb9-b599-deb01adcbafb admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-640836'] for security_group, after_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:16.317147 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.provisioning_blocks [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Provisioning for port 37da5a3a-087e-4df7-9900-7e680c1f0064 completed by entity L2. {{(pid=91831) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 25 16:58:16.324071 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.quota.driver [None req-7ec1684d-62ff-4996-850a-92981776b4d1 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91830) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 16:58:16.324681 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.provisioning_blocks [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Provisioning complete for port 37da5a3a-087e-4df7-9900-7e680c1f0064 triggered by entity L2. {{(pid=91831) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 16:58:16.325773 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3854128'] for port, provisioning_complete {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:16.350373 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-950b4827-a709-43f5-a23c-fd8d66e4811a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3832070'] for port, before_update {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:16.361481 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [None req-b0a5f1f2-4079-4cb9-b599-deb01adcbafb admin admin] 10.222.0.62 "GET /v2.0/security-groups?tenant_id=e89887760271445b993d7b450dbb4c8b&name=default HTTP/1.1" status: 200 len: 2975 time: 1.5436404 May 25 16:58:16.369169 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-016606af-fa75-4773-8c06-7067c06587da req-14de9aa0-d7c5-45f7-b9ac-d3efbbae2cda tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] 10.222.0.62 "GET /v2.0/ports?device_id=bca36110-0b4f-419a-92ef-46cbb9d6215e HTTP/1.1" status: 200 len: 210 time: 0.2726614 May 25 16:58:16.369767 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.wsgi [-] (91829) accepted ('10.222.0.62', 54378) {{(pid=91829) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:58:16.377576 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [None req-7ec1684d-62ff-4996-850a-92981776b4d1 admin admin] Usage tracker for resource:security_group_rule and tenant:e67b65d159aa4f3cad19881fb4bc5f1a is out of sync, need to count used quota {{(pid=91830) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 16:58:16.378822 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c782518b-460a-4ee1-bf39-d008796d4efa admin admin] Pushing event updated for resources: {'Network': ['ID=6545658b-b670-4918-9a90-4574c32bc70a,revision_number=1']} {{(pid=91829) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:58:16.385825 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [None req-7ec1684d-62ff-4996-850a-92981776b4d1 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91830) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 16:58:16.401109 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.quota.driver [None req-7ec1684d-62ff-4996-850a-92981776b4d1 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91830) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 16:58:16.418042 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-c782518b-460a-4ee1-bf39-d008796d4efa admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.567s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:58:16.420088 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-c782518b-460a-4ee1-bf39-d008796d4efa admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.074s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:58:16.425369 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.rpc [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Network 6545658b-b670-4918-9a90-4574c32bc70a details requested by agent ovs-agent-dv-cinder-790492-4-iscsi with host dv-cinder-790492-4-iscsi {{(pid=91831) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 25 16:58:16.547657 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b0a5f1f2-4079-4cb9-b599-deb01adcbafb admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=6255f0ae-78ba-4916-a3f5-7916aa534eb3,revision_number=1']} {{(pid=91829) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:58:16.564668 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-b0a5f1f2-4079-4cb9-b599-deb01adcbafb admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.145s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:58:16.600845 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1f40d34a-0eb9-4d60-b5b9-5a06e965a5fa req-39f8b2c3-31c7-4f0e-9800-75f2a20e1b11 tempest-DeleteServersTestJSON-1172980508 tempest-DeleteServersTestJSON-1172980508-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:58:16.608613 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-1f40d34a-0eb9-4d60-b5b9-5a06e965a5fa req-39f8b2c3-31c7-4f0e-9800-75f2a20e1b11 tempest-DeleteServersTestJSON-1172980508 tempest-DeleteServersTestJSON-1172980508-project] 10.222.0.62 "GET /v2.0/networks?id=ca95b136-0269-430f-b450-69ee5473ae7d HTTP/1.1" status: 200 len: 811 time: 0.5956903 May 25 16:58:16.629158 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-16ba5b9e-d782-4dc5-be96-13fae85a7c29 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:16.677272 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-1f40d34a-0eb9-4d60-b5b9-5a06e965a5fa req-fb906ef2-51f2-425d-83e7-e880621da10e tempest-DeleteServersTestJSON-1172980508 tempest-DeleteServersTestJSON-1172980508-project] 10.222.0.62 "GET /v2.0/quotas/00ab1bb5f5df49f08ef4b15635754b71 HTTP/1.1" status: 200 len: 375 time: 0.0672526 May 25 16:58:16.720032 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3832070'] for port, before_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:16.748749 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-16ba5b9e-d782-4dc5-be96-13fae85a7c29 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:16.754363 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.db [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] For port 37da5a3a-087e-4df7-9900-7e680c1f0064, host dv-cinder-790492-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-790492-4-iscsi',level=0,port_id=37da5a3a-087e-4df7-9900-7e680c1f0064,segment=NetworkSegment(414a8468-1d66-4792-9e81-d8ac5ccf1512),segment_id=414a8468-1d66-4792-9e81-d8ac5ccf1512)] {{(pid=91831) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 16:58:16.761638 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8757892955028', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8757892520933', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8757892521750'] for port, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:16.773583 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:58:16.782756 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-1f40d34a-0eb9-4d60-b5b9-5a06e965a5fa req-eb7862e5-e512-4d0b-bab5-3ce67551ac8c tempest-DeleteServersTestJSON-1172980508 tempest-DeleteServersTestJSON-1172980508-project] 10.222.0.62 "GET /v2.0/ports?tenant_id=00ab1bb5f5df49f08ef4b15635754b71&fields=id HTTP/1.1" status: 200 len: 210 time: 0.1042995 May 25 16:58:16.905513 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Pushing event updated for resources: {'Port': ['ID=37da5a3a-087e-4df7-9900-7e680c1f0064,revision_number=4']} {{(pid=91831) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:58:16.913370 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-7ec1684d-62ff-4996-850a-92981776b4d1 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:16.920535 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91831) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:58:16.923152 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91831) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:58:16.923585 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91831) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:58:16.923928 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91831) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:58:16.924269 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91831) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:58:16.926082 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91831) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:58:16.926424 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91831) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:58:16.926777 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91831) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:58:16.927271 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91831) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:58:16.927581 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91831) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:58:16.928484 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91831) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:58:16.929030 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91831) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:58:16.933727 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Tracked resource versions report: May 25 16:58:16.933727 dv-cinder-790492-4-iscsi neutron-server[91831]: pushed versions: May 25 16:58:16.933727 dv-cinder-790492-4-iscsi neutron-server[91831]: { 'AddressGroup': {'1.2'}, May 25 16:58:16.933727 dv-cinder-790492-4-iscsi neutron-server[91831]: 'ConntrackHelper': {'1.0'}, May 25 16:58:16.933727 dv-cinder-790492-4-iscsi neutron-server[91831]: 'Log': {'1.0'}, May 25 16:58:16.933727 dv-cinder-790492-4-iscsi neutron-server[91831]: 'Network': {'1.1'}, May 25 16:58:16.933727 dv-cinder-790492-4-iscsi neutron-server[91831]: 'Port': {'1.7'}, May 25 16:58:16.933727 dv-cinder-790492-4-iscsi neutron-server[91831]: 'PortForwarding': {'1.2'}, May 25 16:58:16.933727 dv-cinder-790492-4-iscsi neutron-server[91831]: 'QosPolicy': {'1.8'}, May 25 16:58:16.933727 dv-cinder-790492-4-iscsi neutron-server[91831]: 'SecurityGroup': {'1.4'}, May 25 16:58:16.933727 dv-cinder-790492-4-iscsi neutron-server[91831]: 'SecurityGroupRule': {'1.2'}, May 25 16:58:16.933727 dv-cinder-790492-4-iscsi neutron-server[91831]: 'SubPort': {'1.0'}, May 25 16:58:16.933727 dv-cinder-790492-4-iscsi neutron-server[91831]: 'Subnet': {'1.1'}, May 25 16:58:16.933727 dv-cinder-790492-4-iscsi neutron-server[91831]: 'Trunk': {'1.1'}} May 25 16:58:16.933727 dv-cinder-790492-4-iscsi neutron-server[91831]: consumer versions: May 25 16:58:16.933727 dv-cinder-790492-4-iscsi neutron-server[91831]: { DHCP agent@dv-cinder-790492-4-iscsi: {}, May 25 16:58:16.933727 dv-cinder-790492-4-iscsi neutron-server[91831]: HyperV agent@hv-cinder-79049: {}, May 25 16:58:16.933727 dv-cinder-790492-4-iscsi neutron-server[91831]: L3 agent@dv-cinder-790492-4-iscsi: {}, May 25 16:58:16.933727 dv-cinder-790492-4-iscsi neutron-server[91831]: Metadata agent@dv-cinder-790492-4-iscsi: {}, May 25 16:58:16.933727 dv-cinder-790492-4-iscsi neutron-server[91831]: Metering agent@dv-cinder-790492-4-iscsi: {}, May 25 16:58:16.933727 dv-cinder-790492-4-iscsi neutron-server[91831]: Open vSwitch agent@dv-cinder-790492-4-iscsi: { 'AddressGroup': '1.2', May 25 16:58:16.933727 dv-cinder-790492-4-iscsi neutron-server[91831]: 'ConntrackHelper': '1.0', May 25 16:58:16.933727 dv-cinder-790492-4-iscsi neutron-server[91831]: 'Log': '1.0', May 25 16:58:16.933727 dv-cinder-790492-4-iscsi neutron-server[91831]: 'Network': '1.1', May 25 16:58:16.933727 dv-cinder-790492-4-iscsi neutron-server[91831]: 'Port': '1.7', May 25 16:58:16.933727 dv-cinder-790492-4-iscsi neutron-server[91831]: 'PortForwarding': '1.2', May 25 16:58:16.933727 dv-cinder-790492-4-iscsi neutron-server[91831]: 'QosPolicy': '1.8', May 25 16:58:16.933727 dv-cinder-790492-4-iscsi neutron-server[91831]: 'SecurityGroup': '1.4', May 25 16:58:16.933727 dv-cinder-790492-4-iscsi neutron-server[91831]: 'SecurityGroupRule': '1.2', May 25 16:58:16.933727 dv-cinder-790492-4-iscsi neutron-server[91831]: 'SubPort': '1.0', May 25 16:58:16.933727 dv-cinder-790492-4-iscsi neutron-server[91831]: 'Subnet': '1.1', May 25 16:58:16.933727 dv-cinder-790492-4-iscsi neutron-server[91831]: 'Trunk': '1.1'}} May 25 16:58:16.933727 dv-cinder-790492-4-iscsi neutron-server[91831]: {{(pid=91831) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} May 25 16:58:16.962920 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.192s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:58:16.977947 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-16ba5b9e-d782-4dc5-be96-13fae85a7c29 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-640836'] for security_group, after_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:16.980612 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-7ec1684d-62ff-4996-850a-92981776b4d1 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-640836'] for security_group, after_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:16.986966 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:58:16.994836 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-0c33b2c5-6ae5-4569-a433-e17f5696809c admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:58:16.996260 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-1f40d34a-0eb9-4d60-b5b9-5a06e965a5fa req-56c2471d-2edb-477c-96fc-896d38299110 service neutron] 10.222.0.62 "GET /v2.0/networks/ca95b136-0269-430f-b450-69ee5473ae7d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2127187 May 25 16:58:17.001204 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-16ba5b9e-d782-4dc5-be96-13fae85a7c29 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=6255f0ae-78ba-4916-a3f5-7916aa534eb3,revision_number=None']} {{(pid=91829) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:58:17.029178 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-16ba5b9e-d782-4dc5-be96-13fae85a7c29 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.042s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:58:17.032355 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-16ba5b9e-d782-4dc5-be96-13fae85a7c29 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:17.033796 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [None req-16ba5b9e-d782-4dc5-be96-13fae85a7c29 admin admin] 10.222.0.62 "DELETE /v2.0/security-groups/6255f0ae-78ba-4916-a3f5-7916aa534eb3 HTTP/1.1" status: 204 len: 168 time: 0.6521773 May 25 16:58:17.042545 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-950b4827-a709-43f5-a23c-fd8d66e4811a admin admin] Notify callbacks [] for port, precommit_update {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:17.064033 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-950b4827-a709-43f5-a23c-fd8d66e4811a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8757892955028', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8757892520933', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8757892521750'] for port, after_update {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:17.068526 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [None req-7ec1684d-62ff-4996-850a-92981776b4d1 admin admin] 10.222.0.62 "GET /v2.0/security-groups?tenant_id=e67b65d159aa4f3cad19881fb4bc5f1a&name=default HTTP/1.1" status: 200 len: 2975 time: 1.0173430 May 25 16:58:17.069686 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-950b4827-a709-43f5-a23c-fd8d66e4811a admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-549138', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-679997'] for router_interface, after_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:17.074125 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7ec1684d-62ff-4996-850a-92981776b4d1 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=1911ab1e-78c9-4b71-ac2e-c5d95e0c72b6,revision_number=1']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:58:17.078518 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.wsgi [-] (91830) accepted ('10.222.0.62', 54402) {{(pid=91830) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:58:17.081838 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-7ec1684d-62ff-4996-850a-92981776b4d1 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.086s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:58:17.085187 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.006s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:58:17.156705 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-1f40d34a-0eb9-4d60-b5b9-5a06e965a5fa req-34b8346c-c337-403e-8b67-61ebba1abc49 service neutron] 10.222.0.62 "GET /v2.0/networks/ca95b136-0269-430f-b450-69ee5473ae7d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1525643 May 25 16:58:17.261422 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-950b4827-a709-43f5-a23c-fd8d66e4811a admin admin] Pushing event updated for resources: {'Port': ['ID=c201e735-51e1-4301-a2d9-d3c9ffbbd910,revision_number=2']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:58:17.284813 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-950b4827-a709-43f5-a23c-fd8d66e4811a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.200s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:58:17.365835 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-bb3ddb95-ab7e-4af7-86c0-e473777713ed admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:17.367519 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-fe6fdd73-2476-47a8-a52a-9a154a30eedb req-5d554e1e-24d4-4b0e-a4f3-0bf3f99f044c tempest-DeleteServersTestJSON-1172980508 tempest-DeleteServersTestJSON-1172980508-project] 10.222.0.62 "GET /v2.0/ports?device_id=1d5af5b3-8d0b-4cf9-a7f1-ce49a30efc33 HTTP/1.1" status: 200 len: 210 time: 0.0536182 May 25 16:58:17.444421 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-950b4827-a709-43f5-a23c-fd8d66e4811a admin admin] Network 55a46372-d583-4435-a0f6-b9397668217d is already hosted by enough agents. {{(pid=91830) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 25 16:58:17.450188 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.scheduler.base_scheduler [None req-950b4827-a709-43f5-a23c-fd8d66e4811a admin admin] Resources bound (agent type, host, resource id): {{(pid=91830) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 16:58:17.531798 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-bb3ddb95-ab7e-4af7-86c0-e473777713ed admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:17.573293 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-b914d378-e633-47a1-9ae1-cf2386d4e4bd admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55886', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411'] for subnet, after_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:17.615013 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-2bb9ba87-0e92-4d58-931f-57e79ccee942 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:58:17.617860 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-538f6490-2d1e-49aa-b81a-77b384a1dc90 req-b9379040-1672-46cb-95c3-4623a6dbad03 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] 10.222.0.62 "GET /v2.0/ports?device_id=bca36110-0b4f-419a-92ef-46cbb9d6215e HTTP/1.1" status: 200 len: 210 time: 0.0503466 May 25 16:58:17.861791 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b914d378-e633-47a1-9ae1-cf2386d4e4bd admin admin] Pushing event updated for resources: {'Subnet': ['ID=14874ba5-11c2-49e1-8498-d5433e305c90,revision_number=0']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:58:17.862618 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-b914d378-e633-47a1-9ae1-cf2386d4e4bd admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.248s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:58:17.875557 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b914d378-e633-47a1-9ae1-cf2386d4e4bd admin admin] Checking segment: {'id': '3e8beb4d-db01-4975-9049-1762d1db1921', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 671, 'network_id': '6545658b-b670-4918-9a90-4574c32bc70a'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91830) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 25 16:58:17.876099 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b914d378-e633-47a1-9ae1-cf2386d4e4bd admin admin] Network hostable DHCP agents. Network: 6545658b-b670-4918-9a90-4574c32bc70a, hostable agents: ['8d7401c6-8951-4f2b-ace4-208761782bfc'], hosted agents: [] {{(pid=91830) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 25 16:58:17.885239 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-950b4827-a709-43f5-a23c-fd8d66e4811a admin admin] Router 84b3a1b2-10cf-465f-ae5c-ffc9b189ed05 has already been hosted by L3 agent a2d427c1-2d07-43e8-afbe-218c9f7d0445 {{(pid=91830) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 25 16:58:17.893941 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-bb3ddb95-ab7e-4af7-86c0-e473777713ed admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-640836'] for security_group, after_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:17.903338 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:58:17.970873 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bb3ddb95-ab7e-4af7-86c0-e473777713ed admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=1911ab1e-78c9-4b71-ac2e-c5d95e0c72b6,revision_number=None']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:58:17.972741 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-bb3ddb95-ab7e-4af7-86c0-e473777713ed admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.069s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:58:18.004487 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b914d378-e633-47a1-9ae1-cf2386d4e4bd admin admin] Network 6545658b-b670-4918-9a90-4574c32bc70a is scheduled to be hosted by DHCP agent 8d7401c6-8951-4f2b-ace4-208761782bfc with binding_index 1 {{(pid=91830) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 25 16:58:18.043410 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.scheduler.base_scheduler [None req-b914d378-e633-47a1-9ae1-cf2386d4e4bd admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-790492-4-iscsi, 6545658b-b670-4918-9a90-4574c32bc70a) {{(pid=91830) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 16:58:18.056573 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f7c50b59-a201-4501-bdef-419d0572e011 None None] Network 6545658b-b670-4918-9a90-4574c32bc70a requested from dv-cinder-790492-4-iscsi {{(pid=91831) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} May 25 16:58:18.058777 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b914d378-e633-47a1-9ae1-cf2386d4e4bd admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=91830) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:58:18.059549 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-b914d378-e633-47a1-9ae1-cf2386d4e4bd admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-551373'] for subnet, before_response {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:18.146192 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.rpc [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Device 37da5a3a-087e-4df7-9900-7e680c1f0064 up at agent ovs-agent-dv-cinder-790492-4-iscsi {{(pid=91831) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 25 16:58:18.147836 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-bb3ddb95-ab7e-4af7-86c0-e473777713ed admin admin] Notify callbacks [] for security_group, before_response {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:18.149322 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [None req-bb3ddb95-ab7e-4af7-86c0-e473777713ed admin admin] 10.222.0.62 "DELETE /v2.0/security-groups/1911ab1e-78c9-4b71-ac2e-c5d95e0c72b6 HTTP/1.1" status: 204 len: 168 time: 1.0696723 May 25 16:58:18.168763 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [None req-b914d378-e633-47a1-9ae1-cf2386d4e4bd admin admin] 10.222.0.62 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 861 time: 2.2772222 May 25 16:58:18.220397 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-950b4827-a709-43f5-a23c-fd8d66e4811a admin admin] Notify agent at l3_agent.dv-cinder-790492-4-iscsi the message routers_updated {{(pid=91830) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 25 16:58:18.236890 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-58584784-e7c6-45a7-8619-25de8752ad42 None None] Sync routers for ids ['84b3a1b2-10cf-465f-ae5c-ffc9b189ed05'] in dv-cinder-790492-4-iscsi {{(pid=91831) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 25 16:58:18.245840 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [None req-950b4827-a709-43f5-a23c-fd8d66e4811a admin admin] 10.222.0.62 "PUT /v2.0/routers/84b3a1b2-10cf-465f-ae5c-ffc9b189ed05/add_router_interface HTTP/1.1" status: 200 len: 503 time: 5.8812394 May 25 16:58:18.290082 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.l3_dvrscheduler_db [None req-58584784-e7c6-45a7-8619-25de8752ad42 None None] Routers {'84b3a1b2-10cf-465f-ae5c-ffc9b189ed05'} bound to L3 agent in host dv-cinder-790492-4-iscsi {{(pid=91831) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 16:58:18.290706 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.l3_hamode_db [None req-58584784-e7c6-45a7-8619-25de8752ad42 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-790492-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-05-25T16:50:28Z,description=,heartbeat_timestamp=2021-05-25T16:57:58Z,host='dv-cinder-790492-4-iscsi',id=a2d427c1-2d07-43e8-afbe-218c9f7d0445,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T16:50:28Z,topic='l3_agent')) {'router_ids': ['84b3a1b2-10cf-465f-ae5c-ffc9b189ed05'], 'active': True} {{(pid=91831) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 16:58:18.430072 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.provisioning_blocks [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Provisioning complete for port 37da5a3a-087e-4df7-9900-7e680c1f0064 triggered by entity L2. {{(pid=91831) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 16:58:18.430474 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3854128'] for port, provisioning_complete {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:18.439348 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.wsgi [-] (91830) accepted ('10.222.0.62', 54482) {{(pid=91830) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:58:18.544049 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-49cae00a-bfa4-4edc-96f2-43b9a210c389 req-5eb1cd4e-b00e-4098-b12e-199ed4852558 tempest-DeleteServersTestJSON-1172980508 tempest-DeleteServersTestJSON-1172980508-project] 10.222.0.62 "GET /v2.0/ports?device_id=1d5af5b3-8d0b-4cf9-a7f1-ce49a30efc33 HTTP/1.1" status: 200 len: 210 time: 0.0572715 May 25 16:58:18.577258 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.db_base_plugin_v2 [None req-1314f22c-dc18-4c55-8b5e-fa3d414f7282 admin admin] Deleting subnet 05557e0e-b248-41c2-be98-1e8558f4e2cd {{(pid=91830) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}} May 25 16:58:18.581434 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-1314f22c-dc18-4c55-8b5e-fa3d414f7282 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:18.590388 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-71c07257-811f-413f-bcb5-4937076f94ac None None] Network 6545658b-b670-4918-9a90-4574c32bc70a requested from dv-cinder-790492-4-iscsi {{(pid=91831) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} May 25 16:58:18.642168 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-1314f22c-dc18-4c55-8b5e-fa3d414f7282 admin admin] Notify callbacks [] for subnet, precommit_delete_associations {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:18.650823 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-1314f22c-dc18-4c55-8b5e-fa3d414f7282 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3856586'] for subnet, precommit_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:18.820850 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.l3_dvr_db [None req-58584784-e7c6-45a7-8619-25de8752ad42 None None] Set router 84b3a1b2-10cf-465f-ae5c-ffc9b189ed05 gateway port host: dv-cinder-790492-4-iscsi {{(pid=91831) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 16:58:18.954164 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-9e2bfebb-dc20-4a30-ac92-4247934ca9c2 req-115a9716-43c0-4f86-9e86-4f9fe9447519 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] 10.222.0.62 "GET /v2.0/ports?device_id=bca36110-0b4f-419a-92ef-46cbb9d6215e HTTP/1.1" status: 200 len: 210 time: 0.0833082 May 25 16:58:18.965660 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-1314f22c-dc18-4c55-8b5e-fa3d414f7282 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3857535', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55886', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411'] for subnet, after_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:18.972570 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:58:19.037389 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1314f22c-dc18-4c55-8b5e-fa3d414f7282 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=05557e0e-b248-41c2-be98-1e8558f4e2cd,revision_number=None']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:58:19.053725 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-1314f22c-dc18-4c55-8b5e-fa3d414f7282 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.082s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:58:19.083295 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-1314f22c-dc18-4c55-8b5e-fa3d414f7282 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-551373'] for subnet, before_response {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:19.097261 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.wsgi [-] (91829) accepted ('10.222.0.62', 54514) {{(pid=91829) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:58:19.110564 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [None req-1314f22c-dc18-4c55-8b5e-fa3d414f7282 admin admin] 10.222.0.62 "DELETE /v2.0/subnets/05557e0e-b248-41c2-be98-1e8558f4e2cd HTTP/1.1" status: 204 len: 168 time: 0.6701436 May 25 16:58:19.479185 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-65c292ee-e1f6-497e-9ac0-0015f66543cd admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3867326'] for network, before_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:19.491905 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1fc04329-def7-4f7c-bbd6-df77c33e33b6 req-ee756201-49d2-49a0-900f-81a9f09c713e tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:58:19.492634 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.quota.resource [req-1fc04329-def7-4f7c-bbd6-df77c33e33b6 req-ee756201-49d2-49a0-900f-81a9f09c713e tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] Synchronizing usage tracker for tenant:734df673f8b3484d80f35a45fbce9d5e on resource:network {{(pid=91829) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 25 16:58:19.553303 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.quota.resource [req-1fc04329-def7-4f7c-bbd6-df77c33e33b6 req-ee756201-49d2-49a0-900f-81a9f09c713e tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] Unset dirty status for tenant:734df673f8b3484d80f35a45fbce9d5e on resource:network {{(pid=91829) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 25 16:58:19.562704 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-1fc04329-def7-4f7c-bbd6-df77c33e33b6 req-ee756201-49d2-49a0-900f-81a9f09c713e tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/networks?id=55a46372-d583-4435-a0f6-b9397668217d HTTP/1.1" status: 200 len: 818 time: 0.2663603 May 25 16:58:19.729013 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-1fc04329-def7-4f7c-bbd6-df77c33e33b6 req-005194ec-5bd5-4d2f-aaea-0c32904f2861 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/quotas/734df673f8b3484d80f35a45fbce9d5e HTTP/1.1" status: 200 len: 375 time: 0.1654136 May 25 16:58:19.772445 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.l3_hamode_db [None req-58584784-e7c6-45a7-8619-25de8752ad42 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '84b3a1b2-10cf-465f-ae5c-ffc9b189ed05', 'name': 'tempest-ServerRescueNegativeTestJSON-116675553-router', 'tenant_id': '734df673f8b3484d80f35a45fbce9d5e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'external_fixed_ips': [{'subnet_id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'ip_address': '172.27.2.115'}], 'enable_snat': True}, 'gw_port_id': '37da5a3a-087e-4df7-9900-7e680c1f0064', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T16:58:08Z', 'updated_at': '2021-05-25T16:58:16Z', 'revision_number': 4, 'project_id': '734df673f8b3484d80f35a45fbce9d5e', 'gw_port': {'id': '37da5a3a-087e-4df7-9900-7e680c1f0064', 'name': '', 'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'tenant_id': '', 'mac_address': 'fa:16:3e:1e:d4:9c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '84b3a1b2-10cf-465f-ae5c-ffc9b189ed05', 'device_owner': 'network:router_gateway', 'standard_attr_id': 40, 'fixed_ips': [{'subnet_id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'ip_address': '172.27.2.115', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790492-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:58:09Z', 'updated_at': '2021-05-25T16:58:16Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-790492-4-iscsi', '_interfaces': [{'id': 'c201e735-51e1-4301-a2d9-d3c9ffbbd910', 'name': '', 'network_id': '55a46372-d583-4435-a0f6-b9397668217d', 'tenant_id': '734df673f8b3484d80f35a45fbce9d5e', 'mac_address': 'fa:16:3e:3c:b9:6c', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '84b3a1b2-10cf-465f-ae5c-ffc9b189ed05', 'device_owner': 'network:router_interface', 'standard_attr_id': 70, 'fixed_ips': [{'subnet_id': '927bd65a-c4de-491b-b501-302852f4c784', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:58:14Z', 'updated_at': '2021-05-25T16:58:16Z', 'revision_number': 2, 'project_id': '734df673f8b3484d80f35a45fbce9d5e', 'subnets': [{'id': '927bd65a-c4de-491b-b501-302852f4c784', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-790492-4-iscsi', False) {} {{(pid=91831) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 16:58:19.777898 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-58584784-e7c6-45a7-8619-25de8752ad42 None None] Checking router: 84b3a1b2-10cf-465f-ae5c-ffc9b189ed05 for host: dv-cinder-790492-4-iscsi {{(pid=91831) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 25 16:58:19.778882 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-58584784-e7c6-45a7-8619-25de8752ad42 None None] Updating router 84b3a1b2-10cf-465f-ae5c-ffc9b189ed05 port c201e735-51e1-4301-a2d9-d3c9ffbbd910 binding host dv-cinder-790492-4-iscsi {{(pid=91831) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} May 25 16:58:19.862956 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-65c292ee-e1f6-497e-9ac0-0015f66543cd admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3858245', 'neutron.services.segments.db._delete_segments_for_network-8757892982492'] for network, precommit_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:19.867660 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-58584784-e7c6-45a7-8619-25de8752ad42 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3832070'] for port, before_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:19.902108 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-c8450650-2199-4913-b405-e3c654fc1d46 req-a9b890f7-cc88-4038-bf48-6827ce404922 tempest-DeleteServersTestJSON-1172980508 tempest-DeleteServersTestJSON-1172980508-project] 10.222.0.62 "GET /v2.0/ports?device_id=1d5af5b3-8d0b-4cf9-a7f1-ce49a30efc33 HTTP/1.1" status: 200 len: 210 time: 0.1041377 May 25 16:58:19.906747 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-65c292ee-e1f6-497e-9ac0-0015f66543cd admin admin] Subscribe: > segment before_delete 55550000 {{(pid=91829) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 16:58:19.907012 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-65c292ee-e1f6-497e-9ac0-0015f66543cd admin admin] Subscribe: > subnet precommit_delete_associations 55550000 {{(pid=91829) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 16:58:19.907757 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-65c292ee-e1f6-497e-9ac0-0015f66543cd admin admin] Subscribe: > segment_host_mapping after_create 55550000 {{(pid=91829) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 16:58:19.908108 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-65c292ee-e1f6-497e-9ac0-0015f66543cd admin admin] Subscribe: > port after_create 55550000 {{(pid=91829) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 16:58:19.908448 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-65c292ee-e1f6-497e-9ac0-0015f66543cd admin admin] Subscribe: > port after_delete 55550000 {{(pid=91829) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 16:58:19.908804 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-65c292ee-e1f6-497e-9ac0-0015f66543cd admin admin] Subscribe: > port after_update 55550000 {{(pid=91829) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 16:58:19.909124 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-65c292ee-e1f6-497e-9ac0-0015f66543cd admin admin] Subscribe: > segment after_delete 55550000 {{(pid=91829) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 16:58:19.909443 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-65c292ee-e1f6-497e-9ac0-0015f66543cd admin admin] Subscribe: > subnet after_create 55550000 {{(pid=91829) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 16:58:19.909758 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-65c292ee-e1f6-497e-9ac0-0015f66543cd admin admin] Subscribe: > subnet after_delete 55550000 {{(pid=91829) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 16:58:19.910273 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-65c292ee-e1f6-497e-9ac0-0015f66543cd admin admin] Subscribe: > subnet after_update 55550000 {{(pid=91829) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 16:58:20.082053 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-65c292ee-e1f6-497e-9ac0-0015f66543cd admin admin] Subscribe: > subnet after_create 55550000 {{(pid=91829) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 16:58:20.082417 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-65c292ee-e1f6-497e-9ac0-0015f66543cd admin admin] Subscribe: > subnet after_delete 55550000 {{(pid=91829) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 16:58:20.083577 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-65c292ee-e1f6-497e-9ac0-0015f66543cd admin admin] Subscribe: > subnet before_create 55550000 {{(pid=91829) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 16:58:20.084070 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-65c292ee-e1f6-497e-9ac0-0015f66543cd admin admin] Subscribe: > subnet before_update 55550000 {{(pid=91829) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 16:58:20.084634 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.services.segments.db [None req-65c292ee-e1f6-497e-9ac0-0015f66543cd admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['c5a5a647-3069-401d-8a5f-11a0c258615c']}} {{(pid=91829) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 16:58:20.105598 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.services.segments.db [None req-65c292ee-e1f6-497e-9ac0-0015f66543cd admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '9d9bb4c2-7532-4af6-9ccc-e15b90feb851') {'for_net_delete': True} {{(pid=91829) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 16:58:20.105898 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.services.segments.db [None req-65c292ee-e1f6-497e-9ac0-0015f66543cd admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '9d9bb4c2-7532-4af6-9ccc-e15b90feb851') {} {{(pid=91829) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 16:58:20.212098 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.wsgi [-] (91830) accepted ('10.222.0.32', 55649) {{(pid=91830) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:58:20.217475 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-65c292ee-e1f6-497e-9ac0-0015f66543cd admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8757892991389', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-28283199'] for segment, before_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:20.242779 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-8fe92fa1-3c93-47a2-a6b7-c7967439db13 req-5a047f14-f7e4-4a36-830d-f4566c01ac17 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] 10.222.0.62 "GET /v2.0/ports?device_id=bca36110-0b4f-419a-92ef-46cbb9d6215e HTTP/1.1" status: 200 len: 210 time: 0.0686967 May 25 16:58:20.251688 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-65c292ee-e1f6-497e-9ac0-0015f66543cd admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3809789'] for segment, precommit_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:20.279393 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-65c292ee-e1f6-497e-9ac0-0015f66543cd admin admin] Releasing vlan 678 on physical network physnet1 to pool {{(pid=91829) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 25 16:58:20.279906 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-65c292ee-e1f6-497e-9ac0-0015f66543cd admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3809789', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-28230861'] for segment, after_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:20.301721 dv-cinder-790492-4-iscsi neutron-server[91829]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 25 16:58:20.301721 dv-cinder-790492-4-iscsi neutron-server[91829]: from cryptography.utils import int_from_bytes May 25 16:58:20.301721 dv-cinder-790492-4-iscsi neutron-server[91829]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 25 16:58:20.301721 dv-cinder-790492-4-iscsi neutron-server[91829]: from cryptography.utils import int_from_bytes May 25 16:58:20.301721 dv-cinder-790492-4-iscsi neutron-server[91829]: Traceback (most recent call last): May 25 16:58:20.301721 dv-cinder-790492-4-iscsi neutron-server[91829]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 25 16:58:20.301721 dv-cinder-790492-4-iscsi neutron-server[91829]: timer() May 25 16:58:20.301721 dv-cinder-790492-4-iscsi neutron-server[91829]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 25 16:58:20.301721 dv-cinder-790492-4-iscsi neutron-server[91829]: cb(*args, **kw) May 25 16:58:20.301721 dv-cinder-790492-4-iscsi neutron-server[91829]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper May 25 16:58:20.301721 dv-cinder-790492-4-iscsi neutron-server[91829]: return func(*args, **kwargs) May 25 16:58:20.301721 dv-cinder-790492-4-iscsi neutron-server[91829]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 25 16:58:20.301721 dv-cinder-790492-4-iscsi neutron-server[91829]: self._notify() May 25 16:58:20.301721 dv-cinder-790492-4-iscsi neutron-server[91829]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 25 16:58:20.301721 dv-cinder-790492-4-iscsi neutron-server[91829]: self.callback(batched_events) May 25 16:58:20.301721 dv-cinder-790492-4-iscsi neutron-server[91829]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 25 16:58:20.301721 dv-cinder-790492-4-iscsi neutron-server[91829]: event.method(event) May 25 16:58:20.301721 dv-cinder-790492-4-iscsi neutron-server[91829]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 25 16:58:20.301721 dv-cinder-790492-4-iscsi neutron-server[91829]: aggregate_id = self._get_aggregate_id(event.segment_id) May 25 16:58:20.301721 dv-cinder-790492-4-iscsi neutron-server[91829]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 25 16:58:20.301721 dv-cinder-790492-4-iscsi neutron-server[91829]: aggregate_uuid = self.p_client.list_aggregates( May 25 16:58:20.301721 dv-cinder-790492-4-iscsi neutron-server[91829]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 25 16:58:20.301721 dv-cinder-790492-4-iscsi neutron-server[91829]: return f(self, *a, **k) May 25 16:58:20.301721 dv-cinder-790492-4-iscsi neutron-server[91829]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 25 16:58:20.301721 dv-cinder-790492-4-iscsi neutron-server[91829]: return self._get(url).json() May 25 16:58:20.301721 dv-cinder-790492-4-iscsi neutron-server[91829]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 25 16:58:20.301721 dv-cinder-790492-4-iscsi neutron-server[91829]: return self._client.get(url, endpoint_filter=self._ks_filter, May 25 16:58:20.301721 dv-cinder-790492-4-iscsi neutron-server[91829]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 25 16:58:20.301721 dv-cinder-790492-4-iscsi neutron-server[91829]: return self.request(url, 'GET', **kwargs) May 25 16:58:20.301721 dv-cinder-790492-4-iscsi neutron-server[91829]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 25 16:58:20.301721 dv-cinder-790492-4-iscsi neutron-server[91829]: base_url = self.get_endpoint(auth, allow=allow, May 25 16:58:20.301721 dv-cinder-790492-4-iscsi neutron-server[91829]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 25 16:58:20.301721 dv-cinder-790492-4-iscsi neutron-server[91829]: auth = self._auth_required(auth, 'determine endpoint URL') May 25 16:58:20.301721 dv-cinder-790492-4-iscsi neutron-server[91829]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 25 16:58:20.301721 dv-cinder-790492-4-iscsi neutron-server[91829]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 25 16:58:20.301721 dv-cinder-790492-4-iscsi neutron-server[91829]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 25 16:58:20.317040 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-1fc04329-def7-4f7c-bbd6-df77c33e33b6 req-f172288f-d42a-427f-87a4-2e54c6f61266 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/ports?tenant_id=734df673f8b3484d80f35a45fbce9d5e&fields=id HTTP/1.1" status: 200 len: 255 time: 0.5685105 May 25 16:58:20.474963 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-58584784-e7c6-45a7-8619-25de8752ad42 None None] Notify callbacks [] for port, precommit_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:20.491855 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.provisioning_blocks [None req-58584784-e7c6-45a7-8619-25de8752ad42 None None] Transition to ACTIVE for port object c201e735-51e1-4301-a2d9-d3c9ffbbd910 will not be triggered until provisioned by entity L2. {{(pid=91831) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 25 16:58:20.503173 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-58584784-e7c6-45a7-8619-25de8752ad42 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8757892955028', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8757892520933', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8757892521750'] for port, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:20.513506 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-65c292ee-e1f6-497e-9ac0-0015f66543cd admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3858252', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-640806', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-551400', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-683051'] for network, after_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:20.514793 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:58:20.533297 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:58:20.579077 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-65c292ee-e1f6-497e-9ac0-0015f66543cd admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-551373'] for network, before_response {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:20.585417 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-65c292ee-e1f6-497e-9ac0-0015f66543cd admin admin] Pushing event deleted for resources: {'Network': ['ID=c5a5a647-3069-401d-8a5f-11a0c258615c,revision_number=None']} {{(pid=91829) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:58:20.602480 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-65c292ee-e1f6-497e-9ac0-0015f66543cd admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.069s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:58:20.625518 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [None req-65c292ee-e1f6-497e-9ac0-0015f66543cd admin admin] 10.222.0.62 "DELETE /v2.0/networks/c5a5a647-3069-401d-8a5f-11a0c258615c HTTP/1.1" status: 204 len: 168 time: 1.5259540 May 25 16:58:20.627406 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.wsgi [-] (91830) accepted ('10.222.0.62', 54572) {{(pid=91830) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:58:20.689380 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1f40d34a-0eb9-4d60-b5b9-5a06e965a5fa req-a165690d-5742-46e6-84d5-90000fe66aae tempest-DeleteServersTestJSON-1172980508 tempest-DeleteServersTestJSON-1172980508-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=91830) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:58:20.692948 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [req-1f40d34a-0eb9-4d60-b5b9-5a06e965a5fa req-a165690d-5742-46e6-84d5-90000fe66aae tempest-DeleteServersTestJSON-1172980508 tempest-DeleteServersTestJSON-1172980508-project] Synchronizing usage tracker for tenant:00ab1bb5f5df49f08ef4b15635754b71 on resource:network {{(pid=91830) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 25 16:58:20.695944 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-1fc04329-def7-4f7c-bbd6-df77c33e33b6 req-915af99e-4e0e-4a21-ab99-55079061c4fc service neutron] 10.222.0.62 "GET /v2.0/networks/55a46372-d583-4435-a0f6-b9397668217d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3778231 May 25 16:58:20.731244 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0807fb8f-5b83-4d56-9158-4cca2c2c8edc None None] Pushing event updated for resources: {'Port': ['ID=c201e735-51e1-4301-a2d9-d3c9ffbbd910,revision_number=3']} {{(pid=91831) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:58:20.740144 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [None req-0807fb8f-5b83-4d56-9158-4cca2c2c8edc None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.225s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:58:20.855588 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.managers [None req-58584784-e7c6-45a7-8619-25de8752ad42 None None] Attempting to bind port c201e735-51e1-4301-a2d9-d3c9ffbbd910 on host dv-cinder-790492-4-iscsi for vnic_type normal with profile {{(pid=91831) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 25 16:58:20.856303 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.managers [None req-58584784-e7c6-45a7-8619-25de8752ad42 None None] Attempting to bind port c201e735-51e1-4301-a2d9-d3c9ffbbd910 by drivers openvswitch,hyperv on host dv-cinder-790492-4-iscsi at level 0 using segments [{'id': 'f672477b-47fb-432c-acc9-dc57201d80de', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 697, 'network_id': '55a46372-d583-4435-a0f6-b9397668217d'}] {{(pid=91831) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 25 16:58:20.856303 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-58584784-e7c6-45a7-8619-25de8752ad42 None None] Attempting to bind port c201e735-51e1-4301-a2d9-d3c9ffbbd910 on network 55a46372-d583-4435-a0f6-b9397668217d {{(pid=91831) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 25 16:58:20.862577 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.db_base_plugin_v2 [None req-c904d6d3-edc9-48fe-9fc9-b0a8e93d9066 admin admin] Deleting subnet 14874ba5-11c2-49e1-8498-d5433e305c90 {{(pid=91830) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}} May 25 16:58:20.866897 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-58584784-e7c6-45a7-8619-25de8752ad42 None None] Checking agent: {'id': 'fc8251e1-071c-49f7-bc10-1337f1d37d1b', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-790492-4-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 25, 16, 50, 28), 'started_at': datetime.datetime(2021, 5, 25, 16, 50, 58), 'heartbeat_timestamp': datetime.datetime(2021, 5, 25, 16, 57, 58), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-790492-4-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=91831) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 25 16:58:20.867376 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-58584784-e7c6-45a7-8619-25de8752ad42 None None] Checking segment: {'id': 'f672477b-47fb-432c-acc9-dc57201d80de', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 697, 'network_id': '55a46372-d583-4435-a0f6-b9397668217d'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91831) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 25 16:58:20.867672 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-58584784-e7c6-45a7-8619-25de8752ad42 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:20.868112 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-58584784-e7c6-45a7-8619-25de8752ad42 None None] Bound using segment: {'id': 'f672477b-47fb-432c-acc9-dc57201d80de', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 697, 'network_id': '55a46372-d583-4435-a0f6-b9397668217d'} {{(pid=91831) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 25 16:58:20.868542 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.managers [None req-58584784-e7c6-45a7-8619-25de8752ad42 None None] Bound port: c201e735-51e1-4301-a2d9-d3c9ffbbd910, host: dv-cinder-790492-4-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'f672477b-47fb-432c-acc9-dc57201d80de', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 697, 'network_id': '55a46372-d583-4435-a0f6-b9397668217d'}}] {{(pid=91831) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 25 16:58:20.868908 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-58584784-e7c6-45a7-8619-25de8752ad42 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3832070'] for port, before_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:20.908297 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-c904d6d3-edc9-48fe-9fc9-b0a8e93d9066 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:20.968604 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.wsgi [-] (91830) accepted ('10.222.0.32', 55655) {{(pid=91830) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:58:20.969773 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [req-1f40d34a-0eb9-4d60-b5b9-5a06e965a5fa req-a165690d-5742-46e6-84d5-90000fe66aae tempest-DeleteServersTestJSON-1172980508 tempest-DeleteServersTestJSON-1172980508-project] Unset dirty status for tenant:00ab1bb5f5df49f08ef4b15635754b71 on resource:network {{(pid=91830) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 25 16:58:20.971169 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-1f40d34a-0eb9-4d60-b5b9-5a06e965a5fa req-a165690d-5742-46e6-84d5-90000fe66aae tempest-DeleteServersTestJSON-1172980508 tempest-DeleteServersTestJSON-1172980508-project] 10.222.0.32 "GET /v2.0/networks?id=ca95b136-0269-430f-b450-69ee5473ae7d HTTP/1.1" status: 200 len: 811 time: 0.7573907 May 25 16:58:20.996065 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-1fc04329-def7-4f7c-bbd6-df77c33e33b6 req-b26f1f56-ce30-4109-b556-4803e9cdfacd service neutron] 10.222.0.62 "GET /v2.0/networks/55a46372-d583-4435-a0f6-b9397668217d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2942038 May 25 16:58:21.061034 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.v2.base [req-1f40d34a-0eb9-4d60-b5b9-5a06e965a5fa req-f398e8e9-a61a-4bfc-8582-613156d7bda0 tempest-DeleteServersTestJSON-1172980508 tempest-DeleteServersTestJSON-1172980508-project] Request body: {'port': {'device_id': '1d5af5b3-8d0b-4cf9-a7f1-ce49a30efc33', 'network_id': 'ca95b136-0269-430f-b450-69ee5473ae7d', 'admin_state_up': True, 'tenant_id': '00ab1bb5f5df49f08ef4b15635754b71'}} {{(pid=91830) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 16:58:21.065625 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.db [None req-58584784-e7c6-45a7-8619-25de8752ad42 None None] For port c201e735-51e1-4301-a2d9-d3c9ffbbd910, host dv-cinder-790492-4-iscsi, cleared binding levels {{(pid=91831) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 25 16:58:21.076371 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.db [None req-58584784-e7c6-45a7-8619-25de8752ad42 None None] For port c201e735-51e1-4301-a2d9-d3c9ffbbd910, host dv-cinder-790492-4-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-790492-4-iscsi',level=0,port_id=c201e735-51e1-4301-a2d9-d3c9ffbbd910,segment=NetworkSegment(f672477b-47fb-432c-acc9-dc57201d80de),segment_id=f672477b-47fb-432c-acc9-dc57201d80de)] {{(pid=91831) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 25 16:58:21.086188 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-58584784-e7c6-45a7-8619-25de8752ad42 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8757892955028', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8757892520933', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8757892521750'] for port, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:21.101729 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:58:21.284088 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.quota.driver [req-1f40d34a-0eb9-4d60-b5b9-5a06e965a5fa req-f398e8e9-a61a-4bfc-8582-613156d7bda0 tempest-DeleteServersTestJSON-1172980508 tempest-DeleteServersTestJSON-1172980508-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91830) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 16:58:21.288180 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [req-1f40d34a-0eb9-4d60-b5b9-5a06e965a5fa req-f398e8e9-a61a-4bfc-8582-613156d7bda0 tempest-DeleteServersTestJSON-1172980508 tempest-DeleteServersTestJSON-1172980508-project] Usage tracker for resource:port and tenant:00ab1bb5f5df49f08ef4b15635754b71 is out of sync, need to count used quota {{(pid=91830) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 16:58:21.291256 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [req-1f40d34a-0eb9-4d60-b5b9-5a06e965a5fa req-f398e8e9-a61a-4bfc-8582-613156d7bda0 tempest-DeleteServersTestJSON-1172980508 tempest-DeleteServersTestJSON-1172980508-project] Quota usage for port was recalculated. Used quota:0. {{(pid=91830) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 16:58:21.347103 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.quota.driver [req-1f40d34a-0eb9-4d60-b5b9-5a06e965a5fa req-f398e8e9-a61a-4bfc-8582-613156d7bda0 tempest-DeleteServersTestJSON-1172980508 tempest-DeleteServersTestJSON-1172980508-project] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=91830) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 16:58:21.378650 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.l3_dvrscheduler_db [None req-58584784-e7c6-45a7-8619-25de8752ad42 None None] Routers {'84b3a1b2-10cf-465f-ae5c-ffc9b189ed05'} bound to L3 agent in host dv-cinder-790492-4-iscsi {{(pid=91831) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 16:58:21.379293 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.l3_hamode_db [None req-58584784-e7c6-45a7-8619-25de8752ad42 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-790492-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-05-25T16:50:28Z,description=,heartbeat_timestamp=2021-05-25T16:57:58Z,host='dv-cinder-790492-4-iscsi',id=a2d427c1-2d07-43e8-afbe-218c9f7d0445,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T16:50:28Z,topic='l3_agent')) {'router_ids': ['84b3a1b2-10cf-465f-ae5c-ffc9b189ed05'], 'active': True} {{(pid=91831) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 16:58:21.394864 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-c904d6d3-edc9-48fe-9fc9-b0a8e93d9066 admin admin] Notify callbacks [] for subnet, precommit_delete_associations {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:21.423932 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-c904d6d3-edc9-48fe-9fc9-b0a8e93d9066 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3856586'] for subnet, precommit_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:21.541131 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0807fb8f-5b83-4d56-9158-4cca2c2c8edc None None] Pushing event updated for resources: {'Port': ['ID=c201e735-51e1-4301-a2d9-d3c9ffbbd910,revision_number=4']} {{(pid=91831) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:58:21.553383 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [None req-0807fb8f-5b83-4d56-9158-4cca2c2c8edc None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.450s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:58:21.621556 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-e599066e-264f-4339-aa6a-1fc996e182f7 req-d1a807b9-db34-44d5-bd71-36edc1d2173e tempest-DeleteServersTestJSON-1172980508 tempest-DeleteServersTestJSON-1172980508-project] 10.222.0.62 "GET /v2.0/ports?device_id=1d5af5b3-8d0b-4cf9-a7f1-ce49a30efc33 HTTP/1.1" status: 200 len: 210 time: 0.1293964 May 25 16:58:21.623540 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-2f156f5a-afcf-48a1-b6aa-f4446997795b req-a5024958-5f23-462b-bd12-b38d1c6091c4 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/ports?device_id=58da9205-0212-4daa-996c-1eef64a2b702 HTTP/1.1" status: 200 len: 210 time: 0.2225568 May 25 16:58:21.741202 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-1f40d34a-0eb9-4d60-b5b9-5a06e965a5fa req-f398e8e9-a61a-4bfc-8582-613156d7bda0 tempest-DeleteServersTestJSON-1172980508 tempest-DeleteServersTestJSON-1172980508-project] Made reservation on behalf of 00ab1bb5f5df49f08ef4b15635754b71 for: {'port': 1} {{(pid=91830) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 25 16:58:21.753042 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [req-1f40d34a-0eb9-4d60-b5b9-5a06e965a5fa req-f398e8e9-a61a-4bfc-8582-613156d7bda0 tempest-DeleteServersTestJSON-1172980508 tempest-DeleteServersTestJSON-1172980508-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3832070'] for port, before_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:21.802330 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.l3_dvr_db [None req-58584784-e7c6-45a7-8619-25de8752ad42 None None] Set router 84b3a1b2-10cf-465f-ae5c-ffc9b189ed05 gateway port host: dv-cinder-790492-4-iscsi {{(pid=91831) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 16:58:22.044569 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-6b475fda-78e9-443a-a058-7c0138128f75 req-fcb53397-7355-482e-aea4-37bdbcc0fb47 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] 10.222.0.62 "GET /v2.0/ports?device_id=bca36110-0b4f-419a-92ef-46cbb9d6215e HTTP/1.1" status: 200 len: 210 time: 0.1396995 May 25 16:58:22.115013 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-640ac1a9-5581-4f73-9a9e-7ba94abe500f req-c8612856-385c-4b36-83ea-9dcd73c2c6c3 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=91830) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:58:22.134890 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [req-640ac1a9-5581-4f73-9a9e-7ba94abe500f req-c8612856-385c-4b36-83ea-9dcd73c2c6c3 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] Synchronizing usage tracker for tenant:04e8022f24e3464ab1ab7726d6a07e08 on resource:network {{(pid=91830) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 25 16:58:22.264997 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [req-640ac1a9-5581-4f73-9a9e-7ba94abe500f req-c8612856-385c-4b36-83ea-9dcd73c2c6c3 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] Unset dirty status for tenant:04e8022f24e3464ab1ab7726d6a07e08 on resource:network {{(pid=91830) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 25 16:58:22.266448 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-640ac1a9-5581-4f73-9a9e-7ba94abe500f req-c8612856-385c-4b36-83ea-9dcd73c2c6c3 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] 10.222.0.32 "GET /v2.0/networks?id=63b1f335-e2c4-48dd-886b-6be853f8a2fc HTTP/1.1" status: 200 len: 814 time: 1.2943289 May 25 16:58:22.395647 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.l3_hamode_db [None req-58584784-e7c6-45a7-8619-25de8752ad42 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '84b3a1b2-10cf-465f-ae5c-ffc9b189ed05', 'name': 'tempest-ServerRescueNegativeTestJSON-116675553-router', 'tenant_id': '734df673f8b3484d80f35a45fbce9d5e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'external_fixed_ips': [{'subnet_id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'ip_address': '172.27.2.115'}], 'enable_snat': True}, 'gw_port_id': '37da5a3a-087e-4df7-9900-7e680c1f0064', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T16:58:08Z', 'updated_at': '2021-05-25T16:58:16Z', 'revision_number': 4, 'project_id': '734df673f8b3484d80f35a45fbce9d5e', 'gw_port': {'id': '37da5a3a-087e-4df7-9900-7e680c1f0064', 'name': '', 'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'tenant_id': '', 'mac_address': 'fa:16:3e:1e:d4:9c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '84b3a1b2-10cf-465f-ae5c-ffc9b189ed05', 'device_owner': 'network:router_gateway', 'standard_attr_id': 40, 'fixed_ips': [{'subnet_id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'ip_address': '172.27.2.115', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790492-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:58:09Z', 'updated_at': '2021-05-25T16:58:16Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-790492-4-iscsi', '_interfaces': [{'id': 'c201e735-51e1-4301-a2d9-d3c9ffbbd910', 'name': '', 'network_id': '55a46372-d583-4435-a0f6-b9397668217d', 'tenant_id': '734df673f8b3484d80f35a45fbce9d5e', 'mac_address': 'fa:16:3e:3c:b9:6c', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '84b3a1b2-10cf-465f-ae5c-ffc9b189ed05', 'device_owner': 'network:router_interface', 'standard_attr_id': 70, 'fixed_ips': [{'subnet_id': '927bd65a-c4de-491b-b501-302852f4c784', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790492-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:58:14Z', 'updated_at': '2021-05-25T16:58:21Z', 'revision_number': 4, 'project_id': '734df673f8b3484d80f35a45fbce9d5e', 'subnets': [{'id': '927bd65a-c4de-491b-b501-302852f4c784', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-790492-4-iscsi', False) {} {{(pid=91831) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 16:58:22.400552 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-58584784-e7c6-45a7-8619-25de8752ad42 None None] The sync data for ids ['84b3a1b2-10cf-465f-ae5c-ffc9b189ed05'] in dv-cinder-790492-4-iscsi is: [{'id': '84b3a1b2-10cf-465f-ae5c-ffc9b189ed05', 'name': 'tempest-ServerRescueNegativeTestJSON-116675553-router', 'tenant_id': '734df673f8b3484d80f35a45fbce9d5e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'external_fixed_ips': [{'subnet_id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'ip_address': '172.27.2.115'}], 'enable_snat': True}, 'gw_port_id': '37da5a3a-087e-4df7-9900-7e680c1f0064', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T16:58:08Z', 'updated_at': '2021-05-25T16:58:16Z', 'revision_number': 4, 'project_id': '734df673f8b3484d80f35a45fbce9d5e', 'gw_port': {'id': '37da5a3a-087e-4df7-9900-7e680c1f0064', 'name': '', 'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'tenant_id': '', 'mac_address': 'fa:16:3e:1e:d4:9c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '84b3a1b2-10cf-465f-ae5c-ffc9b189ed05', 'device_owner': 'network:router_gateway', 'standard_attr_id': 40, 'fixed_ips': [{'subnet_id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'ip_address': '172.27.2.115', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790492-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:58:09Z', 'updated_at': '2021-05-25T16:58:16Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-790492-4-iscsi', '_interfaces': [{'id': 'c201e735-51e1-4301-a2d9-d3c9ffbbd910', 'name': '', 'network_id': '55a46372-d583-4435-a0f6-b9397668217d', 'tenant_id': '734df673f8b3484d80f35a45fbce9d5e', 'mac_address': 'fa:16:3e:3c:b9:6c', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '84b3a1b2-10cf-465f-ae5c-ffc9b189ed05', 'device_owner': 'network:router_interface', 'standard_attr_id': 70, 'fixed_ips': [{'subnet_id': '927bd65a-c4de-491b-b501-302852f4c784', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790492-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:58:14Z', 'updated_at': '2021-05-25T16:58:21Z', 'revision_number': 4, 'project_id': '734df673f8b3484d80f35a45fbce9d5e', 'subnets': [{'id': '927bd65a-c4de-491b-b501-302852f4c784', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=91831) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 25 16:58:22.497434 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-687f50bd-726f-4df1-a7d3-037283187d42 req-8a88e4ce-9343-44d7-9c2b-16cd1cbe9f53 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:58:22.499115 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-687f50bd-726f-4df1-a7d3-037283187d42 req-8a88e4ce-9343-44d7-9c2b-16cd1cbe9f53 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/networks?id=55a46372-d583-4435-a0f6-b9397668217d HTTP/1.1" status: 200 len: 818 time: 0.2214329 May 25 16:58:22.500706 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-c904d6d3-edc9-48fe-9fc9-b0a8e93d9066 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3857535', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55886', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411'] for subnet, after_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:22.510742 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:58:22.524707 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-687f50bd-726f-4df1-a7d3-037283187d42 req-be84fb31-1fc1-4394-a71d-37a7866a5c59 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/quotas/734df673f8b3484d80f35a45fbce9d5e HTTP/1.1" status: 200 len: 375 time: 0.0193896 May 25 16:58:22.549719 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.db_base_plugin_common [req-1f40d34a-0eb9-4d60-b5b9-5a06e965a5fa req-f398e8e9-a61a-4bfc-8582-613156d7bda0 tempest-DeleteServersTestJSON-1172980508 tempest-DeleteServersTestJSON-1172980508-project] Allocated IP 172.20.0.3 (ca95b136-0269-430f-b450-69ee5473ae7d/34034d6a-51f1-4e15-aa5b-0f79437d26f5/a460da33-52a2-41d5-bcf5-1baa12e65f8f) {{(pid=91830) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 25 16:58:22.563917 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c904d6d3-edc9-48fe-9fc9-b0a8e93d9066 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=14874ba5-11c2-49e1-8498-d5433e305c90,revision_number=None']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:58:22.569674 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-c904d6d3-edc9-48fe-9fc9-b0a8e93d9066 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-551373'] for subnet, before_response {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:22.572257 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-c904d6d3-edc9-48fe-9fc9-b0a8e93d9066 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.062s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:58:22.591100 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [None req-c904d6d3-edc9-48fe-9fc9-b0a8e93d9066 admin admin] 10.222.0.62 "DELETE /v2.0/subnets/14874ba5-11c2-49e1-8498-d5433e305c90 HTTP/1.1" status: 204 len: 168 time: 1.9577203 May 25 16:58:22.591493 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.wsgi [-] (91829) accepted ('10.222.0.62', 54678) {{(pid=91829) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:58:22.794036 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-687f50bd-726f-4df1-a7d3-037283187d42 req-947587b6-1d1c-4043-b81c-fee203184e8e tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/ports?tenant_id=734df673f8b3484d80f35a45fbce9d5e&fields=id HTTP/1.1" status: 200 len: 255 time: 0.2682452 May 25 16:58:22.796768 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-dd56622a-301b-4a39-b666-d3bc9067f4b7 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3867326'] for network, before_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:22.860086 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [req-1f40d34a-0eb9-4d60-b5b9-5a06e965a5fa req-f398e8e9-a61a-4bfc-8582-613156d7bda0 tempest-DeleteServersTestJSON-1172980508 tempest-DeleteServersTestJSON-1172980508-project] Notify callbacks [] for port, precommit_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:22.978362 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [req-1f40d34a-0eb9-4d60-b5b9-5a06e965a5fa req-f398e8e9-a61a-4bfc-8582-613156d7bda0 tempest-DeleteServersTestJSON-1172980508 tempest-DeleteServersTestJSON-1172980508-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8757892520915'] for port, after_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:22.985624 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-950b4827-a709-43f5-a23c-fd8d66e4811a admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:58:23.119022 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-dd56622a-301b-4a39-b666-d3bc9067f4b7 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3858245', 'neutron.services.segments.db._delete_segments_for_network-8757892982492'] for network, precommit_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:23.122312 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f398e8e9-a61a-4bfc-8582-613156d7bda0 tempest-DeleteServersTestJSON-1172980508 tempest-DeleteServersTestJSON-1172980508-project] Pushing event updated for resources: {'Port': ['ID=a460da33-52a2-41d5-bcf5-1baa12e65f8f,revision_number=1']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:58:23.128946 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-f398e8e9-a61a-4bfc-8582-613156d7bda0 tempest-DeleteServersTestJSON-1172980508 tempest-DeleteServersTestJSON-1172980508-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.143s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:58:23.142978 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.services.segments.db [None req-dd56622a-301b-4a39-b666-d3bc9067f4b7 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['6545658b-b670-4918-9a90-4574c32bc70a']}} {{(pid=91829) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 16:58:23.148729 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-1f40d34a-0eb9-4d60-b5b9-5a06e965a5fa req-f398e8e9-a61a-4bfc-8582-613156d7bda0 tempest-DeleteServersTestJSON-1172980508 tempest-DeleteServersTestJSON-1172980508-project] Network ca95b136-0269-430f-b450-69ee5473ae7d is already hosted by enough agents. {{(pid=91830) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 25 16:58:23.150324 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.scheduler.base_scheduler [req-1f40d34a-0eb9-4d60-b5b9-5a06e965a5fa req-f398e8e9-a61a-4bfc-8582-613156d7bda0 tempest-DeleteServersTestJSON-1172980508 tempest-DeleteServersTestJSON-1172980508-project] Resources bound (agent type, host, resource id): {{(pid=91830) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 16:58:23.162673 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.l3_dvrscheduler_db [req-1f40d34a-0eb9-4d60-b5b9-5a06e965a5fa req-f398e8e9-a61a-4bfc-8582-613156d7bda0 tempest-DeleteServersTestJSON-1172980508 tempest-DeleteServersTestJSON-1172980508-project] Received port after_create {{(pid=91830) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 25 16:58:23.170835 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1f40d34a-0eb9-4d60-b5b9-5a06e965a5fa req-f398e8e9-a61a-4bfc-8582-613156d7bda0 tempest-DeleteServersTestJSON-1172980508 tempest-DeleteServersTestJSON-1172980508-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=91830) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:58:23.171782 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [req-1f40d34a-0eb9-4d60-b5b9-5a06e965a5fa req-f398e8e9-a61a-4bfc-8582-613156d7bda0 tempest-DeleteServersTestJSON-1172980508 tempest-DeleteServersTestJSON-1172980508-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-178712', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-551373'] for port, before_response {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:23.179543 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.services.segments.db [None req-dd56622a-301b-4a39-b666-d3bc9067f4b7 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '3e8beb4d-db01-4975-9049-1762d1db1921') {'for_net_delete': True} {{(pid=91829) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 16:58:23.179717 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.services.segments.db [None req-dd56622a-301b-4a39-b666-d3bc9067f4b7 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '3e8beb4d-db01-4975-9049-1762d1db1921') {} {{(pid=91829) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 16:58:23.204578 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-1f40d34a-0eb9-4d60-b5b9-5a06e965a5fa req-f398e8e9-a61a-4bfc-8582-613156d7bda0 tempest-DeleteServersTestJSON-1172980508 tempest-DeleteServersTestJSON-1172980508-project] 10.222.0.32 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 2.1585259 May 25 16:58:23.207317 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.wsgi [req-687f50bd-726f-4df1-a7d3-037283187d42 req-bbe0498d-0d8e-4ed7-9c4e-ef22f15787eb service neutron] http://10.222.0.62:9696/v2.0/extensions returned with HTTP 200 {{(pid=91829) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} May 25 16:58:23.215809 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-687f50bd-726f-4df1-a7d3-037283187d42 req-bbe0498d-0d8e-4ed7-9c4e-ef22f15787eb service neutron] 10.222.0.62 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 13640 time: 0.1600649 May 25 16:58:23.219634 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-dd56622a-301b-4a39-b666-d3bc9067f4b7 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8757892991389', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-28283199'] for segment, before_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:23.367290 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-dd56622a-301b-4a39-b666-d3bc9067f4b7 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3809789'] for segment, precommit_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:23.392899 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-34aa0cb4-770e-4df6-b3d9-c003b17ff3d7 req-b8ab263d-289d-42b1-baed-4e1bb3bc5d35 tempest-DeleteServersTestJSON-1172980508 tempest-DeleteServersTestJSON-1172980508-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:58:23.394455 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-34aa0cb4-770e-4df6-b3d9-c003b17ff3d7 req-b8ab263d-289d-42b1-baed-4e1bb3bc5d35 tempest-DeleteServersTestJSON-1172980508 tempest-DeleteServersTestJSON-1172980508-project] 10.222.0.62 "GET /v2.0/ports?device_id=1d5af5b3-8d0b-4cf9-a7f1-ce49a30efc33 HTTP/1.1" status: 200 len: 931 time: 0.4996936 May 25 16:58:23.395583 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-dd56622a-301b-4a39-b666-d3bc9067f4b7 admin admin] Releasing vlan 671 on physical network physnet1 to pool {{(pid=91829) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 25 16:58:23.395977 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-dd56622a-301b-4a39-b666-d3bc9067f4b7 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3809789', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-28230861'] for segment, after_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:23.412271 dv-cinder-790492-4-iscsi neutron-server[91829]: Traceback (most recent call last): May 25 16:58:23.412271 dv-cinder-790492-4-iscsi neutron-server[91829]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 25 16:58:23.412271 dv-cinder-790492-4-iscsi neutron-server[91829]: timer() May 25 16:58:23.412271 dv-cinder-790492-4-iscsi neutron-server[91829]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 25 16:58:23.412271 dv-cinder-790492-4-iscsi neutron-server[91829]: cb(*args, **kw) May 25 16:58:23.412271 dv-cinder-790492-4-iscsi neutron-server[91829]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper May 25 16:58:23.412271 dv-cinder-790492-4-iscsi neutron-server[91829]: return func(*args, **kwargs) May 25 16:58:23.412271 dv-cinder-790492-4-iscsi neutron-server[91829]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 25 16:58:23.412271 dv-cinder-790492-4-iscsi neutron-server[91829]: self._notify() May 25 16:58:23.412271 dv-cinder-790492-4-iscsi neutron-server[91829]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 25 16:58:23.412271 dv-cinder-790492-4-iscsi neutron-server[91829]: self.callback(batched_events) May 25 16:58:23.412271 dv-cinder-790492-4-iscsi neutron-server[91829]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 25 16:58:23.412271 dv-cinder-790492-4-iscsi neutron-server[91829]: event.method(event) May 25 16:58:23.412271 dv-cinder-790492-4-iscsi neutron-server[91829]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 25 16:58:23.412271 dv-cinder-790492-4-iscsi neutron-server[91829]: aggregate_id = self._get_aggregate_id(event.segment_id) May 25 16:58:23.412271 dv-cinder-790492-4-iscsi neutron-server[91829]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 25 16:58:23.412271 dv-cinder-790492-4-iscsi neutron-server[91829]: aggregate_uuid = self.p_client.list_aggregates( May 25 16:58:23.412271 dv-cinder-790492-4-iscsi neutron-server[91829]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 25 16:58:23.412271 dv-cinder-790492-4-iscsi neutron-server[91829]: return f(self, *a, **k) May 25 16:58:23.412271 dv-cinder-790492-4-iscsi neutron-server[91829]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 25 16:58:23.412271 dv-cinder-790492-4-iscsi neutron-server[91829]: return self._get(url).json() May 25 16:58:23.412271 dv-cinder-790492-4-iscsi neutron-server[91829]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 25 16:58:23.412271 dv-cinder-790492-4-iscsi neutron-server[91829]: return self._client.get(url, endpoint_filter=self._ks_filter, May 25 16:58:23.412271 dv-cinder-790492-4-iscsi neutron-server[91829]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 25 16:58:23.412271 dv-cinder-790492-4-iscsi neutron-server[91829]: return self.request(url, 'GET', **kwargs) May 25 16:58:23.412271 dv-cinder-790492-4-iscsi neutron-server[91829]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 25 16:58:23.412271 dv-cinder-790492-4-iscsi neutron-server[91829]: base_url = self.get_endpoint(auth, allow=allow, May 25 16:58:23.412271 dv-cinder-790492-4-iscsi neutron-server[91829]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 25 16:58:23.412271 dv-cinder-790492-4-iscsi neutron-server[91829]: auth = self._auth_required(auth, 'determine endpoint URL') May 25 16:58:23.412271 dv-cinder-790492-4-iscsi neutron-server[91829]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 25 16:58:23.412271 dv-cinder-790492-4-iscsi neutron-server[91829]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 25 16:58:23.412271 dv-cinder-790492-4-iscsi neutron-server[91829]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 25 16:58:23.554637 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-34aa0cb4-770e-4df6-b3d9-c003b17ff3d7 req-30d32fe0-cd50-4501-b3f9-e5b2af592139 tempest-DeleteServersTestJSON-1172980508 tempest-DeleteServersTestJSON-1172980508-project] 10.222.0.62 "GET /v2.0/security-groups?id=ec198040-29f5-4dbf-8437-e486f3fb935b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1421657 May 25 16:58:23.555504 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-dd56622a-301b-4a39-b666-d3bc9067f4b7 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3858252', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-640806', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-551400', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-683051'] for network, after_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:23.558446 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-687f50bd-726f-4df1-a7d3-037283187d42 req-d5a5d269-53ce-4e9a-b112-e7bfb6f277e9 service neutron] 10.222.0.62 "GET /v2.0/networks/55a46372-d583-4435-a0f6-b9397668217d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3414953 May 25 16:58:23.560955 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-47deb4eb-af69-4fcd-a423-8eb887a7a61d admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:58:23.578487 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-dd56622a-301b-4a39-b666-d3bc9067f4b7 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-551373'] for network, before_response {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:23.672259 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dd56622a-301b-4a39-b666-d3bc9067f4b7 admin admin] Pushing event deleted for resources: {'Network': ['ID=6545658b-b670-4918-9a90-4574c32bc70a,revision_number=None']} {{(pid=91829) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:58:23.683249 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [None req-dd56622a-301b-4a39-b666-d3bc9067f4b7 admin admin] 10.222.0.62 "DELETE /v2.0/networks/6545658b-b670-4918-9a90-4574c32bc70a HTTP/1.1" status: 204 len: 168 time: 1.0905294 May 25 16:58:23.684240 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-dd56622a-301b-4a39-b666-d3bc9067f4b7 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.123s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:58:23.786108 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-5ed00c69-cea0-45be-8b69-914facd7e06a req-d3c8c9c4-fd88-456f-a067-f9011bef02d4 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] 10.222.0.62 "GET /v2.0/ports?device_id=bca36110-0b4f-419a-92ef-46cbb9d6215e HTTP/1.1" status: 200 len: 210 time: 0.0576530 May 25 16:58:23.836372 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-687f50bd-726f-4df1-a7d3-037283187d42 req-bd8942db-8332-4abd-9a44-41e93790df76 service neutron] 10.222.0.62 "GET /v2.0/networks/55a46372-d583-4435-a0f6-b9397668217d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2531569 May 25 16:58:23.907037 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.wsgi [-] (91830) accepted ('10.222.0.62', 54712) {{(pid=91830) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:58:23.991651 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.wsgi [-] (91829) accepted ('10.222.0.62', 54716) {{(pid=91829) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:58:24.002708 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [None req-71efc8aa-b0af-4e19-af84-b018179b9883 admin admin] 10.222.0.62 "GET /v2.0/security-groups?tenant_id=c0689c9a1e32481ca8ee3f0877f82c24&name=default HTTP/1.1" status: 200 len: 2975 time: 0.0935121 May 25 16:58:24.121304 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-4133f5af-0879-4efa-a2b3-0d662d2069d0 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:24.135452 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.rpc [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Device c201e735-51e1-4301-a2d9-d3c9ffbbd910 up at agent ovs-agent-dv-cinder-790492-4-iscsi {{(pid=91831) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 25 16:58:24.140371 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-2dfee938-693f-47e2-be34-d2384b636159 req-b3a1f099-d460-4743-a9ad-5f6d1430ba6b tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/ports?device_id=d87a1395-92e0-4727-a5ed-a8dcdee587c3 HTTP/1.1" status: 200 len: 210 time: 0.0627792 May 25 16:58:24.198058 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-4133f5af-0879-4efa-a2b3-0d662d2069d0 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:24.218687 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.provisioning_blocks [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Provisioning for port c201e735-51e1-4301-a2d9-d3c9ffbbd910 completed by entity L2. {{(pid=91831) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 25 16:58:24.224656 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.provisioning_blocks [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Provisioning complete for port c201e735-51e1-4301-a2d9-d3c9ffbbd910 triggered by entity L2. {{(pid=91831) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 16:58:24.225008 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3854128'] for port, provisioning_complete {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:24.282867 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-4133f5af-0879-4efa-a2b3-0d662d2069d0 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-640836'] for security_group, after_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:24.291730 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:58:24.307752 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-4133f5af-0879-4efa-a2b3-0d662d2069d0 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:24.308801 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [None req-4133f5af-0879-4efa-a2b3-0d662d2069d0 admin admin] 10.222.0.62 "DELETE /v2.0/security-groups/6220201c-bb58-4da7-aa49-5214501844fb HTTP/1.1" status: 204 len: 168 time: 0.3160322 May 25 16:58:24.310247 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4133f5af-0879-4efa-a2b3-0d662d2069d0 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=6220201c-bb58-4da7-aa49-5214501844fb,revision_number=None']} {{(pid=91829) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:58:24.317939 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-4133f5af-0879-4efa-a2b3-0d662d2069d0 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.026s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:58:24.466343 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3832070'] for port, before_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:24.517982 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.db [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] For port c201e735-51e1-4301-a2d9-d3c9ffbbd910, host dv-cinder-790492-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-790492-4-iscsi',level=0,port_id=c201e735-51e1-4301-a2d9-d3c9ffbbd910,segment=NetworkSegment(f672477b-47fb-432c-acc9-dc57201d80de),segment_id=f672477b-47fb-432c-acc9-dc57201d80de)] {{(pid=91831) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 16:58:24.523136 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8757892955028', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8757892520933', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8757892521750'] for port, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:24.525699 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:58:24.613326 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Pushing event updated for resources: {'Port': ['ID=c201e735-51e1-4301-a2d9-d3c9ffbbd910,revision_number=5']} {{(pid=91831) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:58:24.618345 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.092s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:58:24.791872 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b7a8b5e7-316a-40d8-aaaf-366b7281d816 req-b88402b9-a189-45d3-beb4-3be5ff1ed9c3 tempest-DeleteServersTestJSON-1172980508 tempest-DeleteServersTestJSON-1172980508-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:58:24.793627 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-b7a8b5e7-316a-40d8-aaaf-366b7281d816 req-b88402b9-a189-45d3-beb4-3be5ff1ed9c3 tempest-DeleteServersTestJSON-1172980508 tempest-DeleteServersTestJSON-1172980508-project] 10.222.0.62 "GET /v2.0/ports?device_id=1d5af5b3-8d0b-4cf9-a7f1-ce49a30efc33 HTTP/1.1" status: 200 len: 931 time: 0.0900140 May 25 16:58:24.850829 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-b7a8b5e7-316a-40d8-aaaf-366b7281d816 req-e7332850-a4d6-46ba-b1de-038d95bdac79 tempest-DeleteServersTestJSON-1172980508 tempest-DeleteServersTestJSON-1172980508-project] 10.222.0.62 "GET /v2.0/security-groups?id=ec198040-29f5-4dbf-8437-e486f3fb935b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0501280 May 25 16:58:24.863786 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.wsgi [-] (91829) accepted ('10.222.0.62', 54746) {{(pid=91829) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:58:24.921959 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [None req-6399b432-9f6f-46fd-bfd0-36b2609d5c6f admin admin] 10.222.0.62 "GET /v2.0/security-groups?tenant_id=c0eb4b8dd7674c61bad9a1b5a4db5542&name=default HTTP/1.1" status: 200 len: 2975 time: 0.0566831 May 25 16:58:24.953325 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.wsgi [-] (91830) accepted ('10.222.0.62', 54750) {{(pid=91830) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:58:25.012037 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-47c251cb-61bf-4633-9f93-238dcfcf1ec5 req-0cf3603d-4b32-4b10-ab1c-92ffe934ffec tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] 10.222.0.62 "GET /v2.0/ports?device_id=bca36110-0b4f-419a-92ef-46cbb9d6215e HTTP/1.1" status: 200 len: 210 time: 0.0867119 May 25 16:58:25.016541 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-aaac0880-7342-48a7-a846-cb42c66aa576 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:25.064805 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-aaac0880-7342-48a7-a846-cb42c66aa576 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:25.129311 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-aaac0880-7342-48a7-a846-cb42c66aa576 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-640836'] for security_group, after_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:25.133092 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:58:25.144157 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aaac0880-7342-48a7-a846-cb42c66aa576 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=0980e1be-cc99-4423-b010-fb708b67980a,revision_number=None']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:58:25.150413 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-aaac0880-7342-48a7-a846-cb42c66aa576 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.017s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:58:25.154765 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-aaac0880-7342-48a7-a846-cb42c66aa576 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:25.155943 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [None req-aaac0880-7342-48a7-a846-cb42c66aa576 admin admin] 10.222.0.62 "DELETE /v2.0/security-groups/0980e1be-cc99-4423-b010-fb708b67980a HTTP/1.1" status: 204 len: 168 time: 0.2285404 May 25 16:58:25.283264 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-3770edc3-dd6f-4bc8-aaed-442dd42b44d3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:25.329827 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-b3feedf6-cabc-46e5-a9cb-2d337603f01a req-5ed78f79-c692-4af6-83e8-10bbab7c4818 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/ports?device_id=d87a1395-92e0-4727-a5ed-a8dcdee587c3 HTTP/1.1" status: 200 len: 210 time: 0.0462761 May 25 16:58:26.046395 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cae89b3c-6e02-4bf5-acc4-cca823f58f8b req-fdeb81c5-7191-4795-90bd-6469b5a2b27d tempest-DeleteServersTestJSON-1172980508 tempest-DeleteServersTestJSON-1172980508-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:58:26.047905 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-cae89b3c-6e02-4bf5-acc4-cca823f58f8b req-fdeb81c5-7191-4795-90bd-6469b5a2b27d tempest-DeleteServersTestJSON-1172980508 tempest-DeleteServersTestJSON-1172980508-project] 10.222.0.62 "GET /v2.0/ports?device_id=1d5af5b3-8d0b-4cf9-a7f1-ce49a30efc33 HTTP/1.1" status: 200 len: 931 time: 0.0828309 May 25 16:58:26.098936 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-cae89b3c-6e02-4bf5-acc4-cca823f58f8b req-b5b92137-421c-48ef-80ac-3862387edb02 tempest-DeleteServersTestJSON-1172980508 tempest-DeleteServersTestJSON-1172980508-project] 10.222.0.62 "GET /v2.0/security-groups?id=ec198040-29f5-4dbf-8437-e486f3fb935b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0439084 May 25 16:58:26.103666 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.rpc [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Device c201e735-51e1-4301-a2d9-d3c9ffbbd910 up at agent ovs-agent-dv-cinder-790492-4-iscsi {{(pid=91831) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 25 16:58:26.249761 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-42c775e3-af69-48d8-a3f6-095a20752d57 req-2bf0440a-94aa-45cd-a349-0bfbe24b71eb tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] 10.222.0.62 "GET /v2.0/ports?device_id=bca36110-0b4f-419a-92ef-46cbb9d6215e HTTP/1.1" status: 200 len: 210 time: 0.0852923 May 25 16:58:26.321417 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.provisioning_blocks [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Provisioning complete for port c201e735-51e1-4301-a2d9-d3c9ffbbd910 triggered by entity L2. {{(pid=91831) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 16:58:26.322319 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3854128'] for port, provisioning_complete {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:26.522470 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-2753d5b9-5247-4d68-ac07-64bf2471dcd5 req-d33d57c2-4c95-4129-8fb2-f97a352f70f4 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/ports?device_id=d87a1395-92e0-4727-a5ed-a8dcdee587c3 HTTP/1.1" status: 200 len: 210 time: 0.0671177 May 25 16:58:27.306567 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f74ccb22-d290-4b25-bb43-ca1b7ee34f8d req-53467446-563c-40a0-a1ff-d768ca29c43f tempest-DeleteServersTestJSON-1172980508 tempest-DeleteServersTestJSON-1172980508-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:58:27.308431 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-f74ccb22-d290-4b25-bb43-ca1b7ee34f8d req-53467446-563c-40a0-a1ff-d768ca29c43f tempest-DeleteServersTestJSON-1172980508 tempest-DeleteServersTestJSON-1172980508-project] 10.222.0.62 "GET /v2.0/ports?device_id=1d5af5b3-8d0b-4cf9-a7f1-ce49a30efc33 HTTP/1.1" status: 200 len: 931 time: 0.0823259 May 25 16:58:27.442569 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-f74ccb22-d290-4b25-bb43-ca1b7ee34f8d req-bb81bc04-67a9-4c47-baa0-ef9dc454ed67 tempest-DeleteServersTestJSON-1172980508 tempest-DeleteServersTestJSON-1172980508-project] 10.222.0.62 "GET /v2.0/security-groups?id=ec198040-29f5-4dbf-8437-e486f3fb935b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1245501 May 25 16:58:27.518201 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-fc4651be-0a20-438d-b5da-5888628d1724 req-15029a7f-66b7-4def-b851-5387d449f003 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] 10.222.0.62 "GET /v2.0/ports?device_id=bca36110-0b4f-419a-92ef-46cbb9d6215e HTTP/1.1" status: 200 len: 210 time: 0.0742874 May 25 16:58:27.707682 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-c6c46f6a-33c9-4c16-a2df-45d138622265 req-89533276-836c-47d7-8d6d-3000bcfc0ef5 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/ports?device_id=d87a1395-92e0-4727-a5ed-a8dcdee587c3 HTTP/1.1" status: 200 len: 210 time: 0.0569351 May 25 16:58:27.725210 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-47d9e8e8-d328-48e5-a95e-6fc1f48d8450 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:27.854540 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:28.558502 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.wsgi [-] (91830) accepted ('10.222.0.62', 54896) {{(pid=91830) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:58:28.615067 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-0a55eb4a-8b57-4233-84d6-6b423b4ed6db None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:28.826990 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-54139b22-4b9e-4f6e-a8f7-6963a7bb0092 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:28.835532 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-b0c6d5de-88a4-4435-aea8-31141a19f50d req-ee6c63e7-6784-4113-af38-93787bdb0933 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] 10.222.0.62 "GET /v2.0/ports?device_id=bca36110-0b4f-419a-92ef-46cbb9d6215e HTTP/1.1" status: 200 len: 210 time: 0.0961013 May 25 16:58:28.862256 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.quota.driver [None req-54139b22-4b9e-4f6e-a8f7-6963a7bb0092 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91830) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 16:58:28.868607 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6cce2657-b931-4f17-99ec-43273b8bed5b req-6300bbad-deeb-4a56-9e61-b3765dcc5924 tempest-DeleteServersTestJSON-1172980508 tempest-DeleteServersTestJSON-1172980508-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:58:28.871257 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-6cce2657-b931-4f17-99ec-43273b8bed5b req-6300bbad-deeb-4a56-9e61-b3765dcc5924 tempest-DeleteServersTestJSON-1172980508 tempest-DeleteServersTestJSON-1172980508-project] 10.222.0.62 "GET /v2.0/ports?device_id=1d5af5b3-8d0b-4cf9-a7f1-ce49a30efc33 HTTP/1.1" status: 200 len: 931 time: 0.2458615 May 25 16:58:28.882551 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [None req-54139b22-4b9e-4f6e-a8f7-6963a7bb0092 admin admin] Usage tracker for resource:security_group_rule and tenant:9392e98b899f47b5b906d2709cdd94fa is out of sync, need to count used quota {{(pid=91830) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 16:58:28.885788 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [None req-54139b22-4b9e-4f6e-a8f7-6963a7bb0092 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91830) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 16:58:28.892099 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.quota.driver [None req-54139b22-4b9e-4f6e-a8f7-6963a7bb0092 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91830) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 16:58:28.998448 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-6cce2657-b931-4f17-99ec-43273b8bed5b req-6aec3c5e-5352-4891-b37c-86ed14678ed4 tempest-DeleteServersTestJSON-1172980508 tempest-DeleteServersTestJSON-1172980508-project] 10.222.0.62 "GET /v2.0/security-groups?id=ec198040-29f5-4dbf-8437-e486f3fb935b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1206689 May 25 16:58:29.039832 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-54139b22-4b9e-4f6e-a8f7-6963a7bb0092 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:29.054674 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-54139b22-4b9e-4f6e-a8f7-6963a7bb0092 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-640836'] for security_group, after_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:29.071240 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:58:29.114754 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-e4395590-f3fd-427e-993e-5df7c4324c17 req-29cd47e4-6ff7-434c-a299-92063b25e15a tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/ports?device_id=d87a1395-92e0-4727-a5ed-a8dcdee587c3 HTTP/1.1" status: 200 len: 210 time: 0.0694048 May 25 16:58:29.135507 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [None req-54139b22-4b9e-4f6e-a8f7-6963a7bb0092 admin admin] 10.222.0.62 "GET /v2.0/security-groups?tenant_id=9392e98b899f47b5b906d2709cdd94fa&name=default HTTP/1.1" status: 200 len: 2975 time: 0.5758481 May 25 16:58:29.138957 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.wsgi [-] (91830) accepted ('10.222.0.62', 54926) {{(pid=91830) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:58:29.153643 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-54139b22-4b9e-4f6e-a8f7-6963a7bb0092 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=cd780e77-34b5-451d-b5fe-c76c5599a2c0,revision_number=1']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:58:29.158261 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-54139b22-4b9e-4f6e-a8f7-6963a7bb0092 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.087s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:58:29.214643 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-c24fab46-2d6b-4f01-98ba-90389b219e59 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:29.248306 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-c24fab46-2d6b-4f01-98ba-90389b219e59 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:29.324248 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-c24fab46-2d6b-4f01-98ba-90389b219e59 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-640836'] for security_group, after_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:29.329368 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:58:29.345024 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c24fab46-2d6b-4f01-98ba-90389b219e59 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=cd780e77-34b5-451d-b5fe-c76c5599a2c0,revision_number=None']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:58:29.349570 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-c24fab46-2d6b-4f01-98ba-90389b219e59 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.019s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:58:29.354507 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-c24fab46-2d6b-4f01-98ba-90389b219e59 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:29.355745 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [None req-c24fab46-2d6b-4f01-98ba-90389b219e59 admin admin] 10.222.0.62 "DELETE /v2.0/security-groups/cd780e77-34b5-451d-b5fe-c76c5599a2c0 HTTP/1.1" status: 204 len: 168 time: 0.2158971 May 25 16:58:30.145787 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-bd76919a-d3ef-4b67-829e-096f41f92f12 req-43a84686-233d-4360-8b2f-37f30b5cdaeb tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] 10.222.0.62 "GET /v2.0/ports?device_id=bca36110-0b4f-419a-92ef-46cbb9d6215e HTTP/1.1" status: 200 len: 210 time: 0.1204896 May 25 16:58:30.210350 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-57f11b47-1f51-4191-b7c9-af248a48372c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:30.377080 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9ab91747-9bed-471b-913a-b037c1923b74 req-f8a266b1-fc9f-43f3-9a43-4a2e033543cd tempest-DeleteServersTestJSON-1172980508 tempest-DeleteServersTestJSON-1172980508-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:58:30.385444 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-9ab91747-9bed-471b-913a-b037c1923b74 req-f8a266b1-fc9f-43f3-9a43-4a2e033543cd tempest-DeleteServersTestJSON-1172980508 tempest-DeleteServersTestJSON-1172980508-project] 10.222.0.62 "GET /v2.0/ports?device_id=1d5af5b3-8d0b-4cf9-a7f1-ce49a30efc33 HTTP/1.1" status: 200 len: 931 time: 0.1549306 May 25 16:58:30.492558 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-9ab91747-9bed-471b-913a-b037c1923b74 req-3c6955dd-fc4b-4440-929c-732e524aefbf tempest-DeleteServersTestJSON-1172980508 tempest-DeleteServersTestJSON-1172980508-project] 10.222.0.62 "GET /v2.0/security-groups?id=ec198040-29f5-4dbf-8437-e486f3fb935b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0998373 May 25 16:58:30.811000 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-d48a6a0d-7216-41f5-94aa-853ce95cc006 req-71f5951c-5503-4a0f-b912-aac0e58a648f tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/ports?device_id=d87a1395-92e0-4727-a5ed-a8dcdee587c3 HTTP/1.1" status: 200 len: 210 time: 0.1273286 May 25 16:58:31.388863 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-379a7029-21ac-47bf-9c21-31cf7932c9fe req-9d671c97-006e-4809-852b-a0640a66e6ee tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] 10.222.0.62 "GET /v2.0/ports?device_id=bca36110-0b4f-419a-92ef-46cbb9d6215e HTTP/1.1" status: 200 len: 210 time: 0.0522645 May 25 16:58:31.798399 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a71b6138-a2fc-47d7-8ff7-a9c03e31c902 req-e9bead92-dc57-4025-ac10-5495de1c328f tempest-DeleteServersTestJSON-1172980508 tempest-DeleteServersTestJSON-1172980508-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:58:31.799925 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-a71b6138-a2fc-47d7-8ff7-a9c03e31c902 req-e9bead92-dc57-4025-ac10-5495de1c328f tempest-DeleteServersTestJSON-1172980508 tempest-DeleteServersTestJSON-1172980508-project] 10.222.0.62 "GET /v2.0/ports?device_id=1d5af5b3-8d0b-4cf9-a7f1-ce49a30efc33 HTTP/1.1" status: 200 len: 931 time: 0.1031153 May 25 16:58:31.870914 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-a71b6138-a2fc-47d7-8ff7-a9c03e31c902 req-33615d0f-1b3c-4de0-bb28-0a8524998bc6 tempest-DeleteServersTestJSON-1172980508 tempest-DeleteServersTestJSON-1172980508-project] 10.222.0.62 "GET /v2.0/security-groups?id=ec198040-29f5-4dbf-8437-e486f3fb935b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0581176 May 25 16:58:32.045224 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-822a4d3b-4fef-4e3e-a4aa-843cbeebfd0b req-7f5da1a9-345b-45fd-9500-491ea10864ed tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/ports?device_id=d87a1395-92e0-4727-a5ed-a8dcdee587c3 HTTP/1.1" status: 200 len: 210 time: 0.0475466 May 25 16:58:32.171359 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:32.605722 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-e6184230-9f78-427f-857f-f87e6da50733 req-430ca9b9-d294-4fba-90b3-2a0f9f5e7e01 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] 10.222.0.62 "GET /v2.0/ports?device_id=bca36110-0b4f-419a-92ef-46cbb9d6215e HTTP/1.1" status: 200 len: 210 time: 0.0480239 May 25 16:58:33.135744 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a0379205-8ab8-4e3d-83f2-ae598fc6df19 req-30085f14-f66e-4af9-a840-bdfc221d40c3 tempest-DeleteServersTestJSON-1172980508 tempest-DeleteServersTestJSON-1172980508-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:58:33.137590 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-a0379205-8ab8-4e3d-83f2-ae598fc6df19 req-30085f14-f66e-4af9-a840-bdfc221d40c3 tempest-DeleteServersTestJSON-1172980508 tempest-DeleteServersTestJSON-1172980508-project] 10.222.0.62 "GET /v2.0/ports?device_id=1d5af5b3-8d0b-4cf9-a7f1-ce49a30efc33 HTTP/1.1" status: 200 len: 931 time: 0.1606426 May 25 16:58:33.187438 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-a0379205-8ab8-4e3d-83f2-ae598fc6df19 req-5cbaa932-bb16-40c8-97a8-e5c3bf2b9385 tempest-DeleteServersTestJSON-1172980508 tempest-DeleteServersTestJSON-1172980508-project] 10.222.0.62 "GET /v2.0/security-groups?id=ec198040-29f5-4dbf-8437-e486f3fb935b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0438888 May 25 16:58:33.292160 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-3b335984-7bb9-4b4e-96bf-c8fe316e8ef5 req-3d6c8cc4-d592-4a68-9db2-b4f69fdbc3fe tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/ports?device_id=d87a1395-92e0-4727-a5ed-a8dcdee587c3 HTTP/1.1" status: 200 len: 210 time: 0.0553627 May 25 16:58:33.837179 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-61e19b3c-78b9-4fdb-b89b-4092a2b9c6da req-8ce46fc8-4399-4ce9-8965-d29972c3ff01 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] 10.222.0.62 "GET /v2.0/ports?device_id=bca36110-0b4f-419a-92ef-46cbb9d6215e HTTP/1.1" status: 200 len: 210 time: 0.0566549 May 25 16:58:33.876374 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.wsgi [-] (91830) accepted ('10.222.0.62', 55154) {{(pid=91830) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:58:34.073125 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-fd66485f-bdba-48b5-9416-049125ab25b1 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:34.113977 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.quota.driver [None req-fd66485f-bdba-48b5-9416-049125ab25b1 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91830) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 16:58:34.129735 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [None req-fd66485f-bdba-48b5-9416-049125ab25b1 admin admin] Usage tracker for resource:security_group_rule and tenant:f1ff55c7502542eaae97f3e01dd52f47 is out of sync, need to count used quota {{(pid=91830) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 16:58:34.135963 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [None req-fd66485f-bdba-48b5-9416-049125ab25b1 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91830) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 16:58:34.149689 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.quota.driver [None req-fd66485f-bdba-48b5-9416-049125ab25b1 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91830) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 16:58:34.339556 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-fd66485f-bdba-48b5-9416-049125ab25b1 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:34.343776 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-fd66485f-bdba-48b5-9416-049125ab25b1 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-640836'] for security_group, after_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:34.359609 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:58:34.480616 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fd66485f-bdba-48b5-9416-049125ab25b1 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=26fed85c-1509-46c5-a90a-3e0029bd34b4,revision_number=1']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:58:34.512481 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.wsgi [-] (91829) accepted ('10.222.0.62', 55194) {{(pid=91829) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:58:34.513042 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [None req-fd66485f-bdba-48b5-9416-049125ab25b1 admin admin] 10.222.0.62 "GET /v2.0/security-groups?tenant_id=f1ff55c7502542eaae97f3e01dd52f47&name=default HTTP/1.1" status: 200 len: 2975 time: 0.6355410 May 25 16:58:34.515850 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-fd66485f-bdba-48b5-9416-049125ab25b1 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.156s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:58:34.567613 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3293f5bf-7dbf-4e2c-ba49-323b77d03139 req-89d628ae-0196-4c44-a486-cbd7cfcfd645 tempest-DeleteServersTestJSON-1172980508 tempest-DeleteServersTestJSON-1172980508-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:58:34.575462 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-3293f5bf-7dbf-4e2c-ba49-323b77d03139 req-89d628ae-0196-4c44-a486-cbd7cfcfd645 tempest-DeleteServersTestJSON-1172980508 tempest-DeleteServersTestJSON-1172980508-project] 10.222.0.62 "GET /v2.0/ports?device_id=1d5af5b3-8d0b-4cf9-a7f1-ce49a30efc33 HTTP/1.1" status: 200 len: 931 time: 0.1548092 May 25 16:58:34.678156 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-b9effad1-4083-4f71-9da9-6950715a5443 req-f5093fa4-ee6c-4bec-9b57-ce77f1999a62 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/ports?device_id=d87a1395-92e0-4727-a5ed-a8dcdee587c3 HTTP/1.1" status: 200 len: 210 time: 0.0779662 May 25 16:58:34.708528 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-3293f5bf-7dbf-4e2c-ba49-323b77d03139 req-619629c1-205d-403b-871d-8f35b90f4601 tempest-DeleteServersTestJSON-1172980508 tempest-DeleteServersTestJSON-1172980508-project] 10.222.0.62 "GET /v2.0/security-groups?id=ec198040-29f5-4dbf-8437-e486f3fb935b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1321185 May 25 16:58:34.719183 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-e0ca2372-3962-466a-9320-feaf2cd068a8 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:34.755465 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-e0ca2372-3962-466a-9320-feaf2cd068a8 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:34.817110 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-e0ca2372-3962-466a-9320-feaf2cd068a8 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-640836'] for security_group, after_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:34.823735 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-082a08b7-5cb3-452c-a7ea-69ed3e269b4c admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:58:34.836520 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e0ca2372-3962-466a-9320-feaf2cd068a8 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=26fed85c-1509-46c5-a90a-3e0029bd34b4,revision_number=None']} {{(pid=91829) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:58:34.842686 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-e0ca2372-3962-466a-9320-feaf2cd068a8 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.019s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:58:34.846148 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-e0ca2372-3962-466a-9320-feaf2cd068a8 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:34.847246 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [None req-e0ca2372-3962-466a-9320-feaf2cd068a8 admin admin] 10.222.0.62 "DELETE /v2.0/security-groups/26fed85c-1509-46c5-a90a-3e0029bd34b4 HTTP/1.1" status: 204 len: 168 time: 0.3338399 May 25 16:58:35.006916 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-c79f4bc4-51c5-4c1f-bfd6-906d2b64d741 req-80d2ff10-61bf-4c79-8bde-a8af2079c049 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] 10.222.0.62 "GET /v2.0/ports?device_id=bca36110-0b4f-419a-92ef-46cbb9d6215e HTTP/1.1" status: 200 len: 210 time: 0.0560825 May 25 16:58:35.197057 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.wsgi [-] (91829) accepted ('10.222.0.62', 55212) {{(pid=91829) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:58:35.214652 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-79f8b12e-b5bc-4ecc-b313-244d75813d59 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:35.229175 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.quota.driver [None req-79f8b12e-b5bc-4ecc-b313-244d75813d59 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91829) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 16:58:35.232962 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.quota.resource [None req-79f8b12e-b5bc-4ecc-b313-244d75813d59 admin admin] Usage tracker for resource:security_group_rule and tenant:f4c9c7d1f6e74753b0507af0b4959755 is out of sync, need to count used quota {{(pid=91829) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 16:58:35.235751 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.quota.resource [None req-79f8b12e-b5bc-4ecc-b313-244d75813d59 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91829) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 16:58:35.242111 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.quota.driver [None req-79f8b12e-b5bc-4ecc-b313-244d75813d59 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91829) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 16:58:35.325689 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-79f8b12e-b5bc-4ecc-b313-244d75813d59 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:35.329689 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-79f8b12e-b5bc-4ecc-b313-244d75813d59 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-640836'] for security_group, after_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:35.338602 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-4133f5af-0879-4efa-a2b3-0d662d2069d0 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:58:35.376700 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-79f8b12e-b5bc-4ecc-b313-244d75813d59 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=3119b2a3-06e0-48c2-b079-21f1ed197346,revision_number=1']} {{(pid=91829) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:58:35.381434 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [None req-79f8b12e-b5bc-4ecc-b313-244d75813d59 admin admin] 10.222.0.62 "GET /v2.0/security-groups?tenant_id=f4c9c7d1f6e74753b0507af0b4959755&name=default HTTP/1.1" status: 200 len: 2979 time: 0.1831584 May 25 16:58:35.382313 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-79f8b12e-b5bc-4ecc-b313-244d75813d59 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.044s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:58:35.384289 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.wsgi [-] (91829) accepted ('10.222.0.62', 55216) {{(pid=91829) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:58:35.445828 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-277eb1a9-df9d-4264-96e0-e887b816477d admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:35.474896 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-277eb1a9-df9d-4264-96e0-e887b816477d admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:35.535251 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-277eb1a9-df9d-4264-96e0-e887b816477d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-640836'] for security_group, after_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:35.538921 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:58:35.551040 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-277eb1a9-df9d-4264-96e0-e887b816477d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=3119b2a3-06e0-48c2-b079-21f1ed197346,revision_number=None']} {{(pid=91829) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:58:35.555014 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-277eb1a9-df9d-4264-96e0-e887b816477d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.016s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:58:35.558441 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-277eb1a9-df9d-4264-96e0-e887b816477d admin admin] Notify callbacks [] for security_group, before_response {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:35.564886 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [None req-277eb1a9-df9d-4264-96e0-e887b816477d admin admin] 10.222.0.62 "DELETE /v2.0/security-groups/3119b2a3-06e0-48c2-b079-21f1ed197346 HTTP/1.1" status: 204 len: 168 time: 0.1796155 May 25 16:58:35.941533 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-1e745ece-a301-4a49-9c26-d6fb10cf0447 req-1ed5f1b7-3362-4903-96d2-5ca557e263be tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/ports?device_id=d87a1395-92e0-4727-a5ed-a8dcdee587c3 HTTP/1.1" status: 200 len: 210 time: 0.0970216 May 25 16:58:36.006262 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-121e9a67-fb1c-462e-9d03-8f916b53d8f7 req-a20adddf-caa8-44fe-8a66-42288b840ea7 tempest-DeleteServersTestJSON-1172980508 tempest-DeleteServersTestJSON-1172980508-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:58:36.013066 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-121e9a67-fb1c-462e-9d03-8f916b53d8f7 req-a20adddf-caa8-44fe-8a66-42288b840ea7 tempest-DeleteServersTestJSON-1172980508 tempest-DeleteServersTestJSON-1172980508-project] 10.222.0.62 "GET /v2.0/ports?device_id=1d5af5b3-8d0b-4cf9-a7f1-ce49a30efc33 HTTP/1.1" status: 200 len: 931 time: 0.1307821 May 25 16:58:36.113033 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-121e9a67-fb1c-462e-9d03-8f916b53d8f7 req-bc0a71c4-9a90-4295-ad15-7624c16c98c1 tempest-DeleteServersTestJSON-1172980508 tempest-DeleteServersTestJSON-1172980508-project] 10.222.0.62 "GET /v2.0/security-groups?id=ec198040-29f5-4dbf-8437-e486f3fb935b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0965235 May 25 16:58:36.231807 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-9e154b8b-c258-47e4-a954-bf13e55fe61a req-0cfa8aa5-f075-4414-9d62-3aac2a83f826 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] 10.222.0.62 "GET /v2.0/ports?device_id=bca36110-0b4f-419a-92ef-46cbb9d6215e HTTP/1.1" status: 200 len: 210 time: 0.0560813 May 25 16:58:36.511789 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.wsgi [-] (91830) accepted ('10.222.0.62', 55294) {{(pid=91830) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:58:36.693310 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.wsgi [-] (91830) accepted ('10.222.0.62', 55310) {{(pid=91830) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:58:36.773618 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-0875f70f-306c-4c4b-a5a3-fa4b20f27936 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:36.804311 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.quota.driver [None req-0875f70f-306c-4c4b-a5a3-fa4b20f27936 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91830) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 16:58:36.806637 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-42d7e78d-4e5f-4438-a53f-af07f660e27d admin admin] Notify callbacks [] for security_group, before_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:36.818990 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [None req-0875f70f-306c-4c4b-a5a3-fa4b20f27936 admin admin] Usage tracker for resource:security_group_rule and tenant:6acaeeff8e52470e80c9d8366ba9728d is out of sync, need to count used quota {{(pid=91830) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 16:58:36.823060 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [None req-0875f70f-306c-4c4b-a5a3-fa4b20f27936 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91830) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 16:58:36.830644 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.quota.driver [None req-42d7e78d-4e5f-4438-a53f-af07f660e27d admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91830) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 16:58:36.833108 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.quota.driver [None req-0875f70f-306c-4c4b-a5a3-fa4b20f27936 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91830) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 16:58:36.837978 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [None req-42d7e78d-4e5f-4438-a53f-af07f660e27d admin admin] Usage tracker for resource:security_group_rule and tenant:cb0720a756a44aa6b114236e2e63e4b3 is out of sync, need to count used quota {{(pid=91830) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 16:58:36.842340 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [None req-42d7e78d-4e5f-4438-a53f-af07f660e27d admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91830) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 16:58:36.851670 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.quota.driver [None req-42d7e78d-4e5f-4438-a53f-af07f660e27d admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91830) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 16:58:36.979152 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-0875f70f-306c-4c4b-a5a3-fa4b20f27936 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:36.991779 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-0875f70f-306c-4c4b-a5a3-fa4b20f27936 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-640836'] for security_group, after_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:37.002335 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-42d7e78d-4e5f-4438-a53f-af07f660e27d admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:37.004673 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-bb3ddb95-ab7e-4af7-86c0-e473777713ed admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:58:37.016800 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-42d7e78d-4e5f-4438-a53f-af07f660e27d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-640836'] for security_group, after_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:37.069311 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [None req-0875f70f-306c-4c4b-a5a3-fa4b20f27936 admin admin] 10.222.0.62 "GET /v2.0/security-groups?tenant_id=6acaeeff8e52470e80c9d8366ba9728d&name=default HTTP/1.1" status: 200 len: 2979 time: 0.5531192 May 25 16:58:37.069780 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.wsgi [-] (91829) accepted ('10.222.0.62', 55328) {{(pid=91829) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:58:37.071136 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0875f70f-306c-4c4b-a5a3-fa4b20f27936 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=5705f193-aeb0-483e-9bca-150e00231127,revision_number=1']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:58:37.074157 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-0875f70f-306c-4c4b-a5a3-fa4b20f27936 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.069s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:58:37.077211 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.037s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:58:37.087292 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [None req-42d7e78d-4e5f-4438-a53f-af07f660e27d admin admin] 10.222.0.62 "GET /v2.0/security-groups?tenant_id=cb0720a756a44aa6b114236e2e63e4b3&name=default HTTP/1.1" status: 200 len: 2979 time: 0.3927567 May 25 16:58:37.089968 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.wsgi [-] (91830) accepted ('10.222.0.62', 55332) {{(pid=91830) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:58:37.126985 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-42d7e78d-4e5f-4438-a53f-af07f660e27d admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=2226ad3f-981a-4d20-9997-f1f7c81383f4,revision_number=1']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:58:37.130329 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-42d7e78d-4e5f-4438-a53f-af07f660e27d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.053s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:58:37.171997 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-dbc1b6da-ab7e-46eb-8f4f-12aa08c23909 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:37.183156 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-9b770997-2313-4011-ac67-4e4e393bf65d req-ccd9a1e6-80dd-43f4-b21d-54cc29414e01 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/ports?device_id=d87a1395-92e0-4727-a5ed-a8dcdee587c3 HTTP/1.1" status: 200 len: 210 time: 0.1017594 May 25 16:58:37.214951 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-dbc1b6da-ab7e-46eb-8f4f-12aa08c23909 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:37.226790 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-066ef9fd-fd14-4bcc-b6a2-a142c619f63e admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:37.302033 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-dbc1b6da-ab7e-46eb-8f4f-12aa08c23909 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-640836'] for security_group, after_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:37.306255 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-0875f70f-306c-4c4b-a5a3-fa4b20f27936 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:58:37.325888 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dbc1b6da-ab7e-46eb-8f4f-12aa08c23909 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=2226ad3f-981a-4d20-9997-f1f7c81383f4,revision_number=None']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:58:37.340004 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-dbc1b6da-ab7e-46eb-8f4f-12aa08c23909 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.034s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:58:37.363157 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-dbc1b6da-ab7e-46eb-8f4f-12aa08c23909 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:37.364297 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [None req-dbc1b6da-ab7e-46eb-8f4f-12aa08c23909 admin admin] 10.222.0.62 "DELETE /v2.0/security-groups/2226ad3f-981a-4d20-9997-f1f7c81383f4 HTTP/1.1" status: 204 len: 168 time: 0.2734308 May 25 16:58:37.371793 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-066ef9fd-fd14-4bcc-b6a2-a142c619f63e admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:37.447775 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-26afc433-3e23-4164-b8d4-1dd7b700fac1 req-7d8c3dab-66b4-4c57-a319-da7eafd79e43 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] 10.222.0.62 "GET /v2.0/ports?device_id=bca36110-0b4f-419a-92ef-46cbb9d6215e HTTP/1.1" status: 200 len: 210 time: 0.0625384 May 25 16:58:37.496917 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dc8a3b85-ed07-4150-9df4-1822122319b9 req-170efa15-7774-4959-ab4f-ef42741e7626 tempest-DeleteServersTestJSON-1172980508 tempest-DeleteServersTestJSON-1172980508-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:58:37.498370 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-dc8a3b85-ed07-4150-9df4-1822122319b9 req-170efa15-7774-4959-ab4f-ef42741e7626 tempest-DeleteServersTestJSON-1172980508 tempest-DeleteServersTestJSON-1172980508-project] 10.222.0.62 "GET /v2.0/ports?device_id=1d5af5b3-8d0b-4cf9-a7f1-ce49a30efc33 HTTP/1.1" status: 200 len: 931 time: 0.2320960 May 25 16:58:37.526731 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-066ef9fd-fd14-4bcc-b6a2-a142c619f63e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-640836'] for security_group, after_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:37.535631 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:58:37.559688 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-066ef9fd-fd14-4bcc-b6a2-a142c619f63e admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=5705f193-aeb0-483e-9bca-150e00231127,revision_number=None']} {{(pid=91829) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:58:37.566933 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-066ef9fd-fd14-4bcc-b6a2-a142c619f63e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.031s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:58:37.570896 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-066ef9fd-fd14-4bcc-b6a2-a142c619f63e admin admin] Notify callbacks [] for security_group, before_response {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:37.575079 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [None req-066ef9fd-fd14-4bcc-b6a2-a142c619f63e admin admin] 10.222.0.62 "DELETE /v2.0/security-groups/5705f193-aeb0-483e-9bca-150e00231127 HTTP/1.1" status: 204 len: 168 time: 0.5044134 May 25 16:58:37.578669 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-dc8a3b85-ed07-4150-9df4-1822122319b9 req-61b1dc51-d92c-4c33-a304-44c95075d3c3 tempest-DeleteServersTestJSON-1172980508 tempest-DeleteServersTestJSON-1172980508-project] 10.222.0.62 "GET /v2.0/security-groups?id=ec198040-29f5-4dbf-8437-e486f3fb935b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0731089 May 25 16:58:37.977156 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.wsgi [-] (91830) accepted ('10.222.0.62', 55378) {{(pid=91830) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:58:38.001109 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-e0473cad-7db0-4f56-8d35-217e21662195 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:38.019452 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.quota.driver [None req-e0473cad-7db0-4f56-8d35-217e21662195 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91830) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 16:58:38.024266 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [None req-e0473cad-7db0-4f56-8d35-217e21662195 admin admin] Usage tracker for resource:security_group_rule and tenant:d38bc7450e874544af3ee38590f747e1 is out of sync, need to count used quota {{(pid=91830) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 16:58:38.027677 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [None req-e0473cad-7db0-4f56-8d35-217e21662195 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91830) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 16:58:38.034826 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.quota.driver [None req-e0473cad-7db0-4f56-8d35-217e21662195 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91830) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 16:58:38.046257 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.v2.base [req-640ac1a9-5581-4f73-9a9e-7ba94abe500f req-536c60b9-24d4-40c9-8ee1-0c6348339618 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] Request body: {'port': {'device_id': 'bca36110-0b4f-419a-92ef-46cbb9d6215e', 'network_id': '63b1f335-e2c4-48dd-886b-6be853f8a2fc', 'admin_state_up': True, 'tenant_id': '04e8022f24e3464ab1ab7726d6a07e08'}} {{(pid=91830) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 16:58:38.082181 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.wsgi [req-1f40d34a-0eb9-4d60-b5b9-5a06e965a5fa req-33298de4-3b14-4d09-ae9e-1db85e2a9dda tempest-DeleteServersTestJSON-1172980508 tempest-DeleteServersTestJSON-1172980508-project] http://10.222.0.62:9696/v2.0/extensions returned with HTTP 200 {{(pid=91830) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} May 25 16:58:38.083690 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-1f40d34a-0eb9-4d60-b5b9-5a06e965a5fa req-33298de4-3b14-4d09-ae9e-1db85e2a9dda tempest-DeleteServersTestJSON-1172980508 tempest-DeleteServersTestJSON-1172980508-project] 10.222.0.32 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 13640 time: 0.0070684 May 25 16:58:38.251538 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.quota.driver [req-640ac1a9-5581-4f73-9a9e-7ba94abe500f req-536c60b9-24d4-40c9-8ee1-0c6348339618 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91830) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 16:58:38.261419 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [req-640ac1a9-5581-4f73-9a9e-7ba94abe500f req-536c60b9-24d4-40c9-8ee1-0c6348339618 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] Usage tracker for resource:port and tenant:04e8022f24e3464ab1ab7726d6a07e08 is out of sync, need to count used quota {{(pid=91830) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 16:58:38.264834 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [req-640ac1a9-5581-4f73-9a9e-7ba94abe500f req-536c60b9-24d4-40c9-8ee1-0c6348339618 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] Quota usage for port was recalculated. Used quota:0. {{(pid=91830) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 16:58:38.280582 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.quota.driver [req-640ac1a9-5581-4f73-9a9e-7ba94abe500f req-536c60b9-24d4-40c9-8ee1-0c6348339618 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=91830) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 16:58:38.332868 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-e0473cad-7db0-4f56-8d35-217e21662195 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:38.343859 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-e0473cad-7db0-4f56-8d35-217e21662195 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-640836'] for security_group, after_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:38.355912 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-8a1aa840-85db-4a61-9b00-717d53415572 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:58:38.381121 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-640ac1a9-5581-4f73-9a9e-7ba94abe500f req-536c60b9-24d4-40c9-8ee1-0c6348339618 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] Made reservation on behalf of 04e8022f24e3464ab1ab7726d6a07e08 for: {'port': 1} {{(pid=91830) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 25 16:58:38.392688 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [req-640ac1a9-5581-4f73-9a9e-7ba94abe500f req-536c60b9-24d4-40c9-8ee1-0c6348339618 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3832070'] for port, before_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:38.478901 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-54cd2dd8-ce98-4c8f-a066-8e8ad74241fe req-e3426000-e3a8-462a-a2e1-f68e437dd9df tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/ports?device_id=d87a1395-92e0-4727-a5ed-a8dcdee587c3 HTTP/1.1" status: 200 len: 210 time: 0.0750728 May 25 16:58:38.489461 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [None req-e0473cad-7db0-4f56-8d35-217e21662195 admin admin] 10.222.0.62 "GET /v2.0/security-groups?tenant_id=d38bc7450e874544af3ee38590f747e1&name=default HTTP/1.1" status: 200 len: 2979 time: 0.5102196 May 25 16:58:38.492194 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.wsgi [-] (91829) accepted ('10.222.0.62', 55400) {{(pid=91829) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:58:38.544581 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.v2.base [req-1f40d34a-0eb9-4d60-b5b9-5a06e965a5fa req-7978e2af-825f-409b-ad99-16e1046c3d0b service neutron] Request body: {'port': {'device_id': '1d5af5b3-8d0b-4cf9-a7f1-ce49a30efc33', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-79049'}} {{(pid=91830) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 16:58:38.594873 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-d84540da-8977-4576-869d-8f01f0ad5f3e admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:38.661374 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-d84540da-8977-4576-869d-8f01f0ad5f3e admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:38.763787 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e0473cad-7db0-4f56-8d35-217e21662195 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b1b49698-1ae1-491e-8fb9-0190a160ed0a,revision_number=1']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:58:38.853844 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-e0473cad-7db0-4f56-8d35-217e21662195 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.498s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:58:38.928968 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [req-1f40d34a-0eb9-4d60-b5b9-5a06e965a5fa req-7978e2af-825f-409b-ad99-16e1046c3d0b service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3832070'] for port, before_update {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:38.969549 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-61bee81f-86bf-4e26-942a-b6223766e239 req-0f49721a-9f6e-4a07-b62f-a724222dbd9d tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] 10.222.0.62 "GET /v2.0/ports?device_id=bca36110-0b4f-419a-92ef-46cbb9d6215e HTTP/1.1" status: 200 len: 210 time: 0.2773139 May 25 16:58:39.022759 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-d84540da-8977-4576-869d-8f01f0ad5f3e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-640836'] for security_group, after_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:39.035422 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-e54887f5-6e73-4b61-9031-3b983e7b355a admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:58:39.066607 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-d84540da-8977-4576-869d-8f01f0ad5f3e admin admin] Notify callbacks [] for security_group, before_response {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:39.071228 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [None req-d84540da-8977-4576-869d-8f01f0ad5f3e admin admin] 10.222.0.62 "DELETE /v2.0/security-groups/b1b49698-1ae1-491e-8fb9-0190a160ed0a HTTP/1.1" status: 204 len: 168 time: 0.5778813 May 25 16:58:39.085701 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d84540da-8977-4576-869d-8f01f0ad5f3e admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b1b49698-1ae1-491e-8fb9-0190a160ed0a,revision_number=None']} {{(pid=91829) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:58:39.095766 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-d84540da-8977-4576-869d-8f01f0ad5f3e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.061s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:58:39.125563 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cef3c740-d191-4781-831e-3256f9f96127 req-91556442-57fa-47c7-ba2e-61bd068f2e9c tempest-DeleteServersTestJSON-1172980508 tempest-DeleteServersTestJSON-1172980508-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:58:39.127815 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-cef3c740-d191-4781-831e-3256f9f96127 req-91556442-57fa-47c7-ba2e-61bd068f2e9c tempest-DeleteServersTestJSON-1172980508 tempest-DeleteServersTestJSON-1172980508-project] 10.222.0.62 "GET /v2.0/ports?device_id=1d5af5b3-8d0b-4cf9-a7f1-ce49a30efc33 HTTP/1.1" status: 200 len: 931 time: 0.2668965 May 25 16:58:39.214903 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-cef3c740-d191-4781-831e-3256f9f96127 req-2e325449-60b2-4673-a3aa-3d49de3d63de tempest-DeleteServersTestJSON-1172980508 tempest-DeleteServersTestJSON-1172980508-project] 10.222.0.62 "GET /v2.0/security-groups?id=ec198040-29f5-4dbf-8437-e486f3fb935b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0800838 May 25 16:58:39.305093 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.db_base_plugin_common [req-640ac1a9-5581-4f73-9a9e-7ba94abe500f req-536c60b9-24d4-40c9-8ee1-0c6348339618 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] Allocated IP 172.20.0.8 (63b1f335-e2c4-48dd-886b-6be853f8a2fc/b0baa944-cafe-48a4-861a-dae28947b9f0/c4b9c0f2-e3d5-4fff-9b3c-a9175b027fb5) {{(pid=91830) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 25 16:58:39.336233 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.wsgi [-] (91829) accepted ('10.222.0.32', 55699) {{(pid=91829) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:58:39.685693 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1fc04329-def7-4f7c-bbd6-df77c33e33b6 req-5bd6733c-705c-4778-82b8-73a12a71a425 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:58:39.689161 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-1fc04329-def7-4f7c-bbd6-df77c33e33b6 req-5bd6733c-705c-4778-82b8-73a12a71a425 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.32 "GET /v2.0/networks?id=55a46372-d583-4435-a0f6-b9397668217d HTTP/1.1" status: 200 len: 818 time: 0.3516490 May 25 16:58:39.813006 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.v2.base [req-1fc04329-def7-4f7c-bbd6-df77c33e33b6 req-d1e0ec6a-5e14-42ef-94e8-4932e5d432be tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] Request body: {'port': {'device_id': '58da9205-0212-4daa-996c-1eef64a2b702', 'network_id': '55a46372-d583-4435-a0f6-b9397668217d', 'admin_state_up': True, 'tenant_id': '734df673f8b3484d80f35a45fbce9d5e'}} {{(pid=91829) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 16:58:39.885721 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-0151d7e4-87f4-44d0-abdf-5838a8dd70e6 req-2bc1d0e9-21cc-4cc3-83d1-d15d640973ea tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/ports?device_id=d87a1395-92e0-4727-a5ed-a8dcdee587c3 HTTP/1.1" status: 200 len: 210 time: 0.1875918 May 25 16:58:40.003510 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.wsgi [-] (91830) accepted ('10.222.0.32', 55703) {{(pid=91830) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:58:40.333367 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [req-640ac1a9-5581-4f73-9a9e-7ba94abe500f req-536c60b9-24d4-40c9-8ee1-0c6348339618 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] Notify callbacks [] for port, precommit_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:40.424493 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [req-640ac1a9-5581-4f73-9a9e-7ba94abe500f req-536c60b9-24d4-40c9-8ee1-0c6348339618 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8757892520915'] for port, after_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:40.455001 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.notifiers.nova [req-1f40d34a-0eb9-4d60-b5b9-5a06e965a5fa req-7978e2af-825f-409b-ad99-16e1046c3d0b service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id a460da33-52a2-41d5-bcf5-1baa12e65f8f {{(pid=91830) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} May 25 16:58:40.460435 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:58:40.607612 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-536c60b9-24d4-40c9-8ee1-0c6348339618 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] Pushing event updated for resources: {'Port': ['ID=c4b9c0f2-e3d5-4fff-9b3c-a9175b027fb5,revision_number=1']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:58:40.616469 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-687f50bd-726f-4df1-a7d3-037283187d42 req-852c2973-c4a1-43a1-bf50-1224ce06454e tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=91830) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:58:40.617957 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-687f50bd-726f-4df1-a7d3-037283187d42 req-852c2973-c4a1-43a1-bf50-1224ce06454e tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.32 "GET /v2.0/networks?id=55a46372-d583-4435-a0f6-b9397668217d HTTP/1.1" status: 200 len: 818 time: 0.6043358 May 25 16:58:40.619763 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [req-1f40d34a-0eb9-4d60-b5b9-5a06e965a5fa req-7978e2af-825f-409b-ad99-16e1046c3d0b service neutron] Notify callbacks [] for port, precommit_update {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:40.621694 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.quota.driver [req-1fc04329-def7-4f7c-bbd6-df77c33e33b6 req-d1e0ec6a-5e14-42ef-94e8-4932e5d432be tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91829) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 16:58:40.622749 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-536c60b9-24d4-40c9-8ee1-0c6348339618 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.162s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:58:40.628739 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-640ac1a9-5581-4f73-9a9e-7ba94abe500f req-536c60b9-24d4-40c9-8ee1-0c6348339618 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] Network 63b1f335-e2c4-48dd-886b-6be853f8a2fc is already hosted by enough agents. {{(pid=91830) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 25 16:58:40.632998 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.scheduler.base_scheduler [req-640ac1a9-5581-4f73-9a9e-7ba94abe500f req-536c60b9-24d4-40c9-8ee1-0c6348339618 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] Resources bound (agent type, host, resource id): {{(pid=91830) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 16:58:40.641545 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.v2.base [req-687f50bd-726f-4df1-a7d3-037283187d42 req-8dbd849d-a3ea-44e3-91be-f6e8be2ff101 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] Request body: {'port': {'device_id': 'd87a1395-92e0-4727-a5ed-a8dcdee587c3', 'network_id': '55a46372-d583-4435-a0f6-b9397668217d', 'admin_state_up': True, 'tenant_id': '734df673f8b3484d80f35a45fbce9d5e'}} {{(pid=91830) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 16:58:40.651441 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.quota.resource [req-1fc04329-def7-4f7c-bbd6-df77c33e33b6 req-d1e0ec6a-5e14-42ef-94e8-4932e5d432be tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] Usage tracker for resource:port and tenant:734df673f8b3484d80f35a45fbce9d5e is out of sync, need to count used quota {{(pid=91829) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 16:58:40.661171 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.l3_dvrscheduler_db [req-640ac1a9-5581-4f73-9a9e-7ba94abe500f req-536c60b9-24d4-40c9-8ee1-0c6348339618 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] Received port after_create {{(pid=91830) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 25 16:58:40.661483 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.quota.resource [req-1fc04329-def7-4f7c-bbd6-df77c33e33b6 req-d1e0ec6a-5e14-42ef-94e8-4932e5d432be tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] Quota usage for port was recalculated. Used quota:1. {{(pid=91829) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 16:58:40.669069 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-640ac1a9-5581-4f73-9a9e-7ba94abe500f req-536c60b9-24d4-40c9-8ee1-0c6348339618 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=91830) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:58:40.669783 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [req-640ac1a9-5581-4f73-9a9e-7ba94abe500f req-536c60b9-24d4-40c9-8ee1-0c6348339618 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-178712', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-551373'] for port, before_response {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:40.674931 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.quota.driver [req-1fc04329-def7-4f7c-bbd6-df77c33e33b6 req-d1e0ec6a-5e14-42ef-94e8-4932e5d432be tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] Attempting to reserve 1 items for resource port. Total usage: 1; quota limit: 500; headroom:499 {{(pid=91829) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 16:58:40.708400 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.provisioning_blocks [req-1f40d34a-0eb9-4d60-b5b9-5a06e965a5fa req-7978e2af-825f-409b-ad99-16e1046c3d0b service neutron] Transition to ACTIVE for port object a460da33-52a2-41d5-bcf5-1baa12e65f8f will not be triggered until provisioned by entity L2. {{(pid=91830) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 25 16:58:40.710619 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-640ac1a9-5581-4f73-9a9e-7ba94abe500f req-536c60b9-24d4-40c9-8ee1-0c6348339618 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] 10.222.0.32 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 2.6704748 May 25 16:58:40.713247 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f1ef3660-18fb-4cfc-91da-f77f6ec6f274 req-e7ed72d2-60da-4434-859d-7463afa39a1c tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:58:40.716445 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [req-1f40d34a-0eb9-4d60-b5b9-5a06e965a5fa req-7978e2af-825f-409b-ad99-16e1046c3d0b service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8757892955028', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8757892520933', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8757892521750'] for port, after_update {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:40.721018 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-f1ef3660-18fb-4cfc-91da-f77f6ec6f274 req-e7ed72d2-60da-4434-859d-7463afa39a1c tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] 10.222.0.62 "GET /v2.0/ports?device_id=bca36110-0b4f-419a-92ef-46cbb9d6215e HTTP/1.1" status: 200 len: 931 time: 0.3757210 May 25 16:58:40.725722 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-1fc04329-def7-4f7c-bbd6-df77c33e33b6 req-d1e0ec6a-5e14-42ef-94e8-4932e5d432be tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] Made reservation on behalf of 734df673f8b3484d80f35a45fbce9d5e for: {'port': 1} {{(pid=91829) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 25 16:58:40.729089 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [req-1fc04329-def7-4f7c-bbd6-df77c33e33b6 req-d1e0ec6a-5e14-42ef-94e8-4932e5d432be tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3832070'] for port, before_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:40.776702 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-950b4827-a709-43f5-a23c-fd8d66e4811a admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:58:40.808572 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.v2.base [req-640ac1a9-5581-4f73-9a9e-7ba94abe500f req-489a5ab3-bf21-41bc-b210-0415fae48d65 service neutron] Request body: {'port': {'device_id': 'bca36110-0b4f-419a-92ef-46cbb9d6215e', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-79049'}} {{(pid=91830) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 16:58:40.824273 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f8b4f3e8-edd3-4882-b89f-60b725c711ad req-91cdb6bb-6ee2-4c83-9af2-498b7cac33b8 tempest-DeleteServersTestJSON-1172980508 tempest-DeleteServersTestJSON-1172980508-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:58:40.825728 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-f8b4f3e8-edd3-4882-b89f-60b725c711ad req-91cdb6bb-6ee2-4c83-9af2-498b7cac33b8 tempest-DeleteServersTestJSON-1172980508 tempest-DeleteServersTestJSON-1172980508-project] 10.222.0.62 "GET /v2.0/ports?device_id=1d5af5b3-8d0b-4cf9-a7f1-ce49a30efc33 HTTP/1.1" status: 200 len: 931 time: 0.2627633 May 25 16:58:40.936862 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-f1ef3660-18fb-4cfc-91da-f77f6ec6f274 req-1b33199d-9352-4854-903f-e053db7f49b6 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] 10.222.0.62 "GET /v2.0/security-groups?id=f73b90a2-df48-48fb-99e0-5dd4d6a63a15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2098200 May 25 16:58:40.974153 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-f8b4f3e8-edd3-4882-b89f-60b725c711ad req-07e8bae4-1ef4-4fb8-ad1c-905c50488018 tempest-DeleteServersTestJSON-1172980508 tempest-DeleteServersTestJSON-1172980508-project] 10.222.0.62 "GET /v2.0/security-groups?id=ec198040-29f5-4dbf-8437-e486f3fb935b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1389654 May 25 16:58:41.220402 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-4e002d50-5acd-4ab9-8d8e-a13edf3fa896 req-dde44c9f-d46c-41ff-8c3c-5c80e5a56e71 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/ports?device_id=d87a1395-92e0-4727-a5ed-a8dcdee587c3 HTTP/1.1" status: 200 len: 210 time: 0.0698495 May 25 16:58:41.245649 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.db_base_plugin_common [req-1fc04329-def7-4f7c-bbd6-df77c33e33b6 req-d1e0ec6a-5e14-42ef-94e8-4932e5d432be tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] Allocated IP 172.20.0.8 (55a46372-d583-4435-a0f6-b9397668217d/927bd65a-c4de-491b-b501-302852f4c784/60078444-24b6-4560-b0a7-7802c4f8f2f8) {{(pid=91829) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 25 16:58:41.252257 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [req-640ac1a9-5581-4f73-9a9e-7ba94abe500f req-489a5ab3-bf21-41bc-b210-0415fae48d65 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3832070'] for port, before_update {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:41.269210 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7978e2af-825f-409b-ad99-16e1046c3d0b service neutron] Pushing event updated for resources: {'Port': ['ID=a460da33-52a2-41d5-bcf5-1baa12e65f8f,revision_number=2']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:58:41.278607 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.plugins.ml2.managers [req-1f40d34a-0eb9-4d60-b5b9-5a06e965a5fa req-7978e2af-825f-409b-ad99-16e1046c3d0b service neutron] Attempting to bind port a460da33-52a2-41d5-bcf5-1baa12e65f8f on host hv-cinder-79049 for vnic_type normal with profile {{(pid=91830) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 25 16:58:41.279345 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.plugins.ml2.managers [req-1f40d34a-0eb9-4d60-b5b9-5a06e965a5fa req-7978e2af-825f-409b-ad99-16e1046c3d0b service neutron] Attempting to bind port a460da33-52a2-41d5-bcf5-1baa12e65f8f by drivers openvswitch,hyperv on host hv-cinder-79049 at level 0 using segments [{'id': '8721f8e7-e59f-46c5-9d87-1b6cc08601ef', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 672, 'network_id': 'ca95b136-0269-430f-b450-69ee5473ae7d'}] {{(pid=91830) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 25 16:58:41.289363 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1f40d34a-0eb9-4d60-b5b9-5a06e965a5fa req-7978e2af-825f-409b-ad99-16e1046c3d0b service neutron] Attempting to bind port a460da33-52a2-41d5-bcf5-1baa12e65f8f on network ca95b136-0269-430f-b450-69ee5473ae7d {{(pid=91830) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 25 16:58:41.298963 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-7978e2af-825f-409b-ad99-16e1046c3d0b service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.522s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:58:41.430141 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1f40d34a-0eb9-4d60-b5b9-5a06e965a5fa req-7978e2af-825f-409b-ad99-16e1046c3d0b service neutron] Port a460da33-52a2-41d5-bcf5-1baa12e65f8f on network ca95b136-0269-430f-b450-69ee5473ae7d not bound, no agent of type Open vSwitch agent registered on host hv-cinder-79049 {{(pid=91830) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 25 16:58:41.446576 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1f40d34a-0eb9-4d60-b5b9-5a06e965a5fa req-7978e2af-825f-409b-ad99-16e1046c3d0b service neutron] Attempting to bind port a460da33-52a2-41d5-bcf5-1baa12e65f8f on network ca95b136-0269-430f-b450-69ee5473ae7d {{(pid=91830) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 25 16:58:41.446576 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.quota.driver [req-687f50bd-726f-4df1-a7d3-037283187d42 req-8dbd849d-a3ea-44e3-91be-f6e8be2ff101 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91830) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 16:58:41.446576 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [req-687f50bd-726f-4df1-a7d3-037283187d42 req-8dbd849d-a3ea-44e3-91be-f6e8be2ff101 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] Usage tracker for resource:port and tenant:734df673f8b3484d80f35a45fbce9d5e is out of sync, need to count used quota {{(pid=91830) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 16:58:41.446576 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [req-687f50bd-726f-4df1-a7d3-037283187d42 req-8dbd849d-a3ea-44e3-91be-f6e8be2ff101 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] Quota usage for port was recalculated. Used quota:1. {{(pid=91830) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 16:58:41.471966 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.quota.driver [req-687f50bd-726f-4df1-a7d3-037283187d42 req-8dbd849d-a3ea-44e3-91be-f6e8be2ff101 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] Attempting to reserve 1 items for resource port. Total usage: 2; quota limit: 500; headroom:498 {{(pid=91830) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 16:58:41.483859 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1f40d34a-0eb9-4d60-b5b9-5a06e965a5fa req-7978e2af-825f-409b-ad99-16e1046c3d0b service neutron] Checking agent: {'id': '3a1fdee1-bff0-49fb-b470-e13b95ee1b4d', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-79049', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 25, 16, 56, 32), 'started_at': datetime.datetime(2021, 5, 25, 16, 56, 32), 'heartbeat_timestamp': datetime.datetime(2021, 5, 25, 16, 58, 32), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=91830) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 25 16:58:41.484478 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1f40d34a-0eb9-4d60-b5b9-5a06e965a5fa req-7978e2af-825f-409b-ad99-16e1046c3d0b service neutron] Checking segment: {'id': '8721f8e7-e59f-46c5-9d87-1b6cc08601ef', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 672, 'network_id': 'ca95b136-0269-430f-b450-69ee5473ae7d'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91830) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 25 16:58:41.485385 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1f40d34a-0eb9-4d60-b5b9-5a06e965a5fa req-7978e2af-825f-409b-ad99-16e1046c3d0b service neutron] Bound using segment: {'id': '8721f8e7-e59f-46c5-9d87-1b6cc08601ef', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 672, 'network_id': 'ca95b136-0269-430f-b450-69ee5473ae7d'} {{(pid=91830) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 25 16:58:41.486330 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.plugins.ml2.managers [req-1f40d34a-0eb9-4d60-b5b9-5a06e965a5fa req-7978e2af-825f-409b-ad99-16e1046c3d0b service neutron] Bound port: a460da33-52a2-41d5-bcf5-1baa12e65f8f, host: hv-cinder-79049, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '8721f8e7-e59f-46c5-9d87-1b6cc08601ef', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 672, 'network_id': 'ca95b136-0269-430f-b450-69ee5473ae7d'}}] {{(pid=91830) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 25 16:58:41.487692 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [req-1f40d34a-0eb9-4d60-b5b9-5a06e965a5fa req-7978e2af-825f-409b-ad99-16e1046c3d0b service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3832070'] for port, before_update {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:41.516177 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [req-1fc04329-def7-4f7c-bbd6-df77c33e33b6 req-d1e0ec6a-5e14-42ef-94e8-4932e5d432be tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] Notify callbacks [] for port, precommit_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:41.564875 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [req-1fc04329-def7-4f7c-bbd6-df77c33e33b6 req-d1e0ec6a-5e14-42ef-94e8-4932e5d432be tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8757892520915', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28230808'] for port, after_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:41.575588 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-32f6c65c-8179-4466-8c05-98168076c0bc admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:58:41.615989 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.plugins.ml2.db [req-1f40d34a-0eb9-4d60-b5b9-5a06e965a5fa req-7978e2af-825f-409b-ad99-16e1046c3d0b service neutron] For port a460da33-52a2-41d5-bcf5-1baa12e65f8f, host hv-cinder-79049, cleared binding levels {{(pid=91830) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 25 16:58:41.622861 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.plugins.ml2.db [req-1f40d34a-0eb9-4d60-b5b9-5a06e965a5fa req-7978e2af-825f-409b-ad99-16e1046c3d0b service neutron] For port a460da33-52a2-41d5-bcf5-1baa12e65f8f, host hv-cinder-79049, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79049',level=0,port_id=a460da33-52a2-41d5-bcf5-1baa12e65f8f,segment=NetworkSegment(8721f8e7-e59f-46c5-9d87-1b6cc08601ef),segment_id=8721f8e7-e59f-46c5-9d87-1b6cc08601ef)] {{(pid=91830) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 25 16:58:41.638779 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-687f50bd-726f-4df1-a7d3-037283187d42 req-8dbd849d-a3ea-44e3-91be-f6e8be2ff101 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] Made reservation on behalf of 734df673f8b3484d80f35a45fbce9d5e for: {'port': 1} {{(pid=91830) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 25 16:58:41.642485 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [req-687f50bd-726f-4df1-a7d3-037283187d42 req-8dbd849d-a3ea-44e3-91be-f6e8be2ff101 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3832070'] for port, before_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:41.672967 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d1e0ec6a-5e14-42ef-94e8-4932e5d432be tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] Pushing event updated for resources: {'Port': ['ID=60078444-24b6-4560-b0a7-7802c4f8f2f8,revision_number=1']} {{(pid=91829) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:58:41.694082 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-1fc04329-def7-4f7c-bbd6-df77c33e33b6 req-d1e0ec6a-5e14-42ef-94e8-4932e5d432be tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] Network 55a46372-d583-4435-a0f6-b9397668217d is already hosted by enough agents. {{(pid=91829) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 25 16:58:41.695436 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-d1e0ec6a-5e14-42ef-94e8-4932e5d432be tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.120s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:58:41.696488 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.scheduler.base_scheduler [req-1fc04329-def7-4f7c-bbd6-df77c33e33b6 req-d1e0ec6a-5e14-42ef-94e8-4932e5d432be tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] Resources bound (agent type, host, resource id): {{(pid=91829) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 16:58:41.699786 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.l3_dvrscheduler_db [req-1fc04329-def7-4f7c-bbd6-df77c33e33b6 req-d1e0ec6a-5e14-42ef-94e8-4932e5d432be tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] Received port after_create {{(pid=91829) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 25 16:58:41.720988 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [req-1f40d34a-0eb9-4d60-b5b9-5a06e965a5fa req-7978e2af-825f-409b-ad99-16e1046c3d0b service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8757892955028', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8757892520933', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8757892521750'] for port, after_update {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:41.775798 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:58:41.782962 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1fc04329-def7-4f7c-bbd6-df77c33e33b6 req-d1e0ec6a-5e14-42ef-94e8-4932e5d432be tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:58:41.783434 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [req-1fc04329-def7-4f7c-bbd6-df77c33e33b6 req-d1e0ec6a-5e14-42ef-94e8-4932e5d432be tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-178712', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-551373'] for port, before_response {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:41.818850 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-1fc04329-def7-4f7c-bbd6-df77c33e33b6 req-d1e0ec6a-5e14-42ef-94e8-4932e5d432be tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.32 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 2.0303488 May 25 16:58:41.836505 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.v2.base [req-1fc04329-def7-4f7c-bbd6-df77c33e33b6 req-42905d27-cfb2-4b93-8c1c-2dd7aa37f822 service neutron] Request body: {'port': {'device_id': '58da9205-0212-4daa-996c-1eef64a2b702', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-79049'}} {{(pid=91829) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 16:58:42.034383 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [req-1fc04329-def7-4f7c-bbd6-df77c33e33b6 req-42905d27-cfb2-4b93-8c1c-2dd7aa37f822 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3832070'] for port, before_update {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:42.043101 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7978e2af-825f-409b-ad99-16e1046c3d0b service neutron] Pushing event updated for resources: {'Port': ['ID=a460da33-52a2-41d5-bcf5-1baa12e65f8f,revision_number=3']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:58:42.076249 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-7978e2af-825f-409b-ad99-16e1046c3d0b service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.300s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:58:42.270980 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1f40d34a-0eb9-4d60-b5b9-5a06e965a5fa req-7978e2af-825f-409b-ad99-16e1046c3d0b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91830) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:58:42.271652 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [req-1f40d34a-0eb9-4d60-b5b9-5a06e965a5fa req-7978e2af-825f-409b-ad99-16e1046c3d0b service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-178712', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-551373'] for port, before_response {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:42.273067 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-1f40d34a-0eb9-4d60-b5b9-5a06e965a5fa req-7978e2af-825f-409b-ad99-16e1046c3d0b service neutron] 10.222.0.32 "PUT /v2.0/ports/a460da33-52a2-41d5-bcf5-1baa12e65f8f HTTP/1.1" status: 200 len: 1093 time: 3.9570875 May 25 16:58:42.291239 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '1d5af5b3-8d0b-4cf9-a7f1-ce49a30efc33', 'tag': 'a460da33-52a2-41d5-bcf5-1baa12e65f8f'}] {{(pid=91830) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 25 16:58:42.344907 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.wsgi [-] (91829) accepted ('10.222.0.62', 55574) {{(pid=91829) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:58:42.475857 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.db_base_plugin_common [req-687f50bd-726f-4df1-a7d3-037283187d42 req-8dbd849d-a3ea-44e3-91be-f6e8be2ff101 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] Allocated IP 172.20.0.3 (55a46372-d583-4435-a0f6-b9397668217d/927bd65a-c4de-491b-b501-302852f4c784/250e0a7c-f7d1-4092-af1f-d50d5b92f68a) {{(pid=91830) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 25 16:58:42.501801 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5f1976be-9b3d-456d-9b87-0ddf2639438e req-324e2d50-e822-4a43-940b-93b5c42e2cd9 tempest-DeleteServersTestJSON-1172980508 tempest-DeleteServersTestJSON-1172980508-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:58:42.503377 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-5f1976be-9b3d-456d-9b87-0ddf2639438e req-324e2d50-e822-4a43-940b-93b5c42e2cd9 tempest-DeleteServersTestJSON-1172980508 tempest-DeleteServersTestJSON-1172980508-project] 10.222.0.62 "GET /v2.0/ports?device_id=1d5af5b3-8d0b-4cf9-a7f1-ce49a30efc33 HTTP/1.1" status: 200 len: 943 time: 0.2632589 May 25 16:58:42.515895 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c6f8ad2d-61ab-48d7-9c33-3ffb1347f99e req-59f3687e-1fef-4746-ad67-89b80e782f9a tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:58:42.523568 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-c6f8ad2d-61ab-48d7-9c33-3ffb1347f99e req-59f3687e-1fef-4746-ad67-89b80e782f9a tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] 10.222.0.62 "GET /v2.0/ports?device_id=bca36110-0b4f-419a-92ef-46cbb9d6215e HTTP/1.1" status: 200 len: 931 time: 0.2822599 May 25 16:58:42.538538 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1f40d34a-0eb9-4d60-b5b9-5a06e965a5fa req-3ee5e5e3-1a8e-456e-b498-621ea4950891 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91830) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:58:42.540012 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-1f40d34a-0eb9-4d60-b5b9-5a06e965a5fa req-3ee5e5e3-1a8e-456e-b498-621ea4950891 service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=00ab1bb5f5df49f08ef4b15635754b71&device_id=1d5af5b3-8d0b-4cf9-a7f1-ce49a30efc33 HTTP/1.1" status: 200 len: 1096 time: 0.1718423 May 25 16:58:42.595784 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-c6f8ad2d-61ab-48d7-9c33-3ffb1347f99e req-4da42915-feef-4074-8ee3-1c7a7e6be4be tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] 10.222.0.62 "GET /v2.0/security-groups?id=f73b90a2-df48-48fb-99e0-5dd4d6a63a15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0711770 May 25 16:58:42.621869 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-5f1976be-9b3d-456d-9b87-0ddf2639438e req-f5637b7f-a103-4099-b1b4-e6b0ff8b1100 tempest-DeleteServersTestJSON-1172980508 tempest-DeleteServersTestJSON-1172980508-project] 10.222.0.62 "GET /v2.0/security-groups?id=ec198040-29f5-4dbf-8437-e486f3fb935b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0961132 May 25 16:58:42.622776 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-a37eda00-7e38-4b47-a60c-7f4af0910922 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:42.649283 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.quota.driver [None req-a37eda00-7e38-4b47-a60c-7f4af0910922 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91829) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 16:58:42.653689 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.quota.resource [None req-a37eda00-7e38-4b47-a60c-7f4af0910922 admin admin] Usage tracker for resource:security_group_rule and tenant:cbb4c8f829624f68a726806f4666ef1c is out of sync, need to count used quota {{(pid=91829) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 16:58:42.657037 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.quota.resource [None req-a37eda00-7e38-4b47-a60c-7f4af0910922 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91829) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 16:58:42.663868 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.quota.driver [None req-a37eda00-7e38-4b47-a60c-7f4af0910922 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91829) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 16:58:42.668280 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-1f40d34a-0eb9-4d60-b5b9-5a06e965a5fa req-263f544c-eedf-4b04-a3b4-c08227a36af3 service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=a460da33-52a2-41d5-bcf5-1baa12e65f8f HTTP/1.1" status: 200 len: 217 time: 0.1146655 May 25 16:58:42.756446 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.notifiers.nova [req-640ac1a9-5581-4f73-9a9e-7ba94abe500f req-489a5ab3-bf21-41bc-b210-0415fae48d65 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id c4b9c0f2-e3d5-4fff-9b3c-a9175b027fb5 {{(pid=91830) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} May 25 16:58:42.803456 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.quota.resource [req-b04fae29-e789-4e8d-8552-02c4485a85e3 req-72eb78d2-e85a-45c5-9ad7-bf6c0dc13d05 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] Synchronizing usage tracker for tenant:734df673f8b3484d80f35a45fbce9d5e on resource:port {{(pid=91829) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 25 16:58:42.820488 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '1d5af5b3-8d0b-4cf9-a7f1-ce49a30efc33', 'tag': 'a460da33-52a2-41d5-bcf5-1baa12e65f8f', 'status': 'completed', 'code': 200} May 25 16:58:42.824218 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [req-640ac1a9-5581-4f73-9a9e-7ba94abe500f req-489a5ab3-bf21-41bc-b210-0415fae48d65 service neutron] Notify callbacks [] for port, precommit_update {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:42.858163 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-a37eda00-7e38-4b47-a60c-7f4af0910922 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:42.862935 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-a37eda00-7e38-4b47-a60c-7f4af0910922 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-640836'] for security_group, after_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:42.864635 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1f40d34a-0eb9-4d60-b5b9-5a06e965a5fa req-e68fd30f-df3e-4264-9e0d-6c3bc200b98b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=91830) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:58:42.866118 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-1f40d34a-0eb9-4d60-b5b9-5a06e965a5fa req-e68fd30f-df3e-4264-9e0d-6c3bc200b98b service neutron] 10.222.0.32 "GET /v2.0/subnets?id=34034d6a-51f1-4e15-aa5b-0f79437d26f5 HTTP/1.1" status: 200 len: 851 time: 0.1890578 May 25 16:58:42.869171 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.provisioning_blocks [req-640ac1a9-5581-4f73-9a9e-7ba94abe500f req-489a5ab3-bf21-41bc-b210-0415fae48d65 service neutron] Transition to ACTIVE for port object c4b9c0f2-e3d5-4fff-9b3c-a9175b027fb5 will not be triggered until provisioned by entity L2. {{(pid=91830) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 25 16:58:42.877577 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-a4941583-3207-498d-92b5-e58b25b681e3 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:58:42.895879 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.quota.resource [req-b04fae29-e789-4e8d-8552-02c4485a85e3 req-72eb78d2-e85a-45c5-9ad7-bf6c0dc13d05 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] Unset dirty status for tenant:734df673f8b3484d80f35a45fbce9d5e on resource:port {{(pid=91829) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 25 16:58:42.897020 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-b04fae29-e789-4e8d-8552-02c4485a85e3 req-72eb78d2-e85a-45c5-9ad7-bf6c0dc13d05 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/ports?device_id=d87a1395-92e0-4727-a5ed-a8dcdee587c3 HTTP/1.1" status: 200 len: 210 time: 0.1687067 May 25 16:58:42.917378 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-1f40d34a-0eb9-4d60-b5b9-5a06e965a5fa req-0ed41d97-a213-4647-b042-0f97a512e77a service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=ca95b136-0269-430f-b450-69ee5473ae7d&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0442171 May 25 16:58:42.917987 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [req-640ac1a9-5581-4f73-9a9e-7ba94abe500f req-489a5ab3-bf21-41bc-b210-0415fae48d65 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8757892955028', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8757892520933', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8757892521750'] for port, after_update {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:42.927267 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a37eda00-7e38-4b47-a60c-7f4af0910922 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=97ad3767-4cc6-404d-9beb-ed235b37e06d,revision_number=1']} {{(pid=91829) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:58:42.930223 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-a37eda00-7e38-4b47-a60c-7f4af0910922 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.053s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:58:42.934331 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:58:42.935809 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [None req-a37eda00-7e38-4b47-a60c-7f4af0910922 admin admin] 10.222.0.62 "GET /v2.0/security-groups?tenant_id=cbb4c8f829624f68a726806f4666ef1c&name=default HTTP/1.1" status: 200 len: 2979 time: 0.5455055 May 25 16:58:42.936634 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.wsgi [-] (91829) accepted ('10.222.0.62', 55602) {{(pid=91829) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:58:43.007732 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-1e271c69-0798-4a1a-ae03-5e718fda96ac admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:43.038891 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-1e271c69-0798-4a1a-ae03-5e718fda96ac admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:43.099669 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-1e271c69-0798-4a1a-ae03-5e718fda96ac admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-640836'] for security_group, after_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:43.106149 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-16ba5b9e-d782-4dc5-be96-13fae85a7c29 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:58:43.119063 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1e271c69-0798-4a1a-ae03-5e718fda96ac admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=97ad3767-4cc6-404d-9beb-ed235b37e06d,revision_number=None']} {{(pid=91829) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:58:43.125180 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-1e271c69-0798-4a1a-ae03-5e718fda96ac admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.019s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:58:43.126765 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-1e271c69-0798-4a1a-ae03-5e718fda96ac admin admin] Notify callbacks [] for security_group, before_response {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:43.128497 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [None req-1e271c69-0798-4a1a-ae03-5e718fda96ac admin admin] 10.222.0.62 "DELETE /v2.0/security-groups/97ad3767-4cc6-404d-9beb-ed235b37e06d HTTP/1.1" status: 204 len: 168 time: 0.1899700 May 25 16:58:43.183740 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-489a5ab3-bf21-41bc-b210-0415fae48d65 service neutron] Pushing event updated for resources: {'Port': ['ID=c4b9c0f2-e3d5-4fff-9b3c-a9175b027fb5,revision_number=2']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:58:43.187079 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-489a5ab3-bf21-41bc-b210-0415fae48d65 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.253s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:58:43.223510 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [req-687f50bd-726f-4df1-a7d3-037283187d42 req-8dbd849d-a3ea-44e3-91be-f6e8be2ff101 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] Notify callbacks [] for port, precommit_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:43.276890 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.plugins.ml2.managers [req-640ac1a9-5581-4f73-9a9e-7ba94abe500f req-489a5ab3-bf21-41bc-b210-0415fae48d65 service neutron] Attempting to bind port c4b9c0f2-e3d5-4fff-9b3c-a9175b027fb5 on host hv-cinder-79049 for vnic_type normal with profile {{(pid=91830) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 25 16:58:43.277430 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.plugins.ml2.managers [req-640ac1a9-5581-4f73-9a9e-7ba94abe500f req-489a5ab3-bf21-41bc-b210-0415fae48d65 service neutron] Attempting to bind port c4b9c0f2-e3d5-4fff-9b3c-a9175b027fb5 by drivers openvswitch,hyperv on host hv-cinder-79049 at level 0 using segments [{'id': '7d7273c2-c6dd-43fe-83a8-cb776d48dc70', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 651, 'network_id': '63b1f335-e2c4-48dd-886b-6be853f8a2fc'}] {{(pid=91830) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 25 16:58:43.277934 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-640ac1a9-5581-4f73-9a9e-7ba94abe500f req-489a5ab3-bf21-41bc-b210-0415fae48d65 service neutron] Attempting to bind port c4b9c0f2-e3d5-4fff-9b3c-a9175b027fb5 on network 63b1f335-e2c4-48dd-886b-6be853f8a2fc {{(pid=91830) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 25 16:58:43.297061 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-640ac1a9-5581-4f73-9a9e-7ba94abe500f req-489a5ab3-bf21-41bc-b210-0415fae48d65 service neutron] Port c4b9c0f2-e3d5-4fff-9b3c-a9175b027fb5 on network 63b1f335-e2c4-48dd-886b-6be853f8a2fc not bound, no agent of type Open vSwitch agent registered on host hv-cinder-79049 {{(pid=91830) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 25 16:58:43.297449 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-640ac1a9-5581-4f73-9a9e-7ba94abe500f req-489a5ab3-bf21-41bc-b210-0415fae48d65 service neutron] Attempting to bind port c4b9c0f2-e3d5-4fff-9b3c-a9175b027fb5 on network 63b1f335-e2c4-48dd-886b-6be853f8a2fc {{(pid=91830) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 25 16:58:43.313756 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-640ac1a9-5581-4f73-9a9e-7ba94abe500f req-489a5ab3-bf21-41bc-b210-0415fae48d65 service neutron] Checking agent: {'id': '3a1fdee1-bff0-49fb-b470-e13b95ee1b4d', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-79049', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 25, 16, 56, 32), 'started_at': datetime.datetime(2021, 5, 25, 16, 56, 32), 'heartbeat_timestamp': datetime.datetime(2021, 5, 25, 16, 58, 32), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=91830) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 25 16:58:43.314321 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-640ac1a9-5581-4f73-9a9e-7ba94abe500f req-489a5ab3-bf21-41bc-b210-0415fae48d65 service neutron] Checking segment: {'id': '7d7273c2-c6dd-43fe-83a8-cb776d48dc70', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 651, 'network_id': '63b1f335-e2c4-48dd-886b-6be853f8a2fc'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91830) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 25 16:58:43.314851 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-640ac1a9-5581-4f73-9a9e-7ba94abe500f req-489a5ab3-bf21-41bc-b210-0415fae48d65 service neutron] Bound using segment: {'id': '7d7273c2-c6dd-43fe-83a8-cb776d48dc70', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 651, 'network_id': '63b1f335-e2c4-48dd-886b-6be853f8a2fc'} {{(pid=91830) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 25 16:58:43.315969 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.plugins.ml2.managers [req-640ac1a9-5581-4f73-9a9e-7ba94abe500f req-489a5ab3-bf21-41bc-b210-0415fae48d65 service neutron] Bound port: c4b9c0f2-e3d5-4fff-9b3c-a9175b027fb5, host: hv-cinder-79049, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '7d7273c2-c6dd-43fe-83a8-cb776d48dc70', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 651, 'network_id': '63b1f335-e2c4-48dd-886b-6be853f8a2fc'}}] {{(pid=91830) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 25 16:58:43.316471 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [req-640ac1a9-5581-4f73-9a9e-7ba94abe500f req-489a5ab3-bf21-41bc-b210-0415fae48d65 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3832070'] for port, before_update {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:43.329279 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-1f40d34a-0eb9-4d60-b5b9-5a06e965a5fa req-91955662-8b03-4592-8c54-eab120d1baa8 service neutron] 10.222.0.32 "GET /v2.0/networks/ca95b136-0269-430f-b450-69ee5473ae7d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3613763 May 25 16:58:43.468152 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [req-687f50bd-726f-4df1-a7d3-037283187d42 req-8dbd849d-a3ea-44e3-91be-f6e8be2ff101 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8757892520915'] for port, after_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:43.489416 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-489a5ab3-bf21-41bc-b210-0415fae48d65 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:58:43.604278 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-687f50bd-726f-4df1-a7d3-037283187d42 req-8dbd849d-a3ea-44e3-91be-f6e8be2ff101 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] Network 55a46372-d583-4435-a0f6-b9397668217d is already hosted by enough agents. {{(pid=91830) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 25 16:58:43.616502 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.scheduler.base_scheduler [req-687f50bd-726f-4df1-a7d3-037283187d42 req-8dbd849d-a3ea-44e3-91be-f6e8be2ff101 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] Resources bound (agent type, host, resource id): {{(pid=91830) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 16:58:43.620191 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.l3_dvrscheduler_db [req-687f50bd-726f-4df1-a7d3-037283187d42 req-8dbd849d-a3ea-44e3-91be-f6e8be2ff101 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] Received port after_create {{(pid=91830) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 25 16:58:43.629594 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-687f50bd-726f-4df1-a7d3-037283187d42 req-8dbd849d-a3ea-44e3-91be-f6e8be2ff101 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=91830) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:58:43.630458 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [req-687f50bd-726f-4df1-a7d3-037283187d42 req-8dbd849d-a3ea-44e3-91be-f6e8be2ff101 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-178712', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-551373'] for port, before_response {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:43.668461 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dbd849d-a3ea-44e3-91be-f6e8be2ff101 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] Pushing event updated for resources: {'Port': ['ID=250e0a7c-f7d1-4092-af1f-d50d5b92f68a,revision_number=1']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:58:43.673926 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-8dbd849d-a3ea-44e3-91be-f6e8be2ff101 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.184s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:58:43.680298 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.plugins.ml2.db [req-640ac1a9-5581-4f73-9a9e-7ba94abe500f req-489a5ab3-bf21-41bc-b210-0415fae48d65 service neutron] For port c4b9c0f2-e3d5-4fff-9b3c-a9175b027fb5, host hv-cinder-79049, cleared binding levels {{(pid=91830) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 25 16:58:43.687127 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.plugins.ml2.db [req-640ac1a9-5581-4f73-9a9e-7ba94abe500f req-489a5ab3-bf21-41bc-b210-0415fae48d65 service neutron] For port c4b9c0f2-e3d5-4fff-9b3c-a9175b027fb5, host hv-cinder-79049, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79049',level=0,port_id=c4b9c0f2-e3d5-4fff-9b3c-a9175b027fb5,segment=NetworkSegment(7d7273c2-c6dd-43fe-83a8-cb776d48dc70),segment_id=7d7273c2-c6dd-43fe-83a8-cb776d48dc70)] {{(pid=91830) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 25 16:58:43.699701 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [req-640ac1a9-5581-4f73-9a9e-7ba94abe500f req-489a5ab3-bf21-41bc-b210-0415fae48d65 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8757892955028', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8757892520933', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8757892521750'] for port, after_update {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:43.702378 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-1f40d34a-0eb9-4d60-b5b9-5a06e965a5fa req-c4292011-794c-4bd1-8e41-8238dd136a5a service neutron] 10.222.0.32 "GET /v2.0/networks/ca95b136-0269-430f-b450-69ee5473ae7d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3658714 May 25 16:58:43.712216 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-7978e2af-825f-409b-ad99-16e1046c3d0b service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:58:43.752834 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.wsgi [-] (91830) accepted ('10.222.0.62', 55648) {{(pid=91830) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:58:43.752834 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-687f50bd-726f-4df1-a7d3-037283187d42 req-8dbd849d-a3ea-44e3-91be-f6e8be2ff101 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.32 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 3.1144955 May 25 16:58:43.802561 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-640ac1a9-5581-4f73-9a9e-7ba94abe500f req-489a5ab3-bf21-41bc-b210-0415fae48d65 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91830) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:58:43.803225 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [req-640ac1a9-5581-4f73-9a9e-7ba94abe500f req-489a5ab3-bf21-41bc-b210-0415fae48d65 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-178712', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-551373'] for port, before_response {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:43.805142 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-640ac1a9-5581-4f73-9a9e-7ba94abe500f req-489a5ab3-bf21-41bc-b210-0415fae48d65 service neutron] 10.222.0.32 "PUT /v2.0/ports/c4b9c0f2-e3d5-4fff-9b3c-a9175b027fb5 HTTP/1.1" status: 200 len: 1093 time: 3.0391316 May 25 16:58:43.812148 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.v2.base [req-687f50bd-726f-4df1-a7d3-037283187d42 req-9568e620-0c14-4ca6-9056-b9d7945a0b3a service neutron] Request body: {'port': {'device_id': 'd87a1395-92e0-4727-a5ed-a8dcdee587c3', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-79049'}} {{(pid=91830) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 16:58:43.822938 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.wsgi [-] (91829) accepted ('10.222.0.62', 55658) {{(pid=91829) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:58:43.909161 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-73a8192a-b664-4e8a-b0df-2524ae537366 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:43.948363 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.quota.driver [None req-73a8192a-b664-4e8a-b0df-2524ae537366 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91829) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 16:58:43.950618 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-489a5ab3-bf21-41bc-b210-0415fae48d65 service neutron] Pushing event updated for resources: {'Port': ['ID=c4b9c0f2-e3d5-4fff-9b3c-a9175b027fb5,revision_number=3']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:58:43.953483 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.quota.resource [None req-73a8192a-b664-4e8a-b0df-2524ae537366 admin admin] Usage tracker for resource:security_group_rule and tenant:fc0577d0f43c4c6da15e003b87e230ca is out of sync, need to count used quota {{(pid=91829) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 16:58:43.957076 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.quota.resource [None req-73a8192a-b664-4e8a-b0df-2524ae537366 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91829) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 16:58:43.963545 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.quota.driver [None req-73a8192a-b664-4e8a-b0df-2524ae537366 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91829) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 16:58:44.052077 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-489a5ab3-bf21-41bc-b210-0415fae48d65 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.340s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:58:44.059599 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-73a8192a-b664-4e8a-b0df-2524ae537366 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:44.148660 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.db.agents_db [None req-504cb04f-4543-46c1-8db7-349e21db7634 None None] Agent healthcheck: found 6 active agents {{(pid=91832) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} May 25 16:58:44.152258 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-73a8192a-b664-4e8a-b0df-2524ae537366 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-640836'] for security_group, after_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:44.199398 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:58:44.260977 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [None req-73a8192a-b664-4e8a-b0df-2524ae537366 admin admin] 10.222.0.62 "GET /v2.0/security-groups?tenant_id=fc0577d0f43c4c6da15e003b87e230ca&name=default HTTP/1.1" status: 200 len: 2979 time: 0.4306004 May 25 16:58:44.275408 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.wsgi [-] (91829) accepted ('10.222.0.62', 55682) {{(pid=91829) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:58:44.306042 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-cbf8a34c-e2c6-452e-92c6-feb6c9d9b779 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:44.347612 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.quota.driver [None req-cbf8a34c-e2c6-452e-92c6-feb6c9d9b779 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91830) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 16:58:44.352402 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [None req-cbf8a34c-e2c6-452e-92c6-feb6c9d9b779 admin admin] Usage tracker for resource:security_group_rule and tenant:defc4212f68b40db921bb82d9e756dc1 is out of sync, need to count used quota {{(pid=91830) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 16:58:44.353885 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-73a8192a-b664-4e8a-b0df-2524ae537366 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=87042148-91c0-4f9b-8b2c-6f6ac7b8d9c8,revision_number=1']} {{(pid=91829) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:58:44.357752 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [None req-cbf8a34c-e2c6-452e-92c6-feb6c9d9b779 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91830) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 16:58:44.361357 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-73a8192a-b664-4e8a-b0df-2524ae537366 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.162s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:58:44.366765 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.quota.driver [None req-cbf8a34c-e2c6-452e-92c6-feb6c9d9b779 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91830) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 16:58:44.391485 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.notifiers.nova [req-1fc04329-def7-4f7c-bbd6-df77c33e33b6 req-42905d27-cfb2-4b93-8c1c-2dd7aa37f822 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 60078444-24b6-4560-b0a7-7802c4f8f2f8 {{(pid=91829) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} May 25 16:58:44.412266 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [req-1fc04329-def7-4f7c-bbd6-df77c33e33b6 req-42905d27-cfb2-4b93-8c1c-2dd7aa37f822 service neutron] Notify callbacks [] for port, precommit_update {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:44.422594 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-640ac1a9-5581-4f73-9a9e-7ba94abe500f req-b611fdae-749c-48a8-937c-6a7dd032af9b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91830) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:58:44.424762 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-640ac1a9-5581-4f73-9a9e-7ba94abe500f req-b611fdae-749c-48a8-937c-6a7dd032af9b service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=04e8022f24e3464ab1ab7726d6a07e08&device_id=bca36110-0b4f-419a-92ef-46cbb9d6215e HTTP/1.1" status: 200 len: 1096 time: 0.5238421 May 25 16:58:44.425581 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [req-687f50bd-726f-4df1-a7d3-037283187d42 req-9568e620-0c14-4ca6-9056-b9d7945a0b3a service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3832070'] for port, before_update {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:44.426728 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4d8ec83d-52da-44ab-8bc8-740053091e63 req-2c96b8d6-dbd5-4832-b5d4-9b96ccbf6127 tempest-DeleteServersTestJSON-1172980508 tempest-DeleteServersTestJSON-1172980508-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:58:44.428187 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-4d8ec83d-52da-44ab-8bc8-740053091e63 req-2c96b8d6-dbd5-4832-b5d4-9b96ccbf6127 tempest-DeleteServersTestJSON-1172980508 tempest-DeleteServersTestJSON-1172980508-project] 10.222.0.62 "GET /v2.0/ports?device_id=1d5af5b3-8d0b-4cf9-a7f1-ce49a30efc33 HTTP/1.1" status: 200 len: 943 time: 0.4997339 May 25 16:58:44.442126 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bbc26f9a-aa58-40f1-baa4-7c5e4f6fbaf7 req-592c3bcd-09cd-4cb7-9c29-a8aa0e7779a7 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:58:44.445299 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5f4db9b9-925c-49a0-b135-97eff6e1e27e req-ccf8dac7-86aa-492f-ae49-106aaf365688 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91830) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:58:44.447036 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-5f4db9b9-925c-49a0-b135-97eff6e1e27e req-ccf8dac7-86aa-492f-ae49-106aaf365688 service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=00ab1bb5f5df49f08ef4b15635754b71&device_id=1d5af5b3-8d0b-4cf9-a7f1-ce49a30efc33 HTTP/1.1" status: 200 len: 1096 time: 0.6575916 May 25 16:58:44.449042 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-bbc26f9a-aa58-40f1-baa4-7c5e4f6fbaf7 req-592c3bcd-09cd-4cb7-9c29-a8aa0e7779a7 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] 10.222.0.62 "GET /v2.0/ports?device_id=bca36110-0b4f-419a-92ef-46cbb9d6215e HTTP/1.1" status: 200 len: 943 time: 0.5120406 May 25 16:58:44.462405 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.wsgi [-] (91829) accepted ('10.222.0.62', 55692) {{(pid=91829) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:58:44.501083 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.provisioning_blocks [req-1fc04329-def7-4f7c-bbd6-df77c33e33b6 req-42905d27-cfb2-4b93-8c1c-2dd7aa37f822 service neutron] Transition to ACTIVE for port object 60078444-24b6-4560-b0a7-7802c4f8f2f8 will not be triggered until provisioned by entity L2. {{(pid=91829) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 25 16:58:44.525158 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [req-1fc04329-def7-4f7c-bbd6-df77c33e33b6 req-42905d27-cfb2-4b93-8c1c-2dd7aa37f822 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8757892955028', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8757892520933', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8757892521750', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28230801'] for port, after_update {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:44.544151 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-d1e0ec6a-5e14-42ef-94e8-4932e5d432be tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:58:44.555014 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-640ac1a9-5581-4f73-9a9e-7ba94abe500f req-63be7cae-fe55-4c08-bfd2-00373fc5c779 service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=c4b9c0f2-e3d5-4fff-9b3c-a9175b027fb5 HTTP/1.1" status: 200 len: 217 time: 0.1039231 May 25 16:58:44.589571 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-b829821f-7863-49a6-a227-7f113cd1fcb7 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:44.619857 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-bbc26f9a-aa58-40f1-baa4-7c5e4f6fbaf7 req-db4189fd-530f-42da-bf0d-45389116076f tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] 10.222.0.62 "GET /v2.0/security-groups?id=f73b90a2-df48-48fb-99e0-5dd4d6a63a15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1698854 May 25 16:58:44.770719 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-cbf8a34c-e2c6-452e-92c6-feb6c9d9b779 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:44.776974 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-4d8ec83d-52da-44ab-8bc8-740053091e63 req-be72d577-9a3a-49f4-8287-f5cae2054368 tempest-DeleteServersTestJSON-1172980508 tempest-DeleteServersTestJSON-1172980508-project] 10.222.0.62 "GET /v2.0/security-groups?id=ec198040-29f5-4dbf-8437-e486f3fb935b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3224092 May 25 16:58:44.880006 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-b829821f-7863-49a6-a227-7f113cd1fcb7 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:44.896495 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'bca36110-0b4f-419a-92ef-46cbb9d6215e', 'tag': 'c4b9c0f2-e3d5-4fff-9b3c-a9175b027fb5'}] {{(pid=91830) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 25 16:58:44.915214 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-cbf8a34c-e2c6-452e-92c6-feb6c9d9b779 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-640836'] for security_group, after_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:44.917006 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-42905d27-cfb2-4b93-8c1c-2dd7aa37f822 service neutron] Pushing event updated for resources: {'Port': ['ID=60078444-24b6-4560-b0a7-7802c4f8f2f8,revision_number=2']} {{(pid=91829) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:58:44.927595 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-a9095a49-9ed2-4654-851a-666f8087cb36 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:44.974305 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-42905d27-cfb2-4b93-8c1c-2dd7aa37f822 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.430s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:58:45.005662 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-54139b22-4b9e-4f6e-a8f7-6963a7bb0092 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:58:45.013564 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [None req-cbf8a34c-e2c6-452e-92c6-feb6c9d9b779 admin admin] 10.222.0.62 "GET /v2.0/security-groups?tenant_id=defc4212f68b40db921bb82d9e756dc1&name=default HTTP/1.1" status: 200 len: 2979 time: 1.2600386 May 25 16:58:45.030568 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.wsgi [-] (91829) accepted ('10.222.0.62', 55718) {{(pid=91829) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:58:45.036430 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.quota.driver [None req-a9095a49-9ed2-4654-851a-666f8087cb36 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91829) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 16:58:45.045574 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-b829821f-7863-49a6-a227-7f113cd1fcb7 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-640836'] for security_group, after_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:45.061683 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.quota.resource [None req-a9095a49-9ed2-4654-851a-666f8087cb36 admin admin] Usage tracker for resource:security_group_rule and tenant:1c8e3a0677284eb3b4584fb88e5b89a9 is out of sync, need to count used quota {{(pid=91829) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 16:58:45.071109 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'bca36110-0b4f-419a-92ef-46cbb9d6215e', 'tag': 'c4b9c0f2-e3d5-4fff-9b3c-a9175b027fb5', 'status': 'completed', 'code': 200} May 25 16:58:45.093881 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.quota.resource [None req-a9095a49-9ed2-4654-851a-666f8087cb36 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91829) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 16:58:45.101924 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-640ac1a9-5581-4f73-9a9e-7ba94abe500f req-0243b4b1-07ce-4a8a-bb20-c19aba3629a9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=91830) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:58:45.103358 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-640ac1a9-5581-4f73-9a9e-7ba94abe500f req-0243b4b1-07ce-4a8a-bb20-c19aba3629a9 service neutron] 10.222.0.32 "GET /v2.0/subnets?id=b0baa944-cafe-48a4-861a-dae28947b9f0 HTTP/1.1" status: 200 len: 854 time: 0.5031624 May 25 16:58:45.105987 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:58:45.133775 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.quota.driver [None req-a9095a49-9ed2-4654-851a-666f8087cb36 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91829) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 16:58:45.177858 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-b829821f-7863-49a6-a227-7f113cd1fcb7 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:45.178989 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [None req-b829821f-7863-49a6-a227-7f113cd1fcb7 admin admin] 10.222.0.62 "DELETE /v2.0/security-groups/87042148-91c0-4f9b-8b2c-6f6ac7b8d9c8 HTTP/1.1" status: 204 len: 168 time: 0.9024572 May 25 16:58:45.188585 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b829821f-7863-49a6-a227-7f113cd1fcb7 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=87042148-91c0-4f9b-8b2c-6f6ac7b8d9c8,revision_number=None']} {{(pid=91829) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:58:45.191861 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-640ac1a9-5581-4f73-9a9e-7ba94abe500f req-c45e18a0-2569-45fc-bbca-3da3ba6f5aca service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=63b1f335-e2c4-48dd-886b-6be853f8a2fc&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0684707 May 25 16:58:45.192483 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cbf8a34c-e2c6-452e-92c6-feb6c9d9b779 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=ce0c5004-3924-4017-ae06-1ec2578e79bd,revision_number=1']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:58:45.197254 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5f4db9b9-925c-49a0-b135-97eff6e1e27e req-ac7e0fa6-e138-446b-8153-05ea258bbbdd service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91830) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:58:45.199507 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-5f4db9b9-925c-49a0-b135-97eff6e1e27e req-ac7e0fa6-e138-446b-8153-05ea258bbbdd service neutron] 10.222.0.32 "GET /v2.0/networks?id=ca95b136-0269-430f-b450-69ee5473ae7d HTTP/1.1" status: 200 len: 912 time: 0.6890230 May 25 16:58:45.202670 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-cbf8a34c-e2c6-452e-92c6-feb6c9d9b779 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.197s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:58:45.205783 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-b829821f-7863-49a6-a227-7f113cd1fcb7 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.100s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:58:45.262583 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.plugins.ml2.managers [req-1fc04329-def7-4f7c-bbd6-df77c33e33b6 req-42905d27-cfb2-4b93-8c1c-2dd7aa37f822 service neutron] Attempting to bind port 60078444-24b6-4560-b0a7-7802c4f8f2f8 on host hv-cinder-79049 for vnic_type normal with profile {{(pid=91829) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 25 16:58:45.262937 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.plugins.ml2.managers [req-1fc04329-def7-4f7c-bbd6-df77c33e33b6 req-42905d27-cfb2-4b93-8c1c-2dd7aa37f822 service neutron] Attempting to bind port 60078444-24b6-4560-b0a7-7802c4f8f2f8 by drivers openvswitch,hyperv on host hv-cinder-79049 at level 0 using segments [{'id': 'f672477b-47fb-432c-acc9-dc57201d80de', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 697, 'network_id': '55a46372-d583-4435-a0f6-b9397668217d'}] {{(pid=91829) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 25 16:58:45.263393 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1fc04329-def7-4f7c-bbd6-df77c33e33b6 req-42905d27-cfb2-4b93-8c1c-2dd7aa37f822 service neutron] Attempting to bind port 60078444-24b6-4560-b0a7-7802c4f8f2f8 on network 55a46372-d583-4435-a0f6-b9397668217d {{(pid=91829) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 25 16:58:45.272210 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-7c6080bb-7653-4688-9e96-96009b8dfbd8 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:45.280951 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-87c90297-9586-4f11-82bf-d3559ffcb48c req-3fec6442-bb6e-412f-9b26-6fb784c209f8 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:58:45.282855 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-87c90297-9586-4f11-82bf-d3559ffcb48c req-3fec6442-bb6e-412f-9b26-6fb784c209f8 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/ports?device_id=d87a1395-92e0-4727-a5ed-a8dcdee587c3 HTTP/1.1" status: 200 len: 931 time: 0.4969532 May 25 16:58:45.287245 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1fc04329-def7-4f7c-bbd6-df77c33e33b6 req-42905d27-cfb2-4b93-8c1c-2dd7aa37f822 service neutron] Port 60078444-24b6-4560-b0a7-7802c4f8f2f8 on network 55a46372-d583-4435-a0f6-b9397668217d not bound, no agent of type Open vSwitch agent registered on host hv-cinder-79049 {{(pid=91829) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 25 16:58:45.287598 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1fc04329-def7-4f7c-bbd6-df77c33e33b6 req-42905d27-cfb2-4b93-8c1c-2dd7aa37f822 service neutron] Attempting to bind port 60078444-24b6-4560-b0a7-7802c4f8f2f8 on network 55a46372-d583-4435-a0f6-b9397668217d {{(pid=91829) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 25 16:58:45.306845 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1fc04329-def7-4f7c-bbd6-df77c33e33b6 req-42905d27-cfb2-4b93-8c1c-2dd7aa37f822 service neutron] Checking agent: {'id': '3a1fdee1-bff0-49fb-b470-e13b95ee1b4d', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-79049', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 25, 16, 56, 32), 'started_at': datetime.datetime(2021, 5, 25, 16, 56, 32), 'heartbeat_timestamp': datetime.datetime(2021, 5, 25, 16, 58, 32), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=91829) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 25 16:58:45.307233 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1fc04329-def7-4f7c-bbd6-df77c33e33b6 req-42905d27-cfb2-4b93-8c1c-2dd7aa37f822 service neutron] Checking segment: {'id': 'f672477b-47fb-432c-acc9-dc57201d80de', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 697, 'network_id': '55a46372-d583-4435-a0f6-b9397668217d'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91829) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 25 16:58:45.307753 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1fc04329-def7-4f7c-bbd6-df77c33e33b6 req-42905d27-cfb2-4b93-8c1c-2dd7aa37f822 service neutron] Bound using segment: {'id': 'f672477b-47fb-432c-acc9-dc57201d80de', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 697, 'network_id': '55a46372-d583-4435-a0f6-b9397668217d'} {{(pid=91829) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 25 16:58:45.308267 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.plugins.ml2.managers [req-1fc04329-def7-4f7c-bbd6-df77c33e33b6 req-42905d27-cfb2-4b93-8c1c-2dd7aa37f822 service neutron] Bound port: 60078444-24b6-4560-b0a7-7802c4f8f2f8, host: hv-cinder-79049, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'f672477b-47fb-432c-acc9-dc57201d80de', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 697, 'network_id': '55a46372-d583-4435-a0f6-b9397668217d'}}] {{(pid=91829) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 25 16:58:45.308570 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [req-1fc04329-def7-4f7c-bbd6-df77c33e33b6 req-42905d27-cfb2-4b93-8c1c-2dd7aa37f822 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3832070'] for port, before_update {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:45.369981 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-5f4db9b9-925c-49a0-b135-97eff6e1e27e req-d0f3bbb7-cb48-4972-b920-2f4e4f61e955 service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=a460da33-52a2-41d5-bcf5-1baa12e65f8f HTTP/1.1" status: 200 len: 217 time: 0.1457446 May 25 16:58:45.400176 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-7c6080bb-7653-4688-9e96-96009b8dfbd8 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:45.474947 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.quota.resource [req-87c90297-9586-4f11-82bf-d3559ffcb48c req-eabd74d6-3b50-486a-8d30-33c0d5f41edb tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] Synchronizing usage tracker for tenant:734df673f8b3484d80f35a45fbce9d5e on resource:security_group {{(pid=91829) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 25 16:58:45.520314 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5f4db9b9-925c-49a0-b135-97eff6e1e27e req-e36b4333-1f0e-4620-91a1-85e00742bbc6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=91830) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:58:45.521844 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-5f4db9b9-925c-49a0-b135-97eff6e1e27e req-e36b4333-1f0e-4620-91a1-85e00742bbc6 service neutron] 10.222.0.32 "GET /v2.0/subnets?id=34034d6a-51f1-4e15-aa5b-0f79437d26f5 HTTP/1.1" status: 200 len: 851 time: 0.1404810 May 25 16:58:45.540926 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.quota.resource [req-87c90297-9586-4f11-82bf-d3559ffcb48c req-eabd74d6-3b50-486a-8d30-33c0d5f41edb tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] Unset dirty status for tenant:734df673f8b3484d80f35a45fbce9d5e on resource:security_group {{(pid=91829) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 25 16:58:45.542124 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-87c90297-9586-4f11-82bf-d3559ffcb48c req-eabd74d6-3b50-486a-8d30-33c0d5f41edb tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/security-groups?id=8ee5c4ed-9c60-4e39-9185-7e283704a7dc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2482221 May 25 16:58:45.547547 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.plugins.ml2.db [req-1fc04329-def7-4f7c-bbd6-df77c33e33b6 req-42905d27-cfb2-4b93-8c1c-2dd7aa37f822 service neutron] For port 60078444-24b6-4560-b0a7-7802c4f8f2f8, host hv-cinder-79049, cleared binding levels {{(pid=91829) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 25 16:58:45.552411 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-a9095a49-9ed2-4654-851a-666f8087cb36 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:45.555007 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.plugins.ml2.db [req-1fc04329-def7-4f7c-bbd6-df77c33e33b6 req-42905d27-cfb2-4b93-8c1c-2dd7aa37f822 service neutron] For port 60078444-24b6-4560-b0a7-7802c4f8f2f8, host hv-cinder-79049, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79049',level=0,port_id=60078444-24b6-4560-b0a7-7802c4f8f2f8,segment=NetworkSegment(f672477b-47fb-432c-acc9-dc57201d80de),segment_id=f672477b-47fb-432c-acc9-dc57201d80de)] {{(pid=91829) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 25 16:58:45.556622 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-a9095a49-9ed2-4654-851a-666f8087cb36 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-640836'] for security_group, after_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:45.565743 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-2714ef29-2cff-4111-a072-19281e281870 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:58:45.582208 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [req-1fc04329-def7-4f7c-bbd6-df77c33e33b6 req-42905d27-cfb2-4b93-8c1c-2dd7aa37f822 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8757892955028', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8757892520933', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8757892521750', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28230801'] for port, after_update {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:45.593458 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-5f4db9b9-925c-49a0-b135-97eff6e1e27e req-1a98ed01-7b90-4d99-9351-dd0ac52083e4 service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=ca95b136-0269-430f-b450-69ee5473ae7d&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0644596 May 25 16:58:45.595504 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.notifiers.nova [req-687f50bd-726f-4df1-a7d3-037283187d42 req-9568e620-0c14-4ca6-9056-b9d7945a0b3a service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 250e0a7c-f7d1-4092-af1f-d50d5b92f68a {{(pid=91830) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} May 25 16:58:45.603095 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-640ac1a9-5581-4f73-9a9e-7ba94abe500f req-db03c84b-6176-4819-873d-7391cfee058e service neutron] 10.222.0.32 "GET /v2.0/networks/63b1f335-e2c4-48dd-886b-6be853f8a2fc?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3994918 May 25 16:58:45.605412 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-7c6080bb-7653-4688-9e96-96009b8dfbd8 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-640836'] for security_group, after_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:45.608216 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [req-687f50bd-726f-4df1-a7d3-037283187d42 req-9568e620-0c14-4ca6-9056-b9d7945a0b3a service neutron] Notify callbacks [] for port, precommit_update {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:45.630770 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [None req-a9095a49-9ed2-4654-851a-666f8087cb36 admin admin] 10.222.0.62 "GET /v2.0/security-groups?tenant_id=1c8e3a0677284eb3b4584fb88e5b89a9&name=default HTTP/1.1" status: 200 len: 2979 time: 1.1546187 May 25 16:58:45.635345 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.wsgi [-] (91829) accepted ('10.222.0.62', 55738) {{(pid=91829) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:58:45.642698 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a9095a49-9ed2-4654-851a-666f8087cb36 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=be199693-510e-4040-be4f-9d7535110fa7,revision_number=1']} {{(pid=91829) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:58:45.658279 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1fc04329-def7-4f7c-bbd6-df77c33e33b6 req-42905d27-cfb2-4b93-8c1c-2dd7aa37f822 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:58:45.660098 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [req-1fc04329-def7-4f7c-bbd6-df77c33e33b6 req-42905d27-cfb2-4b93-8c1c-2dd7aa37f822 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-178712', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-551373'] for port, before_response {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:45.660819 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-1fc04329-def7-4f7c-bbd6-df77c33e33b6 req-42905d27-cfb2-4b93-8c1c-2dd7aa37f822 service neutron] 10.222.0.32 "PUT /v2.0/ports/60078444-24b6-4560-b0a7-7802c4f8f2f8 HTTP/1.1" status: 200 len: 1093 time: 3.8350108 May 25 16:58:45.661303 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '58da9205-0212-4daa-996c-1eef64a2b702', 'tag': '60078444-24b6-4560-b0a7-7802c4f8f2f8'}] {{(pid=91829) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 25 16:58:45.666228 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-a9095a49-9ed2-4654-851a-666f8087cb36 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.100s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:58:45.668454 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.068s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:58:45.723652 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-7c6080bb-7653-4688-9e96-96009b8dfbd8 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:45.725967 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [None req-7c6080bb-7653-4688-9e96-96009b8dfbd8 admin admin] 10.222.0.62 "DELETE /v2.0/security-groups/ce0c5004-3924-4017-ae06-1ec2578e79bd HTTP/1.1" status: 204 len: 168 time: 0.6902425 May 25 16:58:45.775233 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.provisioning_blocks [req-687f50bd-726f-4df1-a7d3-037283187d42 req-9568e620-0c14-4ca6-9056-b9d7945a0b3a service neutron] Transition to ACTIVE for port object 250e0a7c-f7d1-4092-af1f-d50d5b92f68a will not be triggered until provisioned by entity L2. {{(pid=91830) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 25 16:58:45.797313 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [req-687f50bd-726f-4df1-a7d3-037283187d42 req-9568e620-0c14-4ca6-9056-b9d7945a0b3a service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8757892955028', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8757892520933', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8757892521750'] for port, after_update {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:45.810818 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-536c60b9-24d4-40c9-8ee1-0c6348339618 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:58:45.857247 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-42905d27-cfb2-4b93-8c1c-2dd7aa37f822 service neutron] Pushing event updated for resources: {'Port': ['ID=60078444-24b6-4560-b0a7-7802c4f8f2f8,revision_number=3']} {{(pid=91829) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:58:45.931052 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-42905d27-cfb2-4b93-8c1c-2dd7aa37f822 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.262s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:58:45.969003 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-b829821f-7863-49a6-a227-7f113cd1fcb7 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.349s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:58:46.094751 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-640ac1a9-5581-4f73-9a9e-7ba94abe500f req-8209ac96-ee6e-40b0-ad76-2e9106d10729 service neutron] 10.222.0.32 "GET /v2.0/networks/63b1f335-e2c4-48dd-886b-6be853f8a2fc?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.4647207 May 25 16:58:46.176147 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.plugins.ml2.managers [req-687f50bd-726f-4df1-a7d3-037283187d42 req-9568e620-0c14-4ca6-9056-b9d7945a0b3a service neutron] Attempting to bind port 250e0a7c-f7d1-4092-af1f-d50d5b92f68a on host hv-cinder-79049 for vnic_type normal with profile {{(pid=91830) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 25 16:58:46.176478 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.plugins.ml2.managers [req-687f50bd-726f-4df1-a7d3-037283187d42 req-9568e620-0c14-4ca6-9056-b9d7945a0b3a service neutron] Attempting to bind port 250e0a7c-f7d1-4092-af1f-d50d5b92f68a by drivers openvswitch,hyperv on host hv-cinder-79049 at level 0 using segments [{'id': 'f672477b-47fb-432c-acc9-dc57201d80de', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 697, 'network_id': '55a46372-d583-4435-a0f6-b9397668217d'}] {{(pid=91830) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 25 16:58:46.176809 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-687f50bd-726f-4df1-a7d3-037283187d42 req-9568e620-0c14-4ca6-9056-b9d7945a0b3a service neutron] Attempting to bind port 250e0a7c-f7d1-4092-af1f-d50d5b92f68a on network 55a46372-d583-4435-a0f6-b9397668217d {{(pid=91830) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 25 16:58:46.178976 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7c6080bb-7653-4688-9e96-96009b8dfbd8 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=ce0c5004-3924-4017-ae06-1ec2578e79bd,revision_number=None']} {{(pid=91829) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:58:46.182901 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-7c6080bb-7653-4688-9e96-96009b8dfbd8 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.214s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:58:46.227331 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-b0b32c7c-1058-46da-a16c-e33c8a0a9d67 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:46.254510 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1fc04329-def7-4f7c-bbd6-df77c33e33b6 req-a72ac828-0487-48c9-8bd8-6b780872bb00 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:58:46.255973 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-1fc04329-def7-4f7c-bbd6-df77c33e33b6 req-a72ac828-0487-48c9-8bd8-6b780872bb00 service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=734df673f8b3484d80f35a45fbce9d5e&device_id=58da9205-0212-4daa-996c-1eef64a2b702 HTTP/1.1" status: 200 len: 1096 time: 0.5456605 May 25 16:58:46.276731 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-048a29ab-8e73-4aaf-8287-47f40309fc8e req-4319e56c-34a7-4b4d-9a2a-c5d05361e752 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:58:46.282541 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-687f50bd-726f-4df1-a7d3-037283187d42 req-9568e620-0c14-4ca6-9056-b9d7945a0b3a service neutron] Port 250e0a7c-f7d1-4092-af1f-d50d5b92f68a on network 55a46372-d583-4435-a0f6-b9397668217d not bound, no agent of type Open vSwitch agent registered on host hv-cinder-79049 {{(pid=91830) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 25 16:58:46.283288 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-687f50bd-726f-4df1-a7d3-037283187d42 req-9568e620-0c14-4ca6-9056-b9d7945a0b3a service neutron] Attempting to bind port 250e0a7c-f7d1-4092-af1f-d50d5b92f68a on network 55a46372-d583-4435-a0f6-b9397668217d {{(pid=91830) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 25 16:58:46.284628 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-048a29ab-8e73-4aaf-8287-47f40309fc8e req-4319e56c-34a7-4b4d-9a2a-c5d05361e752 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] 10.222.0.62 "GET /v2.0/ports?device_id=bca36110-0b4f-419a-92ef-46cbb9d6215e HTTP/1.1" status: 200 len: 943 time: 0.4594939 May 25 16:58:46.297015 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9568e620-0c14-4ca6-9056-b9d7945a0b3a service neutron] Pushing event updated for resources: {'Port': ['ID=250e0a7c-f7d1-4092-af1f-d50d5b92f68a,revision_number=2']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:58:46.307924 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-9568e620-0c14-4ca6-9056-b9d7945a0b3a service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.497s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:58:46.314225 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-687f50bd-726f-4df1-a7d3-037283187d42 req-9568e620-0c14-4ca6-9056-b9d7945a0b3a service neutron] Checking agent: {'id': '3a1fdee1-bff0-49fb-b470-e13b95ee1b4d', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-79049', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 25, 16, 56, 32), 'started_at': datetime.datetime(2021, 5, 25, 16, 56, 32), 'heartbeat_timestamp': datetime.datetime(2021, 5, 25, 16, 58, 32), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=91830) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 25 16:58:46.314983 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-687f50bd-726f-4df1-a7d3-037283187d42 req-9568e620-0c14-4ca6-9056-b9d7945a0b3a service neutron] Checking segment: {'id': 'f672477b-47fb-432c-acc9-dc57201d80de', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 697, 'network_id': '55a46372-d583-4435-a0f6-b9397668217d'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91830) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 25 16:58:46.315511 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-687f50bd-726f-4df1-a7d3-037283187d42 req-9568e620-0c14-4ca6-9056-b9d7945a0b3a service neutron] Bound using segment: {'id': 'f672477b-47fb-432c-acc9-dc57201d80de', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 697, 'network_id': '55a46372-d583-4435-a0f6-b9397668217d'} {{(pid=91830) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 25 16:58:46.316070 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.plugins.ml2.managers [req-687f50bd-726f-4df1-a7d3-037283187d42 req-9568e620-0c14-4ca6-9056-b9d7945a0b3a service neutron] Bound port: 250e0a7c-f7d1-4092-af1f-d50d5b92f68a, host: hv-cinder-79049, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'f672477b-47fb-432c-acc9-dc57201d80de', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 697, 'network_id': '55a46372-d583-4435-a0f6-b9397668217d'}}] {{(pid=91830) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 25 16:58:46.316534 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [req-687f50bd-726f-4df1-a7d3-037283187d42 req-9568e620-0c14-4ca6-9056-b9d7945a0b3a service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3832070'] for port, before_update {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:46.402931 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.wsgi [-] (91830) accepted ('10.222.0.62', 55780) {{(pid=91830) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:58:46.430676 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-5f4db9b9-925c-49a0-b135-97eff6e1e27e req-de24a24b-d762-462f-9c06-27b79c7c9045 service neutron] 10.222.0.32 "GET /v2.0/networks/ca95b136-0269-430f-b450-69ee5473ae7d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.8243032 May 25 16:58:46.486528 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-4fef73b2-caf0-4354-a489-bc342583b443 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:46.519990 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-b0b32c7c-1058-46da-a16c-e33c8a0a9d67 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:46.563334 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-1fc04329-def7-4f7c-bbd6-df77c33e33b6 req-d3ea72ca-c231-4dd1-b11f-39c0261eaf63 service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=60078444-24b6-4560-b0a7-7802c4f8f2f8 HTTP/1.1" status: 200 len: 217 time: 0.2717414 May 25 16:58:46.592603 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.quota.driver [None req-4fef73b2-caf0-4354-a489-bc342583b443 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91830) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 16:58:46.614201 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [None req-4fef73b2-caf0-4354-a489-bc342583b443 admin admin] Usage tracker for resource:security_group_rule and tenant:89a6cc93aa2e48918bfa5cadec2f77c0 is out of sync, need to count used quota {{(pid=91830) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 16:58:46.622266 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [None req-4fef73b2-caf0-4354-a489-bc342583b443 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91830) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 16:58:46.640066 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f88b106a-78c9-4bbe-9ee2-f139258b65b1 req-77fcb745-e856-40c8-8e70-117af04c0f20 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91830) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:58:46.642158 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-f88b106a-78c9-4bbe-9ee2-f139258b65b1 req-77fcb745-e856-40c8-8e70-117af04c0f20 service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=04e8022f24e3464ab1ab7726d6a07e08&device_id=bca36110-0b4f-419a-92ef-46cbb9d6215e HTTP/1.1" status: 200 len: 1096 time: 0.4755116 May 25 16:58:46.651693 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.quota.driver [None req-4fef73b2-caf0-4354-a489-bc342583b443 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91830) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 16:58:46.654314 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.plugins.ml2.db [req-687f50bd-726f-4df1-a7d3-037283187d42 req-9568e620-0c14-4ca6-9056-b9d7945a0b3a service neutron] For port 250e0a7c-f7d1-4092-af1f-d50d5b92f68a, host hv-cinder-79049, cleared binding levels {{(pid=91830) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 25 16:58:46.671244 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-048a29ab-8e73-4aaf-8287-47f40309fc8e req-057b5447-34b6-4252-976a-6e610524237b tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] 10.222.0.62 "GET /v2.0/security-groups?id=f73b90a2-df48-48fb-99e0-5dd4d6a63a15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3856859 May 25 16:58:46.698799 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b82f71e3-4b51-43ee-a99e-00aad4c8997b req-d5b4ccbb-171b-4358-93e7-4329ba7a3007 tempest-DeleteServersTestJSON-1172980508 tempest-DeleteServersTestJSON-1172980508-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:58:46.705005 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.plugins.ml2.db [req-687f50bd-726f-4df1-a7d3-037283187d42 req-9568e620-0c14-4ca6-9056-b9d7945a0b3a service neutron] For port 250e0a7c-f7d1-4092-af1f-d50d5b92f68a, host hv-cinder-79049, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79049',level=0,port_id=250e0a7c-f7d1-4092-af1f-d50d5b92f68a,segment=NetworkSegment(f672477b-47fb-432c-acc9-dc57201d80de),segment_id=f672477b-47fb-432c-acc9-dc57201d80de)] {{(pid=91830) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 25 16:58:46.709208 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-b82f71e3-4b51-43ee-a99e-00aad4c8997b req-d5b4ccbb-171b-4358-93e7-4329ba7a3007 tempest-DeleteServersTestJSON-1172980508 tempest-DeleteServersTestJSON-1172980508-project] 10.222.0.62 "GET /v2.0/ports?device_id=1d5af5b3-8d0b-4cf9-a7f1-ce49a30efc33 HTTP/1.1" status: 200 len: 943 time: 0.7207599 May 25 16:58:46.740367 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1fc04329-def7-4f7c-bbd6-df77c33e33b6 req-145a4eea-9b31-4b62-8c17-773573ca001a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:58:46.741791 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-1fc04329-def7-4f7c-bbd6-df77c33e33b6 req-145a4eea-9b31-4b62-8c17-773573ca001a service neutron] 10.222.0.32 "GET /v2.0/subnets?id=927bd65a-c4de-491b-b501-302852f4c784 HTTP/1.1" status: 200 len: 858 time: 0.1642590 May 25 16:58:46.756709 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-b0b32c7c-1058-46da-a16c-e33c8a0a9d67 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-640836'] for security_group, after_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:46.781150 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [req-687f50bd-726f-4df1-a7d3-037283187d42 req-9568e620-0c14-4ca6-9056-b9d7945a0b3a service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8757892955028', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8757892520933', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8757892521750'] for port, after_update {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:46.796806 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-a37eda00-7e38-4b47-a60c-7f4af0910922 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:58:46.812804 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:58:46.833147 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-b82f71e3-4b51-43ee-a99e-00aad4c8997b req-78b0da37-1528-43cc-9a98-f586df859544 tempest-DeleteServersTestJSON-1172980508 tempest-DeleteServersTestJSON-1172980508-project] 10.222.0.62 "GET /v2.0/security-groups?id=ec198040-29f5-4dbf-8437-e486f3fb935b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1229348 May 25 16:58:46.839698 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-1fc04329-def7-4f7c-bbd6-df77c33e33b6 req-4ecf8cb3-ff72-40ce-89be-c92fd3d035b5 service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=55a46372-d583-4435-a0f6-b9397668217d&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0840089 May 25 16:58:46.843281 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.wsgi [-] (91829) accepted ('10.222.0.62', 55798) {{(pid=91829) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:58:46.844064 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b0b32c7c-1058-46da-a16c-e33c8a0a9d67 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=be199693-510e-4040-be4f-9d7535110fa7,revision_number=None']} {{(pid=91829) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:58:46.847669 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-b0b32c7c-1058-46da-a16c-e33c8a0a9d67 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.051s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:58:46.911183 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-b0b32c7c-1058-46da-a16c-e33c8a0a9d67 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:46.914884 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [None req-b0b32c7c-1058-46da-a16c-e33c8a0a9d67 admin admin] 10.222.0.62 "DELETE /v2.0/security-groups/be199693-510e-4040-be4f-9d7535110fa7 HTTP/1.1" status: 204 len: 168 time: 1.2733114 May 25 16:58:46.935595 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9568e620-0c14-4ca6-9056-b9d7945a0b3a service neutron] Pushing event updated for resources: {'Port': ['ID=250e0a7c-f7d1-4092-af1f-d50d5b92f68a,revision_number=3']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:58:46.948190 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-9568e620-0c14-4ca6-9056-b9d7945a0b3a service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.135s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:58:46.963482 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-5f4db9b9-925c-49a0-b135-97eff6e1e27e req-0379b749-6201-4202-a8b1-6efe2f143922 service neutron] 10.222.0.32 "GET /v2.0/networks/ca95b136-0269-430f-b450-69ee5473ae7d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.5131173 May 25 16:58:46.987197 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-687f50bd-726f-4df1-a7d3-037283187d42 req-9568e620-0c14-4ca6-9056-b9d7945a0b3a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91830) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:58:46.988145 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [req-687f50bd-726f-4df1-a7d3-037283187d42 req-9568e620-0c14-4ca6-9056-b9d7945a0b3a service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-178712', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-551373'] for port, before_response {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:46.989591 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-687f50bd-726f-4df1-a7d3-037283187d42 req-9568e620-0c14-4ca6-9056-b9d7945a0b3a service neutron] 10.222.0.32 "PUT /v2.0/ports/250e0a7c-f7d1-4092-af1f-d50d5b92f68a HTTP/1.1" status: 200 len: 1093 time: 3.2068341 May 25 16:58:47.022632 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f88b106a-78c9-4bbe-9ee2-f139258b65b1 req-f7759322-39f3-486f-b34d-305393d226cb service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91830) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:58:47.024313 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-f88b106a-78c9-4bbe-9ee2-f139258b65b1 req-f7759322-39f3-486f-b34d-305393d226cb service neutron] 10.222.0.32 "GET /v2.0/networks?id=63b1f335-e2c4-48dd-886b-6be853f8a2fc HTTP/1.1" status: 200 len: 915 time: 0.3674524 May 25 16:58:47.099227 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'd87a1395-92e0-4727-a5ed-a8dcdee587c3', 'tag': '250e0a7c-f7d1-4092-af1f-d50d5b92f68a'}] {{(pid=91830) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 25 16:58:47.104587 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-f88b106a-78c9-4bbe-9ee2-f139258b65b1 req-326e4ae8-b05d-4576-9a78-85bc582cb647 service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=c4b9c0f2-e3d5-4fff-9b3c-a9175b027fb5 HTTP/1.1" status: 200 len: 217 time: 0.0723174 May 25 16:58:47.120731 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-1fc04329-def7-4f7c-bbd6-df77c33e33b6 req-e7d8c478-8eb6-421f-869b-f24d2896b264 service neutron] 10.222.0.32 "GET /v2.0/networks/55a46372-d583-4435-a0f6-b9397668217d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2714024 May 25 16:58:47.158157 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9063e156-07b6-45aa-9ad2-ae9ea35b7968 req-fead7a45-efa6-417e-9837-05d8ed59cf05 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:58:47.175315 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-9063e156-07b6-45aa-9ad2-ae9ea35b7968 req-fead7a45-efa6-417e-9837-05d8ed59cf05 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/ports?device_id=d87a1395-92e0-4727-a5ed-a8dcdee587c3 HTTP/1.1" status: 200 len: 943 time: 0.1537049 May 25 16:58:47.206846 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-4fef73b2-caf0-4354-a489-bc342583b443 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:47.210025 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '58da9205-0212-4daa-996c-1eef64a2b702', 'tag': '60078444-24b6-4560-b0a7-7802c4f8f2f8', 'status': 'completed', 'code': 200} May 25 16:58:47.215873 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-4fef73b2-caf0-4354-a489-bc342583b443 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-640836'] for security_group, after_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:47.229772 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-687f50bd-726f-4df1-a7d3-037283187d42 req-554dea46-aae4-4113-a066-1894a52bcb2a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91830) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:58:47.231346 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-687f50bd-726f-4df1-a7d3-037283187d42 req-554dea46-aae4-4113-a066-1894a52bcb2a service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=734df673f8b3484d80f35a45fbce9d5e&device_id=d87a1395-92e0-4727-a5ed-a8dcdee587c3 HTTP/1.1" status: 200 len: 1096 time: 0.1245480 May 25 16:58:47.233437 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:58:47.278408 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [None req-4fef73b2-caf0-4354-a489-bc342583b443 admin admin] 10.222.0.62 "GET /v2.0/security-groups?tenant_id=89a6cc93aa2e48918bfa5cadec2f77c0&name=default HTTP/1.1" status: 200 len: 2979 time: 0.8681269 May 25 16:58:47.278408 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4fef73b2-caf0-4354-a489-bc342583b443 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=3916a51a-d10f-409b-8206-52744c833cb2,revision_number=1']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:58:47.281044 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.wsgi [-] (91830) accepted ('10.222.0.62', 55818) {{(pid=91830) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:58:47.284519 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-293ad530-5f37-4fd2-87bc-5c37328fb5fc admin admin] Notify callbacks [] for security_group, before_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:47.295249 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-4fef73b2-caf0-4354-a489-bc342583b443 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.062s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:58:47.309796 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'd87a1395-92e0-4727-a5ed-a8dcdee587c3', 'tag': '250e0a7c-f7d1-4092-af1f-d50d5b92f68a', 'status': 'completed', 'code': 200} May 25 16:58:47.314317 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-9063e156-07b6-45aa-9ad2-ae9ea35b7968 req-cd324a56-6125-4ff3-bc8d-cd400a40d166 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/security-groups?id=8ee5c4ed-9c60-4e39-9185-7e283704a7dc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1378510 May 25 16:58:47.316850 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.quota.driver [None req-293ad530-5f37-4fd2-87bc-5c37328fb5fc admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91829) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 16:58:47.321172 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.quota.resource [None req-293ad530-5f37-4fd2-87bc-5c37328fb5fc admin admin] Usage tracker for resource:security_group_rule and tenant:c2f89b4d55cc4f89bffd8295fa898bed is out of sync, need to count used quota {{(pid=91829) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 16:58:47.324618 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.quota.resource [None req-293ad530-5f37-4fd2-87bc-5c37328fb5fc admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91829) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 16:58:47.344096 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.quota.driver [None req-293ad530-5f37-4fd2-87bc-5c37328fb5fc admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91829) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 16:58:47.369171 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-a2287d98-7cb9-4b82-bab2-d762baa5679d admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:47.403431 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-a2287d98-7cb9-4b82-bab2-d762baa5679d admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:47.450404 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-293ad530-5f37-4fd2-87bc-5c37328fb5fc admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:47.457943 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-293ad530-5f37-4fd2-87bc-5c37328fb5fc admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-640836'] for security_group, after_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:47.466209 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:58:47.473308 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-a2287d98-7cb9-4b82-bab2-d762baa5679d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-640836'] for security_group, after_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:47.479244 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-dea2f965-5743-4fd9-9f3e-e50867f6b6ba admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:58:47.492896 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a2287d98-7cb9-4b82-bab2-d762baa5679d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=3916a51a-d10f-409b-8206-52744c833cb2,revision_number=None']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:58:47.495794 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-a2287d98-7cb9-4b82-bab2-d762baa5679d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.016s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:58:47.501306 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-293ad530-5f37-4fd2-87bc-5c37328fb5fc admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=be89b7dd-99f6-485f-8963-4447e3323f93,revision_number=1']} {{(pid=91829) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:58:47.518798 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-a2287d98-7cb9-4b82-bab2-d762baa5679d admin admin] Notify callbacks [] for security_group, before_response {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:47.522837 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [None req-a2287d98-7cb9-4b82-bab2-d762baa5679d admin admin] 10.222.0.62 "DELETE /v2.0/security-groups/3916a51a-d10f-409b-8206-52744c833cb2 HTTP/1.1" status: 204 len: 168 time: 0.2401247 May 25 16:58:47.537760 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-293ad530-5f37-4fd2-87bc-5c37328fb5fc admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.071s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:58:47.544105 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [None req-293ad530-5f37-4fd2-87bc-5c37328fb5fc admin admin] 10.222.0.62 "GET /v2.0/security-groups?tenant_id=c2f89b4d55cc4f89bffd8295fa898bed&name=default HTTP/1.1" status: 200 len: 2979 time: 0.6980810 May 25 16:58:47.547090 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.wsgi [-] (91829) accepted ('10.222.0.62', 55832) {{(pid=91829) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:58:47.610772 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-fa3059d3-8e32-4b0a-99fc-a58e992f1fba admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:47.638367 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-fa3059d3-8e32-4b0a-99fc-a58e992f1fba admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:47.654098 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.wsgi [-] (91830) accepted ('10.222.0.62', 55836) {{(pid=91830) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:58:47.672431 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-a1d2d385-5bc4-49bb-90a8-674b9b272ae9 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:47.688242 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.quota.driver [None req-a1d2d385-5bc4-49bb-90a8-674b9b272ae9 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91830) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 16:58:47.692634 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [None req-a1d2d385-5bc4-49bb-90a8-674b9b272ae9 admin admin] Usage tracker for resource:security_group_rule and tenant:2e5b2aa717cf4fcab0169450c10a1b76 is out of sync, need to count used quota {{(pid=91830) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 16:58:47.695673 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [None req-a1d2d385-5bc4-49bb-90a8-674b9b272ae9 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91830) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 16:58:47.702511 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.quota.driver [None req-a1d2d385-5bc4-49bb-90a8-674b9b272ae9 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91830) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 16:58:47.722642 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-fa3059d3-8e32-4b0a-99fc-a58e992f1fba admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-640836'] for security_group, after_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:47.728502 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-293ad530-5f37-4fd2-87bc-5c37328fb5fc admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:58:47.745143 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fa3059d3-8e32-4b0a-99fc-a58e992f1fba admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=be89b7dd-99f6-485f-8963-4447e3323f93,revision_number=None']} {{(pid=91829) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:58:47.749335 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-fa3059d3-8e32-4b0a-99fc-a58e992f1fba admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.021s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:58:47.750647 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-fa3059d3-8e32-4b0a-99fc-a58e992f1fba admin admin] Notify callbacks [] for security_group, before_response {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:47.751933 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [None req-fa3059d3-8e32-4b0a-99fc-a58e992f1fba admin admin] 10.222.0.62 "DELETE /v2.0/security-groups/be89b7dd-99f6-485f-8963-4447e3323f93 HTTP/1.1" status: 204 len: 168 time: 0.2037730 May 25 16:58:47.903172 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-a1d2d385-5bc4-49bb-90a8-674b9b272ae9 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:47.914378 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-a1d2d385-5bc4-49bb-90a8-674b9b272ae9 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-640836'] for security_group, after_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:47.926720 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-e0473cad-7db0-4f56-8d35-217e21662195 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:58:47.970148 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-271efde5-9a58-42ee-bd24-d53d60435907 req-c97dd06b-9903-4d10-a6ce-d7e278fcefaf tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:58:47.978796 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-271efde5-9a58-42ee-bd24-d53d60435907 req-c97dd06b-9903-4d10-a6ce-d7e278fcefaf tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] 10.222.0.62 "GET /v2.0/ports?device_id=bca36110-0b4f-419a-92ef-46cbb9d6215e HTTP/1.1" status: 200 len: 943 time: 0.1464088 May 25 16:58:47.993662 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [None req-a1d2d385-5bc4-49bb-90a8-674b9b272ae9 admin admin] 10.222.0.62 "GET /v2.0/security-groups?tenant_id=2e5b2aa717cf4fcab0169450c10a1b76&name=default HTTP/1.1" status: 200 len: 2979 time: 0.3362486 May 25 16:58:47.993662 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a1d2d385-5bc4-49bb-90a8-674b9b272ae9 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=ff64f7e7-cee1-4303-923e-c43532a8676c,revision_number=1']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:58:47.996245 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.wsgi [-] (91830) accepted ('10.222.0.62', 55860) {{(pid=91830) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:58:47.999521 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-a1d2d385-5bc4-49bb-90a8-674b9b272ae9 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.073s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:58:48.073029 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-d9d7a79d-394b-4913-8b44-e92883b8537f admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:48.085860 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-271efde5-9a58-42ee-bd24-d53d60435907 req-36643b10-1b3d-4243-90a6-215a640f2f37 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] 10.222.0.62 "GET /v2.0/security-groups?id=f73b90a2-df48-48fb-99e0-5dd4d6a63a15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1052551 May 25 16:58:48.101875 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-d9d7a79d-394b-4913-8b44-e92883b8537f admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:48.118287 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-caab7c23-53fe-449b-a677-02ec027d4e88 req-0e446bb2-0b05-4e91-bac8-5a754d3f99a6 tempest-DeleteServersTestJSON-1172980508 tempest-DeleteServersTestJSON-1172980508-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:58:48.119930 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-caab7c23-53fe-449b-a677-02ec027d4e88 req-0e446bb2-0b05-4e91-bac8-5a754d3f99a6 tempest-DeleteServersTestJSON-1172980508 tempest-DeleteServersTestJSON-1172980508-project] 10.222.0.62 "GET /v2.0/ports?device_id=1d5af5b3-8d0b-4cf9-a7f1-ce49a30efc33 HTTP/1.1" status: 200 len: 943 time: 0.0954063 May 25 16:58:48.164952 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-d9d7a79d-394b-4913-8b44-e92883b8537f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-640836'] for security_group, after_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:48.170626 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:58:48.178421 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-caab7c23-53fe-449b-a677-02ec027d4e88 req-27a86aa3-54a7-4d78-b434-753dabe1d379 tempest-DeleteServersTestJSON-1172980508 tempest-DeleteServersTestJSON-1172980508-project] 10.222.0.62 "GET /v2.0/security-groups?id=ec198040-29f5-4dbf-8437-e486f3fb935b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0486183 May 25 16:58:48.186171 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-d9d7a79d-394b-4913-8b44-e92883b8537f admin admin] Notify callbacks [] for security_group, before_response {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:48.187904 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [None req-d9d7a79d-394b-4913-8b44-e92883b8537f admin admin] 10.222.0.62 "DELETE /v2.0/security-groups/ff64f7e7-cee1-4303-923e-c43532a8676c HTTP/1.1" status: 204 len: 168 time: 0.1904485 May 25 16:58:48.188761 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d9d7a79d-394b-4913-8b44-e92883b8537f admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=ff64f7e7-cee1-4303-923e-c43532a8676c,revision_number=None']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:58:48.192101 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-d9d7a79d-394b-4913-8b44-e92883b8537f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.021s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:58:48.416922 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.wsgi [-] (91830) accepted ('10.222.0.62', 55878) {{(pid=91830) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:58:48.519449 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.rpc [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Device a460da33-52a2-41d5-bcf5-1baa12e65f8f details requested by agent hyperv_hv-cinder-79049 with host hv-cinder-79049 {{(pid=91831) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 25 16:58:48.539044 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d5026a12-b79f-4fb2-84bd-fe4e64c67381 req-6249c414-01b0-49fe-8e40-15671c61dc9e tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:58:48.540552 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-d5026a12-b79f-4fb2-84bd-fe4e64c67381 req-6249c414-01b0-49fe-8e40-15671c61dc9e tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/ports?device_id=d87a1395-92e0-4727-a5ed-a8dcdee587c3 HTTP/1.1" status: 200 len: 943 time: 0.1120505 May 25 16:58:48.645763 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-5af0d23d-3b30-44ea-ba6e-3a360c4bcd95 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:48.651495 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-d5026a12-b79f-4fb2-84bd-fe4e64c67381 req-5a9a0b87-74d4-4152-bda6-9e7b5ff46214 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/security-groups?id=8ee5c4ed-9c60-4e39-9185-7e283704a7dc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0957928 May 25 16:58:48.723683 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.quota.driver [None req-5af0d23d-3b30-44ea-ba6e-3a360c4bcd95 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91830) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 16:58:48.724497 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.db [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] For port a460da33-52a2-41d5-bcf5-1baa12e65f8f, host hv-cinder-79049, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79049',level=0,port_id=a460da33-52a2-41d5-bcf5-1baa12e65f8f,segment=NetworkSegment(8721f8e7-e59f-46c5-9d87-1b6cc08601ef),segment_id=8721f8e7-e59f-46c5-9d87-1b6cc08601ef)] {{(pid=91831) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 16:58:48.729276 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [None req-5af0d23d-3b30-44ea-ba6e-3a360c4bcd95 admin admin] Usage tracker for resource:security_group_rule and tenant:324a0bf7950649e1a32d26a4fc29aa44 is out of sync, need to count used quota {{(pid=91830) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 16:58:48.734468 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [None req-5af0d23d-3b30-44ea-ba6e-3a360c4bcd95 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91830) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 16:58:48.744142 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.quota.driver [None req-5af0d23d-3b30-44ea-ba6e-3a360c4bcd95 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91830) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 16:58:48.773827 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.rpc [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Returning: {'device': 'a460da33-52a2-41d5-bcf5-1baa12e65f8f', 'network_id': 'ca95b136-0269-430f-b450-69ee5473ae7d', 'port_id': 'a460da33-52a2-41d5-bcf5-1baa12e65f8f', 'mac_address': 'fa:16:3e:6a:22:23', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 672, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '34034d6a-51f1-4e15-aa5b-0f79437d26f5', 'ip_address': '172.20.0.3'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=91831) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 25 16:58:48.797635 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f88b106a-78c9-4bbe-9ee2-f139258b65b1 req-3529ac3d-facb-4302-a27a-388d9fcccc22 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=91830) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:58:48.799953 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-f88b106a-78c9-4bbe-9ee2-f139258b65b1 req-3529ac3d-facb-4302-a27a-388d9fcccc22 service neutron] 10.222.0.32 "GET /v2.0/subnets?id=b0baa944-cafe-48a4-861a-dae28947b9f0 HTTP/1.1" status: 200 len: 854 time: 0.2892890 May 25 16:58:48.843636 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3832070'] for port, before_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:48.867904 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.notifiers.nova [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id a460da33-52a2-41d5-bcf5-1baa12e65f8f {{(pid=91831) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} May 25 16:58:48.890130 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.db [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] For port a460da33-52a2-41d5-bcf5-1baa12e65f8f, host hv-cinder-79049, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79049',level=0,port_id=a460da33-52a2-41d5-bcf5-1baa12e65f8f,segment=NetworkSegment(8721f8e7-e59f-46c5-9d87-1b6cc08601ef),segment_id=8721f8e7-e59f-46c5-9d87-1b6cc08601ef)] {{(pid=91831) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 16:58:48.895671 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8757892955028', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8757892520933', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8757892521750'] for port, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:48.899132 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:58:48.920667 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-5af0d23d-3b30-44ea-ba6e-3a360c4bcd95 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:48.929598 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-5af0d23d-3b30-44ea-ba6e-3a360c4bcd95 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-640836'] for security_group, after_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:48.942896 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-42d7e78d-4e5f-4438-a53f-af07f660e27d admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:58:48.985498 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [None req-5af0d23d-3b30-44ea-ba6e-3a360c4bcd95 admin admin] 10.222.0.62 "GET /v2.0/security-groups?tenant_id=324a0bf7950649e1a32d26a4fc29aa44&name=default HTTP/1.1" status: 200 len: 2979 time: 0.5669279 May 25 16:58:48.986179 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5af0d23d-3b30-44ea-ba6e-3a360c4bcd95 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=ed7f387b-b5fc-42cc-aa57-d9e7a2ab9b6d,revision_number=1']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:58:48.986870 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.wsgi [-] (91829) accepted ('10.222.0.62', 55908) {{(pid=91829) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:58:48.990836 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-5af0d23d-3b30-44ea-ba6e-3a360c4bcd95 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.047s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:58:49.008507 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Pushing event updated for resources: {'Port': ['ID=a460da33-52a2-41d5-bcf5-1baa12e65f8f,revision_number=4']} {{(pid=91831) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:58:49.011984 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.113s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:58:49.056570 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-e5f43353-e6f4-4a15-b99b-9e86b7a47b18 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:49.084029 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-e5f43353-e6f4-4a15-b99b-9e86b7a47b18 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:49.147331 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-e5f43353-e6f4-4a15-b99b-9e86b7a47b18 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-640836'] for security_group, after_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:49.152104 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-73a8192a-b664-4e8a-b0df-2524ae537366 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:58:49.165724 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e5f43353-e6f4-4a15-b99b-9e86b7a47b18 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=ed7f387b-b5fc-42cc-aa57-d9e7a2ab9b6d,revision_number=None']} {{(pid=91829) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:58:49.168786 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-e5f43353-e6f4-4a15-b99b-9e86b7a47b18 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.017s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:58:49.176249 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-e5f43353-e6f4-4a15-b99b-9e86b7a47b18 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:49.180490 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [None req-e5f43353-e6f4-4a15-b99b-9e86b7a47b18 admin admin] 10.222.0.62 "DELETE /v2.0/security-groups/ed7f387b-b5fc-42cc-aa57-d9e7a2ab9b6d HTTP/1.1" status: 204 len: 168 time: 0.1904786 May 25 16:58:49.397929 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0586bbf8-4b32-48e7-8223-6b1f1f9f6d7b req-cf313676-5bd4-421a-8b5a-505bcd674a11 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:58:49.399370 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-0586bbf8-4b32-48e7-8223-6b1f1f9f6d7b req-cf313676-5bd4-421a-8b5a-505bcd674a11 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] 10.222.0.62 "GET /v2.0/ports?device_id=bca36110-0b4f-419a-92ef-46cbb9d6215e HTTP/1.1" status: 200 len: 943 time: 0.1678612 May 25 16:58:49.449629 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dbfb7b4b-777d-45e3-a820-6202cc0b8025 req-4559bcc8-8834-4317-978f-082bc7c6a1df tempest-DeleteServersTestJSON-1172980508 tempest-DeleteServersTestJSON-1172980508-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:58:49.451076 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-dbfb7b4b-777d-45e3-a820-6202cc0b8025 req-4559bcc8-8834-4317-978f-082bc7c6a1df tempest-DeleteServersTestJSON-1172980508 tempest-DeleteServersTestJSON-1172980508-project] 10.222.0.62 "GET /v2.0/ports?device_id=1d5af5b3-8d0b-4cf9-a7f1-ce49a30efc33 HTTP/1.1" status: 200 len: 944 time: 0.1348233 May 25 16:58:49.480458 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-0586bbf8-4b32-48e7-8223-6b1f1f9f6d7b req-2d99afe5-5c18-48ba-b077-3a6a279fe5c7 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] 10.222.0.62 "GET /v2.0/security-groups?id=f73b90a2-df48-48fb-99e0-5dd4d6a63a15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0753329 May 25 16:58:49.527354 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-dbfb7b4b-777d-45e3-a820-6202cc0b8025 req-6b2a7a72-f1d0-4c86-8e6f-79e83bc5a127 tempest-DeleteServersTestJSON-1172980508 tempest-DeleteServersTestJSON-1172980508-project] 10.222.0.62 "GET /v2.0/security-groups?id=ec198040-29f5-4dbf-8437-e486f3fb935b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0675313 May 25 16:58:49.644072 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-687f50bd-726f-4df1-a7d3-037283187d42 req-372c0cab-9f1e-4641-bd65-278aa7be21b7 service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=250e0a7c-f7d1-4092-af1f-d50d5b92f68a HTTP/1.1" status: 200 len: 217 time: 0.1387329 May 25 16:58:49.650623 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-f88b106a-78c9-4bbe-9ee2-f139258b65b1 req-02a149e0-3cf4-43af-849d-f1d3c49da6e6 service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=63b1f335-e2c4-48dd-886b-6be853f8a2fc&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0576158 May 25 16:58:49.666000 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-1fc04329-def7-4f7c-bbd6-df77c33e33b6 req-aaa33acf-3154-44cd-9587-d7ac892ed1c6 service neutron] 10.222.0.32 "GET /v2.0/networks/55a46372-d583-4435-a0f6-b9397668217d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1621130 May 25 16:58:49.812109 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.wsgi [-] (91830) accepted ('10.222.0.62', 55954) {{(pid=91830) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:58:49.832346 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-621816b9-8285-48a3-ad95-6222f0f4f806 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:49.848368 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.quota.driver [None req-621816b9-8285-48a3-ad95-6222f0f4f806 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91830) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 16:58:49.852403 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [None req-621816b9-8285-48a3-ad95-6222f0f4f806 admin admin] Usage tracker for resource:security_group_rule and tenant:03c53bd106174b789524bc36473f1a86 is out of sync, need to count used quota {{(pid=91830) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 16:58:49.855249 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [None req-621816b9-8285-48a3-ad95-6222f0f4f806 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91830) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 16:58:49.861393 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.quota.driver [None req-621816b9-8285-48a3-ad95-6222f0f4f806 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91830) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 16:58:49.909423 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1542e871-ccfa-4b96-a1e8-e3e7e7ed9fab req-09092ce7-8cb8-45d4-b4b6-2e332bef36fd tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:58:49.911167 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-1542e871-ccfa-4b96-a1e8-e3e7e7ed9fab req-09092ce7-8cb8-45d4-b4b6-2e332bef36fd tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/ports?device_id=d87a1395-92e0-4727-a5ed-a8dcdee587c3 HTTP/1.1" status: 200 len: 943 time: 0.1341567 May 25 16:58:49.965292 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-621816b9-8285-48a3-ad95-6222f0f4f806 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:49.971748 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-621816b9-8285-48a3-ad95-6222f0f4f806 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-640836'] for security_group, after_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:49.975047 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-1542e871-ccfa-4b96-a1e8-e3e7e7ed9fab req-9b450e72-99b4-49e2-9151-3d27f31ae849 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/security-groups?id=8ee5c4ed-9c60-4e39-9185-7e283704a7dc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0557301 May 25 16:58:49.982883 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-cbf8a34c-e2c6-452e-92c6-feb6c9d9b779 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:58:50.039304 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [None req-621816b9-8285-48a3-ad95-6222f0f4f806 admin admin] 10.222.0.62 "GET /v2.0/security-groups?tenant_id=03c53bd106174b789524bc36473f1a86&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2261095 May 25 16:58:50.040174 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-621816b9-8285-48a3-ad95-6222f0f4f806 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=98e73c5b-c145-4b7c-a09b-bbd7a925df1b,revision_number=1']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:58:50.041971 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.wsgi [-] (91829) accepted ('10.222.0.62', 55962) {{(pid=91829) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:58:50.043698 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-621816b9-8285-48a3-ad95-6222f0f4f806 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.061s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:58:50.109139 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-74acfdc4-5fb6-4ef2-9be0-b52c684435a9 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:50.136665 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-74acfdc4-5fb6-4ef2-9be0-b52c684435a9 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:50.200874 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-74acfdc4-5fb6-4ef2-9be0-b52c684435a9 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-640836'] for security_group, after_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:50.206790 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:58:50.218428 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-74acfdc4-5fb6-4ef2-9be0-b52c684435a9 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=98e73c5b-c145-4b7c-a09b-bbd7a925df1b,revision_number=None']} {{(pid=91829) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:58:50.225289 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-74acfdc4-5fb6-4ef2-9be0-b52c684435a9 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.018s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:58:50.239537 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-74acfdc4-5fb6-4ef2-9be0-b52c684435a9 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:50.240674 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [None req-74acfdc4-5fb6-4ef2-9be0-b52c684435a9 admin admin] 10.222.0.62 "DELETE /v2.0/security-groups/98e73c5b-c145-4b7c-a09b-bbd7a925df1b HTTP/1.1" status: 204 len: 168 time: 0.1973271 May 25 16:58:50.667127 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.wsgi [-] (91830) accepted ('10.222.0.62', 55996) {{(pid=91830) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:58:50.810290 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e738476e-d68f-43a3-b863-805e050840b7 req-21acb610-b0d1-4feb-b611-fa7dbbf18335 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:58:50.811720 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-e738476e-d68f-43a3-b863-805e050840b7 req-21acb610-b0d1-4feb-b611-fa7dbbf18335 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] 10.222.0.62 "GET /v2.0/ports?device_id=bca36110-0b4f-419a-92ef-46cbb9d6215e HTTP/1.1" status: 200 len: 943 time: 0.2059863 May 25 16:58:50.847148 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e20668b9-642d-400d-9a2a-ee6fd803b132 req-67078d45-26f6-438d-9d9d-343025f104f0 tempest-DeleteServersTestJSON-1172980508 tempest-DeleteServersTestJSON-1172980508-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:58:50.853827 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-e20668b9-642d-400d-9a2a-ee6fd803b132 req-67078d45-26f6-438d-9d9d-343025f104f0 tempest-DeleteServersTestJSON-1172980508 tempest-DeleteServersTestJSON-1172980508-project] 10.222.0.62 "GET /v2.0/ports?device_id=1d5af5b3-8d0b-4cf9-a7f1-ce49a30efc33 HTTP/1.1" status: 200 len: 944 time: 0.1839030 May 25 16:58:50.909525 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-e738476e-d68f-43a3-b863-805e050840b7 req-5a435e15-bd6f-48e7-9e24-2cd5412c8411 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] 10.222.0.62 "GET /v2.0/security-groups?id=f73b90a2-df48-48fb-99e0-5dd4d6a63a15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0886979 May 25 16:58:50.925812 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-e20668b9-642d-400d-9a2a-ee6fd803b132 req-678a124d-af2c-4843-b2b9-6796de9307a4 tempest-DeleteServersTestJSON-1172980508 tempest-DeleteServersTestJSON-1172980508-project] 10.222.0.62 "GET /v2.0/security-groups?id=ec198040-29f5-4dbf-8437-e486f3fb935b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0710464 May 25 16:58:51.139317 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-3a28ccce-c1b4-40cc-ba06-3820a0c7dd7c admin admin] Notify callbacks [] for security_group, before_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:51.219097 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.quota.driver [None req-3a28ccce-c1b4-40cc-ba06-3820a0c7dd7c admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91830) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 16:58:51.231313 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [None req-3a28ccce-c1b4-40cc-ba06-3820a0c7dd7c admin admin] Usage tracker for resource:security_group_rule and tenant:26934c1cfda347fca4860ea9b32730a9 is out of sync, need to count used quota {{(pid=91830) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 16:58:51.236052 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-687f50bd-726f-4df1-a7d3-037283187d42 req-937291c4-9cb0-4e57-b6b5-4e1580cfd0ac service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=91830) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:58:51.237539 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-687f50bd-726f-4df1-a7d3-037283187d42 req-937291c4-9cb0-4e57-b6b5-4e1580cfd0ac service neutron] 10.222.0.32 "GET /v2.0/subnets?id=927bd65a-c4de-491b-b501-302852f4c784 HTTP/1.1" status: 200 len: 858 time: 0.3166640 May 25 16:58:51.240522 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [None req-3a28ccce-c1b4-40cc-ba06-3820a0c7dd7c admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91830) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 16:58:51.246612 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-292015fc-31b7-45a7-ba3d-a295e3dece64 req-7f3b6516-3b03-4863-91d8-52645ec3e6d9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:58:51.248036 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-292015fc-31b7-45a7-ba3d-a295e3dece64 req-7f3b6516-3b03-4863-91d8-52645ec3e6d9 service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=734df673f8b3484d80f35a45fbce9d5e&device_id=58da9205-0212-4daa-996c-1eef64a2b702 HTTP/1.1" status: 200 len: 1096 time: 0.2486889 May 25 16:58:51.291123 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.quota.driver [None req-3a28ccce-c1b4-40cc-ba06-3820a0c7dd7c admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91830) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 16:58:51.313984 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-687f50bd-726f-4df1-a7d3-037283187d42 req-5db2175f-2506-4364-8a97-c00581ec30ad service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=55a46372-d583-4435-a0f6-b9397668217d&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0663722 May 25 16:58:51.363210 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-f88b106a-78c9-4bbe-9ee2-f139258b65b1 req-e20d54a1-f34f-4af7-952a-f9172917ec23 service neutron] 10.222.0.32 "GET /v2.0/networks/63b1f335-e2c4-48dd-886b-6be853f8a2fc?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2720299 May 25 16:58:51.399010 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-292015fc-31b7-45a7-ba3d-a295e3dece64 req-97811a08-1b70-4077-8bda-8278322414a0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:58:51.401864 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-292015fc-31b7-45a7-ba3d-a295e3dece64 req-97811a08-1b70-4077-8bda-8278322414a0 service neutron] 10.222.0.32 "GET /v2.0/networks?id=55a46372-d583-4435-a0f6-b9397668217d HTTP/1.1" status: 200 len: 919 time: 0.1437144 May 25 16:58:51.414404 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a20ae7c9-22c8-413f-938a-4fcc449e07fb req-39597cb7-67c2-4cc5-8311-50398d2631a2 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:58:51.415777 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-a20ae7c9-22c8-413f-938a-4fcc449e07fb req-39597cb7-67c2-4cc5-8311-50398d2631a2 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/ports?device_id=d87a1395-92e0-4727-a5ed-a8dcdee587c3 HTTP/1.1" status: 200 len: 943 time: 0.3222342 May 25 16:58:51.616959 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-292015fc-31b7-45a7-ba3d-a295e3dece64 req-babcd231-f895-4de4-bdca-d89ec01948e4 service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=60078444-24b6-4560-b0a7-7802c4f8f2f8 HTTP/1.1" status: 200 len: 217 time: 0.1997900 May 25 16:58:51.664562 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-687f50bd-726f-4df1-a7d3-037283187d42 req-6a614506-7051-4607-b310-6a7ee30feefd service neutron] 10.222.0.32 "GET /v2.0/networks/55a46372-d583-4435-a0f6-b9397668217d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3230126 May 25 16:58:51.691488 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-292015fc-31b7-45a7-ba3d-a295e3dece64 req-9ab173dc-f086-4c0c-97d6-514cb286443a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:58:51.693418 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-292015fc-31b7-45a7-ba3d-a295e3dece64 req-9ab173dc-f086-4c0c-97d6-514cb286443a service neutron] 10.222.0.32 "GET /v2.0/subnets?id=927bd65a-c4de-491b-b501-302852f4c784 HTTP/1.1" status: 200 len: 858 time: 0.0696766 May 25 16:58:51.696829 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-3a28ccce-c1b4-40cc-ba06-3820a0c7dd7c admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:51.703413 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-f88b106a-78c9-4bbe-9ee2-f139258b65b1 req-765a9b63-f9ef-484e-8ead-469b0c2c0a27 service neutron] 10.222.0.32 "GET /v2.0/networks/63b1f335-e2c4-48dd-886b-6be853f8a2fc?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3317425 May 25 16:58:51.707572 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-3a28ccce-c1b4-40cc-ba06-3820a0c7dd7c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-640836'] for security_group, after_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:51.710981 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-a20ae7c9-22c8-413f-938a-4fcc449e07fb req-a0787329-1bf3-4269-8d3a-69689c4da30a tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/security-groups?id=8ee5c4ed-9c60-4e39-9185-7e283704a7dc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1863153 May 25 16:58:51.760671 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-292015fc-31b7-45a7-ba3d-a295e3dece64 req-7a3348d1-e289-41c5-826c-bf5b9f1e581e service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=55a46372-d583-4435-a0f6-b9397668217d&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0474172 May 25 16:58:51.769561 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-dbc1b6da-ab7e-46eb-8f4f-12aa08c23909 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:58:51.838981 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [None req-3a28ccce-c1b4-40cc-ba06-3820a0c7dd7c admin admin] 10.222.0.62 "GET /v2.0/security-groups?tenant_id=26934c1cfda347fca4860ea9b32730a9&name=default HTTP/1.1" status: 200 len: 2979 time: 1.1705453 May 25 16:58:51.850190 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.wsgi [-] (91830) accepted ('10.222.0.62', 56046) {{(pid=91830) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:58:51.856304 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3a28ccce-c1b4-40cc-ba06-3820a0c7dd7c admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=07ced2f5-9126-487b-a3f5-051f713e8ed0,revision_number=1']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:58:51.888306 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-3a28ccce-c1b4-40cc-ba06-3820a0c7dd7c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.119s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:58:51.939305 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-687f50bd-726f-4df1-a7d3-037283187d42 req-763744c5-f2c8-43a9-b3a4-4d945b1d222f service neutron] 10.222.0.32 "GET /v2.0/networks/55a46372-d583-4435-a0f6-b9397668217d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2651970 May 25 16:58:51.947765 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-292015fc-31b7-45a7-ba3d-a295e3dece64 req-5e9ea720-f2e1-4a4f-a01a-bb8d900a305b service neutron] 10.222.0.32 "GET /v2.0/networks/55a46372-d583-4435-a0f6-b9397668217d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1790867 May 25 16:58:51.963464 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-586a41a0-3061-4e81-8c21-4033243f4cd6 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:52.025598 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-586a41a0-3061-4e81-8c21-4033243f4cd6 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:52.145447 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-586a41a0-3061-4e81-8c21-4033243f4cd6 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-640836'] for security_group, after_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:52.153459 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-fd66485f-bdba-48b5-9416-049125ab25b1 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:58:52.174719 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-586a41a0-3061-4e81-8c21-4033243f4cd6 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=07ced2f5-9126-487b-a3f5-051f713e8ed0,revision_number=None']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:58:52.185674 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-586a41a0-3061-4e81-8c21-4033243f4cd6 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.032s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:58:52.196976 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-586a41a0-3061-4e81-8c21-4033243f4cd6 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:52.201994 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [None req-586a41a0-3061-4e81-8c21-4033243f4cd6 admin admin] 10.222.0.62 "DELETE /v2.0/security-groups/07ced2f5-9126-487b-a3f5-051f713e8ed0 HTTP/1.1" status: 204 len: 168 time: 0.3493929 May 25 16:58:52.306139 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-936f8ffb-084e-483d-832a-ec061482f36a req-3283af2c-1866-45a4-8e37-37e6dd007f72 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:58:52.308005 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-936f8ffb-084e-483d-832a-ec061482f36a req-3283af2c-1866-45a4-8e37-37e6dd007f72 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] 10.222.0.62 "GET /v2.0/ports?device_id=bca36110-0b4f-419a-92ef-46cbb9d6215e HTTP/1.1" status: 200 len: 943 time: 0.2039602 May 25 16:58:52.319994 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b7a43cfb-43a5-427c-a954-41d5782f2646 req-391c5017-cc19-4572-92bc-ab20821c997e tempest-DeleteServersTestJSON-1172980508 tempest-DeleteServersTestJSON-1172980508-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:58:52.326438 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-b7a43cfb-43a5-427c-a954-41d5782f2646 req-391c5017-cc19-4572-92bc-ab20821c997e tempest-DeleteServersTestJSON-1172980508 tempest-DeleteServersTestJSON-1172980508-project] 10.222.0.62 "GET /v2.0/ports?device_id=1d5af5b3-8d0b-4cf9-a7f1-ce49a30efc33 HTTP/1.1" status: 200 len: 944 time: 0.1569433 May 25 16:58:52.398961 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-b7a43cfb-43a5-427c-a954-41d5782f2646 req-dcc261fc-633c-4596-9aa4-5d6ee3bcd5e4 tempest-DeleteServersTestJSON-1172980508 tempest-DeleteServersTestJSON-1172980508-project] 10.222.0.62 "GET /v2.0/security-groups?id=ec198040-29f5-4dbf-8437-e486f3fb935b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0713542 May 25 16:58:52.403349 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-936f8ffb-084e-483d-832a-ec061482f36a req-83a5a9a1-36a1-476b-806a-be95852cdff3 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] 10.222.0.62 "GET /v2.0/security-groups?id=f73b90a2-df48-48fb-99e0-5dd4d6a63a15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0740380 May 25 16:58:52.892954 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b625c398-7ab6-4707-9f13-2869613d02d0 req-cb7259b6-770d-44f6-9866-7cdfe3d3d9f6 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:58:52.894859 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-b625c398-7ab6-4707-9f13-2869613d02d0 req-cb7259b6-770d-44f6-9866-7cdfe3d3d9f6 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/ports?device_id=d87a1395-92e0-4727-a5ed-a8dcdee587c3 HTTP/1.1" status: 200 len: 943 time: 0.0807076 May 25 16:58:52.948738 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-b625c398-7ab6-4707-9f13-2869613d02d0 req-1065c990-07c4-4473-bcc5-a8d6cb3c59c4 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/security-groups?id=8ee5c4ed-9c60-4e39-9185-7e283704a7dc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0482056 May 25 16:58:53.778294 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-292015fc-31b7-45a7-ba3d-a295e3dece64 req-2d530763-2e39-40e2-a279-bd8ac60be159 service neutron] 10.222.0.32 "GET /v2.0/networks/55a46372-d583-4435-a0f6-b9397668217d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2273307 May 25 16:58:53.788591 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c7549673-f0c0-41ff-866b-7540f914eef7 req-6098c507-f1ff-4f5b-9881-4be64e692582 tempest-DeleteServersTestJSON-1172980508 tempest-DeleteServersTestJSON-1172980508-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:58:53.789949 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-c7549673-f0c0-41ff-866b-7540f914eef7 req-6098c507-f1ff-4f5b-9881-4be64e692582 tempest-DeleteServersTestJSON-1172980508 tempest-DeleteServersTestJSON-1172980508-project] 10.222.0.62 "GET /v2.0/ports?device_id=1d5af5b3-8d0b-4cf9-a7f1-ce49a30efc33 HTTP/1.1" status: 200 len: 944 time: 0.2799194 May 25 16:58:53.797789 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-94aa321e-9f7c-493e-a203-f7576b456a6a req-6c8cb5ff-e86e-48c8-a76e-867ec90ae36b tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:58:53.799177 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-94aa321e-9f7c-493e-a203-f7576b456a6a req-6c8cb5ff-e86e-48c8-a76e-867ec90ae36b tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] 10.222.0.62 "GET /v2.0/ports?device_id=bca36110-0b4f-419a-92ef-46cbb9d6215e HTTP/1.1" status: 200 len: 943 time: 0.2261539 May 25 16:58:53.868741 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-c7549673-f0c0-41ff-866b-7540f914eef7 req-aa0cf9e3-a7fb-4251-8df8-1bb360cb5920 tempest-DeleteServersTestJSON-1172980508 tempest-DeleteServersTestJSON-1172980508-project] 10.222.0.62 "GET /v2.0/security-groups?id=ec198040-29f5-4dbf-8437-e486f3fb935b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0686476 May 25 16:58:53.873108 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-94aa321e-9f7c-493e-a203-f7576b456a6a req-37d66689-80a5-42b0-bc47-466ce643ca4f tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] 10.222.0.62 "GET /v2.0/security-groups?id=f73b90a2-df48-48fb-99e0-5dd4d6a63a15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0604091 May 25 16:58:54.131489 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-10eb1ee6-2f6c-441f-a69e-73da627ec53e req-ffa8d6c4-dc6b-4002-89f0-c85ccd82f4fe tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:58:54.132936 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-10eb1ee6-2f6c-441f-a69e-73da627ec53e req-ffa8d6c4-dc6b-4002-89f0-c85ccd82f4fe tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/ports?device_id=d87a1395-92e0-4727-a5ed-a8dcdee587c3 HTTP/1.1" status: 200 len: 943 time: 0.0806396 May 25 16:58:54.178151 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-10eb1ee6-2f6c-441f-a69e-73da627ec53e req-30edd0f8-a8fc-4671-b5f1-e84b51bd0fb3 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/security-groups?id=8ee5c4ed-9c60-4e39-9185-7e283704a7dc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0396028 May 25 16:58:54.651308 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.db [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] get_ports_and_sgs() called for port_ids ['a460da33-52a2-41d5-bcf5-1baa12e65f8f'] {{(pid=91831) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 25 16:58:55.112699 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2ac6ce8e-de0a-4b25-ad0e-eb24d59fd859 req-3c874de5-3db7-4926-abb8-8376f6945665 tempest-DeleteServersTestJSON-1172980508 tempest-DeleteServersTestJSON-1172980508-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:58:55.113879 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-2ac6ce8e-de0a-4b25-ad0e-eb24d59fd859 req-3c874de5-3db7-4926-abb8-8376f6945665 tempest-DeleteServersTestJSON-1172980508 tempest-DeleteServersTestJSON-1172980508-project] 10.222.0.62 "GET /v2.0/ports?device_id=1d5af5b3-8d0b-4cf9-a7f1-ce49a30efc33 HTTP/1.1" status: 200 len: 944 time: 0.1392586 May 25 16:58:55.122146 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-26f222cd-2099-4bdf-8d8e-cb9a7e50a80e req-d0efe1ac-0708-4078-bf68-ed1ec188fc74 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:58:55.123506 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-26f222cd-2099-4bdf-8d8e-cb9a7e50a80e req-d0efe1ac-0708-4078-bf68-ed1ec188fc74 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] 10.222.0.62 "GET /v2.0/ports?device_id=bca36110-0b4f-419a-92ef-46cbb9d6215e HTTP/1.1" status: 200 len: 943 time: 0.1176357 May 25 16:58:55.250148 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-2ac6ce8e-de0a-4b25-ad0e-eb24d59fd859 req-8d5380d7-b8d5-44a5-a5bd-3b231737cdbc tempest-DeleteServersTestJSON-1172980508 tempest-DeleteServersTestJSON-1172980508-project] 10.222.0.62 "GET /v2.0/security-groups?id=ec198040-29f5-4dbf-8437-e486f3fb935b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1255968 May 25 16:58:55.254874 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-26f222cd-2099-4bdf-8d8e-cb9a7e50a80e req-cc49187b-d55f-4944-b3ad-b43aa2c04a1e tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] 10.222.0.62 "GET /v2.0/security-groups?id=f73b90a2-df48-48fb-99e0-5dd4d6a63a15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1143939 May 25 16:58:55.287305 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-50ad4ab2-914f-4ab2-895e-29adc3b6d6f4 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:55.424639 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d100826f-88ba-4f45-b53c-ae6e27a9ec74 req-7150f637-316b-4e0b-8bfe-716ee78b68a7 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:58:55.426080 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-d100826f-88ba-4f45-b53c-ae6e27a9ec74 req-7150f637-316b-4e0b-8bfe-716ee78b68a7 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/ports?device_id=d87a1395-92e0-4727-a5ed-a8dcdee587c3 HTTP/1.1" status: 200 len: 943 time: 0.0776813 May 25 16:58:55.469760 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-d100826f-88ba-4f45-b53c-ae6e27a9ec74 req-5ad10fb8-f1a2-4c4a-9e61-99ec186aebaa tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/security-groups?id=8ee5c4ed-9c60-4e39-9185-7e283704a7dc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0380735 May 25 16:58:56.297797 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1bf2113f-d8da-4c8a-a7ea-f80461c6e834 req-a9ea000e-7d9d-44be-b829-2c3ccb588732 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:58:56.299338 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-1bf2113f-d8da-4c8a-a7ea-f80461c6e834 req-a9ea000e-7d9d-44be-b829-2c3ccb588732 service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=734df673f8b3484d80f35a45fbce9d5e&device_id=d87a1395-92e0-4727-a5ed-a8dcdee587c3 HTTP/1.1" status: 200 len: 1096 time: 0.0718606 May 25 16:58:56.548320 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1bf2113f-d8da-4c8a-a7ea-f80461c6e834 req-ed780ea2-a2e7-426f-9259-93d164fa9124 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:58:56.549691 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-1bf2113f-d8da-4c8a-a7ea-f80461c6e834 req-ed780ea2-a2e7-426f-9259-93d164fa9124 service neutron] 10.222.0.32 "GET /v2.0/networks?id=55a46372-d583-4435-a0f6-b9397668217d HTTP/1.1" status: 200 len: 919 time: 0.2429700 May 25 16:58:56.616605 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e42550c9-c89b-4dad-87f0-a579b2f713ea req-2acb5b81-09c7-46c7-99f5-f8500a0f5fa0 tempest-DeleteServersTestJSON-1172980508 tempest-DeleteServersTestJSON-1172980508-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:58:56.619493 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-e42550c9-c89b-4dad-87f0-a579b2f713ea req-2acb5b81-09c7-46c7-99f5-f8500a0f5fa0 tempest-DeleteServersTestJSON-1172980508 tempest-DeleteServersTestJSON-1172980508-project] 10.222.0.62 "GET /v2.0/ports?device_id=1d5af5b3-8d0b-4cf9-a7f1-ce49a30efc33 HTTP/1.1" status: 200 len: 944 time: 0.2423203 May 25 16:58:56.633329 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2662b4f6-f1c5-4350-836a-d7ed96fc2e0f req-cdea7a29-2eaa-44bf-bb4d-bad8a82cccee tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:58:56.641735 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-2662b4f6-f1c5-4350-836a-d7ed96fc2e0f req-cdea7a29-2eaa-44bf-bb4d-bad8a82cccee tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] 10.222.0.62 "GET /v2.0/ports?device_id=bca36110-0b4f-419a-92ef-46cbb9d6215e HTTP/1.1" status: 200 len: 943 time: 0.2567151 May 25 16:58:56.647759 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-1bf2113f-d8da-4c8a-a7ea-f80461c6e834 req-0e688c2c-9729-4355-b5dc-25379b40c536 service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=250e0a7c-f7d1-4092-af1f-d50d5b92f68a HTTP/1.1" status: 200 len: 217 time: 0.0889661 May 25 16:58:56.773863 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-e42550c9-c89b-4dad-87f0-a579b2f713ea req-65d40521-6fff-4dc7-858a-cbdb3d2481cb tempest-DeleteServersTestJSON-1172980508 tempest-DeleteServersTestJSON-1172980508-project] 10.222.0.62 "GET /v2.0/security-groups?id=ec198040-29f5-4dbf-8437-e486f3fb935b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1293645 May 25 16:58:56.780960 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-2662b4f6-f1c5-4350-836a-d7ed96fc2e0f req-9e883069-3d37-4be7-94c9-18ab2fa965f2 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] 10.222.0.62 "GET /v2.0/security-groups?id=f73b90a2-df48-48fb-99e0-5dd4d6a63a15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1346674 May 25 16:58:56.782491 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1bf2113f-d8da-4c8a-a7ea-f80461c6e834 req-a1a92a02-27b4-4450-9592-134e3d431e20 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:58:56.783967 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-1bf2113f-d8da-4c8a-a7ea-f80461c6e834 req-a1a92a02-27b4-4450-9592-134e3d431e20 service neutron] 10.222.0.32 "GET /v2.0/subnets?id=927bd65a-c4de-491b-b501-302852f4c784 HTTP/1.1" status: 200 len: 858 time: 0.1236131 May 25 16:58:56.843945 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-1bf2113f-d8da-4c8a-a7ea-f80461c6e834 req-9e0e8f05-5c99-4b9b-94a4-d87bd4b5690b service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=55a46372-d583-4435-a0f6-b9397668217d&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0457554 May 25 16:58:57.049954 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-1bf2113f-d8da-4c8a-a7ea-f80461c6e834 req-f2825be8-152a-49bf-8db1-edd569a7be53 service neutron] 10.222.0.32 "GET /v2.0/networks/55a46372-d583-4435-a0f6-b9397668217d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1986840 May 25 16:58:57.058468 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ec2da6fe-ea84-40a4-8adc-3db8e538f332 req-3bb24d63-3374-4682-9208-99d601b0e271 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:58:57.059754 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-ec2da6fe-ea84-40a4-8adc-3db8e538f332 req-3bb24d63-3374-4682-9208-99d601b0e271 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/ports?device_id=d87a1395-92e0-4727-a5ed-a8dcdee587c3 HTTP/1.1" status: 200 len: 943 time: 0.1851277 May 25 16:58:57.182607 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-ec2da6fe-ea84-40a4-8adc-3db8e538f332 req-6a9abdc5-cf23-4c80-8c37-479d0348938e tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/security-groups?id=8ee5c4ed-9c60-4e39-9185-7e283704a7dc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1162257 May 25 16:58:57.262155 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-1bf2113f-d8da-4c8a-a7ea-f80461c6e834 req-ebf1681d-463e-4a29-93fd-0a57d116f413 service neutron] 10.222.0.32 "GET /v2.0/networks/55a46372-d583-4435-a0f6-b9397668217d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1668680 May 25 16:58:57.681367 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-969fc427-31ec-4c8c-898d-2a56d2f86014 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:57.850869 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:58.029063 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d02b4955-c4f8-479f-8b82-e3670b89b2bd req-add4f435-5df7-4044-8dc0-834cbc2c225b tempest-DeleteServersTestJSON-1172980508 tempest-DeleteServersTestJSON-1172980508-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:58:58.030633 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-d02b4955-c4f8-479f-8b82-e3670b89b2bd req-add4f435-5df7-4044-8dc0-834cbc2c225b tempest-DeleteServersTestJSON-1172980508 tempest-DeleteServersTestJSON-1172980508-project] 10.222.0.62 "GET /v2.0/ports?device_id=1d5af5b3-8d0b-4cf9-a7f1-ce49a30efc33 HTTP/1.1" status: 200 len: 944 time: 0.1444466 May 25 16:58:58.038383 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c30de789-5882-427b-9a29-ddc9b748a2ca req-835a354c-6a3a-442e-a698-49a8afaf9b38 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:58:58.039717 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-c30de789-5882-427b-9a29-ddc9b748a2ca req-835a354c-6a3a-442e-a698-49a8afaf9b38 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] 10.222.0.62 "GET /v2.0/ports?device_id=bca36110-0b4f-419a-92ef-46cbb9d6215e HTTP/1.1" status: 200 len: 943 time: 0.1229141 May 25 16:58:58.104263 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-d02b4955-c4f8-479f-8b82-e3670b89b2bd req-add755f1-333e-4d86-bddb-379cd2bb128f tempest-DeleteServersTestJSON-1172980508 tempest-DeleteServersTestJSON-1172980508-project] 10.222.0.62 "GET /v2.0/security-groups?id=ec198040-29f5-4dbf-8437-e486f3fb935b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0636027 May 25 16:58:58.114624 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-c30de789-5882-427b-9a29-ddc9b748a2ca req-f449ce57-47a1-41aa-8209-818748352ec4 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] 10.222.0.62 "GET /v2.0/security-groups?id=f73b90a2-df48-48fb-99e0-5dd4d6a63a15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0591071 May 25 16:58:58.382649 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c1d9ae93-3c47-4d50-bc9d-2588b46428c2 req-89df3968-7aa2-4bf5-81e6-a15433d5e382 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:58:58.384122 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-c1d9ae93-3c47-4d50-bc9d-2588b46428c2 req-89df3968-7aa2-4bf5-81e6-a15433d5e382 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/ports?device_id=d87a1395-92e0-4727-a5ed-a8dcdee587c3 HTTP/1.1" status: 200 len: 943 time: 0.0813434 May 25 16:58:58.429825 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-c1d9ae93-3c47-4d50-bc9d-2588b46428c2 req-ef6e1edc-011f-445e-956a-c58302883e08 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/security-groups?id=8ee5c4ed-9c60-4e39-9185-7e283704a7dc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0396926 May 25 16:58:58.585079 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-0a55eb4a-8b57-4233-84d6-6b423b4ed6db None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:58.669850 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.rpc [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Device c4b9c0f2-e3d5-4fff-9b3c-a9175b027fb5 details requested by agent hyperv_hv-cinder-79049 with host hv-cinder-79049 {{(pid=91831) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 25 16:58:58.744367 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.rpc [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Device a460da33-52a2-41d5-bcf5-1baa12e65f8f up at agent hyperv_hv-cinder-79049 {{(pid=91831) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 25 16:58:58.855162 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.db [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] For port c4b9c0f2-e3d5-4fff-9b3c-a9175b027fb5, host hv-cinder-79049, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79049',level=0,port_id=c4b9c0f2-e3d5-4fff-9b3c-a9175b027fb5,segment=NetworkSegment(7d7273c2-c6dd-43fe-83a8-cb776d48dc70),segment_id=7d7273c2-c6dd-43fe-83a8-cb776d48dc70)] {{(pid=91831) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 16:58:58.869680 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.rpc [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Returning: {'device': 'c4b9c0f2-e3d5-4fff-9b3c-a9175b027fb5', 'network_id': '63b1f335-e2c4-48dd-886b-6be853f8a2fc', 'port_id': 'c4b9c0f2-e3d5-4fff-9b3c-a9175b027fb5', 'mac_address': 'fa:16:3e:a3:0f:eb', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 651, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'b0baa944-cafe-48a4-861a-dae28947b9f0', 'ip_address': '172.20.0.8'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=91831) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 25 16:58:58.871584 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.provisioning_blocks [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Provisioning for port a460da33-52a2-41d5-bcf5-1baa12e65f8f completed by entity L2. {{(pid=91831) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 25 16:58:58.877577 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.provisioning_blocks [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Provisioning complete for port a460da33-52a2-41d5-bcf5-1baa12e65f8f triggered by entity L2. {{(pid=91831) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 16:58:58.877968 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3854128'] for port, provisioning_complete {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:58.989357 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3832070'] for port, before_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:59.044638 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.notifiers.nova [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id c4b9c0f2-e3d5-4fff-9b3c-a9175b027fb5 {{(pid=91831) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} May 25 16:58:59.070000 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.db [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] For port c4b9c0f2-e3d5-4fff-9b3c-a9175b027fb5, host hv-cinder-79049, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79049',level=0,port_id=c4b9c0f2-e3d5-4fff-9b3c-a9175b027fb5,segment=NetworkSegment(7d7273c2-c6dd-43fe-83a8-cb776d48dc70),segment_id=7d7273c2-c6dd-43fe-83a8-cb776d48dc70)] {{(pid=91831) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 16:58:59.072566 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3832070'] for port, before_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:59.083718 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8757892955028', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8757892520933', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8757892521750'] for port, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:59.090101 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [None req-0807fb8f-5b83-4d56-9158-4cca2c2c8edc None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:58:59.247289 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.db [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] For port a460da33-52a2-41d5-bcf5-1baa12e65f8f, host hv-cinder-79049, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79049',level=0,port_id=a460da33-52a2-41d5-bcf5-1baa12e65f8f,segment=NetworkSegment(8721f8e7-e59f-46c5-9d87-1b6cc08601ef),segment_id=8721f8e7-e59f-46c5-9d87-1b6cc08601ef)] {{(pid=91831) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 16:58:59.253780 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '1d5af5b3-8d0b-4cf9-a7f1-ce49a30efc33', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'a460da33-52a2-41d5-bcf5-1baa12e65f8f'}] {{(pid=91831) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 25 16:58:59.350523 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8757892955028', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8757892520933', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8757892521750'] for port, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:58:59.383014 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Pushing event updated for resources: {'Port': ['ID=c4b9c0f2-e3d5-4fff-9b3c-a9175b027fb5,revision_number=4']} {{(pid=91831) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:58:59.388873 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.298s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:58:59.389514 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.026s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:58:59.416813 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e638ca5f-30c3-453d-ad5d-3bbbfa2f11f6 req-078e8da5-e889-4f62-a414-a1c5f66f725e tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:58:59.424083 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-e638ca5f-30c3-453d-ad5d-3bbbfa2f11f6 req-078e8da5-e889-4f62-a414-a1c5f66f725e tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] 10.222.0.62 "GET /v2.0/ports?device_id=bca36110-0b4f-419a-92ef-46cbb9d6215e HTTP/1.1" status: 200 len: 944 time: 0.1586521 May 25 16:58:59.479656 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-e638ca5f-30c3-453d-ad5d-3bbbfa2f11f6 req-f1a34340-b855-4758-af5e-0e1855f4f610 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] 10.222.0.62 "GET /v2.0/security-groups?id=f73b90a2-df48-48fb-99e0-5dd4d6a63a15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0544903 May 25 16:58:59.505818 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Pushing event updated for resources: {'Port': ['ID=a460da33-52a2-41d5-bcf5-1baa12e65f8f,revision_number=5']} {{(pid=91831) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:58:59.509817 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.120s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:58:59.519307 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b614e7f2-e37a-4607-a8ee-183cf9a8ef36 req-92c9fca5-88a0-4fbc-9ae5-944142e6b54b tempest-DeleteServersTestJSON-1172980508 tempest-DeleteServersTestJSON-1172980508-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:58:59.520759 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-b614e7f2-e37a-4607-a8ee-183cf9a8ef36 req-92c9fca5-88a0-4fbc-9ae5-944142e6b54b tempest-DeleteServersTestJSON-1172980508 tempest-DeleteServersTestJSON-1172980508-project] 10.222.0.62 "GET /v2.0/ports?device_id=1d5af5b3-8d0b-4cf9-a7f1-ce49a30efc33 HTTP/1.1" status: 200 len: 945 time: 0.1937823 May 25 16:58:59.641088 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.db [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] get_ports_and_sgs() called for port_ids ['c4b9c0f2-e3d5-4fff-9b3c-a9175b027fb5'] {{(pid=91831) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 25 16:58:59.691181 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-b614e7f2-e37a-4607-a8ee-183cf9a8ef36 req-43bc8326-6486-441c-962d-93304b3c1c88 tempest-DeleteServersTestJSON-1172980508 tempest-DeleteServersTestJSON-1172980508-project] 10.222.0.62 "GET /v2.0/security-groups?id=ec198040-29f5-4dbf-8437-e486f3fb935b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1606448 May 25 16:58:59.736823 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0b674633-a0e2-48df-95d3-aff9547afe51 req-63e2bb1f-33df-4128-bf5f-f0fcfab3f7e7 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:58:59.744274 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-0b674633-a0e2-48df-95d3-aff9547afe51 req-63e2bb1f-33df-4128-bf5f-f0fcfab3f7e7 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/ports?device_id=d87a1395-92e0-4727-a5ed-a8dcdee587c3 HTTP/1.1" status: 200 len: 943 time: 0.1285717 May 25 16:58:59.818456 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-0b674633-a0e2-48df-95d3-aff9547afe51 req-fca716a4-3c72-402e-83b3-2dfb7466724e tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/security-groups?id=8ee5c4ed-9c60-4e39-9185-7e283704a7dc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0730789 May 25 16:58:59.855179 dv-cinder-790492-4-iscsi neutron-server[91831]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '1d5af5b3-8d0b-4cf9-a7f1-ce49a30efc33', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'a460da33-52a2-41d5-bcf5-1baa12e65f8f', 'code': 200} May 25 16:59:00.093821 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d9fb77c2-dbc0-4c9b-99b6-35af8afe99e6 req-ac4a4f64-e6c2-4ee5-bb7a-0e85997e8e50 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:59:00.096009 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-d9fb77c2-dbc0-4c9b-99b6-35af8afe99e6 req-ac4a4f64-e6c2-4ee5-bb7a-0e85997e8e50 service neutron] 10.222.0.32 "GET /v2.0/ports?device_id=1d5af5b3-8d0b-4cf9-a7f1-ce49a30efc33 HTTP/1.1" status: 200 len: 1098 time: 0.0693178 May 25 16:59:00.118005 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [req-d9fb77c2-dbc0-4c9b-99b6-35af8afe99e6 req-da00636d-52f1-4b58-a426-66f2be765122 service neutron] Notify callbacks [] for security_group, before_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:59:00.131625 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.quota.driver [req-d9fb77c2-dbc0-4c9b-99b6-35af8afe99e6 req-da00636d-52f1-4b58-a426-66f2be765122 service neutron] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91829) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 16:59:00.135403 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.quota.resource [req-d9fb77c2-dbc0-4c9b-99b6-35af8afe99e6 req-da00636d-52f1-4b58-a426-66f2be765122 service neutron] Usage tracker for resource:security_group_rule and tenant:12246d52c80446878be3d905fa93ac95 is out of sync, need to count used quota {{(pid=91829) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 16:59:00.138082 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.quota.resource [req-d9fb77c2-dbc0-4c9b-99b6-35af8afe99e6 req-da00636d-52f1-4b58-a426-66f2be765122 service neutron] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91829) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 16:59:00.144240 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.quota.driver [req-d9fb77c2-dbc0-4c9b-99b6-35af8afe99e6 req-da00636d-52f1-4b58-a426-66f2be765122 service neutron] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91829) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 16:59:00.195292 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-57f11b47-1f51-4191-b7c9-af248a48372c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:59:00.230341 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [req-d9fb77c2-dbc0-4c9b-99b6-35af8afe99e6 req-da00636d-52f1-4b58-a426-66f2be765122 service neutron] Notify callbacks [] for security_group, precommit_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:59:00.234131 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [req-d9fb77c2-dbc0-4c9b-99b6-35af8afe99e6 req-da00636d-52f1-4b58-a426-66f2be765122 service neutron] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-640836'] for security_group, after_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:59:00.240918 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-a9095a49-9ed2-4654-851a-666f8087cb36 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:59:00.265352 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-d9fb77c2-dbc0-4c9b-99b6-35af8afe99e6 req-da00636d-52f1-4b58-a426-66f2be765122 service neutron] 10.222.0.32 "GET /v2.0/security-groups?id=ec198040-29f5-4dbf-8437-e486f3fb935b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1621342 May 25 16:59:00.272687 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-da00636d-52f1-4b58-a426-66f2be765122 service neutron] Pushing event updated for resources: {'SecurityGroup': ['ID=8736d524-c889-4649-8a6d-4e1db4ca8e30,revision_number=1']} {{(pid=91829) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:59:00.275736 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-da00636d-52f1-4b58-a426-66f2be765122 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.035s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:59:00.677064 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-88ff88c8-bb95-400e-a391-d2ea654050d2 req-8a0ac0ce-1314-4ef5-ab62-983b6d5546c4 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:59:00.678921 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-88ff88c8-bb95-400e-a391-d2ea654050d2 req-8a0ac0ce-1314-4ef5-ab62-983b6d5546c4 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] 10.222.0.62 "GET /v2.0/ports?device_id=bca36110-0b4f-419a-92ef-46cbb9d6215e HTTP/1.1" status: 200 len: 944 time: 0.0878909 May 25 16:59:00.679501 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.rpc [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Device 60078444-24b6-4560-b0a7-7802c4f8f2f8 details requested by agent hyperv_hv-cinder-79049 with host hv-cinder-79049 {{(pid=91831) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 25 16:59:00.730904 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-88ff88c8-bb95-400e-a391-d2ea654050d2 req-78b2ac24-d1b3-4265-acde-1e192cffc62c tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] 10.222.0.62 "GET /v2.0/security-groups?id=f73b90a2-df48-48fb-99e0-5dd4d6a63a15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0450289 May 25 16:59:00.904836 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.db [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] For port 60078444-24b6-4560-b0a7-7802c4f8f2f8, host hv-cinder-79049, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79049',level=0,port_id=60078444-24b6-4560-b0a7-7802c4f8f2f8,segment=NetworkSegment(f672477b-47fb-432c-acc9-dc57201d80de),segment_id=f672477b-47fb-432c-acc9-dc57201d80de)] {{(pid=91831) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 16:59:00.938646 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.rpc [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Returning: {'device': '60078444-24b6-4560-b0a7-7802c4f8f2f8', 'network_id': '55a46372-d583-4435-a0f6-b9397668217d', 'port_id': '60078444-24b6-4560-b0a7-7802c4f8f2f8', 'mac_address': 'fa:16:3e:82:11:28', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 697, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '927bd65a-c4de-491b-b501-302852f4c784', 'ip_address': '172.20.0.8'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=91831) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 25 16:59:00.964036 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-68db40ae-e39c-4f78-8582-431196b6899a req-021a8705-93ce-4cf5-aff9-84b60394292f tempest-DeleteServersTestJSON-1172980508 tempest-DeleteServersTestJSON-1172980508-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:59:00.972671 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-68db40ae-e39c-4f78-8582-431196b6899a req-021a8705-93ce-4cf5-aff9-84b60394292f tempest-DeleteServersTestJSON-1172980508 tempest-DeleteServersTestJSON-1172980508-project] 10.222.0.62 "GET /v2.0/ports?device_id=1d5af5b3-8d0b-4cf9-a7f1-ce49a30efc33 HTTP/1.1" status: 200 len: 945 time: 0.1234694 May 25 16:59:01.038588 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3832070'] for port, before_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:59:01.058394 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.notifiers.nova [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 60078444-24b6-4560-b0a7-7802c4f8f2f8 {{(pid=91831) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} May 25 16:59:01.079236 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.db [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] For port 60078444-24b6-4560-b0a7-7802c4f8f2f8, host hv-cinder-79049, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79049',level=0,port_id=60078444-24b6-4560-b0a7-7802c4f8f2f8,segment=NetworkSegment(f672477b-47fb-432c-acc9-dc57201d80de),segment_id=f672477b-47fb-432c-acc9-dc57201d80de)] {{(pid=91831) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 16:59:01.084952 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8757892955028', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8757892520933', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8757892521750'] for port, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:59:01.086791 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.rpc [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Device 250e0a7c-f7d1-4092-af1f-d50d5b92f68a details requested by agent hyperv_hv-cinder-79049 with host hv-cinder-79049 {{(pid=91831) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 25 16:59:01.091072 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:59:01.126660 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-68db40ae-e39c-4f78-8582-431196b6899a req-0f488dd6-e041-42e3-becc-e15654ee7d1b tempest-DeleteServersTestJSON-1172980508 tempest-DeleteServersTestJSON-1172980508-project] 10.222.0.62 "GET /v2.0/security-groups?id=ec198040-29f5-4dbf-8437-e486f3fb935b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1523139 May 25 16:59:01.139353 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6f32d2ae-9a3d-4ba6-a3f9-a6cf5166c167 req-be34fd5f-467c-4553-bc76-bebf5ec5d89a tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:59:01.148674 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-6f32d2ae-9a3d-4ba6-a3f9-a6cf5166c167 req-be34fd5f-467c-4553-bc76-bebf5ec5d89a tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/ports?device_id=d87a1395-92e0-4727-a5ed-a8dcdee587c3 HTTP/1.1" status: 200 len: 943 time: 0.1428654 May 25 16:59:01.190620 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Pushing event updated for resources: {'Port': ['ID=60078444-24b6-4560-b0a7-7802c4f8f2f8,revision_number=4']} {{(pid=91831) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:59:01.194732 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.db [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] For port 250e0a7c-f7d1-4092-af1f-d50d5b92f68a, host hv-cinder-79049, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79049',level=0,port_id=250e0a7c-f7d1-4092-af1f-d50d5b92f68a,segment=NetworkSegment(f672477b-47fb-432c-acc9-dc57201d80de),segment_id=f672477b-47fb-432c-acc9-dc57201d80de)] {{(pid=91831) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 16:59:01.203108 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-6f32d2ae-9a3d-4ba6-a3f9-a6cf5166c167 req-1f7d8c6d-6a8e-4b1f-b191-9a154dfa482a tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/security-groups?id=8ee5c4ed-9c60-4e39-9185-7e283704a7dc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0534894 May 25 16:59:01.204175 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.113s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:59:01.213215 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.rpc [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Returning: {'device': '250e0a7c-f7d1-4092-af1f-d50d5b92f68a', 'network_id': '55a46372-d583-4435-a0f6-b9397668217d', 'port_id': '250e0a7c-f7d1-4092-af1f-d50d5b92f68a', 'mac_address': 'fa:16:3e:2b:6d:50', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 697, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '927bd65a-c4de-491b-b501-302852f4c784', 'ip_address': '172.20.0.3'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=91831) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 25 16:59:01.283331 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3832070'] for port, before_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:59:01.301368 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.notifiers.nova [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 250e0a7c-f7d1-4092-af1f-d50d5b92f68a {{(pid=91831) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} May 25 16:59:01.317494 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.db [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] For port 250e0a7c-f7d1-4092-af1f-d50d5b92f68a, host hv-cinder-79049, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79049',level=0,port_id=250e0a7c-f7d1-4092-af1f-d50d5b92f68a,segment=NetworkSegment(f672477b-47fb-432c-acc9-dc57201d80de),segment_id=f672477b-47fb-432c-acc9-dc57201d80de)] {{(pid=91831) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 16:59:01.321742 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8757892955028', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8757892520933', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8757892521750'] for port, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:59:01.324752 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:59:01.391410 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Pushing event updated for resources: {'Port': ['ID=250e0a7c-f7d1-4092-af1f-d50d5b92f68a,revision_number=4']} {{(pid=91831) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:59:01.395506 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.071s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:59:01.927047 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d88f4073-dc07-4274-961d-047284713b33 req-e70b091f-c1b6-4e13-9681-7f283287ee4c tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:59:01.928455 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-d88f4073-dc07-4274-961d-047284713b33 req-e70b091f-c1b6-4e13-9681-7f283287ee4c tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] 10.222.0.62 "GET /v2.0/ports?device_id=bca36110-0b4f-419a-92ef-46cbb9d6215e HTTP/1.1" status: 200 len: 944 time: 0.0831895 May 25 16:59:01.978860 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-d88f4073-dc07-4274-961d-047284713b33 req-a2822f3e-c2c0-4e02-ba82-216244df80e6 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] 10.222.0.62 "GET /v2.0/security-groups?id=f73b90a2-df48-48fb-99e0-5dd4d6a63a15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0443182 May 25 16:59:02.383715 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c8e1246c-5dc5-4dfa-8728-21041086abab req-cb1ef70a-5395-4718-817f-b06fed1b96cc tempest-DeleteServersTestJSON-1172980508 tempest-DeleteServersTestJSON-1172980508-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:59:02.385155 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-c8e1246c-5dc5-4dfa-8728-21041086abab req-cb1ef70a-5395-4718-817f-b06fed1b96cc tempest-DeleteServersTestJSON-1172980508 tempest-DeleteServersTestJSON-1172980508-project] 10.222.0.62 "GET /v2.0/ports?device_id=1d5af5b3-8d0b-4cf9-a7f1-ce49a30efc33 HTTP/1.1" status: 200 len: 945 time: 0.1371763 May 25 16:59:02.423556 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-633d3bc3-2196-46ba-9268-f38ec59f289f req-df44d8fa-2f2c-4609-ae07-5f36deff7a78 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:59:02.425096 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-633d3bc3-2196-46ba-9268-f38ec59f289f req-df44d8fa-2f2c-4609-ae07-5f36deff7a78 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/ports?device_id=d87a1395-92e0-4727-a5ed-a8dcdee587c3 HTTP/1.1" status: 200 len: 944 time: 0.1223481 May 25 16:59:02.426477 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:59:02.460214 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-c8e1246c-5dc5-4dfa-8728-21041086abab req-de282f61-6454-409f-bad3-861169aa066e tempest-DeleteServersTestJSON-1172980508 tempest-DeleteServersTestJSON-1172980508-project] 10.222.0.62 "GET /v2.0/security-groups?id=ec198040-29f5-4dbf-8437-e486f3fb935b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0689609 May 25 16:59:02.482918 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-633d3bc3-2196-46ba-9268-f38ec59f289f req-931b4f87-dfb7-4203-82db-53ac4bcb6feb tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/security-groups?id=8ee5c4ed-9c60-4e39-9185-7e283704a7dc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0489945 May 25 16:59:03.171632 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c8589642-8e62-416a-a400-465e86013e8f req-284f4cbb-170a-4511-9e07-90c223c2aaf5 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:59:03.173582 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-c8589642-8e62-416a-a400-465e86013e8f req-284f4cbb-170a-4511-9e07-90c223c2aaf5 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] 10.222.0.62 "GET /v2.0/ports?device_id=bca36110-0b4f-419a-92ef-46cbb9d6215e HTTP/1.1" status: 200 len: 944 time: 0.0815563 May 25 16:59:03.216771 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-c8589642-8e62-416a-a400-465e86013e8f req-fb2a209e-1ff7-46d5-8c54-7717fe50de03 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] 10.222.0.62 "GET /v2.0/security-groups?id=f73b90a2-df48-48fb-99e0-5dd4d6a63a15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0375659 May 25 16:59:03.648941 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e1899f44-da0d-4f32-9eba-e75142f9ba6f req-73d394cc-e92c-4375-beab-c9bfc4548af3 tempest-DeleteServersTestJSON-1172980508 tempest-DeleteServersTestJSON-1172980508-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:59:03.650452 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-e1899f44-da0d-4f32-9eba-e75142f9ba6f req-73d394cc-e92c-4375-beab-c9bfc4548af3 tempest-DeleteServersTestJSON-1172980508 tempest-DeleteServersTestJSON-1172980508-project] 10.222.0.62 "GET /v2.0/ports?device_id=1d5af5b3-8d0b-4cf9-a7f1-ce49a30efc33 HTTP/1.1" status: 200 len: 945 time: 0.0826197 May 25 16:59:03.695098 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-e1899f44-da0d-4f32-9eba-e75142f9ba6f req-bcfacde7-c538-48cd-9f6a-01deb290892e tempest-DeleteServersTestJSON-1172980508 tempest-DeleteServersTestJSON-1172980508-project] 10.222.0.62 "GET /v2.0/security-groups?id=ec198040-29f5-4dbf-8437-e486f3fb935b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0389271 May 25 16:59:03.798588 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4def5052-a745-475b-b3e5-55b2c4e1b540 req-5008f8ab-796e-42bc-84e5-960e4dffb32a tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:59:03.799947 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-4def5052-a745-475b-b3e5-55b2c4e1b540 req-5008f8ab-796e-42bc-84e5-960e4dffb32a tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/ports?device_id=d87a1395-92e0-4727-a5ed-a8dcdee587c3 HTTP/1.1" status: 200 len: 944 time: 0.0818250 May 25 16:59:03.844377 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-4def5052-a745-475b-b3e5-55b2c4e1b540 req-36ecb80f-2201-4fe2-9f43-c8eaf735c591 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/security-groups?id=8ee5c4ed-9c60-4e39-9185-7e283704a7dc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0388961 May 25 16:59:04.399259 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eee6e424-3b09-4ade-96ce-6053ac49ea8c req-846855a1-625f-4eff-8026-e3ed04cdd161 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:59:04.400707 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-eee6e424-3b09-4ade-96ce-6053ac49ea8c req-846855a1-625f-4eff-8026-e3ed04cdd161 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] 10.222.0.62 "GET /v2.0/ports?device_id=bca36110-0b4f-419a-92ef-46cbb9d6215e HTTP/1.1" status: 200 len: 944 time: 0.0781686 May 25 16:59:04.449352 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-eee6e424-3b09-4ade-96ce-6053ac49ea8c req-d8f5cb7f-1a54-47f5-9b11-4ff4937761e7 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] 10.222.0.62 "GET /v2.0/security-groups?id=f73b90a2-df48-48fb-99e0-5dd4d6a63a15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0424252 May 25 16:59:04.876753 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3f90437b-ca5b-440b-972b-22c5c488a20c req-e6cfc854-8e26-485a-a5ad-607d2a0cd1d1 tempest-DeleteServersTestJSON-1172980508 tempest-DeleteServersTestJSON-1172980508-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:59:04.878245 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-3f90437b-ca5b-440b-972b-22c5c488a20c req-e6cfc854-8e26-485a-a5ad-607d2a0cd1d1 tempest-DeleteServersTestJSON-1172980508 tempest-DeleteServersTestJSON-1172980508-project] 10.222.0.62 "GET /v2.0/ports?device_id=1d5af5b3-8d0b-4cf9-a7f1-ce49a30efc33 HTTP/1.1" status: 200 len: 945 time: 0.0779481 May 25 16:59:04.921336 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-3f90437b-ca5b-440b-972b-22c5c488a20c req-ab382ffb-2d1e-446b-a8b9-e1b3b498c911 tempest-DeleteServersTestJSON-1172980508 tempest-DeleteServersTestJSON-1172980508-project] 10.222.0.62 "GET /v2.0/security-groups?id=ec198040-29f5-4dbf-8437-e486f3fb935b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0373845 May 25 16:59:05.052685 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6b1279a7-e584-4b72-b9a2-87c3ee61219b req-76a99815-0cba-4084-be57-b6a923f9c37c tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:59:05.052685 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-6b1279a7-e584-4b72-b9a2-87c3ee61219b req-76a99815-0cba-4084-be57-b6a923f9c37c tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/ports?device_id=d87a1395-92e0-4727-a5ed-a8dcdee587c3 HTTP/1.1" status: 200 len: 944 time: 0.1008780 May 25 16:59:05.095441 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-6b1279a7-e584-4b72-b9a2-87c3ee61219b req-388e8404-f931-40f5-859b-8a5c4f6ff945 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/security-groups?id=8ee5c4ed-9c60-4e39-9185-7e283704a7dc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0420094 May 25 16:59:05.630012 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d20007eb-42f4-4359-b108-d86af89b2d47 req-8e650491-7133-451a-9454-e508dd40a90d tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:59:05.631408 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-d20007eb-42f4-4359-b108-d86af89b2d47 req-8e650491-7133-451a-9454-e508dd40a90d tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] 10.222.0.62 "GET /v2.0/ports?device_id=bca36110-0b4f-419a-92ef-46cbb9d6215e HTTP/1.1" status: 200 len: 944 time: 0.0783091 May 25 16:59:05.675999 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-d20007eb-42f4-4359-b108-d86af89b2d47 req-61810250-305a-4ca4-9325-f46a0c8dcbe4 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] 10.222.0.62 "GET /v2.0/security-groups?id=f73b90a2-df48-48fb-99e0-5dd4d6a63a15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0386071 May 25 16:59:06.109492 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e27cae1e-93bc-43f3-8db2-585ae2d2efe5 req-a52c89dc-766a-47e6-888e-f845b22f7746 tempest-DeleteServersTestJSON-1172980508 tempest-DeleteServersTestJSON-1172980508-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:59:06.111030 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-e27cae1e-93bc-43f3-8db2-585ae2d2efe5 req-a52c89dc-766a-47e6-888e-f845b22f7746 tempest-DeleteServersTestJSON-1172980508 tempest-DeleteServersTestJSON-1172980508-project] 10.222.0.62 "GET /v2.0/ports?device_id=1d5af5b3-8d0b-4cf9-a7f1-ce49a30efc33 HTTP/1.1" status: 200 len: 945 time: 0.0840206 May 25 16:59:06.166537 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-e27cae1e-93bc-43f3-8db2-585ae2d2efe5 req-48ff7719-6e79-4bc8-9ad5-c9b5fd6f9350 tempest-DeleteServersTestJSON-1172980508 tempest-DeleteServersTestJSON-1172980508-project] 10.222.0.62 "GET /v2.0/security-groups?id=ec198040-29f5-4dbf-8437-e486f3fb935b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0482225 May 25 16:59:06.300784 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-22d58547-5c0d-47e6-9692-9a7985f35e29 req-1c9f0ca8-accd-448e-a2e3-af0e82b4de9d tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:59:06.302237 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-22d58547-5c0d-47e6-9692-9a7985f35e29 req-1c9f0ca8-accd-448e-a2e3-af0e82b4de9d tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/ports?device_id=d87a1395-92e0-4727-a5ed-a8dcdee587c3 HTTP/1.1" status: 200 len: 944 time: 0.0816562 May 25 16:59:06.349275 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-22d58547-5c0d-47e6-9692-9a7985f35e29 req-0cc39a59-151c-4b7a-ae49-889f76c66303 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/security-groups?id=8ee5c4ed-9c60-4e39-9185-7e283704a7dc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0413787 May 25 16:59:06.427789 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.db [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] get_ports_and_sgs() called for port_ids ['250e0a7c-f7d1-4092-af1f-d50d5b92f68a'] {{(pid=91831) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 25 16:59:06.453155 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.db [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] get_ports_and_sgs() called for port_ids ['60078444-24b6-4560-b0a7-7802c4f8f2f8'] {{(pid=91831) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 25 16:59:06.926569 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8eef7f96-e6b8-41fb-86a9-b45ce7951274 req-67f131ee-565c-4126-a8eb-d494a8bd618b tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:59:06.928006 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-8eef7f96-e6b8-41fb-86a9-b45ce7951274 req-67f131ee-565c-4126-a8eb-d494a8bd618b tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] 10.222.0.62 "GET /v2.0/ports?device_id=bca36110-0b4f-419a-92ef-46cbb9d6215e HTTP/1.1" status: 200 len: 944 time: 0.1319816 May 25 16:59:06.982582 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-8eef7f96-e6b8-41fb-86a9-b45ce7951274 req-c93915ad-3737-49d3-88bb-dc5d90765a11 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] 10.222.0.62 "GET /v2.0/security-groups?id=f73b90a2-df48-48fb-99e0-5dd4d6a63a15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0421038 May 25 16:59:07.365174 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aafcd349-3558-4e2a-ad02-de3d56c81b29 req-0d5935f1-7455-4ac4-9f5f-6c9dea412e22 tempest-DeleteServersTestJSON-1172980508 tempest-DeleteServersTestJSON-1172980508-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:59:07.366641 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-aafcd349-3558-4e2a-ad02-de3d56c81b29 req-0d5935f1-7455-4ac4-9f5f-6c9dea412e22 tempest-DeleteServersTestJSON-1172980508 tempest-DeleteServersTestJSON-1172980508-project] 10.222.0.62 "GET /v2.0/ports?device_id=1d5af5b3-8d0b-4cf9-a7f1-ce49a30efc33 HTTP/1.1" status: 200 len: 945 time: 0.0896847 May 25 16:59:07.412177 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-aafcd349-3558-4e2a-ad02-de3d56c81b29 req-e0b0ca36-860c-4041-910f-aec61ed4468e tempest-DeleteServersTestJSON-1172980508 tempest-DeleteServersTestJSON-1172980508-project] 10.222.0.62 "GET /v2.0/security-groups?id=ec198040-29f5-4dbf-8437-e486f3fb935b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0397043 May 25 16:59:07.529630 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8d525dc5-576e-41a8-bb55-e8e5c052767e req-80576a1b-e24d-4f52-aac6-6798ee9985fb tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:59:07.531051 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-8d525dc5-576e-41a8-bb55-e8e5c052767e req-80576a1b-e24d-4f52-aac6-6798ee9985fb tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/ports?device_id=d87a1395-92e0-4727-a5ed-a8dcdee587c3 HTTP/1.1" status: 200 len: 944 time: 0.0772746 May 25 16:59:07.577002 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-8d525dc5-576e-41a8-bb55-e8e5c052767e req-d78e4c9e-0680-454d-835b-edb9d0f5782f tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/security-groups?id=8ee5c4ed-9c60-4e39-9185-7e283704a7dc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0401921 May 25 16:59:08.170377 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-13b78a5b-77f2-46e7-b086-e007e8bdc2fc req-cd21dd0f-a0d2-4197-8f84-f0bb9c6dacfd tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:59:08.171783 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-13b78a5b-77f2-46e7-b086-e007e8bdc2fc req-cd21dd0f-a0d2-4197-8f84-f0bb9c6dacfd tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] 10.222.0.62 "GET /v2.0/ports?device_id=bca36110-0b4f-419a-92ef-46cbb9d6215e HTTP/1.1" status: 200 len: 944 time: 0.0810282 May 25 16:59:08.215192 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-13b78a5b-77f2-46e7-b086-e007e8bdc2fc req-34fd6ded-8b70-40f6-b23b-37c66c65af33 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] 10.222.0.62 "GET /v2.0/security-groups?id=f73b90a2-df48-48fb-99e0-5dd4d6a63a15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0377116 May 25 16:59:08.599125 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-960a7831-897a-4534-b13b-e619303c9a52 req-c5fe80b5-d47e-4e6e-a6fc-960000410334 tempest-DeleteServersTestJSON-1172980508 tempest-DeleteServersTestJSON-1172980508-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:59:08.600598 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-960a7831-897a-4534-b13b-e619303c9a52 req-c5fe80b5-d47e-4e6e-a6fc-960000410334 tempest-DeleteServersTestJSON-1172980508 tempest-DeleteServersTestJSON-1172980508-project] 10.222.0.62 "GET /v2.0/ports?device_id=1d5af5b3-8d0b-4cf9-a7f1-ce49a30efc33 HTTP/1.1" status: 200 len: 945 time: 0.0813625 May 25 16:59:08.645356 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-960a7831-897a-4534-b13b-e619303c9a52 req-efb9882f-84fa-4957-a9c7-ddef74eec0ae tempest-DeleteServersTestJSON-1172980508 tempest-DeleteServersTestJSON-1172980508-project] 10.222.0.62 "GET /v2.0/security-groups?id=ec198040-29f5-4dbf-8437-e486f3fb935b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0387955 May 25 16:59:08.759998 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b7c4e0c0-2f70-47bf-bd36-16b1d666c349 req-95cf8cfc-3cfe-4e8e-b5ed-dc85c65310e2 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:59:08.761509 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-b7c4e0c0-2f70-47bf-bd36-16b1d666c349 req-95cf8cfc-3cfe-4e8e-b5ed-dc85c65310e2 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/ports?device_id=d87a1395-92e0-4727-a5ed-a8dcdee587c3 HTTP/1.1" status: 200 len: 944 time: 0.0807548 May 25 16:59:08.808579 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-b7c4e0c0-2f70-47bf-bd36-16b1d666c349 req-c2ab526f-f49a-4535-9d0a-c05e5f1063a8 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/security-groups?id=8ee5c4ed-9c60-4e39-9185-7e283704a7dc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0413821 May 25 16:59:09.402942 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d7459a1a-2ea7-49ed-8129-5c1f61d1da3e req-eb35fdba-e9b6-4a2d-acfe-8483d83b269c tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:59:09.404355 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-d7459a1a-2ea7-49ed-8129-5c1f61d1da3e req-eb35fdba-e9b6-4a2d-acfe-8483d83b269c tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] 10.222.0.62 "GET /v2.0/ports?device_id=bca36110-0b4f-419a-92ef-46cbb9d6215e HTTP/1.1" status: 200 len: 944 time: 0.0812087 May 25 16:59:09.448413 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-d7459a1a-2ea7-49ed-8129-5c1f61d1da3e req-00b57416-c650-4577-918f-52c0374a102a tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] 10.222.0.62 "GET /v2.0/security-groups?id=f73b90a2-df48-48fb-99e0-5dd4d6a63a15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0377159 May 25 16:59:09.804580 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.rpc [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Device c4b9c0f2-e3d5-4fff-9b3c-a9175b027fb5 up at agent hyperv_hv-cinder-79049 {{(pid=91831) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 25 16:59:09.835349 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ec5c4f12-c57f-495c-b34a-1a12435aab44 req-7e6a6f13-39e9-429f-972f-c1d3919903ad tempest-DeleteServersTestJSON-1172980508 tempest-DeleteServersTestJSON-1172980508-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:59:09.837279 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-ec5c4f12-c57f-495c-b34a-1a12435aab44 req-7e6a6f13-39e9-429f-972f-c1d3919903ad tempest-DeleteServersTestJSON-1172980508 tempest-DeleteServersTestJSON-1172980508-project] 10.222.0.62 "GET /v2.0/ports?device_id=1d5af5b3-8d0b-4cf9-a7f1-ce49a30efc33 HTTP/1.1" status: 200 len: 945 time: 0.0886650 May 25 16:59:09.882320 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.provisioning_blocks [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Provisioning for port c4b9c0f2-e3d5-4fff-9b3c-a9175b027fb5 completed by entity L2. {{(pid=91831) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 25 16:59:09.887442 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.provisioning_blocks [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Provisioning complete for port c4b9c0f2-e3d5-4fff-9b3c-a9175b027fb5 triggered by entity L2. {{(pid=91831) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 16:59:09.887687 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3854128'] for port, provisioning_complete {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:59:09.890432 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-ec5c4f12-c57f-495c-b34a-1a12435aab44 req-762790e6-be5f-4f87-8337-d74f1ff274c0 tempest-DeleteServersTestJSON-1172980508 tempest-DeleteServersTestJSON-1172980508-project] 10.222.0.62 "GET /v2.0/security-groups?id=ec198040-29f5-4dbf-8437-e486f3fb935b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0470054 May 25 16:59:10.003451 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-28048e38-01ed-4787-bab0-639f3fdf6197 req-89e7839b-94dd-4a99-8cac-e088f013ae92 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:59:10.004886 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-28048e38-01ed-4787-bab0-639f3fdf6197 req-89e7839b-94dd-4a99-8cac-e088f013ae92 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/ports?device_id=d87a1395-92e0-4727-a5ed-a8dcdee587c3 HTTP/1.1" status: 200 len: 944 time: 0.0824950 May 25 16:59:10.006645 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3832070'] for port, before_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:59:10.034167 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'bca36110-0b4f-419a-92ef-46cbb9d6215e', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'c4b9c0f2-e3d5-4fff-9b3c-a9175b027fb5'}] {{(pid=91831) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 25 16:59:10.044535 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.db [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] For port c4b9c0f2-e3d5-4fff-9b3c-a9175b027fb5, host hv-cinder-79049, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79049',level=0,port_id=c4b9c0f2-e3d5-4fff-9b3c-a9175b027fb5,segment=NetworkSegment(7d7273c2-c6dd-43fe-83a8-cb776d48dc70),segment_id=7d7273c2-c6dd-43fe-83a8-cb776d48dc70)] {{(pid=91831) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 16:59:10.048572 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8757892955028', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8757892520933', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8757892521750'] for port, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:59:10.049032 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-28048e38-01ed-4787-bab0-639f3fdf6197 req-ee0aa96c-6b2e-4dea-9a32-66dd6e18cbfe tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/security-groups?id=8ee5c4ed-9c60-4e39-9185-7e283704a7dc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0382476 May 25 16:59:10.051466 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:59:10.089848 dv-cinder-790492-4-iscsi neutron-server[91831]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'bca36110-0b4f-419a-92ef-46cbb9d6215e', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'c4b9c0f2-e3d5-4fff-9b3c-a9175b027fb5', 'code': 200} May 25 16:59:10.121360 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Pushing event updated for resources: {'Port': ['ID=c4b9c0f2-e3d5-4fff-9b3c-a9175b027fb5,revision_number=5']} {{(pid=91831) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:59:10.124308 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.073s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:59:10.628306 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1178c094-320f-418a-99ff-130f6f4de326 req-6d08d8ce-0995-4170-b1c7-9ba3d326f6c3 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:59:10.629715 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-1178c094-320f-418a-99ff-130f6f4de326 req-6d08d8ce-0995-4170-b1c7-9ba3d326f6c3 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] 10.222.0.62 "GET /v2.0/ports?device_id=bca36110-0b4f-419a-92ef-46cbb9d6215e HTTP/1.1" status: 200 len: 945 time: 0.0788391 May 25 16:59:10.676774 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-1178c094-320f-418a-99ff-130f6f4de326 req-b86664e0-60ea-48bd-a6e3-e755ab6ba2b7 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] 10.222.0.62 "GET /v2.0/security-groups?id=f73b90a2-df48-48fb-99e0-5dd4d6a63a15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0414629 May 25 16:59:11.072986 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-873e974d-6620-4311-a78a-a0ff6809eedf req-e0f1f33e-697a-47fb-a537-e23b952c5163 tempest-DeleteServersTestJSON-1172980508 tempest-DeleteServersTestJSON-1172980508-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:59:11.074444 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-873e974d-6620-4311-a78a-a0ff6809eedf req-e0f1f33e-697a-47fb-a537-e23b952c5163 tempest-DeleteServersTestJSON-1172980508 tempest-DeleteServersTestJSON-1172980508-project] 10.222.0.62 "GET /v2.0/ports?device_id=1d5af5b3-8d0b-4cf9-a7f1-ce49a30efc33 HTTP/1.1" status: 200 len: 945 time: 0.0799603 May 25 16:59:11.119451 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-873e974d-6620-4311-a78a-a0ff6809eedf req-757eacab-8c7f-4e2e-92b4-3239c1eb6e74 tempest-DeleteServersTestJSON-1172980508 tempest-DeleteServersTestJSON-1172980508-project] 10.222.0.62 "GET /v2.0/security-groups?id=ec198040-29f5-4dbf-8437-e486f3fb935b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0393231 May 25 16:59:11.376238 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6856115a-dc71-44d5-9c47-c34dd26c6e58 req-15e1dd85-3ac8-4239-be95-a16fd6159b1b tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:59:11.378282 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-6856115a-dc71-44d5-9c47-c34dd26c6e58 req-15e1dd85-3ac8-4239-be95-a16fd6159b1b tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/ports?device_id=d87a1395-92e0-4727-a5ed-a8dcdee587c3 HTTP/1.1" status: 200 len: 944 time: 0.0829513 May 25 16:59:11.421469 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-6856115a-dc71-44d5-9c47-c34dd26c6e58 req-d0d41c1c-2aa2-4075-a5fa-c5d1199ae3e9 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/security-groups?id=8ee5c4ed-9c60-4e39-9185-7e283704a7dc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0373504 May 25 16:59:11.597653 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-00b0362f-fe38-474a-81e7-3501a44b3aa7 req-a47a2aa4-2692-4fac-b62b-882fd046dfe2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:59:11.599111 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-00b0362f-fe38-474a-81e7-3501a44b3aa7 req-a47a2aa4-2692-4fac-b62b-882fd046dfe2 service neutron] 10.222.0.32 "GET /v2.0/ports?device_id=bca36110-0b4f-419a-92ef-46cbb9d6215e HTTP/1.1" status: 200 len: 1098 time: 0.0689080 May 25 16:59:11.639853 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-00b0362f-fe38-474a-81e7-3501a44b3aa7 req-180c440a-7de5-4c0e-8dde-f92ebe0baaa9 service neutron] 10.222.0.32 "GET /v2.0/security-groups?id=f73b90a2-df48-48fb-99e0-5dd4d6a63a15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0321450 May 25 16:59:11.861201 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1e09f788-01c6-4521-a675-14bf45e71bb0 req-fbf24d24-22cb-46c9-bf15-49f6a0ae4586 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:59:11.862716 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-1e09f788-01c6-4521-a675-14bf45e71bb0 req-fbf24d24-22cb-46c9-bf15-49f6a0ae4586 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] 10.222.0.62 "GET /v2.0/ports?device_id=bca36110-0b4f-419a-92ef-46cbb9d6215e HTTP/1.1" status: 200 len: 945 time: 0.0842192 May 25 16:59:11.907548 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-1e09f788-01c6-4521-a675-14bf45e71bb0 req-e2eb43c3-a5a7-4458-855c-67f0091548d0 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] 10.222.0.62 "GET /v2.0/security-groups?id=f73b90a2-df48-48fb-99e0-5dd4d6a63a15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0391800 May 25 16:59:12.298679 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-38e721df-44c0-49de-9cd9-e95a5ac4d1ed req-cae59ba2-c1a6-41d5-b171-a7c6c77834ee tempest-DeleteServersTestJSON-1172980508 tempest-DeleteServersTestJSON-1172980508-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:59:12.300658 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-38e721df-44c0-49de-9cd9-e95a5ac4d1ed req-cae59ba2-c1a6-41d5-b171-a7c6c77834ee tempest-DeleteServersTestJSON-1172980508 tempest-DeleteServersTestJSON-1172980508-project] 10.222.0.62 "GET /v2.0/ports?device_id=1d5af5b3-8d0b-4cf9-a7f1-ce49a30efc33 HTTP/1.1" status: 200 len: 945 time: 0.0768933 May 25 16:59:12.347073 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-38e721df-44c0-49de-9cd9-e95a5ac4d1ed req-44ce6347-80f5-4547-9b73-390c7e2369ae tempest-DeleteServersTestJSON-1172980508 tempest-DeleteServersTestJSON-1172980508-project] 10.222.0.62 "GET /v2.0/security-groups?id=ec198040-29f5-4dbf-8437-e486f3fb935b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0405977 May 25 16:59:12.612193 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0a910f7e-368b-454f-997f-134dbeaf5363 req-ce10fb36-febb-4866-bbe2-e8efbd5e4f7e tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:59:12.613640 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-0a910f7e-368b-454f-997f-134dbeaf5363 req-ce10fb36-febb-4866-bbe2-e8efbd5e4f7e tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/ports?device_id=d87a1395-92e0-4727-a5ed-a8dcdee587c3 HTTP/1.1" status: 200 len: 944 time: 0.0800335 May 25 16:59:12.658970 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-0a910f7e-368b-454f-997f-134dbeaf5363 req-288fa092-b3f4-48d1-aa1f-6403884eb906 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/security-groups?id=8ee5c4ed-9c60-4e39-9185-7e283704a7dc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0391607 May 25 16:59:13.092406 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aa60303a-2bdb-40a2-a5d3-a7a94f603f8b req-79fa870b-f26f-49bd-874a-8f47c94b0f4d tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:59:13.093845 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-aa60303a-2bdb-40a2-a5d3-a7a94f603f8b req-79fa870b-f26f-49bd-874a-8f47c94b0f4d tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] 10.222.0.62 "GET /v2.0/ports?device_id=bca36110-0b4f-419a-92ef-46cbb9d6215e HTTP/1.1" status: 200 len: 945 time: 0.0824733 May 25 16:59:13.138216 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-aa60303a-2bdb-40a2-a5d3-a7a94f603f8b req-0fc5bd2a-ac65-4be8-92cf-de11ae0d0f54 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] 10.222.0.62 "GET /v2.0/security-groups?id=f73b90a2-df48-48fb-99e0-5dd4d6a63a15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0381999 May 25 16:59:13.528655 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a7e84f01-733d-44dd-a921-558338a7cb91 req-de25347c-4bae-46a9-8213-ea99c50e9766 tempest-DeleteServersTestJSON-1172980508 tempest-DeleteServersTestJSON-1172980508-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:59:13.530101 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-a7e84f01-733d-44dd-a921-558338a7cb91 req-de25347c-4bae-46a9-8213-ea99c50e9766 tempest-DeleteServersTestJSON-1172980508 tempest-DeleteServersTestJSON-1172980508-project] 10.222.0.62 "GET /v2.0/ports?device_id=1d5af5b3-8d0b-4cf9-a7f1-ce49a30efc33 HTTP/1.1" status: 200 len: 945 time: 0.0779436 May 25 16:59:13.574318 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-a7e84f01-733d-44dd-a921-558338a7cb91 req-3e8ccaf5-7696-4f80-95a9-ad930d094bc0 tempest-DeleteServersTestJSON-1172980508 tempest-DeleteServersTestJSON-1172980508-project] 10.222.0.62 "GET /v2.0/security-groups?id=ec198040-29f5-4dbf-8437-e486f3fb935b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0386357 May 25 16:59:13.890804 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a3b12c6d-fe8e-4bcd-b272-619979b209d2 req-7b36fae4-90e3-45ec-845d-41a2576a35e6 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:59:13.892221 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-a3b12c6d-fe8e-4bcd-b272-619979b209d2 req-7b36fae4-90e3-45ec-845d-41a2576a35e6 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/ports?device_id=d87a1395-92e0-4727-a5ed-a8dcdee587c3 HTTP/1.1" status: 200 len: 944 time: 0.1274328 May 25 16:59:13.936533 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-a3b12c6d-fe8e-4bcd-b272-619979b209d2 req-9db7e36d-8f87-405f-b6db-f30cd9f28ba9 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/security-groups?id=8ee5c4ed-9c60-4e39-9185-7e283704a7dc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0385981 May 25 16:59:14.320760 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3eeb5ad9-67bc-461d-890e-2d234f241f7d req-4d2e6cac-d457-4aa9-8112-c8a6585a5e8e tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:59:14.322207 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-3eeb5ad9-67bc-461d-890e-2d234f241f7d req-4d2e6cac-d457-4aa9-8112-c8a6585a5e8e tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] 10.222.0.62 "GET /v2.0/ports?device_id=bca36110-0b4f-419a-92ef-46cbb9d6215e HTTP/1.1" status: 200 len: 945 time: 0.0789733 May 25 16:59:14.369433 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-3eeb5ad9-67bc-461d-890e-2d234f241f7d req-6d04f876-e7ea-4a6a-acb8-d30ce5db04d0 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] 10.222.0.62 "GET /v2.0/security-groups?id=f73b90a2-df48-48fb-99e0-5dd4d6a63a15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0411847 May 25 16:59:14.753936 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-81299a47-bcff-4543-95bf-c986e9b3c83e req-1e7a773b-c463-40f5-9cbd-b08f10608e11 tempest-DeleteServersTestJSON-1172980508 tempest-DeleteServersTestJSON-1172980508-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:59:14.755515 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-81299a47-bcff-4543-95bf-c986e9b3c83e req-1e7a773b-c463-40f5-9cbd-b08f10608e11 tempest-DeleteServersTestJSON-1172980508 tempest-DeleteServersTestJSON-1172980508-project] 10.222.0.62 "GET /v2.0/ports?device_id=1d5af5b3-8d0b-4cf9-a7f1-ce49a30efc33 HTTP/1.1" status: 200 len: 945 time: 0.0800011 May 25 16:59:14.800650 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-81299a47-bcff-4543-95bf-c986e9b3c83e req-b9ee5818-f1d6-4241-9d83-1309a59b6a95 tempest-DeleteServersTestJSON-1172980508 tempest-DeleteServersTestJSON-1172980508-project] 10.222.0.62 "GET /v2.0/security-groups?id=ec198040-29f5-4dbf-8437-e486f3fb935b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0395417 May 25 16:59:15.123077 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9d57fe91-c30a-4639-8bed-99a69d431aeb req-4d7db1f7-1b85-44d5-850a-af5f920e1f23 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:59:15.124819 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-9d57fe91-c30a-4639-8bed-99a69d431aeb req-4d7db1f7-1b85-44d5-850a-af5f920e1f23 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/ports?device_id=d87a1395-92e0-4727-a5ed-a8dcdee587c3 HTTP/1.1" status: 200 len: 944 time: 0.0846205 May 25 16:59:15.170448 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-9d57fe91-c30a-4639-8bed-99a69d431aeb req-8f831f5e-3a99-43d3-b14d-8d8020dfbde7 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/security-groups?id=8ee5c4ed-9c60-4e39-9185-7e283704a7dc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0395865 May 25 16:59:15.547546 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5570783c-875e-4bb3-b58e-011159767927 req-6a0e9db6-3e27-4e93-864b-10fd55246fd2 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:59:15.549404 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-5570783c-875e-4bb3-b58e-011159767927 req-6a0e9db6-3e27-4e93-864b-10fd55246fd2 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] 10.222.0.62 "GET /v2.0/ports?device_id=bca36110-0b4f-419a-92ef-46cbb9d6215e HTTP/1.1" status: 200 len: 945 time: 0.0779469 May 25 16:59:15.592497 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-5570783c-875e-4bb3-b58e-011159767927 req-10432e90-1a67-4f9d-8611-9fed0681c1a0 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] 10.222.0.62 "GET /v2.0/security-groups?id=f73b90a2-df48-48fb-99e0-5dd4d6a63a15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0371048 May 25 16:59:15.986951 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a18d02c6-23d5-40a5-9fd8-9a1e66586288 req-8c154373-9a3c-486d-8211-e3751c9dcfed tempest-DeleteServersTestJSON-1172980508 tempest-DeleteServersTestJSON-1172980508-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:59:15.988394 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-a18d02c6-23d5-40a5-9fd8-9a1e66586288 req-8c154373-9a3c-486d-8211-e3751c9dcfed tempest-DeleteServersTestJSON-1172980508 tempest-DeleteServersTestJSON-1172980508-project] 10.222.0.62 "GET /v2.0/ports?device_id=1d5af5b3-8d0b-4cf9-a7f1-ce49a30efc33 HTTP/1.1" status: 200 len: 945 time: 0.0827606 May 25 16:59:16.031497 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-a18d02c6-23d5-40a5-9fd8-9a1e66586288 req-cd33fd0e-2f6b-4611-86cc-1f87c5d055ab tempest-DeleteServersTestJSON-1172980508 tempest-DeleteServersTestJSON-1172980508-project] 10.222.0.62 "GET /v2.0/security-groups?id=ec198040-29f5-4dbf-8437-e486f3fb935b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0375216 May 25 16:59:16.359561 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bccbfefe-7330-4489-8690-2be795422b2b req-00423bce-1446-471d-b6e6-491b48547aa8 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:59:16.361017 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-bccbfefe-7330-4489-8690-2be795422b2b req-00423bce-1446-471d-b6e6-491b48547aa8 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/ports?device_id=d87a1395-92e0-4727-a5ed-a8dcdee587c3 HTTP/1.1" status: 200 len: 944 time: 0.0855737 May 25 16:59:16.406220 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-bccbfefe-7330-4489-8690-2be795422b2b req-5b721fb5-9610-4e47-b3da-13f74bf21a66 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/security-groups?id=8ee5c4ed-9c60-4e39-9185-7e283704a7dc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0385644 May 25 16:59:16.776947 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6fd17b4b-9ecd-4bbf-8572-80e3125b2b0e req-0c46d7eb-4403-4baf-9bf7-111b68758567 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:59:16.778391 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-6fd17b4b-9ecd-4bbf-8572-80e3125b2b0e req-0c46d7eb-4403-4baf-9bf7-111b68758567 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] 10.222.0.62 "GET /v2.0/ports?device_id=bca36110-0b4f-419a-92ef-46cbb9d6215e HTTP/1.1" status: 200 len: 945 time: 0.0826101 May 25 16:59:16.823503 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-6fd17b4b-9ecd-4bbf-8572-80e3125b2b0e req-a015288d-6b23-4e52-bb39-03af86238beb tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] 10.222.0.62 "GET /v2.0/security-groups?id=f73b90a2-df48-48fb-99e0-5dd4d6a63a15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0392129 May 25 16:59:17.215658 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-074482d6-1581-441e-adab-6c147d4952d7 req-fc1b1afa-4f8c-440c-a092-d9b6d942b134 tempest-DeleteServersTestJSON-1172980508 tempest-DeleteServersTestJSON-1172980508-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:59:17.217055 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-074482d6-1581-441e-adab-6c147d4952d7 req-fc1b1afa-4f8c-440c-a092-d9b6d942b134 tempest-DeleteServersTestJSON-1172980508 tempest-DeleteServersTestJSON-1172980508-project] 10.222.0.62 "GET /v2.0/ports?device_id=1d5af5b3-8d0b-4cf9-a7f1-ce49a30efc33 HTTP/1.1" status: 200 len: 945 time: 0.0812805 May 25 16:59:17.265355 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-074482d6-1581-441e-adab-6c147d4952d7 req-2bbb77a7-b5fe-4ba3-b4d2-02a88d33a8f8 tempest-DeleteServersTestJSON-1172980508 tempest-DeleteServersTestJSON-1172980508-project] 10.222.0.62 "GET /v2.0/security-groups?id=ec198040-29f5-4dbf-8437-e486f3fb935b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0419791 May 25 16:59:17.540818 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.rpc [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Device 60078444-24b6-4560-b0a7-7802c4f8f2f8 up at agent hyperv_hv-cinder-79049 {{(pid=91831) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 25 16:59:17.590401 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-706605c3-f93d-47be-8635-ca5f05278e15 req-5b85ab37-4a67-47b6-bd1e-90295e0139bc tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:59:17.591835 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-706605c3-f93d-47be-8635-ca5f05278e15 req-5b85ab37-4a67-47b6-bd1e-90295e0139bc tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/ports?device_id=d87a1395-92e0-4727-a5ed-a8dcdee587c3 HTTP/1.1" status: 200 len: 944 time: 0.0801651 May 25 16:59:17.609114 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.provisioning_blocks [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Provisioning for port 60078444-24b6-4560-b0a7-7802c4f8f2f8 completed by entity L2. {{(pid=91831) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 25 16:59:17.615396 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.provisioning_blocks [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Provisioning complete for port 60078444-24b6-4560-b0a7-7802c4f8f2f8 triggered by entity L2. {{(pid=91831) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 16:59:17.615780 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3854128'] for port, provisioning_complete {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:59:17.636056 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-706605c3-f93d-47be-8635-ca5f05278e15 req-cbe5e5a6-6f8b-4c40-b51b-479b042207f5 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/security-groups?id=8ee5c4ed-9c60-4e39-9185-7e283704a7dc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0384963 May 25 16:59:17.739191 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3832070'] for port, before_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:59:17.770839 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '58da9205-0212-4daa-996c-1eef64a2b702', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '60078444-24b6-4560-b0a7-7802c4f8f2f8'}] {{(pid=91831) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 25 16:59:17.780658 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.db [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] For port 60078444-24b6-4560-b0a7-7802c4f8f2f8, host hv-cinder-79049, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79049',level=0,port_id=60078444-24b6-4560-b0a7-7802c4f8f2f8,segment=NetworkSegment(f672477b-47fb-432c-acc9-dc57201d80de),segment_id=f672477b-47fb-432c-acc9-dc57201d80de)] {{(pid=91831) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 16:59:17.786189 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8757892955028', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8757892520933', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8757892521750'] for port, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:59:17.786562 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.rpc [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Device 250e0a7c-f7d1-4092-af1f-d50d5b92f68a up at agent hyperv_hv-cinder-79049 {{(pid=91831) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 25 16:59:17.816828 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:59:17.854149 dv-cinder-790492-4-iscsi neutron-server[91831]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '58da9205-0212-4daa-996c-1eef64a2b702', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '60078444-24b6-4560-b0a7-7802c4f8f2f8', 'code': 200} May 25 16:59:17.911154 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Pushing event updated for resources: {'Port': ['ID=60078444-24b6-4560-b0a7-7802c4f8f2f8,revision_number=5']} {{(pid=91831) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:59:17.922303 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91831) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:59:17.922644 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91831) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:59:17.922978 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91831) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:59:17.923311 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91831) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:59:17.924168 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91831) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:59:17.924493 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91831) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:59:17.924813 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91831) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:59:17.925131 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91831) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:59:17.925463 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91831) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:59:17.925785 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91831) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:59:17.926134 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91831) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:59:17.926450 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91831) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:59:17.931078 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.114s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:59:17.936841 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.provisioning_blocks [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Provisioning for port 250e0a7c-f7d1-4092-af1f-d50d5b92f68a completed by entity L2. {{(pid=91831) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 25 16:59:17.947350 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.provisioning_blocks [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Provisioning complete for port 250e0a7c-f7d1-4092-af1f-d50d5b92f68a triggered by entity L2. {{(pid=91831) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 16:59:17.947741 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3854128'] for port, provisioning_complete {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:59:18.030522 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-77f8b613-8246-4a32-b7ab-813fdb52c5b4 req-6918e69d-ce67-4bfa-98a2-b510139c2ec1 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:59:18.031991 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-77f8b613-8246-4a32-b7ab-813fdb52c5b4 req-6918e69d-ce67-4bfa-98a2-b510139c2ec1 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] 10.222.0.62 "GET /v2.0/ports?device_id=bca36110-0b4f-419a-92ef-46cbb9d6215e HTTP/1.1" status: 200 len: 945 time: 0.0888817 May 25 16:59:18.075900 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3832070'] for port, before_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:59:18.108969 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.db [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] For port 250e0a7c-f7d1-4092-af1f-d50d5b92f68a, host hv-cinder-79049, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79049',level=0,port_id=250e0a7c-f7d1-4092-af1f-d50d5b92f68a,segment=NetworkSegment(f672477b-47fb-432c-acc9-dc57201d80de),segment_id=f672477b-47fb-432c-acc9-dc57201d80de)] {{(pid=91831) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 16:59:18.112705 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8757892955028', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8757892520933', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8757892521750'] for port, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:59:18.114431 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:59:18.129579 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-77f8b613-8246-4a32-b7ab-813fdb52c5b4 req-ecdcca34-9a67-4522-9d76-b79af8c07f18 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] 10.222.0.62 "GET /v2.0/security-groups?id=f73b90a2-df48-48fb-99e0-5dd4d6a63a15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0919886 May 25 16:59:18.145365 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-793bee12-e6fa-4204-9fdc-8b234decfaca req-ebe1cda2-f8fb-4414-84d1-1c0e982fc14b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:59:18.147570 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-793bee12-e6fa-4204-9fdc-8b234decfaca req-ebe1cda2-f8fb-4414-84d1-1c0e982fc14b service neutron] 10.222.0.32 "GET /v2.0/ports?device_id=58da9205-0212-4daa-996c-1eef64a2b702 HTTP/1.1" status: 200 len: 1098 time: 0.0958412 May 25 16:59:18.179379 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Pushing event updated for resources: {'Port': ['ID=250e0a7c-f7d1-4092-af1f-d50d5b92f68a,revision_number=5']} {{(pid=91831) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:59:18.182688 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.068s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:59:18.194397 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-793bee12-e6fa-4204-9fdc-8b234decfaca req-16e27bff-7754-4e40-871b-c8496089a17c service neutron] 10.222.0.32 "GET /v2.0/security-groups?id=8ee5c4ed-9c60-4e39-9185-7e283704a7dc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0389900 May 25 16:59:18.451702 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b67bef0f-6e9c-4ab1-a7ab-f0c6bcf8a214 req-b4753f31-0c90-4565-a8ce-88ca86be7928 tempest-DeleteServersTestJSON-1172980508 tempest-DeleteServersTestJSON-1172980508-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:59:18.453225 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-b67bef0f-6e9c-4ab1-a7ab-f0c6bcf8a214 req-b4753f31-0c90-4565-a8ce-88ca86be7928 tempest-DeleteServersTestJSON-1172980508 tempest-DeleteServersTestJSON-1172980508-project] 10.222.0.62 "GET /v2.0/ports?device_id=1d5af5b3-8d0b-4cf9-a7f1-ce49a30efc33 HTTP/1.1" status: 200 len: 945 time: 0.0808265 May 25 16:59:18.498176 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-b67bef0f-6e9c-4ab1-a7ab-f0c6bcf8a214 req-e657397e-c098-4074-80bc-d4855b9db7b0 tempest-DeleteServersTestJSON-1172980508 tempest-DeleteServersTestJSON-1172980508-project] 10.222.0.62 "GET /v2.0/security-groups?id=ec198040-29f5-4dbf-8437-e486f3fb935b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0383661 May 25 16:59:18.833183 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b60bc299-f8a4-4476-87b2-441f09c9a8e5 req-5f6c3d16-7fe7-4154-9825-867030936f83 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:59:18.835551 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-b60bc299-f8a4-4476-87b2-441f09c9a8e5 req-5f6c3d16-7fe7-4154-9825-867030936f83 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/ports?device_id=d87a1395-92e0-4727-a5ed-a8dcdee587c3 HTTP/1.1" status: 200 len: 945 time: 0.0949469 May 25 16:59:18.885528 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-b60bc299-f8a4-4476-87b2-441f09c9a8e5 req-60976325-b9a8-4e32-b831-8997c4af95d7 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/security-groups?id=8ee5c4ed-9c60-4e39-9185-7e283704a7dc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0439372 May 25 16:59:19.317823 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3c96df8c-cb4b-47ee-a865-cf57a4851059 req-9cc8aa17-b2b3-491b-8958-22b395d7ceb4 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:59:19.319198 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-3c96df8c-cb4b-47ee-a865-cf57a4851059 req-9cc8aa17-b2b3-491b-8958-22b395d7ceb4 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] 10.222.0.62 "GET /v2.0/ports?device_id=bca36110-0b4f-419a-92ef-46cbb9d6215e HTTP/1.1" status: 200 len: 945 time: 0.0793147 May 25 16:59:19.364477 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-3c96df8c-cb4b-47ee-a865-cf57a4851059 req-5a7c3591-e9d8-4f6e-afea-7baa7beb304e tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] 10.222.0.62 "GET /v2.0/security-groups?id=f73b90a2-df48-48fb-99e0-5dd4d6a63a15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0391161 May 25 16:59:19.855547 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'd87a1395-92e0-4727-a5ed-a8dcdee587c3', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '250e0a7c-f7d1-4092-af1f-d50d5b92f68a'}] {{(pid=91831) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 25 16:59:19.898840 dv-cinder-790492-4-iscsi neutron-server[91831]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'd87a1395-92e0-4727-a5ed-a8dcdee587c3', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '250e0a7c-f7d1-4092-af1f-d50d5b92f68a', 'code': 200} May 25 16:59:20.097269 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-01894df2-28de-4da4-a84d-848ee2228a21 req-7eeaeb6c-c411-4133-94b3-b97a54adc737 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:59:20.099454 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-01894df2-28de-4da4-a84d-848ee2228a21 req-7eeaeb6c-c411-4133-94b3-b97a54adc737 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/ports?device_id=d87a1395-92e0-4727-a5ed-a8dcdee587c3 HTTP/1.1" status: 200 len: 945 time: 0.0990644 May 25 16:59:20.164286 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-01894df2-28de-4da4-a84d-848ee2228a21 req-dd08109e-120c-4e6c-b666-3740b2dd1efa tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/security-groups?id=8ee5c4ed-9c60-4e39-9185-7e283704a7dc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0581415 May 25 16:59:20.212483 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.wsgi [-] (91829) accepted ('10.222.0.62', 56728) {{(pid=91829) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:59:20.371167 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-b90c454d-42a0-4e23-9549-5fa855794a97 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:59:20.392895 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-076b9c60-04c3-4adc-9a6f-4b53c3a40b50 req-f3997ce9-85a9-4310-b316-e9a3aa93d4ae service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:59:20.394976 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-076b9c60-04c3-4adc-9a6f-4b53c3a40b50 req-f3997ce9-85a9-4310-b316-e9a3aa93d4ae service neutron] 10.222.0.32 "GET /v2.0/ports?device_id=d87a1395-92e0-4727-a5ed-a8dcdee587c3 HTTP/1.1" status: 200 len: 1098 time: 0.1236300 May 25 16:59:20.396083 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.quota.driver [None req-b90c454d-42a0-4e23-9549-5fa855794a97 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91829) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 16:59:20.400268 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.quota.resource [None req-b90c454d-42a0-4e23-9549-5fa855794a97 admin admin] Usage tracker for resource:security_group_rule and tenant:0af552ab490b488ab4b8d123cdba64e9 is out of sync, need to count used quota {{(pid=91829) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 16:59:20.403306 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.quota.resource [None req-b90c454d-42a0-4e23-9549-5fa855794a97 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91829) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 16:59:20.410329 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.quota.driver [None req-b90c454d-42a0-4e23-9549-5fa855794a97 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91829) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 16:59:20.463921 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-076b9c60-04c3-4adc-9a6f-4b53c3a40b50 req-6e110ca1-79a5-4983-aa1f-5bdc1b27be62 service neutron] 10.222.0.32 "GET /v2.0/security-groups?id=8ee5c4ed-9c60-4e39-9185-7e283704a7dc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0547471 May 25 16:59:20.589534 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-b90c454d-42a0-4e23-9549-5fa855794a97 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:59:20.598434 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-b90c454d-42a0-4e23-9549-5fa855794a97 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-640836'] for security_group, after_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:59:20.607320 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-da00636d-52f1-4b58-a426-66f2be765122 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:59:20.718791 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bdce3fd5-6925-4883-9f44-f7d6391e0664 req-9556982e-f040-4e0b-8539-1f9c3dcac1df tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:59:20.718791 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-bdce3fd5-6925-4883-9f44-f7d6391e0664 req-9556982e-f040-4e0b-8539-1f9c3dcac1df tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] 10.222.0.62 "GET /v2.0/ports?device_id=bca36110-0b4f-419a-92ef-46cbb9d6215e HTTP/1.1" status: 200 len: 945 time: 0.2221861 May 25 16:59:20.727758 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [None req-b90c454d-42a0-4e23-9549-5fa855794a97 admin admin] 10.222.0.62 "GET /v2.0/security-groups?tenant_id=0af552ab490b488ab4b8d123cdba64e9&name=default HTTP/1.1" status: 200 len: 2979 time: 0.5141909 May 25 16:59:20.728717 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b90c454d-42a0-4e23-9549-5fa855794a97 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=6f077ae3-2c5e-44c6-a89f-dfebcef8b227,revision_number=1']} {{(pid=91829) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:59:20.730397 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.wsgi [-] (91830) accepted ('10.222.0.62', 56756) {{(pid=91830) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:59:20.768211 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b90c454d-42a0-4e23-9549-5fa855794a97 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91829) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:59:20.769080 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b90c454d-42a0-4e23-9549-5fa855794a97 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91829) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:59:20.769433 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b90c454d-42a0-4e23-9549-5fa855794a97 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91829) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:59:20.769765 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b90c454d-42a0-4e23-9549-5fa855794a97 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91829) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:59:20.770119 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b90c454d-42a0-4e23-9549-5fa855794a97 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91829) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:59:20.770449 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b90c454d-42a0-4e23-9549-5fa855794a97 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91829) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:59:20.770791 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b90c454d-42a0-4e23-9549-5fa855794a97 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91829) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:59:20.771101 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b90c454d-42a0-4e23-9549-5fa855794a97 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91829) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:59:20.771426 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b90c454d-42a0-4e23-9549-5fa855794a97 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91829) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:59:20.771755 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b90c454d-42a0-4e23-9549-5fa855794a97 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91829) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:59:20.772078 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b90c454d-42a0-4e23-9549-5fa855794a97 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91829) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:59:20.772397 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b90c454d-42a0-4e23-9549-5fa855794a97 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91829) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:59:20.792502 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-b90c454d-42a0-4e23-9549-5fa855794a97 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.182s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:59:20.797645 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-bdce3fd5-6925-4883-9f44-f7d6391e0664 req-ac50b4cb-267d-42ea-8fab-d26c7de2e950 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] 10.222.0.62 "GET /v2.0/security-groups?id=f73b90a2-df48-48fb-99e0-5dd4d6a63a15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0724258 May 25 16:59:20.820052 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-c8b6e6c5-2002-4e06-9ad9-617f557090d7 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:59:20.853229 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-c8b6e6c5-2002-4e06-9ad9-617f557090d7 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:59:20.914669 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-c8b6e6c5-2002-4e06-9ad9-617f557090d7 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-640836'] for security_group, after_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:59:20.918899 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:59:20.931057 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c8b6e6c5-2002-4e06-9ad9-617f557090d7 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=6f077ae3-2c5e-44c6-a89f-dfebcef8b227,revision_number=None']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:59:20.944860 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c8b6e6c5-2002-4e06-9ad9-617f557090d7 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91830) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:59:20.945215 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c8b6e6c5-2002-4e06-9ad9-617f557090d7 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91830) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:59:20.945561 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c8b6e6c5-2002-4e06-9ad9-617f557090d7 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91830) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:59:20.945898 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c8b6e6c5-2002-4e06-9ad9-617f557090d7 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91830) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:59:20.946273 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c8b6e6c5-2002-4e06-9ad9-617f557090d7 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91830) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:59:20.946596 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c8b6e6c5-2002-4e06-9ad9-617f557090d7 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91830) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:59:20.946924 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c8b6e6c5-2002-4e06-9ad9-617f557090d7 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91830) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:59:20.947256 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c8b6e6c5-2002-4e06-9ad9-617f557090d7 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91830) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:59:20.947587 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c8b6e6c5-2002-4e06-9ad9-617f557090d7 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91830) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:59:20.947910 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c8b6e6c5-2002-4e06-9ad9-617f557090d7 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91830) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:59:20.948254 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c8b6e6c5-2002-4e06-9ad9-617f557090d7 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91830) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:59:20.948562 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c8b6e6c5-2002-4e06-9ad9-617f557090d7 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91830) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 16:59:20.956758 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-c8b6e6c5-2002-4e06-9ad9-617f557090d7 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.038s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:59:20.958043 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-c8b6e6c5-2002-4e06-9ad9-617f557090d7 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:59:20.959141 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [None req-c8b6e6c5-2002-4e06-9ad9-617f557090d7 admin admin] 10.222.0.62 "DELETE /v2.0/security-groups/6f077ae3-2c5e-44c6-a89f-dfebcef8b227 HTTP/1.1" status: 204 len: 168 time: 0.2275181 May 25 16:59:21.150588 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.db.agents_db [None req-504cb04f-4543-46c1-8db7-349e21db7634 None None] Agent healthcheck: found 6 active agents {{(pid=91832) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} May 25 16:59:21.294254 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.wsgi [-] (91829) accepted ('10.222.0.62', 56790) {{(pid=91829) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:59:21.324267 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-fea52170-8718-4a27-91f2-bef73a6eb572 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:59:21.402857 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.quota.driver [None req-fea52170-8718-4a27-91f2-bef73a6eb572 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91829) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 16:59:21.411026 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.quota.resource [None req-fea52170-8718-4a27-91f2-bef73a6eb572 admin admin] Usage tracker for resource:security_group_rule and tenant:1ce76e7ea14a451aade215cd692cc23b is out of sync, need to count used quota {{(pid=91829) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 16:59:21.414820 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.quota.resource [None req-fea52170-8718-4a27-91f2-bef73a6eb572 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91829) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 16:59:21.423738 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.quota.driver [None req-fea52170-8718-4a27-91f2-bef73a6eb572 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91829) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 16:59:21.509330 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-49b5f98e-2fca-4c68-89e1-fec84199fd41 req-2b1a2b0d-a938-4a79-b39e-5e2e08130e1b tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:59:21.510842 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-49b5f98e-2fca-4c68-89e1-fec84199fd41 req-2b1a2b0d-a938-4a79-b39e-5e2e08130e1b tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/ports?device_id=d87a1395-92e0-4727-a5ed-a8dcdee587c3 HTTP/1.1" status: 200 len: 945 time: 0.1879210 May 25 16:59:21.606160 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-49b5f98e-2fca-4c68-89e1-fec84199fd41 req-891efd23-2e54-45a3-9dbf-6fa99dc94de0 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/security-groups?id=8ee5c4ed-9c60-4e39-9185-7e283704a7dc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0807209 May 25 16:59:21.607154 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-fea52170-8718-4a27-91f2-bef73a6eb572 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:59:21.611671 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-fea52170-8718-4a27-91f2-bef73a6eb572 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-640836'] for security_group, after_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:59:21.625793 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-1e271c69-0798-4a1a-ae03-5e718fda96ac admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:59:21.657113 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fea52170-8718-4a27-91f2-bef73a6eb572 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=23a48b45-37ca-489d-8603-13fa469abaa1,revision_number=1']} {{(pid=91829) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:59:21.667436 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-fea52170-8718-4a27-91f2-bef73a6eb572 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.042s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:59:21.678832 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [None req-fea52170-8718-4a27-91f2-bef73a6eb572 admin admin] 10.222.0.62 "GET /v2.0/security-groups?tenant_id=1ce76e7ea14a451aade215cd692cc23b&name=default HTTP/1.1" status: 200 len: 2979 time: 0.3889585 May 25 16:59:21.679041 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.wsgi [-] (91830) accepted ('10.222.0.62', 56814) {{(pid=91830) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:59:21.743591 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-92d1c8b1-0f52-4de8-bc40-cb6d6d572a22 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:59:21.769871 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-92d1c8b1-0f52-4de8-bc40-cb6d6d572a22 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:59:21.855222 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-92d1c8b1-0f52-4de8-bc40-cb6d6d572a22 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-640836'] for security_group, after_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:59:21.859657 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:59:21.874042 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-92d1c8b1-0f52-4de8-bc40-cb6d6d572a22 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=23a48b45-37ca-489d-8603-13fa469abaa1,revision_number=None']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:59:21.882211 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-92d1c8b1-0f52-4de8-bc40-cb6d6d572a22 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.022s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:59:21.894455 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-92d1c8b1-0f52-4de8-bc40-cb6d6d572a22 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:59:21.895587 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [None req-92d1c8b1-0f52-4de8-bc40-cb6d6d572a22 admin admin] 10.222.0.62 "DELETE /v2.0/security-groups/23a48b45-37ca-489d-8603-13fa469abaa1 HTTP/1.1" status: 204 len: 168 time: 0.2154577 May 25 16:59:22.882141 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-88ef686a-5657-4610-9db2-2d4b26553198 req-b96cf7cb-cbdd-44bd-88ba-f75848533448 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:59:22.883866 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-88ef686a-5657-4610-9db2-2d4b26553198 req-b96cf7cb-cbdd-44bd-88ba-f75848533448 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/ports?device_id=d87a1395-92e0-4727-a5ed-a8dcdee587c3 HTTP/1.1" status: 200 len: 945 time: 0.1346900 May 25 16:59:22.957108 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-88ef686a-5657-4610-9db2-2d4b26553198 req-5ee1e345-4cd6-4298-8799-821ddb36a1fe tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/security-groups?id=8ee5c4ed-9c60-4e39-9185-7e283704a7dc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0662684 May 25 16:59:23.451966 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4e723f4e-4d3f-47e0-b768-76908d9047bd req-27ef0161-cce4-4e17-8c28-c8e6637a8729 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:59:23.453524 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-4e723f4e-4d3f-47e0-b768-76908d9047bd req-27ef0161-cce4-4e17-8c28-c8e6637a8729 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/ports?device_id=d87a1395-92e0-4727-a5ed-a8dcdee587c3 HTTP/1.1" status: 200 len: 945 time: 0.1201293 May 25 16:59:23.506163 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-4e723f4e-4d3f-47e0-b768-76908d9047bd req-555352c7-d752-41eb-ac44-2c9975ad05ca tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/security-groups?id=8ee5c4ed-9c60-4e39-9185-7e283704a7dc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0413284 May 25 16:59:24.693763 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.wsgi [-] (91830) accepted ('10.222.0.62', 56998) {{(pid=91830) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:59:24.703206 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-479e843d-14e7-4e74-959f-22d37b183774 req-31c262c2-5f78-430c-a998-35a7697ae7c6 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:59:24.704659 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-479e843d-14e7-4e74-959f-22d37b183774 req-31c262c2-5f78-430c-a998-35a7697ae7c6 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/ports?device_id=d87a1395-92e0-4727-a5ed-a8dcdee587c3 HTTP/1.1" status: 200 len: 945 time: 0.0853071 May 25 16:59:24.750607 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-479e843d-14e7-4e74-959f-22d37b183774 req-9d8e9584-0b9a-4129-9e38-d74dec54bb13 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/security-groups?id=8ee5c4ed-9c60-4e39-9185-7e283704a7dc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0395401 May 25 16:59:24.816414 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-a97c15a3-faf5-4143-9754-162a8c8e1671 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:59:24.832994 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.quota.driver [None req-a97c15a3-faf5-4143-9754-162a8c8e1671 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91830) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 16:59:24.836785 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [None req-a97c15a3-faf5-4143-9754-162a8c8e1671 admin admin] Usage tracker for resource:security_group_rule and tenant:327bb549ac8c48458882a46216c989df is out of sync, need to count used quota {{(pid=91830) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 16:59:24.839673 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [None req-a97c15a3-faf5-4143-9754-162a8c8e1671 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91830) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 16:59:24.845301 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.quota.driver [None req-a97c15a3-faf5-4143-9754-162a8c8e1671 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91830) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 16:59:24.927509 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-a97c15a3-faf5-4143-9754-162a8c8e1671 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:59:24.931000 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-a97c15a3-faf5-4143-9754-162a8c8e1671 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-640836'] for security_group, after_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:59:24.940444 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-c8b6e6c5-2002-4e06-9ad9-617f557090d7 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:59:24.981673 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [None req-a97c15a3-faf5-4143-9754-162a8c8e1671 admin admin] 10.222.0.62 "GET /v2.0/security-groups?tenant_id=327bb549ac8c48458882a46216c989df&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2866287 May 25 16:59:24.982261 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a97c15a3-faf5-4143-9754-162a8c8e1671 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=1a73138f-5253-4490-bee2-0a0c80655b58,revision_number=1']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:59:24.984537 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.wsgi [-] (91830) accepted ('10.222.0.62', 57010) {{(pid=91830) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:59:24.986998 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-a97c15a3-faf5-4143-9754-162a8c8e1671 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.047s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:59:25.051871 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-a700e0e6-1a34-4560-85f5-e1ab5df12d6d admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:59:25.077840 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-a700e0e6-1a34-4560-85f5-e1ab5df12d6d admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:59:25.130293 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-a700e0e6-1a34-4560-85f5-e1ab5df12d6d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-640836'] for security_group, after_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:59:25.133765 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:59:25.146501 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a700e0e6-1a34-4560-85f5-e1ab5df12d6d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=1a73138f-5253-4490-bee2-0a0c80655b58,revision_number=None']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:59:25.148733 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-a700e0e6-1a34-4560-85f5-e1ab5df12d6d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.015s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:59:25.154487 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-a700e0e6-1a34-4560-85f5-e1ab5df12d6d admin admin] Notify callbacks [] for security_group, before_response {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:59:25.155606 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [None req-a700e0e6-1a34-4560-85f5-e1ab5df12d6d admin admin] 10.222.0.62 "DELETE /v2.0/security-groups/1a73138f-5253-4490-bee2-0a0c80655b58 HTTP/1.1" status: 204 len: 168 time: 0.1701846 May 25 16:59:25.287740 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-f7c2b26d-b321-4e5e-bb43-1ff93f5e7acc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:59:25.432511 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.wsgi [-] (91830) accepted ('10.222.0.62', 57022) {{(pid=91830) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:59:25.450752 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-33c9ba35-e221-4bb6-8268-4d1900424f27 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:59:25.464559 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.quota.driver [None req-33c9ba35-e221-4bb6-8268-4d1900424f27 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91830) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 16:59:25.468270 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [None req-33c9ba35-e221-4bb6-8268-4d1900424f27 admin admin] Usage tracker for resource:security_group_rule and tenant:9c2dbd1cb6c1484cbd3bb163ebb3cb22 is out of sync, need to count used quota {{(pid=91830) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 16:59:25.471088 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [None req-33c9ba35-e221-4bb6-8268-4d1900424f27 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91830) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 16:59:25.476791 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.quota.driver [None req-33c9ba35-e221-4bb6-8268-4d1900424f27 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91830) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 16:59:25.562050 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-33c9ba35-e221-4bb6-8268-4d1900424f27 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:59:25.566988 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-33c9ba35-e221-4bb6-8268-4d1900424f27 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-640836'] for security_group, after_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:59:25.576178 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-d9d7a79d-394b-4913-8b44-e92883b8537f admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:59:25.618781 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-33c9ba35-e221-4bb6-8268-4d1900424f27 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=415a3d8e-a948-4330-8256-ab12ca1e3dc9,revision_number=1']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:59:25.623079 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [None req-33c9ba35-e221-4bb6-8268-4d1900424f27 admin admin] 10.222.0.62 "GET /v2.0/security-groups?tenant_id=9c2dbd1cb6c1484cbd3bb163ebb3cb22&name=default HTTP/1.1" status: 200 len: 2979 time: 0.1894433 May 25 16:59:25.623980 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-33c9ba35-e221-4bb6-8268-4d1900424f27 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.048s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:59:25.625498 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.wsgi [-] (91830) accepted ('10.222.0.62', 57030) {{(pid=91830) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:59:25.684313 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-f1611ff9-1774-4bea-b162-763e8e620ddb admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:59:25.709312 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-f1611ff9-1774-4bea-b162-763e8e620ddb admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:59:25.766835 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-f1611ff9-1774-4bea-b162-763e8e620ddb admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-640836'] for security_group, after_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:59:25.770401 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-4fef73b2-caf0-4354-a489-bc342583b443 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:59:25.781259 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f1611ff9-1774-4bea-b162-763e8e620ddb admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=415a3d8e-a948-4330-8256-ab12ca1e3dc9,revision_number=None']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:59:25.785315 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-f1611ff9-1774-4bea-b162-763e8e620ddb admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.015s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:59:25.788475 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-f1611ff9-1774-4bea-b162-763e8e620ddb admin admin] Notify callbacks [] for security_group, before_response {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:59:25.791837 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [None req-f1611ff9-1774-4bea-b162-763e8e620ddb admin admin] 10.222.0.62 "DELETE /v2.0/security-groups/415a3d8e-a948-4330-8256-ab12ca1e3dc9 HTTP/1.1" status: 204 len: 168 time: 0.1631632 May 25 16:59:25.945088 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e2cd2180-8c82-4205-8e8f-cea328475cc7 req-c8cc6aed-2497-4c5e-ad5d-cb7be765d258 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:59:25.946970 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-e2cd2180-8c82-4205-8e8f-cea328475cc7 req-c8cc6aed-2497-4c5e-ad5d-cb7be765d258 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/ports?device_id=d87a1395-92e0-4727-a5ed-a8dcdee587c3 HTTP/1.1" status: 200 len: 945 time: 0.0849750 May 25 16:59:25.991354 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-e2cd2180-8c82-4205-8e8f-cea328475cc7 req-0d44df2a-b6e6-4a41-8f22-4429f768e478 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/security-groups?id=8ee5c4ed-9c60-4e39-9185-7e283704a7dc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0389664 May 25 16:59:27.185512 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0d92b093-925a-4825-8321-11681de0ccab req-9feb7bf6-a1e1-441d-98cb-8f4bd04ad97a tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:59:27.186989 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-0d92b093-925a-4825-8321-11681de0ccab req-9feb7bf6-a1e1-441d-98cb-8f4bd04ad97a tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/ports?device_id=d87a1395-92e0-4727-a5ed-a8dcdee587c3 HTTP/1.1" status: 200 len: 945 time: 0.0820861 May 25 16:59:27.232909 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-0d92b093-925a-4825-8321-11681de0ccab req-24ed57c0-0da9-4940-9163-abe2e4d1dbce tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/security-groups?id=8ee5c4ed-9c60-4e39-9185-7e283704a7dc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0397017 May 25 16:59:27.682835 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-de39e55f-4791-4db3-8e29-e5f84de787c0 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:59:27.855025 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:59:28.413561 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-85a88ac0-391a-48c8-92ba-54e406a1a590 req-d956a725-ee9f-4ed9-b5f6-c8b2291fd155 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:59:28.415064 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-85a88ac0-391a-48c8-92ba-54e406a1a590 req-d956a725-ee9f-4ed9-b5f6-c8b2291fd155 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/ports?device_id=d87a1395-92e0-4727-a5ed-a8dcdee587c3 HTTP/1.1" status: 200 len: 945 time: 0.0790217 May 25 16:59:28.518520 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-85a88ac0-391a-48c8-92ba-54e406a1a590 req-6fc2f5cd-cfca-4b76-a716-d1a80e99ad25 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/security-groups?id=8ee5c4ed-9c60-4e39-9185-7e283704a7dc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0967586 May 25 16:59:28.569001 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e2f1b69a-98a4-49f8-90f6-9c5c51fc171c req-29d364a5-7066-4a8a-a463-ff85d6ead04d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:59:28.571405 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-e2f1b69a-98a4-49f8-90f6-9c5c51fc171c req-29d364a5-7066-4a8a-a463-ff85d6ead04d service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=734df673f8b3484d80f35a45fbce9d5e&device_id=d87a1395-92e0-4727-a5ed-a8dcdee587c3 HTTP/1.1" status: 200 len: 1098 time: 0.1075013 May 25 16:59:28.591392 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-0a55eb4a-8b57-4233-84d6-6b423b4ed6db None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:59:28.623393 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-fb29361a-1587-4de7-aba1-b06ae930ebf4 req-ac4a4008-7548-4e22-904d-f568331cbe5b service neutron] 10.222.0.32 "GET /v2.0/ports?device_id=bca36110-0b4f-419a-92ef-46cbb9d6215e&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.1168489 May 25 16:59:28.734228 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e2f1b69a-98a4-49f8-90f6-9c5c51fc171c req-bb9c8847-ac13-4097-8824-39adda77e9b9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:59:28.736116 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-e2f1b69a-98a4-49f8-90f6-9c5c51fc171c req-bb9c8847-ac13-4097-8824-39adda77e9b9 service neutron] 10.222.0.32 "GET /v2.0/networks?id=55a46372-d583-4435-a0f6-b9397668217d HTTP/1.1" status: 200 len: 919 time: 0.1462431 May 25 16:59:28.795948 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fb29361a-1587-4de7-aba1-b06ae930ebf4 req-3a46cf6c-d108-4c8e-82a3-1ba4f83adf67 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91830) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:59:28.799259 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-fb29361a-1587-4de7-aba1-b06ae930ebf4 req-3a46cf6c-d108-4c8e-82a3-1ba4f83adf67 service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=04e8022f24e3464ab1ab7726d6a07e08&device_id=bca36110-0b4f-419a-92ef-46cbb9d6215e HTTP/1.1" status: 200 len: 1098 time: 0.0826397 May 25 16:59:28.811677 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-e2f1b69a-98a4-49f8-90f6-9c5c51fc171c req-c94bab6c-01b4-43c9-a052-030e9c41ea4f service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=250e0a7c-f7d1-4092-af1f-d50d5b92f68a HTTP/1.1" status: 200 len: 217 time: 0.0681746 May 25 16:59:28.882573 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e2f1b69a-98a4-49f8-90f6-9c5c51fc171c req-16247ea9-b4c1-439b-9642-916e49404509 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:59:28.884014 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-e2f1b69a-98a4-49f8-90f6-9c5c51fc171c req-16247ea9-b4c1-439b-9642-916e49404509 service neutron] 10.222.0.32 "GET /v2.0/subnets?id=927bd65a-c4de-491b-b501-302852f4c784 HTTP/1.1" status: 200 len: 858 time: 0.0599964 May 25 16:59:28.936101 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-e2f1b69a-98a4-49f8-90f6-9c5c51fc171c req-f8f4edcc-a1d5-4450-b5c4-45b06daec2bb service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=55a46372-d583-4435-a0f6-b9397668217d&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0441313 May 25 16:59:29.005488 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fb29361a-1587-4de7-aba1-b06ae930ebf4 req-25fcd3d1-f756-457f-b354-2815b3fc9eb6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91830) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:59:29.007251 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-fb29361a-1587-4de7-aba1-b06ae930ebf4 req-25fcd3d1-f756-457f-b354-2815b3fc9eb6 service neutron] 10.222.0.32 "GET /v2.0/networks?id=63b1f335-e2c4-48dd-886b-6be853f8a2fc HTTP/1.1" status: 200 len: 915 time: 0.1824629 May 25 16:59:29.075000 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-e2f1b69a-98a4-49f8-90f6-9c5c51fc171c req-37eaf5da-d5dc-45f3-ac69-75b6ae5ba17a service neutron] 10.222.0.32 "GET /v2.0/networks/55a46372-d583-4435-a0f6-b9397668217d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1310751 May 25 16:59:29.089204 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-fb29361a-1587-4de7-aba1-b06ae930ebf4 req-db85bac3-dfea-416c-9899-380b227ddc15 service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=c4b9c0f2-e3d5-4fff-9b3c-a9175b027fb5 HTTP/1.1" status: 200 len: 217 time: 0.0712681 May 25 16:59:29.160522 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fb29361a-1587-4de7-aba1-b06ae930ebf4 req-aa455038-ccfa-4e3f-8249-5dd7c328e619 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=91830) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:59:29.161983 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-fb29361a-1587-4de7-aba1-b06ae930ebf4 req-aa455038-ccfa-4e3f-8249-5dd7c328e619 service neutron] 10.222.0.32 "GET /v2.0/subnets?id=b0baa944-cafe-48a4-861a-dae28947b9f0 HTTP/1.1" status: 200 len: 854 time: 0.0580173 May 25 16:59:29.213415 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-e2f1b69a-98a4-49f8-90f6-9c5c51fc171c req-47616151-97d5-48a4-a347-3b0f26f1bbd8 service neutron] 10.222.0.32 "GET /v2.0/networks/55a46372-d583-4435-a0f6-b9397668217d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1303761 May 25 16:59:29.216417 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-fb29361a-1587-4de7-aba1-b06ae930ebf4 req-3a53f0a8-0aa8-4346-ae6a-2d584e3f49ad service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=63b1f335-e2c4-48dd-886b-6be853f8a2fc&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0451941 May 25 16:59:29.373437 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-fb29361a-1587-4de7-aba1-b06ae930ebf4 req-7f68a57b-10cd-44a4-9ebe-99b5106c9037 service neutron] 10.222.0.32 "GET /v2.0/networks/63b1f335-e2c4-48dd-886b-6be853f8a2fc?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1394746 May 25 16:59:29.505665 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-fb29361a-1587-4de7-aba1-b06ae930ebf4 req-86c21b0e-805e-4f90-8f60-1e97b992f62a service neutron] 10.222.0.32 "GET /v2.0/networks/63b1f335-e2c4-48dd-886b-6be853f8a2fc?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1246824 May 25 16:59:29.715522 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b790bf86-4d78-453d-8a70-9b30e4d544f8 req-453a8fe1-743d-46fd-ad8e-4ddbb8879faf tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:59:29.716933 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-b790bf86-4d78-453d-8a70-9b30e4d544f8 req-453a8fe1-743d-46fd-ad8e-4ddbb8879faf tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/ports?device_id=d87a1395-92e0-4727-a5ed-a8dcdee587c3 HTTP/1.1" status: 200 len: 945 time: 0.0826004 May 25 16:59:29.759384 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-b790bf86-4d78-453d-8a70-9b30e4d544f8 req-cd462974-b2b1-481d-a708-4b0d5f712789 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/security-groups?id=8ee5c4ed-9c60-4e39-9185-7e283704a7dc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0367613 May 25 16:59:30.217527 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-57f11b47-1f51-4191-b7c9-af248a48372c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:59:30.964381 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d78294dd-88a8-4358-9e19-f412277e6ebc req-9e8cdaa2-142b-4943-8c72-066306997d48 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:59:30.965876 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-d78294dd-88a8-4358-9e19-f412277e6ebc req-9e8cdaa2-142b-4943-8c72-066306997d48 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/ports?device_id=d87a1395-92e0-4727-a5ed-a8dcdee587c3 HTTP/1.1" status: 200 len: 945 time: 0.0891211 May 25 16:59:31.019281 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-d78294dd-88a8-4358-9e19-f412277e6ebc req-167a3daa-82e5-410a-ab20-0e278a417d4a tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/security-groups?id=8ee5c4ed-9c60-4e39-9185-7e283704a7dc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0469408 May 25 16:59:32.273186 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ff47b01d-03c8-4cf4-bfe2-a1878ec3515b req-0ffd6bee-fee0-4357-8ef3-1794f5a000c6 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:59:32.275392 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-ff47b01d-03c8-4cf4-bfe2-a1878ec3515b req-0ffd6bee-fee0-4357-8ef3-1794f5a000c6 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/ports?device_id=d87a1395-92e0-4727-a5ed-a8dcdee587c3 HTTP/1.1" status: 200 len: 945 time: 0.1467116 May 25 16:59:32.324288 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-ff47b01d-03c8-4cf4-bfe2-a1878ec3515b req-2391bf70-540b-425a-bedf-a3e36a212ab3 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/security-groups?id=8ee5c4ed-9c60-4e39-9185-7e283704a7dc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0432701 May 25 16:59:32.348416 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:59:32.508908 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.wsgi [-] (91830) accepted ('10.222.0.62', 57216) {{(pid=91830) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:59:32.622733 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-bc31e898-55f4-4bfe-b194-4fea99dcafd2 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:59:32.636530 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.quota.driver [None req-bc31e898-55f4-4bfe-b194-4fea99dcafd2 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91830) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 16:59:32.640213 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [None req-bc31e898-55f4-4bfe-b194-4fea99dcafd2 admin admin] Usage tracker for resource:security_group_rule and tenant:cab5a62c5b944218a9f08c3224de2eae is out of sync, need to count used quota {{(pid=91830) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 16:59:32.643131 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [None req-bc31e898-55f4-4bfe-b194-4fea99dcafd2 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91830) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 16:59:32.648682 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.quota.driver [None req-bc31e898-55f4-4bfe-b194-4fea99dcafd2 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91830) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 16:59:32.729397 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-bc31e898-55f4-4bfe-b194-4fea99dcafd2 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:59:32.733258 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-bc31e898-55f4-4bfe-b194-4fea99dcafd2 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-640836'] for security_group, after_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:59:32.742055 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-5af0d23d-3b30-44ea-ba6e-3a360c4bcd95 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:59:32.779729 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc31e898-55f4-4bfe-b194-4fea99dcafd2 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=1f72fe3f-c6ba-4c87-ab06-4e33160e768f,revision_number=1']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:59:32.791794 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.wsgi [-] (91829) accepted ('10.222.0.62', 57228) {{(pid=91829) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:59:32.791905 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [None req-bc31e898-55f4-4bfe-b194-4fea99dcafd2 admin admin] 10.222.0.62 "GET /v2.0/security-groups?tenant_id=cab5a62c5b944218a9f08c3224de2eae&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2817717 May 25 16:59:32.793064 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-bc31e898-55f4-4bfe-b194-4fea99dcafd2 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.051s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:59:32.853769 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-df8828d1-1bba-4754-8ebc-1c3d57f825a9 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:59:32.880264 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-df8828d1-1bba-4754-8ebc-1c3d57f825a9 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:59:32.930651 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-df8828d1-1bba-4754-8ebc-1c3d57f825a9 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-640836'] for security_group, after_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:59:32.936212 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-277eb1a9-df9d-4264-96e0-e887b816477d admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:59:32.951313 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-df8828d1-1bba-4754-8ebc-1c3d57f825a9 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=1f72fe3f-c6ba-4c87-ab06-4e33160e768f,revision_number=None']} {{(pid=91829) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:59:32.953809 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-df8828d1-1bba-4754-8ebc-1c3d57f825a9 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.018s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:59:32.965648 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-df8828d1-1bba-4754-8ebc-1c3d57f825a9 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:59:32.966765 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [None req-df8828d1-1bba-4754-8ebc-1c3d57f825a9 admin admin] 10.222.0.62 "DELETE /v2.0/security-groups/1f72fe3f-c6ba-4c87-ab06-4e33160e768f HTTP/1.1" status: 204 len: 168 time: 0.1738276 May 25 16:59:33.243259 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.wsgi [-] (91829) accepted ('10.222.0.62', 57240) {{(pid=91829) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:59:33.261624 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-d69b55d2-9f47-4586-ba13-59eb768f5f87 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:59:33.276411 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.quota.driver [None req-d69b55d2-9f47-4586-ba13-59eb768f5f87 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91829) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 16:59:33.280249 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.quota.resource [None req-d69b55d2-9f47-4586-ba13-59eb768f5f87 admin admin] Usage tracker for resource:security_group_rule and tenant:04eddcd57582458182f773ee3107ce09 is out of sync, need to count used quota {{(pid=91829) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 16:59:33.283520 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.quota.resource [None req-d69b55d2-9f47-4586-ba13-59eb768f5f87 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91829) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 16:59:33.289373 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.quota.driver [None req-d69b55d2-9f47-4586-ba13-59eb768f5f87 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91829) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 16:59:33.369191 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-d69b55d2-9f47-4586-ba13-59eb768f5f87 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:59:33.373177 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-d69b55d2-9f47-4586-ba13-59eb768f5f87 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-640836'] for security_group, after_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:59:33.381928 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-b0a5f1f2-4079-4cb9-b599-deb01adcbafb admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:59:33.424970 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [None req-d69b55d2-9f47-4586-ba13-59eb768f5f87 admin admin] 10.222.0.62 "GET /v2.0/security-groups?tenant_id=04eddcd57582458182f773ee3107ce09&name=default HTTP/1.1" status: 200 len: 2979 time: 0.1782048 May 25 16:59:33.424970 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d69b55d2-9f47-4586-ba13-59eb768f5f87 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=81cd16fb-f5de-454c-8ba7-a4f3eaccce9a,revision_number=1']} {{(pid=91829) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:59:33.425809 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.wsgi [-] (91830) accepted ('10.222.0.62', 57246) {{(pid=91830) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:59:33.427093 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-d69b55d2-9f47-4586-ba13-59eb768f5f87 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.045s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:59:33.500458 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-cf641e61-80a8-4817-a311-f6cad64596a5 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:59:33.513390 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e38cb408-f95b-4ba1-a704-e4a78fb1bb61 req-08d49840-bfb6-4be1-822a-97b1773f0f07 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:59:33.514855 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-e38cb408-f95b-4ba1-a704-e4a78fb1bb61 req-08d49840-bfb6-4be1-822a-97b1773f0f07 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/ports?device_id=d87a1395-92e0-4727-a5ed-a8dcdee587c3 HTTP/1.1" status: 200 len: 945 time: 0.0799239 May 25 16:59:33.531368 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-cf641e61-80a8-4817-a311-f6cad64596a5 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:59:33.563548 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-e38cb408-f95b-4ba1-a704-e4a78fb1bb61 req-bd7ca16a-6584-4061-a199-4c91b1ebe25e tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/security-groups?id=8ee5c4ed-9c60-4e39-9185-7e283704a7dc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0420194 May 25 16:59:33.584467 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-cf641e61-80a8-4817-a311-f6cad64596a5 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-640836'] for security_group, after_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:59:33.589613 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-a97c15a3-faf5-4143-9754-162a8c8e1671 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:59:33.601707 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cf641e61-80a8-4817-a311-f6cad64596a5 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=81cd16fb-f5de-454c-8ba7-a4f3eaccce9a,revision_number=None']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:59:33.606188 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-cf641e61-80a8-4817-a311-f6cad64596a5 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.017s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:59:33.610450 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-cf641e61-80a8-4817-a311-f6cad64596a5 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:59:33.612212 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [None req-cf641e61-80a8-4817-a311-f6cad64596a5 admin admin] 10.222.0.62 "DELETE /v2.0/security-groups/81cd16fb-f5de-454c-8ba7-a4f3eaccce9a HTTP/1.1" status: 204 len: 168 time: 0.1788700 May 25 16:59:34.761458 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f865bd7d-4299-46eb-a3f9-8a88cfa6d5dc req-4acbfa1c-4c19-481f-92fa-be5a62d55c4a tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:59:34.762182 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-f865bd7d-4299-46eb-a3f9-8a88cfa6d5dc req-4acbfa1c-4c19-481f-92fa-be5a62d55c4a tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/ports?device_id=d87a1395-92e0-4727-a5ed-a8dcdee587c3 HTTP/1.1" status: 200 len: 945 time: 0.0854933 May 25 16:59:34.808608 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-f865bd7d-4299-46eb-a3f9-8a88cfa6d5dc req-79d10dd8-f764-44f2-ac2c-4d6ae2969694 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/security-groups?id=8ee5c4ed-9c60-4e39-9185-7e283704a7dc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0407763 May 25 16:59:35.997064 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4bc59288-5f25-44a2-9572-62f94e253e5e req-80f7e1b8-9ce8-49a3-990f-0a5d3a047f79 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:59:35.998537 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-4bc59288-5f25-44a2-9572-62f94e253e5e req-80f7e1b8-9ce8-49a3-990f-0a5d3a047f79 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/ports?device_id=d87a1395-92e0-4727-a5ed-a8dcdee587c3 HTTP/1.1" status: 200 len: 945 time: 0.0839627 May 25 16:59:36.043027 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-4bc59288-5f25-44a2-9572-62f94e253e5e req-e962b1a7-87c6-4812-8c41-35cd7ba22a2f tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/security-groups?id=8ee5c4ed-9c60-4e39-9185-7e283704a7dc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0388546 May 25 16:59:37.253594 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dbdbcac4-288d-4837-8438-da0e7c185f8f req-eecf3fe3-d565-40c0-a6ed-44f5a08cda6a tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:59:37.255067 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-dbdbcac4-288d-4837-8438-da0e7c185f8f req-eecf3fe3-d565-40c0-a6ed-44f5a08cda6a tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/ports?device_id=d87a1395-92e0-4727-a5ed-a8dcdee587c3 HTTP/1.1" status: 200 len: 945 time: 0.0859008 May 25 16:59:37.300782 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-dbdbcac4-288d-4837-8438-da0e7c185f8f req-91bfa43f-940d-41ec-987a-403287d31c79 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/security-groups?id=8ee5c4ed-9c60-4e39-9185-7e283704a7dc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0400276 May 25 16:59:38.503133 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e316ea93-6a73-4c7f-9a86-b6cc994a3c5c req-74245557-c4b5-4426-a1dd-14fd04839665 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:59:38.504633 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-e316ea93-6a73-4c7f-9a86-b6cc994a3c5c req-74245557-c4b5-4426-a1dd-14fd04839665 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/ports?device_id=d87a1395-92e0-4727-a5ed-a8dcdee587c3 HTTP/1.1" status: 200 len: 945 time: 0.0882516 May 25 16:59:38.554167 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-e316ea93-6a73-4c7f-9a86-b6cc994a3c5c req-140245fd-1819-47ed-a598-df119cfeb2b6 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/security-groups?id=8ee5c4ed-9c60-4e39-9185-7e283704a7dc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0432277 May 25 16:59:39.306084 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.wsgi [-] (91830) accepted ('10.222.0.62', 57434) {{(pid=91830) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:59:39.424385 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-0b5501f5-9fab-4ed6-8138-26ad30a51c5c admin admin] Notify callbacks [] for security_group, before_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:59:39.439315 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.quota.driver [None req-0b5501f5-9fab-4ed6-8138-26ad30a51c5c admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91830) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 16:59:39.443076 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [None req-0b5501f5-9fab-4ed6-8138-26ad30a51c5c admin admin] Usage tracker for resource:security_group_rule and tenant:72079f959bb44714a7bffbf16eacfcda is out of sync, need to count used quota {{(pid=91830) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 16:59:39.445833 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [None req-0b5501f5-9fab-4ed6-8138-26ad30a51c5c admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91830) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 16:59:39.451699 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.quota.driver [None req-0b5501f5-9fab-4ed6-8138-26ad30a51c5c admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91830) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 16:59:39.534309 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-0b5501f5-9fab-4ed6-8138-26ad30a51c5c admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:59:39.539003 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-0b5501f5-9fab-4ed6-8138-26ad30a51c5c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-640836'] for security_group, after_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:59:39.547175 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-a2287d98-7cb9-4b82-bab2-d762baa5679d admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:59:39.585613 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [None req-0b5501f5-9fab-4ed6-8138-26ad30a51c5c admin admin] 10.222.0.62 "GET /v2.0/security-groups?tenant_id=72079f959bb44714a7bffbf16eacfcda&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2781878 May 25 16:59:39.587187 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0b5501f5-9fab-4ed6-8138-26ad30a51c5c admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=cafc3408-a56d-4971-94fd-fb893511e47f,revision_number=1']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:59:39.588382 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.wsgi [-] (91829) accepted ('10.222.0.62', 57444) {{(pid=91829) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:59:39.599103 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-0b5501f5-9fab-4ed6-8138-26ad30a51c5c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.052s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:59:39.659894 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-e99bee91-eeef-48a0-9efc-0b445f9f1ac0 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:59:39.685332 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-e99bee91-eeef-48a0-9efc-0b445f9f1ac0 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:59:39.795677 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a76a8338-cce6-43d9-8d24-d0deb868f884 req-14f32dd9-cc67-4b74-a90f-40026036d455 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:59:39.797116 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-a76a8338-cce6-43d9-8d24-d0deb868f884 req-14f32dd9-cc67-4b74-a90f-40026036d455 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/ports?device_id=d87a1395-92e0-4727-a5ed-a8dcdee587c3 HTTP/1.1" status: 200 len: 945 time: 0.1049266 May 25 16:59:39.818536 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-e99bee91-eeef-48a0-9efc-0b445f9f1ac0 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-640836'] for security_group, after_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:59:39.824556 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-066ef9fd-fd14-4bcc-b6a2-a142c619f63e admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:59:39.842419 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e99bee91-eeef-48a0-9efc-0b445f9f1ac0 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=cafc3408-a56d-4971-94fd-fb893511e47f,revision_number=None']} {{(pid=91829) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:59:39.848584 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-e99bee91-eeef-48a0-9efc-0b445f9f1ac0 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.024s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:59:39.865973 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-e99bee91-eeef-48a0-9efc-0b445f9f1ac0 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:59:39.869678 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [None req-e99bee91-eeef-48a0-9efc-0b445f9f1ac0 admin admin] 10.222.0.62 "DELETE /v2.0/security-groups/cafc3408-a56d-4971-94fd-fb893511e47f HTTP/1.1" status: 204 len: 168 time: 0.2792261 May 25 16:59:39.874950 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-a76a8338-cce6-43d9-8d24-d0deb868f884 req-76fda010-9fe0-4eef-aa73-2535cf29a45a tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/security-groups?id=8ee5c4ed-9c60-4e39-9185-7e283704a7dc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0708332 May 25 16:59:40.154672 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.wsgi [-] (91829) accepted ('10.222.0.62', 57462) {{(pid=91829) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:59:40.171815 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-a2df9107-e961-4d1e-9b4a-3e7e133b2c0d admin admin] Notify callbacks [] for security_group, before_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:59:40.186213 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.quota.driver [None req-a2df9107-e961-4d1e-9b4a-3e7e133b2c0d admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91829) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 16:59:40.189864 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.quota.resource [None req-a2df9107-e961-4d1e-9b4a-3e7e133b2c0d admin admin] Usage tracker for resource:security_group_rule and tenant:c615f97a07534e17a097d61aa1c7b8e8 is out of sync, need to count used quota {{(pid=91829) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 16:59:40.192556 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.quota.resource [None req-a2df9107-e961-4d1e-9b4a-3e7e133b2c0d admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91829) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 16:59:40.198126 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.quota.driver [None req-a2df9107-e961-4d1e-9b4a-3e7e133b2c0d admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91829) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 16:59:40.277189 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-a2df9107-e961-4d1e-9b4a-3e7e133b2c0d admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:59:40.280639 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-a2df9107-e961-4d1e-9b4a-3e7e133b2c0d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-640836'] for security_group, after_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:59:40.289232 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-e0ca2372-3962-466a-9320-feaf2cd068a8 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:59:40.326310 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [None req-a2df9107-e961-4d1e-9b4a-3e7e133b2c0d admin admin] 10.222.0.62 "GET /v2.0/security-groups?tenant_id=c615f97a07534e17a097d61aa1c7b8e8&name=default HTTP/1.1" status: 200 len: 2979 time: 0.1705966 May 25 16:59:40.327840 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a2df9107-e961-4d1e-9b4a-3e7e133b2c0d admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=5bbec421-c192-4009-b860-403d622d4fa8,revision_number=1']} {{(pid=91829) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:59:40.328982 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.wsgi [-] (91830) accepted ('10.222.0.62', 57466) {{(pid=91830) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:59:40.331543 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-a2df9107-e961-4d1e-9b4a-3e7e133b2c0d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.042s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:59:40.395607 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-f6d0fd64-b179-429d-9ed1-76cf80f9a84a admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:59:40.421694 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-f6d0fd64-b179-429d-9ed1-76cf80f9a84a admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:59:40.472019 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-f6d0fd64-b179-429d-9ed1-76cf80f9a84a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-640836'] for security_group, after_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:59:40.475841 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:59:40.488233 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f6d0fd64-b179-429d-9ed1-76cf80f9a84a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=5bbec421-c192-4009-b860-403d622d4fa8,revision_number=None']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:59:40.490463 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-f6d0fd64-b179-429d-9ed1-76cf80f9a84a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.015s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:59:40.498640 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-f6d0fd64-b179-429d-9ed1-76cf80f9a84a admin admin] Notify callbacks [] for security_group, before_response {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:59:40.502101 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [None req-f6d0fd64-b179-429d-9ed1-76cf80f9a84a admin admin] 10.222.0.62 "DELETE /v2.0/security-groups/5bbec421-c192-4009-b860-403d622d4fa8 HTTP/1.1" status: 204 len: 168 time: 0.1692417 May 25 16:59:41.070601 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-79a7660c-0f93-45f2-a56e-3a2484c2f715 req-bb3be5e6-fbbb-4b7c-9b77-b5f42c44fda9 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:59:41.072141 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-79a7660c-0f93-45f2-a56e-3a2484c2f715 req-bb3be5e6-fbbb-4b7c-9b77-b5f42c44fda9 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/ports?device_id=d87a1395-92e0-4727-a5ed-a8dcdee587c3 HTTP/1.1" status: 200 len: 945 time: 0.0859179 May 25 16:59:41.121506 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-79a7660c-0f93-45f2-a56e-3a2484c2f715 req-20026e6b-9d44-4c98-a609-273cf455cd87 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/security-groups?id=8ee5c4ed-9c60-4e39-9185-7e283704a7dc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0438631 May 25 16:59:42.315795 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a601c6f4-43f1-4cff-8da5-57271a8c9b1b req-2a612e07-9863-46a0-8d30-3749953b1962 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:59:42.317388 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-a601c6f4-43f1-4cff-8da5-57271a8c9b1b req-2a612e07-9863-46a0-8d30-3749953b1962 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/ports?device_id=d87a1395-92e0-4727-a5ed-a8dcdee587c3 HTTP/1.1" status: 200 len: 945 time: 0.0820224 May 25 16:59:42.319804 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.wsgi [-] (91829) accepted ('10.222.0.62', 57550) {{(pid=91829) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:59:42.367013 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-a601c6f4-43f1-4cff-8da5-57271a8c9b1b req-164058c4-6c68-4832-a9b7-78410aaaafc6 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/security-groups?id=8ee5c4ed-9c60-4e39-9185-7e283704a7dc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0413337 May 25 16:59:42.435437 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-c791cf4c-8a35-4eac-9ff1-928c0f12b241 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:59:42.449616 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.quota.driver [None req-c791cf4c-8a35-4eac-9ff1-928c0f12b241 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91829) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 16:59:42.453319 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.quota.resource [None req-c791cf4c-8a35-4eac-9ff1-928c0f12b241 admin admin] Usage tracker for resource:security_group_rule and tenant:879606138f454ae8abbff26e8d6a2176 is out of sync, need to count used quota {{(pid=91829) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 16:59:42.456669 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.quota.resource [None req-c791cf4c-8a35-4eac-9ff1-928c0f12b241 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91829) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 16:59:42.462291 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.quota.driver [None req-c791cf4c-8a35-4eac-9ff1-928c0f12b241 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91829) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 16:59:42.540620 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-c791cf4c-8a35-4eac-9ff1-928c0f12b241 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:59:42.544083 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-c791cf4c-8a35-4eac-9ff1-928c0f12b241 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-640836'] for security_group, after_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:59:42.552539 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:59:42.590367 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [None req-c791cf4c-8a35-4eac-9ff1-928c0f12b241 admin admin] 10.222.0.62 "GET /v2.0/security-groups?tenant_id=879606138f454ae8abbff26e8d6a2176&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2696259 May 25 16:59:42.591912 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c791cf4c-8a35-4eac-9ff1-928c0f12b241 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=080b352e-eba5-4e10-ba75-6a31bf805e0f,revision_number=1']} {{(pid=91829) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:59:42.593077 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.wsgi [-] (91830) accepted ('10.222.0.62', 57556) {{(pid=91830) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:59:42.594852 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-c791cf4c-8a35-4eac-9ff1-928c0f12b241 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.042s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:59:42.650278 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-e60f01a0-76d8-4093-9fa4-ca6cce199868 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:59:42.675642 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-e60f01a0-76d8-4093-9fa4-ca6cce199868 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:59:42.732114 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-e60f01a0-76d8-4093-9fa4-ca6cce199868 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-640836'] for security_group, after_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:59:42.737357 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-7ec1684d-62ff-4996-850a-92981776b4d1 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:59:42.750107 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e60f01a0-76d8-4093-9fa4-ca6cce199868 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=080b352e-eba5-4e10-ba75-6a31bf805e0f,revision_number=None']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:59:42.754196 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-e60f01a0-76d8-4093-9fa4-ca6cce199868 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.017s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:59:42.757516 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-e60f01a0-76d8-4093-9fa4-ca6cce199868 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:59:42.761252 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [None req-e60f01a0-76d8-4093-9fa4-ca6cce199868 admin admin] 10.222.0.62 "DELETE /v2.0/security-groups/080b352e-eba5-4e10-ba75-6a31bf805e0f HTTP/1.1" status: 204 len: 168 time: 0.1671786 May 25 16:59:43.032222 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.wsgi [-] (91830) accepted ('10.222.0.62', 57568) {{(pid=91830) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:59:43.050686 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-045abec0-52a0-42a4-b917-af681be6151f admin admin] Notify callbacks [] for security_group, before_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:59:43.066639 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.quota.driver [None req-045abec0-52a0-42a4-b917-af681be6151f admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91830) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 16:59:43.070418 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [None req-045abec0-52a0-42a4-b917-af681be6151f admin admin] Usage tracker for resource:security_group_rule and tenant:a187b30f80ed4cc0adbf842f9e0fec69 is out of sync, need to count used quota {{(pid=91830) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 16:59:43.073553 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [None req-045abec0-52a0-42a4-b917-af681be6151f admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91830) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 16:59:43.080472 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.quota.driver [None req-045abec0-52a0-42a4-b917-af681be6151f admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91830) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 16:59:43.165459 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-045abec0-52a0-42a4-b917-af681be6151f admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:59:43.169643 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-045abec0-52a0-42a4-b917-af681be6151f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-640836'] for security_group, after_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:59:43.178494 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-f6d0fd64-b179-429d-9ed1-76cf80f9a84a admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:59:43.218869 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [None req-045abec0-52a0-42a4-b917-af681be6151f admin admin] 10.222.0.62 "GET /v2.0/security-groups?tenant_id=a187b30f80ed4cc0adbf842f9e0fec69&name=default HTTP/1.1" status: 200 len: 2979 time: 0.1846931 May 25 16:59:43.220952 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.wsgi [-] (91830) accepted ('10.222.0.62', 57578) {{(pid=91830) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 16:59:43.232254 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-045abec0-52a0-42a4-b917-af681be6151f admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=61f48bce-2748-4686-af21-6c713260ef63,revision_number=1']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:59:43.237356 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-045abec0-52a0-42a4-b917-af681be6151f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.059s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:59:43.285995 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-50d2169b-a7cb-4d88-bbda-3f4254321d15 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:59:43.312851 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-50d2169b-a7cb-4d88-bbda-3f4254321d15 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:59:43.378543 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-50d2169b-a7cb-4d88-bbda-3f4254321d15 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-640836'] for security_group, after_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:59:43.378543 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-586a41a0-3061-4e81-8c21-4033243f4cd6 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 16:59:43.387873 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-50d2169b-a7cb-4d88-bbda-3f4254321d15 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=61f48bce-2748-4686-af21-6c713260ef63,revision_number=None']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 16:59:43.392676 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-50d2169b-a7cb-4d88-bbda-3f4254321d15 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.017s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 16:59:43.393888 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-50d2169b-a7cb-4d88-bbda-3f4254321d15 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:59:43.397228 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [None req-50d2169b-a7cb-4d88-bbda-3f4254321d15 admin admin] 10.222.0.62 "DELETE /v2.0/security-groups/61f48bce-2748-4686-af21-6c713260ef63 HTTP/1.1" status: 204 len: 168 time: 0.1731834 May 25 16:59:43.566010 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2cd9dc87-3f5f-43f7-8f1e-981e92f73f5c req-a09f2cd5-e46b-4f33-b21f-9c5417150f9a tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:59:43.567447 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-2cd9dc87-3f5f-43f7-8f1e-981e92f73f5c req-a09f2cd5-e46b-4f33-b21f-9c5417150f9a tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/ports?device_id=d87a1395-92e0-4727-a5ed-a8dcdee587c3 HTTP/1.1" status: 200 len: 945 time: 0.0855303 May 25 16:59:43.611990 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-2cd9dc87-3f5f-43f7-8f1e-981e92f73f5c req-1886820a-4460-4ec1-8e1a-66ee6dcde0f3 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/security-groups?id=8ee5c4ed-9c60-4e39-9185-7e283704a7dc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0387766 May 25 16:59:44.796679 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-50f4244e-d98a-4448-9cde-3baeac6cf316 req-2d89f829-21ae-476c-b893-4fdb2a623665 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:59:44.808033 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-50f4244e-d98a-4448-9cde-3baeac6cf316 req-2d89f829-21ae-476c-b893-4fdb2a623665 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/ports?device_id=d87a1395-92e0-4727-a5ed-a8dcdee587c3 HTTP/1.1" status: 200 len: 945 time: 0.0878284 May 25 16:59:44.846101 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-50f4244e-d98a-4448-9cde-3baeac6cf316 req-214e2645-26f0-47fe-808a-e301938dc6ab tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/security-groups?id=8ee5c4ed-9c60-4e39-9185-7e283704a7dc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0409076 May 25 16:59:46.045650 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b76959fe-2866-45ea-bb3e-4ec048cee0d4 req-20442fba-2bb4-4f59-88bf-518bd46cf6c0 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:59:46.047039 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-b76959fe-2866-45ea-bb3e-4ec048cee0d4 req-20442fba-2bb4-4f59-88bf-518bd46cf6c0 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/ports?device_id=d87a1395-92e0-4727-a5ed-a8dcdee587c3 HTTP/1.1" status: 200 len: 945 time: 0.0891802 May 25 16:59:46.091352 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-b76959fe-2866-45ea-bb3e-4ec048cee0d4 req-3c846077-ab4d-4cd2-a00f-04ff62ad320d tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/security-groups?id=8ee5c4ed-9c60-4e39-9185-7e283704a7dc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0381007 May 25 16:59:47.280101 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fda477b9-790a-44f0-b259-ecf0c5d46930 req-8534a1b6-6ec3-4d7f-bb8c-0fdd696c4f50 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:59:47.281537 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-fda477b9-790a-44f0-b259-ecf0c5d46930 req-8534a1b6-6ec3-4d7f-bb8c-0fdd696c4f50 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/ports?device_id=d87a1395-92e0-4727-a5ed-a8dcdee587c3 HTTP/1.1" status: 200 len: 945 time: 0.0831015 May 25 16:59:47.373131 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-fda477b9-790a-44f0-b259-ecf0c5d46930 req-7e9c8095-7daf-4fc5-b0c4-ad95527e2896 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/security-groups?id=8ee5c4ed-9c60-4e39-9185-7e283704a7dc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0853775 May 25 16:59:48.558076 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-15164d2d-9882-4eac-8af9-cd964393d877 req-20f55a1a-0439-4a45-94d5-7a2ad161138e tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:59:48.559527 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-15164d2d-9882-4eac-8af9-cd964393d877 req-20f55a1a-0439-4a45-94d5-7a2ad161138e tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/ports?device_id=d87a1395-92e0-4727-a5ed-a8dcdee587c3 HTTP/1.1" status: 200 len: 945 time: 0.0796745 May 25 16:59:48.604971 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-15164d2d-9882-4eac-8af9-cd964393d877 req-5c556423-3660-401e-8e59-955b4851722e tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/security-groups?id=8ee5c4ed-9c60-4e39-9185-7e283704a7dc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0391734 May 25 16:59:49.845855 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3f730900-689d-4b30-9a92-a30ec6776de2 req-76e54b0f-dbdd-45cb-a130-e386ddc5964b tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:59:49.847326 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-3f730900-689d-4b30-9a92-a30ec6776de2 req-76e54b0f-dbdd-45cb-a130-e386ddc5964b tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/ports?device_id=d87a1395-92e0-4727-a5ed-a8dcdee587c3 HTTP/1.1" status: 200 len: 945 time: 0.1103375 May 25 16:59:49.861847 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a6e4bc99-a22c-4463-8c47-d2964b5f069d req-8ae7d354-eade-468b-93c6-45d56d799672 tempest-DeleteServersTestJSON-1172980508 tempest-DeleteServersTestJSON-1172980508-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:59:49.863316 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-a6e4bc99-a22c-4463-8c47-d2964b5f069d req-8ae7d354-eade-468b-93c6-45d56d799672 tempest-DeleteServersTestJSON-1172980508 tempest-DeleteServersTestJSON-1172980508-project] 10.222.0.62 "GET /v2.0/ports?device_id=1d5af5b3-8d0b-4cf9-a7f1-ce49a30efc33 HTTP/1.1" status: 200 len: 945 time: 0.1838188 May 25 16:59:49.928621 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-3f730900-689d-4b30-9a92-a30ec6776de2 req-7e2f924f-3481-43fa-80fe-7eba41b87695 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/security-groups?id=8ee5c4ed-9c60-4e39-9185-7e283704a7dc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0752022 May 25 16:59:49.939240 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-a6e4bc99-a22c-4463-8c47-d2964b5f069d req-970a62dd-e211-44b5-b2bf-876749005b55 tempest-DeleteServersTestJSON-1172980508 tempest-DeleteServersTestJSON-1172980508-project] 10.222.0.62 "GET /v2.0/security-groups?id=ec198040-29f5-4dbf-8437-e486f3fb935b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0590451 May 25 16:59:51.191476 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c574311b-6646-4258-b0d0-c8216acee28c req-f2389956-7674-4770-9e20-d43719f1e27f tempest-DeleteServersTestJSON-1172980508 tempest-DeleteServersTestJSON-1172980508-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:59:51.192918 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-c574311b-6646-4258-b0d0-c8216acee28c req-f2389956-7674-4770-9e20-d43719f1e27f tempest-DeleteServersTestJSON-1172980508 tempest-DeleteServersTestJSON-1172980508-project] 10.222.0.62 "GET /v2.0/ports?device_id=1d5af5b3-8d0b-4cf9-a7f1-ce49a30efc33 HTTP/1.1" status: 200 len: 945 time: 0.1106851 May 25 16:59:51.201061 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-48048ea6-4643-41ec-8298-d01fd3f69d60 req-39a05805-5e9c-49d5-a323-78b9a5df9376 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:59:51.202467 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-48048ea6-4643-41ec-8298-d01fd3f69d60 req-39a05805-5e9c-49d5-a323-78b9a5df9376 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/ports?device_id=d87a1395-92e0-4727-a5ed-a8dcdee587c3 HTTP/1.1" status: 200 len: 945 time: 0.1533055 May 25 16:59:51.270069 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-c574311b-6646-4258-b0d0-c8216acee28c req-1c29652d-daa0-4ea0-bc15-ade4bd860b97 tempest-DeleteServersTestJSON-1172980508 tempest-DeleteServersTestJSON-1172980508-project] 10.222.0.62 "GET /v2.0/security-groups?id=ec198040-29f5-4dbf-8437-e486f3fb935b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0666125 May 25 16:59:51.279718 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-48048ea6-4643-41ec-8298-d01fd3f69d60 req-fd5bbe3a-8dba-4ae5-8700-1b971e9155fb tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/security-groups?id=8ee5c4ed-9c60-4e39-9185-7e283704a7dc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0576472 May 25 16:59:52.523951 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c4b8568f-9fd5-4d5c-8256-a52a5d56bf4c req-7dd34e91-c0eb-4ecd-9441-df6e0d378538 tempest-DeleteServersTestJSON-1172980508 tempest-DeleteServersTestJSON-1172980508-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:59:52.525374 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-c4b8568f-9fd5-4d5c-8256-a52a5d56bf4c req-7dd34e91-c0eb-4ecd-9441-df6e0d378538 tempest-DeleteServersTestJSON-1172980508 tempest-DeleteServersTestJSON-1172980508-project] 10.222.0.62 "GET /v2.0/ports?device_id=1d5af5b3-8d0b-4cf9-a7f1-ce49a30efc33 HTTP/1.1" status: 200 len: 945 time: 0.1434975 May 25 16:59:52.533117 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b736c126-13d3-4d54-9bb4-5dac9de86a79 req-c741aafe-9177-4be2-bdc7-4fe2f8336f7f tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:59:52.534457 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-b736c126-13d3-4d54-9bb4-5dac9de86a79 req-c741aafe-9177-4be2-bdc7-4fe2f8336f7f tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/ports?device_id=d87a1395-92e0-4727-a5ed-a8dcdee587c3 HTTP/1.1" status: 200 len: 945 time: 0.1156154 May 25 16:59:52.603585 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-c4b8568f-9fd5-4d5c-8256-a52a5d56bf4c req-7a81b146-8b26-419d-b443-04c72b65fefb tempest-DeleteServersTestJSON-1172980508 tempest-DeleteServersTestJSON-1172980508-project] 10.222.0.62 "GET /v2.0/security-groups?id=ec198040-29f5-4dbf-8437-e486f3fb935b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0682063 May 25 16:59:52.607848 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-b736c126-13d3-4d54-9bb4-5dac9de86a79 req-e846ea02-33f9-4de2-aea9-47c804eef3fa tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/security-groups?id=8ee5c4ed-9c60-4e39-9185-7e283704a7dc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0575004 May 25 16:59:53.844918 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0bc1ce8b-02a3-414d-8d64-f6e5fc792d90 req-20d46dfc-d567-436e-9534-49dd655ffb44 tempest-DeleteServersTestJSON-1172980508 tempest-DeleteServersTestJSON-1172980508-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:59:53.846357 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-0bc1ce8b-02a3-414d-8d64-f6e5fc792d90 req-20d46dfc-d567-436e-9534-49dd655ffb44 tempest-DeleteServersTestJSON-1172980508 tempest-DeleteServersTestJSON-1172980508-project] 10.222.0.62 "GET /v2.0/ports?device_id=1d5af5b3-8d0b-4cf9-a7f1-ce49a30efc33 HTTP/1.1" status: 200 len: 945 time: 0.1391246 May 25 16:59:53.854097 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-36d94af3-3505-48ea-8ceb-3279c6a02153 req-3f73d60d-1044-4d9f-bb4f-579057f92bff tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:59:53.855457 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-36d94af3-3505-48ea-8ceb-3279c6a02153 req-3f73d60d-1044-4d9f-bb4f-579057f92bff tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/ports?device_id=d87a1395-92e0-4727-a5ed-a8dcdee587c3 HTTP/1.1" status: 200 len: 945 time: 0.1156571 May 25 16:59:53.924813 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-0bc1ce8b-02a3-414d-8d64-f6e5fc792d90 req-43eba35a-3bd9-49cb-a920-a1f1bbf8f051 tempest-DeleteServersTestJSON-1172980508 tempest-DeleteServersTestJSON-1172980508-project] 10.222.0.62 "GET /v2.0/security-groups?id=ec198040-29f5-4dbf-8437-e486f3fb935b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0683935 May 25 16:59:53.928986 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-36d94af3-3505-48ea-8ceb-3279c6a02153 req-fec7b871-a755-4401-ac68-73ccc411671d tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/security-groups?id=8ee5c4ed-9c60-4e39-9185-7e283704a7dc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0593276 May 25 16:59:55.169702 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1656de50-be60-41b9-888f-86871a7a2d72 req-a19e8405-98e8-4cd2-ac00-ec249c3ed667 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:59:55.171070 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-1656de50-be60-41b9-888f-86871a7a2d72 req-a19e8405-98e8-4cd2-ac00-ec249c3ed667 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/ports?device_id=d87a1395-92e0-4727-a5ed-a8dcdee587c3 HTTP/1.1" status: 200 len: 945 time: 0.1393206 May 25 16:59:55.179008 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3bcd4cad-07e8-455e-a14d-52cee4f2ce93 req-75bd4d13-036e-484c-8549-f2d4cc43d125 tempest-DeleteServersTestJSON-1172980508 tempest-DeleteServersTestJSON-1172980508-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:59:55.180322 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-3bcd4cad-07e8-455e-a14d-52cee4f2ce93 req-75bd4d13-036e-484c-8549-f2d4cc43d125 tempest-DeleteServersTestJSON-1172980508 tempest-DeleteServersTestJSON-1172980508-project] 10.222.0.62 "GET /v2.0/ports?device_id=1d5af5b3-8d0b-4cf9-a7f1-ce49a30efc33 HTTP/1.1" status: 200 len: 945 time: 0.1473501 May 25 16:59:55.248661 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-1656de50-be60-41b9-888f-86871a7a2d72 req-d58cf41a-6870-412f-b44c-7e71faac1842 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/security-groups?id=8ee5c4ed-9c60-4e39-9185-7e283704a7dc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0671680 May 25 16:59:55.251881 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-3bcd4cad-07e8-455e-a14d-52cee4f2ce93 req-04889721-687d-4a45-b251-e7b6d39f2945 tempest-DeleteServersTestJSON-1172980508 tempest-DeleteServersTestJSON-1172980508-project] 10.222.0.62 "GET /v2.0/security-groups?id=ec198040-29f5-4dbf-8437-e486f3fb935b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0576034 May 25 16:59:55.288947 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-b8e1e079-2136-4332-8734-ba04f4f1c131 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:59:56.492579 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-98c052fe-b6bd-4f2d-a34f-3d66ddaf7b23 req-9b69c15b-5043-4ca1-ba52-8dd02c3c43ea tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:59:56.494034 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-98c052fe-b6bd-4f2d-a34f-3d66ddaf7b23 req-9b69c15b-5043-4ca1-ba52-8dd02c3c43ea tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/ports?device_id=d87a1395-92e0-4727-a5ed-a8dcdee587c3 HTTP/1.1" status: 200 len: 945 time: 0.1385589 May 25 16:59:56.506171 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1f81404e-bd76-4d8b-bf34-8e8ab2ccf8ca req-f11add29-7c7a-4a6f-a24f-a42dcc3c7023 tempest-DeleteServersTestJSON-1172980508 tempest-DeleteServersTestJSON-1172980508-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:59:56.507806 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-1f81404e-bd76-4d8b-bf34-8e8ab2ccf8ca req-f11add29-7c7a-4a6f-a24f-a42dcc3c7023 tempest-DeleteServersTestJSON-1172980508 tempest-DeleteServersTestJSON-1172980508-project] 10.222.0.62 "GET /v2.0/ports?device_id=1d5af5b3-8d0b-4cf9-a7f1-ce49a30efc33 HTTP/1.1" status: 200 len: 945 time: 0.1217360 May 25 16:59:56.573957 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-98c052fe-b6bd-4f2d-a34f-3d66ddaf7b23 req-80344653-fe25-4663-92f2-c4b18af0d944 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/security-groups?id=8ee5c4ed-9c60-4e39-9185-7e283704a7dc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0652046 May 25 16:59:56.581711 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-1f81404e-bd76-4d8b-bf34-8e8ab2ccf8ca req-b9381175-5c42-4e52-99f8-03a32531b0f6 tempest-DeleteServersTestJSON-1172980508 tempest-DeleteServersTestJSON-1172980508-project] 10.222.0.62 "GET /v2.0/security-groups?id=ec198040-29f5-4dbf-8437-e486f3fb935b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0585308 May 25 16:59:57.688448 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-afa2b679-cce1-464c-80b2-9b51a1af1b32 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:59:57.841936 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-62dc31ed-af38-41dc-a020-d08a87cada92 req-a7595611-0c46-47f3-92fb-69c2bd0352d9 tempest-DeleteServersTestJSON-1172980508 tempest-DeleteServersTestJSON-1172980508-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:59:57.843475 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-62dc31ed-af38-41dc-a020-d08a87cada92 req-a7595611-0c46-47f3-92fb-69c2bd0352d9 tempest-DeleteServersTestJSON-1172980508 tempest-DeleteServersTestJSON-1172980508-project] 10.222.0.62 "GET /v2.0/ports?device_id=1d5af5b3-8d0b-4cf9-a7f1-ce49a30efc33 HTTP/1.1" status: 200 len: 945 time: 0.1452446 May 25 16:59:57.856211 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a9c1c806-aa04-4678-9733-e054e2884753 req-76a32c94-a128-40ac-b1b2-a37400c0c780 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:59:57.857676 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-a9c1c806-aa04-4678-9733-e054e2884753 req-76a32c94-a128-40ac-b1b2-a37400c0c780 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/ports?device_id=d87a1395-92e0-4727-a5ed-a8dcdee587c3 HTTP/1.1" status: 200 len: 945 time: 0.1576219 May 25 16:59:57.864796 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:59:57.934640 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-62dc31ed-af38-41dc-a020-d08a87cada92 req-a9cab16f-ecff-4e0b-aaac-03c38fc38d8c tempest-DeleteServersTestJSON-1172980508 tempest-DeleteServersTestJSON-1172980508-project] 10.222.0.62 "GET /v2.0/security-groups?id=ec198040-29f5-4dbf-8437-e486f3fb935b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0759842 May 25 16:59:57.937379 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-a9c1c806-aa04-4678-9733-e054e2884753 req-72b90a31-01a2-4633-9c67-4e76b5d61515 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/security-groups?id=8ee5c4ed-9c60-4e39-9185-7e283704a7dc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0648181 May 25 16:59:58.148898 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.db.agents_db [None req-504cb04f-4543-46c1-8db7-349e21db7634 None None] Agent healthcheck: found 6 active agents {{(pid=91832) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} May 25 16:59:58.590122 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-0a55eb4a-8b57-4233-84d6-6b423b4ed6db None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 16:59:59.186308 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a9fd1089-0259-4d15-a42c-f58e2041efb1 req-ad74b4f7-44be-467f-ac61-a12d6fe6eb82 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:59:59.187671 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-a9fd1089-0259-4d15-a42c-f58e2041efb1 req-ad74b4f7-44be-467f-ac61-a12d6fe6eb82 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/ports?device_id=d87a1395-92e0-4727-a5ed-a8dcdee587c3 HTTP/1.1" status: 200 len: 945 time: 0.1105378 May 25 16:59:59.194950 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8e1c9c5b-fbd8-4876-aba4-8a3c69f4738d req-e5b12175-f171-4888-a03c-9472535bf8b5 tempest-DeleteServersTestJSON-1172980508 tempest-DeleteServersTestJSON-1172980508-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 16:59:59.196271 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-8e1c9c5b-fbd8-4876-aba4-8a3c69f4738d req-e5b12175-f171-4888-a03c-9472535bf8b5 tempest-DeleteServersTestJSON-1172980508 tempest-DeleteServersTestJSON-1172980508-project] 10.222.0.62 "GET /v2.0/ports?device_id=1d5af5b3-8d0b-4cf9-a7f1-ce49a30efc33 HTTP/1.1" status: 200 len: 945 time: 0.1511669 May 25 16:59:59.321780 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-a9fd1089-0259-4d15-a42c-f58e2041efb1 req-34c427a0-b3fc-4903-ae7b-8d5b4a8f21fd tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/security-groups?id=8ee5c4ed-9c60-4e39-9185-7e283704a7dc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1245606 May 25 16:59:59.326119 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-8e1c9c5b-fbd8-4876-aba4-8a3c69f4738d req-3004616a-1c42-4cf6-8d16-45f9e02f8e28 tempest-DeleteServersTestJSON-1172980508 tempest-DeleteServersTestJSON-1172980508-project] 10.222.0.62 "GET /v2.0/security-groups?id=ec198040-29f5-4dbf-8437-e486f3fb935b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0578399 May 25 17:00:00.199456 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-57f11b47-1f51-4191-b7c9-af248a48372c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:00.573445 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b211ed58-4eac-4b36-93ba-1de17589ff2c req-9a206fef-cc36-4793-9503-d5634618aa28 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:00:00.574802 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-b211ed58-4eac-4b36-93ba-1de17589ff2c req-9a206fef-cc36-4793-9503-d5634618aa28 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/ports?device_id=d87a1395-92e0-4727-a5ed-a8dcdee587c3 HTTP/1.1" status: 200 len: 945 time: 0.1491411 May 25 17:00:00.583214 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7907fb0e-34a4-4677-9e3c-64a9dc44f61b req-a1739486-8269-444e-bee4-343c006c86d0 tempest-DeleteServersTestJSON-1172980508 tempest-DeleteServersTestJSON-1172980508-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:00:00.584631 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-7907fb0e-34a4-4677-9e3c-64a9dc44f61b req-a1739486-8269-444e-bee4-343c006c86d0 tempest-DeleteServersTestJSON-1172980508 tempest-DeleteServersTestJSON-1172980508-project] 10.222.0.62 "GET /v2.0/ports?device_id=1d5af5b3-8d0b-4cf9-a7f1-ce49a30efc33 HTTP/1.1" status: 200 len: 945 time: 0.1233354 May 25 17:00:00.652479 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-b211ed58-4eac-4b36-93ba-1de17589ff2c req-dafe47da-3a5d-4e09-b934-fc4e617af216 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/security-groups?id=8ee5c4ed-9c60-4e39-9185-7e283704a7dc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0669265 May 25 17:00:00.659745 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-7907fb0e-34a4-4677-9e3c-64a9dc44f61b req-4cd0f80e-96b4-4aff-a0bc-7230201750d8 tempest-DeleteServersTestJSON-1172980508 tempest-DeleteServersTestJSON-1172980508-project] 10.222.0.62 "GET /v2.0/security-groups?id=ec198040-29f5-4dbf-8437-e486f3fb935b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0612032 May 25 17:00:01.892171 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7e4630aa-7b50-4b23-bbb8-a67f4230275d req-d9f75e15-c441-4ab7-adda-0963b24fbc8b tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:00:01.893582 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-7e4630aa-7b50-4b23-bbb8-a67f4230275d req-d9f75e15-c441-4ab7-adda-0963b24fbc8b tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/ports?device_id=d87a1395-92e0-4727-a5ed-a8dcdee587c3 HTTP/1.1" status: 200 len: 945 time: 0.1342673 May 25 17:00:01.901425 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9c0dff2d-09ff-4474-b262-f6e7df8a8917 req-efd090d6-36f5-4224-a54b-b94a35567a1a tempest-DeleteServersTestJSON-1172980508 tempest-DeleteServersTestJSON-1172980508-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:00:01.902758 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-9c0dff2d-09ff-4474-b262-f6e7df8a8917 req-efd090d6-36f5-4224-a54b-b94a35567a1a tempest-DeleteServersTestJSON-1172980508 tempest-DeleteServersTestJSON-1172980508-project] 10.222.0.62 "GET /v2.0/ports?device_id=1d5af5b3-8d0b-4cf9-a7f1-ce49a30efc33 HTTP/1.1" status: 200 len: 945 time: 0.1129420 May 25 17:00:01.972330 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-7e4630aa-7b50-4b23-bbb8-a67f4230275d req-9f2f86b9-e5f5-4c33-aa63-d1c05a29b922 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/security-groups?id=8ee5c4ed-9c60-4e39-9185-7e283704a7dc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0686514 May 25 17:00:01.976588 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-9c0dff2d-09ff-4474-b262-f6e7df8a8917 req-536434fa-8e46-4333-a4d1-2e4a1c4c6b76 tempest-DeleteServersTestJSON-1172980508 tempest-DeleteServersTestJSON-1172980508-project] 10.222.0.62 "GET /v2.0/security-groups?id=ec198040-29f5-4dbf-8437-e486f3fb935b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0574801 May 25 17:00:02.334163 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:03.225437 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-578b9af4-4b61-41ff-b611-ce43473443eb req-78be9855-98b0-49d8-b262-910195dcc013 tempest-DeleteServersTestJSON-1172980508 tempest-DeleteServersTestJSON-1172980508-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:00:03.226904 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-578b9af4-4b61-41ff-b611-ce43473443eb req-78be9855-98b0-49d8-b262-910195dcc013 tempest-DeleteServersTestJSON-1172980508 tempest-DeleteServersTestJSON-1172980508-project] 10.222.0.62 "GET /v2.0/ports?device_id=1d5af5b3-8d0b-4cf9-a7f1-ce49a30efc33 HTTP/1.1" status: 200 len: 945 time: 0.1444731 May 25 17:00:03.234266 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c8f42f70-cd98-4688-a9e0-a29e7a40934e req-f8383d5e-c2e6-414e-a5e7-747ad26fd79d tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:00:03.235664 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-c8f42f70-cd98-4688-a9e0-a29e7a40934e req-f8383d5e-c2e6-414e-a5e7-747ad26fd79d tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/ports?device_id=d87a1395-92e0-4727-a5ed-a8dcdee587c3 HTTP/1.1" status: 200 len: 945 time: 0.1514463 May 25 17:00:03.304870 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-578b9af4-4b61-41ff-b611-ce43473443eb req-b273ccf3-e14c-4e79-820c-26192ea263ab tempest-DeleteServersTestJSON-1172980508 tempest-DeleteServersTestJSON-1172980508-project] 10.222.0.62 "GET /v2.0/security-groups?id=ec198040-29f5-4dbf-8437-e486f3fb935b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0682557 May 25 17:00:03.309458 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-c8f42f70-cd98-4688-a9e0-a29e7a40934e req-5bc0520d-e673-4a55-aaed-7882bedcc548 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/security-groups?id=8ee5c4ed-9c60-4e39-9185-7e283704a7dc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0579474 May 25 17:00:03.401304 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7362853a-140c-4aeb-a244-c78904d4072a req-9dbb5265-3a21-42f0-8a80-eb3dfc352c5c tempest-DeleteServersTestJSON-1172980508 tempest-DeleteServersTestJSON-1172980508-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91830) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:00:03.402034 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [req-7362853a-140c-4aeb-a244-c78904d4072a req-9dbb5265-3a21-42f0-8a80-eb3dfc352c5c tempest-DeleteServersTestJSON-1172980508 tempest-DeleteServersTestJSON-1172980508-project] Synchronizing usage tracker for tenant:00ab1bb5f5df49f08ef4b15635754b71 on resource:port {{(pid=91830) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 25 17:00:03.420080 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [req-7362853a-140c-4aeb-a244-c78904d4072a req-9dbb5265-3a21-42f0-8a80-eb3dfc352c5c tempest-DeleteServersTestJSON-1172980508 tempest-DeleteServersTestJSON-1172980508-project] Unset dirty status for tenant:00ab1bb5f5df49f08ef4b15635754b71 on resource:port {{(pid=91830) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 25 17:00:03.421379 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-7362853a-140c-4aeb-a244-c78904d4072a req-9dbb5265-3a21-42f0-8a80-eb3dfc352c5c tempest-DeleteServersTestJSON-1172980508 tempest-DeleteServersTestJSON-1172980508-project] 10.222.0.32 "GET /v2.0/ports?device_id=1d5af5b3-8d0b-4cf9-a7f1-ce49a30efc33 HTTP/1.1" status: 200 len: 945 time: 0.1077745 May 25 17:00:03.564976 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.plugins.ml2.plugin [req-7362853a-140c-4aeb-a244-c78904d4072a req-894dffd1-cbc4-443b-96b6-0c876bc4a0b5 tempest-DeleteServersTestJSON-1172980508 tempest-DeleteServersTestJSON-1172980508-project] Deleting port a460da33-52a2-41d5-bcf5-1baa12e65f8f {{(pid=91830) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 25 17:00:03.565318 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [req-7362853a-140c-4aeb-a244-c78904d4072a req-894dffd1-cbc4-443b-96b6-0c876bc4a0b5 tempest-DeleteServersTestJSON-1172980508 tempest-DeleteServersTestJSON-1172980508-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8757892952899'] for port, before_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:03.697189 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.plugins.ml2.db [req-7362853a-140c-4aeb-a244-c78904d4072a req-894dffd1-cbc4-443b-96b6-0c876bc4a0b5 tempest-DeleteServersTestJSON-1172980508 tempest-DeleteServersTestJSON-1172980508-project] For port a460da33-52a2-41d5-bcf5-1baa12e65f8f, host hv-cinder-79049, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79049',level=0,port_id=a460da33-52a2-41d5-bcf5-1baa12e65f8f,segment=NetworkSegment(8721f8e7-e59f-46c5-9d87-1b6cc08601ef),segment_id=8721f8e7-e59f-46c5-9d87-1b6cc08601ef)] {{(pid=91830) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 17:00:03.697543 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [req-7362853a-140c-4aeb-a244-c78904d4072a req-894dffd1-cbc4-443b-96b6-0c876bc4a0b5 tempest-DeleteServersTestJSON-1172980508 tempest-DeleteServersTestJSON-1172980508-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-683770'] for port, precommit_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:03.871269 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.plugins.ml2.plugin [req-7362853a-140c-4aeb-a244-c78904d4072a req-894dffd1-cbc4-443b-96b6-0c876bc4a0b5 tempest-DeleteServersTestJSON-1172980508 tempest-DeleteServersTestJSON-1172980508-project] Calling delete_port for a460da33-52a2-41d5-bcf5-1baa12e65f8f owned by compute:nova {{(pid=91830) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 25 17:00:04.049560 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [req-7362853a-140c-4aeb-a244-c78904d4072a req-894dffd1-cbc4-443b-96b6-0c876bc4a0b5 tempest-DeleteServersTestJSON-1172980508 tempest-DeleteServersTestJSON-1172980508-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8757892955046', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8757892520924'] for port, after_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:04.056834 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-9568e620-0c14-4ca6-9056-b9d7945a0b3a service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:00:04.066451 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.db [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] get_ports_and_sgs() called for port_ids ['a460da33-52a2-41d5-bcf5-1baa12e65f8f'] {{(pid=91831) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 25 17:00:04.105651 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-894dffd1-cbc4-443b-96b6-0c876bc4a0b5 tempest-DeleteServersTestJSON-1172980508 tempest-DeleteServersTestJSON-1172980508-project] Pushing event deleted for resources: {'Port': ['ID=a460da33-52a2-41d5-bcf5-1baa12e65f8f,revision_number=None']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:00:04.108700 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-894dffd1-cbc4-443b-96b6-0c876bc4a0b5 tempest-DeleteServersTestJSON-1172980508 tempest-DeleteServersTestJSON-1172980508-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.052s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:00:04.184832 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.l3_dvrscheduler_db [req-7362853a-140c-4aeb-a244-c78904d4072a req-894dffd1-cbc4-443b-96b6-0c876bc4a0b5 tempest-DeleteServersTestJSON-1172980508 tempest-DeleteServersTestJSON-1172980508-project] No DVR routers for this DVR port a460da33-52a2-41d5-bcf5-1baa12e65f8f on host hv-cinder-79049 {{(pid=91830) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 25 17:00:04.187870 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [req-7362853a-140c-4aeb-a244-c78904d4072a req-894dffd1-cbc4-443b-96b6-0c876bc4a0b5 tempest-DeleteServersTestJSON-1172980508 tempest-DeleteServersTestJSON-1172980508-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-178712'] for port, before_response {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:04.190383 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '1d5af5b3-8d0b-4cf9-a7f1-ce49a30efc33', 'name': 'network-vif-deleted', 'tag': 'a460da33-52a2-41d5-bcf5-1baa12e65f8f'}] {{(pid=91830) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 25 17:00:04.206081 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-7362853a-140c-4aeb-a244-c78904d4072a req-894dffd1-cbc4-443b-96b6-0c876bc4a0b5 tempest-DeleteServersTestJSON-1172980508 tempest-DeleteServersTestJSON-1172980508-project] 10.222.0.32 "DELETE /v2.0/ports/a460da33-52a2-41d5-bcf5-1baa12e65f8f HTTP/1.1" status: 204 len: 173 time: 0.7779889 May 25 17:00:04.238828 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '1d5af5b3-8d0b-4cf9-a7f1-ce49a30efc33', 'name': 'network-vif-deleted', 'tag': 'a460da33-52a2-41d5-bcf5-1baa12e65f8f', 'status': 'completed', 'code': 200} May 25 17:00:04.510245 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-dc8c6c61-f006-451a-869e-2a22a15ef8f5 req-55ae4dfa-3def-4afb-bb38-1a851fefb86e tempest-DeleteServersTestJSON-1172980508 tempest-DeleteServersTestJSON-1172980508-project] 10.222.0.62 "GET /v2.0/ports?device_id=1d5af5b3-8d0b-4cf9-a7f1-ce49a30efc33 HTTP/1.1" status: 200 len: 210 time: 0.0840414 May 25 17:00:04.558367 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eb92628e-a6f4-46c2-991b-cac6ffb7ea1c req-f46fe92f-de05-462e-928f-3501fd650e21 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:00:04.562447 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-eb92628e-a6f4-46c2-991b-cac6ffb7ea1c req-f46fe92f-de05-462e-928f-3501fd650e21 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/ports?device_id=d87a1395-92e0-4727-a5ed-a8dcdee587c3 HTTP/1.1" status: 200 len: 945 time: 0.1027372 May 25 17:00:04.610097 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-eb92628e-a6f4-46c2-991b-cac6ffb7ea1c req-efb9c0aa-d99e-41b7-a1a0-a5959f5ca42e tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/security-groups?id=8ee5c4ed-9c60-4e39-9185-7e283704a7dc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0435083 May 25 17:00:04.772343 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.wsgi [-] (91830) accepted ('10.222.0.62', 58044) {{(pid=91830) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:00:04.926195 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-131d35fe-0b85-4d61-a5c4-2b01eb4645f2 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:04.940956 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.quota.driver [None req-131d35fe-0b85-4d61-a5c4-2b01eb4645f2 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91830) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 17:00:04.944666 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [None req-131d35fe-0b85-4d61-a5c4-2b01eb4645f2 admin admin] Usage tracker for resource:security_group_rule and tenant:7477d1cc231a4b2f8ad7b591e0efea3c is out of sync, need to count used quota {{(pid=91830) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 17:00:04.947437 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [None req-131d35fe-0b85-4d61-a5c4-2b01eb4645f2 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91830) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 17:00:04.954347 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.quota.driver [None req-131d35fe-0b85-4d61-a5c4-2b01eb4645f2 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91830) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 17:00:05.042129 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-131d35fe-0b85-4d61-a5c4-2b01eb4645f2 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:05.046064 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-131d35fe-0b85-4d61-a5c4-2b01eb4645f2 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-640836'] for security_group, after_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:05.054863 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-a1d2d385-5bc4-49bb-90a8-674b9b272ae9 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:00:05.093187 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-131d35fe-0b85-4d61-a5c4-2b01eb4645f2 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=f3f75110-fb4d-4658-8ac2-0c70ad692ce7,revision_number=1']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:00:05.097503 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [None req-131d35fe-0b85-4d61-a5c4-2b01eb4645f2 admin admin] 10.222.0.62 "GET /v2.0/security-groups?tenant_id=7477d1cc231a4b2f8ad7b591e0efea3c&name=default HTTP/1.1" status: 200 len: 2979 time: 0.3233132 May 25 17:00:05.098419 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-131d35fe-0b85-4d61-a5c4-2b01eb4645f2 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.044s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:00:05.100018 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.wsgi [-] (91830) accepted ('10.222.0.62', 58058) {{(pid=91830) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:00:05.112353 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.wsgi [-] (91829) accepted ('10.222.0.62', 58062) {{(pid=91829) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:00:05.159453 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-e540a9dc-7eaa-44e0-a83a-b482e90117fd admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:05.184944 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-e540a9dc-7eaa-44e0-a83a-b482e90117fd admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:05.233893 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-18bd6063-fa56-43fe-8cef-9eab4b22ed00 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:05.246011 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-e540a9dc-7eaa-44e0-a83a-b482e90117fd admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-640836'] for security_group, after_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:05.249003 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.quota.driver [None req-18bd6063-fa56-43fe-8cef-9eab4b22ed00 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91829) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 17:00:05.251325 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:00:05.253568 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.quota.resource [None req-18bd6063-fa56-43fe-8cef-9eab4b22ed00 admin admin] Usage tracker for resource:security_group_rule and tenant:b671a051583f427fb4de7379c58ef839 is out of sync, need to count used quota {{(pid=91829) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 17:00:05.260645 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.quota.resource [None req-18bd6063-fa56-43fe-8cef-9eab4b22ed00 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91829) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 17:00:05.262068 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e540a9dc-7eaa-44e0-a83a-b482e90117fd admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=f3f75110-fb4d-4658-8ac2-0c70ad692ce7,revision_number=None']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:00:05.266367 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-e540a9dc-7eaa-44e0-a83a-b482e90117fd admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.014s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:00:05.270091 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.quota.driver [None req-18bd6063-fa56-43fe-8cef-9eab4b22ed00 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91829) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 17:00:05.271957 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-e540a9dc-7eaa-44e0-a83a-b482e90117fd admin admin] Notify callbacks [] for security_group, before_response {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:05.273155 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [None req-e540a9dc-7eaa-44e0-a83a-b482e90117fd admin admin] 10.222.0.62 "DELETE /v2.0/security-groups/f3f75110-fb4d-4658-8ac2-0c70ad692ce7 HTTP/1.1" status: 204 len: 168 time: 0.1722498 May 25 17:00:05.424139 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-18bd6063-fa56-43fe-8cef-9eab4b22ed00 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:05.440911 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-18bd6063-fa56-43fe-8cef-9eab4b22ed00 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-640836'] for security_group, after_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:05.488546 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-d69b55d2-9f47-4586-ba13-59eb768f5f87 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:00:05.499720 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [None req-18bd6063-fa56-43fe-8cef-9eab4b22ed00 admin admin] 10.222.0.62 "GET /v2.0/security-groups?tenant_id=b671a051583f427fb4de7379c58ef839&name=default HTTP/1.1" status: 200 len: 2979 time: 0.3862302 May 25 17:00:05.502969 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.wsgi [-] (91829) accepted ('10.222.0.62', 58078) {{(pid=91829) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:00:05.618590 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-18bd6063-fa56-43fe-8cef-9eab4b22ed00 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=f079729a-5dcd-4bf6-a89c-23b99e3dbd2f,revision_number=1']} {{(pid=91829) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:00:05.625504 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-0bf15bbb-392a-4801-aaa5-a311f217d559 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:05.641759 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-18bd6063-fa56-43fe-8cef-9eab4b22ed00 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.153s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:00:05.657585 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-0bf15bbb-392a-4801-aaa5-a311f217d559 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:05.747895 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-0bf15bbb-392a-4801-aaa5-a311f217d559 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-640836'] for security_group, after_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:05.753249 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:00:05.872498 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0bf15bbb-392a-4801-aaa5-a311f217d559 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=f079729a-5dcd-4bf6-a89c-23b99e3dbd2f,revision_number=None']} {{(pid=91829) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:00:05.874767 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-0bf15bbb-392a-4801-aaa5-a311f217d559 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.122s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:00:05.905635 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-0bf15bbb-392a-4801-aaa5-a311f217d559 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:05.907500 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [None req-0bf15bbb-392a-4801-aaa5-a311f217d559 admin admin] 10.222.0.62 "DELETE /v2.0/security-groups/f079729a-5dcd-4bf6-a89c-23b99e3dbd2f HTTP/1.1" status: 204 len: 168 time: 0.4034059 May 25 17:00:05.946314 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cdadea6a-53b2-400b-84e3-28ba6a236909 req-495e13dd-4526-4eba-8f1d-ed071d5ecca8 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:00:05.947855 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-cdadea6a-53b2-400b-84e3-28ba6a236909 req-495e13dd-4526-4eba-8f1d-ed071d5ecca8 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/ports?device_id=d87a1395-92e0-4727-a5ed-a8dcdee587c3 HTTP/1.1" status: 200 len: 945 time: 0.1620562 May 25 17:00:06.032121 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-cdadea6a-53b2-400b-84e3-28ba6a236909 req-25658190-9cc0-4b73-93ed-55c89aea4b16 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/security-groups?id=8ee5c4ed-9c60-4e39-9185-7e283704a7dc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0780909 May 25 17:00:06.366668 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.wsgi [-] (91829) accepted ('10.222.0.62', 58140) {{(pid=91829) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:00:06.383847 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-1553ffb3-c81a-460d-8cb7-d926a83ef7f8 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:06.400775 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.quota.driver [None req-1553ffb3-c81a-460d-8cb7-d926a83ef7f8 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91829) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 17:00:06.405276 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.quota.resource [None req-1553ffb3-c81a-460d-8cb7-d926a83ef7f8 admin admin] Usage tracker for resource:security_group_rule and tenant:639d33ff7ea94fb5adf9ce13e0d17314 is out of sync, need to count used quota {{(pid=91829) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 17:00:06.408945 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.quota.resource [None req-1553ffb3-c81a-460d-8cb7-d926a83ef7f8 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91829) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 17:00:06.415245 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.quota.driver [None req-1553ffb3-c81a-460d-8cb7-d926a83ef7f8 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91829) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 17:00:06.519900 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-1553ffb3-c81a-460d-8cb7-d926a83ef7f8 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:06.527803 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-1553ffb3-c81a-460d-8cb7-d926a83ef7f8 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-640836'] for security_group, after_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:06.543344 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:00:06.578697 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1553ffb3-c81a-460d-8cb7-d926a83ef7f8 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=98f97381-2d2e-4b0f-a18c-103d86671d68,revision_number=1']} {{(pid=91829) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:00:06.597061 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-1553ffb3-c81a-460d-8cb7-d926a83ef7f8 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.054s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:00:06.610334 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.wsgi [-] (91830) accepted ('10.222.0.62', 58154) {{(pid=91830) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:00:06.629196 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [None req-1553ffb3-c81a-460d-8cb7-d926a83ef7f8 admin admin] 10.222.0.62 "GET /v2.0/security-groups?tenant_id=639d33ff7ea94fb5adf9ce13e0d17314&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2614617 May 25 17:00:06.632090 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.wsgi [-] (91830) accepted ('10.222.0.62', 58162) {{(pid=91830) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:00:06.760418 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-4bb33017-1c2a-4edd-a45a-37a5eb8021e6 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:06.768019 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.v2.base [None req-6097c204-3721-40e2-b75e-41fc3bd03097 admin admin] Request body: {'network': {'name': 'tempest-TestShelveInstance-1452464711-network', 'tenant_id': 'a736cc60cc2143c4b6dea99321051da5'}} {{(pid=91830) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 17:00:06.780956 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.quota.driver [None req-6097c204-3721-40e2-b75e-41fc3bd03097 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91830) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 17:00:06.793347 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [None req-6097c204-3721-40e2-b75e-41fc3bd03097 admin admin] Usage tracker for resource:network and tenant:a736cc60cc2143c4b6dea99321051da5 is out of sync, need to count used quota {{(pid=91830) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 17:00:06.799576 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [None req-6097c204-3721-40e2-b75e-41fc3bd03097 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=91830) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 17:00:06.808147 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-4bb33017-1c2a-4edd-a45a-37a5eb8021e6 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:06.820807 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.quota.driver [None req-6097c204-3721-40e2-b75e-41fc3bd03097 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91830) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 17:00:06.841916 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-6097c204-3721-40e2-b75e-41fc3bd03097 admin admin] Made reservation on behalf of a736cc60cc2143c4b6dea99321051da5 for: {'network': 1} {{(pid=91830) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 25 17:00:06.844382 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-6097c204-3721-40e2-b75e-41fc3bd03097 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-3832077'] for network, before_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:06.868704 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-6097c204-3721-40e2-b75e-41fc3bd03097 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:06.892563 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.quota.driver [None req-6097c204-3721-40e2-b75e-41fc3bd03097 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91830) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 17:00:06.896965 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [None req-6097c204-3721-40e2-b75e-41fc3bd03097 admin admin] Usage tracker for resource:security_group_rule and tenant:a736cc60cc2143c4b6dea99321051da5 is out of sync, need to count used quota {{(pid=91830) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 17:00:06.900231 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [None req-6097c204-3721-40e2-b75e-41fc3bd03097 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91830) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 17:00:06.910370 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.quota.driver [None req-6097c204-3721-40e2-b75e-41fc3bd03097 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91830) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 17:00:06.932328 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-4bb33017-1c2a-4edd-a45a-37a5eb8021e6 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-640836'] for security_group, after_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:06.945260 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-a700e0e6-1a34-4560-85f5-e1ab5df12d6d admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:00:06.962450 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4bb33017-1c2a-4edd-a45a-37a5eb8021e6 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=98f97381-2d2e-4b0f-a18c-103d86671d68,revision_number=None']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:00:06.966279 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-4bb33017-1c2a-4edd-a45a-37a5eb8021e6 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.021s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:00:06.972181 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-4bb33017-1c2a-4edd-a45a-37a5eb8021e6 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:06.975850 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [None req-4bb33017-1c2a-4edd-a45a-37a5eb8021e6 admin admin] 10.222.0.62 "DELETE /v2.0/security-groups/98f97381-2d2e-4b0f-a18c-103d86671d68 HTTP/1.1" status: 204 len: 168 time: 0.3393104 May 25 17:00:07.073350 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-6097c204-3721-40e2-b75e-41fc3bd03097 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:07.079409 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-6097c204-3721-40e2-b75e-41fc3bd03097 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-640836'] for security_group, after_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:07.085425 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-f1611ff9-1774-4bea-b162-763e8e620ddb admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:00:07.119677 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-6097c204-3721-40e2-b75e-41fc3bd03097 admin admin] vlan segment allocate from pool success with {'vlan_id': 659, 'physical_network': 'physnet1'} {{(pid=91830) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 25 17:00:07.142190 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6097c204-3721-40e2-b75e-41fc3bd03097 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=da846e59-0f03-40bf-a502-658c82363359,revision_number=1']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:00:07.151545 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-6097c204-3721-40e2-b75e-41fc3bd03097 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.065s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:00:07.153545 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-6097c204-3721-40e2-b75e-41fc3bd03097 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3809789'] for segment, precommit_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:07.154232 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.db.segments_db [None req-6097c204-3721-40e2-b75e-41fc3bd03097 admin admin] Added segment 55bc70ae-213c-42ca-b035-b4a902044007 of type vlan for network 613457eb-6f6d-4604-8f6c-f2d318ff9bc5 May 25 17:00:07.211905 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-6097c204-3721-40e2-b75e-41fc3bd03097 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8757892541013'] for network, precommit_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:07.246934 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-6097c204-3721-40e2-b75e-41fc3bd03097 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-640806', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-551400'] for network, after_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:07.248540 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6097c204-3721-40e2-b75e-41fc3bd03097 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91830) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:00:07.249364 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-6097c204-3721-40e2-b75e-41fc3bd03097 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-551373'] for network, before_response {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:07.256245 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-0c33b2c5-6ae5-4569-a433-e17f5696809c admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:00:07.293819 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1d1c71a1-c2ec-487c-afdf-de5fcb433bf9 req-b8d257d7-7731-41a7-bf8a-66a9a5abd0c4 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:00:07.302636 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-1d1c71a1-c2ec-487c-afdf-de5fcb433bf9 req-b8d257d7-7731-41a7-bf8a-66a9a5abd0c4 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/ports?device_id=d87a1395-92e0-4727-a5ed-a8dcdee587c3 HTTP/1.1" status: 200 len: 945 time: 0.1335421 May 25 17:00:07.357343 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-1d1c71a1-c2ec-487c-afdf-de5fcb433bf9 req-f0f7888a-a46b-4f4c-83a8-4a7e4610fc3b tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/security-groups?id=8ee5c4ed-9c60-4e39-9185-7e283704a7dc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0534737 May 25 17:00:07.373328 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.wsgi [-] (91829) accepted ('10.222.0.62', 58202) {{(pid=91829) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:00:07.393793 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6097c204-3721-40e2-b75e-41fc3bd03097 admin admin] Pushing event updated for resources: {'Network': ['ID=613457eb-6f6d-4604-8f6c-f2d318ff9bc5,revision_number=1']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:00:07.399117 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [None req-6097c204-3721-40e2-b75e-41fc3bd03097 admin admin] 10.222.0.62 "POST /v2.0/networks HTTP/1.1" status: 201 len: 882 time: 0.7875206 May 25 17:00:07.400311 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-6097c204-3721-40e2-b75e-41fc3bd03097 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.144s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:00:07.402021 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.wsgi [-] (91829) accepted ('10.222.0.62', 58208) {{(pid=91829) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:00:07.405376 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.rpc [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Network 613457eb-6f6d-4604-8f6c-f2d318ff9bc5 details requested by agent ovs-agent-dv-cinder-790492-4-iscsi with host dv-cinder-790492-4-iscsi {{(pid=91831) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 25 17:00:07.410765 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.v2.base [None req-063b2335-c316-4bb3-8cea-0aec64b4de51 admin admin] Request body: {'subnet': {'network_id': '613457eb-6f6d-4604-8f6c-f2d318ff9bc5', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestShelveInstance-1452464711-subnet', 'tenant_id': 'a736cc60cc2143c4b6dea99321051da5', 'ip_version': 4}} {{(pid=91829) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 17:00:07.416698 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.quota.driver [None req-063b2335-c316-4bb3-8cea-0aec64b4de51 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91829) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 17:00:07.422554 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.quota.resource [None req-063b2335-c316-4bb3-8cea-0aec64b4de51 admin admin] Usage tracker for resource:subnet and tenant:a736cc60cc2143c4b6dea99321051da5 is out of sync, need to count used quota {{(pid=91829) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 17:00:07.426139 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.quota.resource [None req-063b2335-c316-4bb3-8cea-0aec64b4de51 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=91829) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 17:00:07.433090 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.quota.driver [None req-063b2335-c316-4bb3-8cea-0aec64b4de51 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91829) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 17:00:07.449560 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-063b2335-c316-4bb3-8cea-0aec64b4de51 admin admin] Made reservation on behalf of a736cc60cc2143c4b6dea99321051da5 for: {'subnet': 1} {{(pid=91829) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 25 17:00:07.452307 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-063b2335-c316-4bb3-8cea-0aec64b4de51 admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-28266129'] for subnet, before_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:07.552253 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.wsgi [-] (91830) accepted ('10.222.0.62', 58214) {{(pid=91830) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:00:07.572028 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-8bb5f453-1db4-45eb-a03f-b62d67afa80f admin admin] Notify callbacks [] for security_group, before_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:07.579943 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-7c925fe4-0161-44c2-8d1b-f24cf920aca9 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:07.588309 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.quota.driver [None req-8bb5f453-1db4-45eb-a03f-b62d67afa80f admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91830) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 17:00:07.592162 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [None req-8bb5f453-1db4-45eb-a03f-b62d67afa80f admin admin] Usage tracker for resource:security_group_rule and tenant:19f0d5e888a34aeaa0250fd695c04774 is out of sync, need to count used quota {{(pid=91830) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 17:00:07.595523 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [None req-8bb5f453-1db4-45eb-a03f-b62d67afa80f admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91830) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 17:00:07.601801 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.quota.driver [None req-8bb5f453-1db4-45eb-a03f-b62d67afa80f admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91830) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 17:00:07.603641 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.quota.driver [None req-7c925fe4-0161-44c2-8d1b-f24cf920aca9 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91829) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 17:00:07.610711 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.quota.resource [None req-7c925fe4-0161-44c2-8d1b-f24cf920aca9 admin admin] Usage tracker for resource:security_group_rule and tenant:2ce61476a6c14d309256c1a8380b0764 is out of sync, need to count used quota {{(pid=91829) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 17:00:07.614249 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.quota.resource [None req-7c925fe4-0161-44c2-8d1b-f24cf920aca9 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91829) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 17:00:07.622495 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.quota.driver [None req-7c925fe4-0161-44c2-8d1b-f24cf920aca9 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91829) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 17:00:07.698962 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-8bb5f453-1db4-45eb-a03f-b62d67afa80f admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:07.704504 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-8bb5f453-1db4-45eb-a03f-b62d67afa80f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-640836'] for security_group, after_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:07.714116 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-621816b9-8285-48a3-ad95-6222f0f4f806 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:00:07.751736 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.rpc [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Device a460da33-52a2-41d5-bcf5-1baa12e65f8f no longer exists at agent hyperv_hv-cinder-79049 {{(pid=91831) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 25 17:00:07.765958 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [None req-8bb5f453-1db4-45eb-a03f-b62d67afa80f admin admin] 10.222.0.62 "GET /v2.0/security-groups?tenant_id=19f0d5e888a34aeaa0250fd695c04774&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2084668 May 25 17:00:07.773529 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.wsgi [-] (91830) accepted ('10.222.0.62', 58222) {{(pid=91830) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:00:07.779050 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8bb5f453-1db4-45eb-a03f-b62d67afa80f admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=be86a297-0524-4c9c-aadb-60a1e62eb0f9,revision_number=1']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:00:07.806912 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.plugin [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] No Port match for: a460da33-52a2-41d5-bcf5-1baa12e65f8f {{(pid=91831) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}} May 25 17:00:07.807262 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.rpc [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Device a460da33-52a2-41d5-bcf5-1baa12e65f8f not bound to the agent host hv-cinder-79049 {{(pid=91831) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 25 17:00:07.808224 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-8bb5f453-1db4-45eb-a03f-b62d67afa80f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.094s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:00:07.827506 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-7c925fe4-0161-44c2-8d1b-f24cf920aca9 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:07.879521 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.wsgi [-] (91830) accepted ('10.222.0.62', 58232) {{(pid=91830) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:00:07.884818 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-7c925fe4-0161-44c2-8d1b-f24cf920aca9 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-640836'] for security_group, after_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:07.894083 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-fa3059d3-8e32-4b0a-99fc-a58e992f1fba admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:00:07.914380 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-607d4592-b6ac-46f3-9cc3-a7f7b1d185fc admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:07.973767 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-607d4592-b6ac-46f3-9cc3-a7f7b1d185fc admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:08.000132 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.db_base_plugin_v2 [None req-54c25aaf-01e5-45d4-9c8b-4e8e4bec5c49 admin admin] Deleting subnet 34034d6a-51f1-4e15-aa5b-0f79437d26f5 {{(pid=91830) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}} May 25 17:00:08.011140 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [None req-7c925fe4-0161-44c2-8d1b-f24cf920aca9 admin admin] 10.222.0.62 "GET /v2.0/security-groups?tenant_id=2ce61476a6c14d309256c1a8380b0764&name=default HTTP/1.1" status: 200 len: 2979 time: 0.6366181 May 25 17:00:08.012179 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-54c25aaf-01e5-45d4-9c8b-4e8e4bec5c49 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:08.014105 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.wsgi [-] (91829) accepted ('10.222.0.62', 58238) {{(pid=91829) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:00:08.015042 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7c925fe4-0161-44c2-8d1b-f24cf920aca9 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=2780ea41-3c63-427b-b6e9-e0669d77e46e,revision_number=1']} {{(pid=91829) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:00:08.018845 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-7c925fe4-0161-44c2-8d1b-f24cf920aca9 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.125s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:00:08.086946 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-54c25aaf-01e5-45d4-9c8b-4e8e4bec5c49 admin admin] Notify callbacks [] for subnet, precommit_delete_associations {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:08.096002 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-54c25aaf-01e5-45d4-9c8b-4e8e4bec5c49 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3856586'] for subnet, precommit_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:08.121138 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-0b42170a-8b4a-4914-90bf-183ba4a7a921 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:08.166538 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-607d4592-b6ac-46f3-9cc3-a7f7b1d185fc admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-640836'] for security_group, after_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:08.183715 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-e60f01a0-76d8-4093-9fa4-ca6cce199868 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:00:08.202661 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-0b42170a-8b4a-4914-90bf-183ba4a7a921 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:08.232484 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-063b2335-c316-4bb3-8cea-0aec64b4de51 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55886', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-27333672', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-28266119'] for subnet, after_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:08.246097 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:00:08.249479 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-607d4592-b6ac-46f3-9cc3-a7f7b1d185fc admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=be86a297-0524-4c9c-aadb-60a1e62eb0f9,revision_number=None']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:00:08.252084 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-607d4592-b6ac-46f3-9cc3-a7f7b1d185fc admin admin] Notify callbacks [] for security_group, before_response {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:08.253014 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [None req-607d4592-b6ac-46f3-9cc3-a7f7b1d185fc admin admin] 10.222.0.62 "DELETE /v2.0/security-groups/be86a297-0524-4c9c-aadb-60a1e62eb0f9 HTTP/1.1" status: 204 len: 168 time: 0.4784062 May 25 17:00:08.254088 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-607d4592-b6ac-46f3-9cc3-a7f7b1d185fc admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.078s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:00:08.339596 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-063b2335-c316-4bb3-8cea-0aec64b4de51 admin admin] Checking segment: {'id': '55bc70ae-213c-42ca-b035-b4a902044007', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 659, 'network_id': '613457eb-6f6d-4604-8f6c-f2d318ff9bc5'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91829) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 25 17:00:08.339955 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-063b2335-c316-4bb3-8cea-0aec64b4de51 admin admin] Network hostable DHCP agents. Network: 613457eb-6f6d-4604-8f6c-f2d318ff9bc5, hostable agents: ['8d7401c6-8951-4f2b-ace4-208761782bfc'], hosted agents: [] {{(pid=91829) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 25 17:00:08.344936 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-063b2335-c316-4bb3-8cea-0aec64b4de51 admin admin] Pushing event updated for resources: {'Subnet': ['ID=3fc60650-484d-4574-bb67-0e4931bc9854,revision_number=0']} {{(pid=91829) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:00:08.347603 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-063b2335-c316-4bb3-8cea-0aec64b4de51 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.103s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:00:08.355632 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-0b42170a-8b4a-4914-90bf-183ba4a7a921 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-640836'] for security_group, after_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:08.360125 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-0bf15bbb-392a-4801-aaa5-a311f217d559 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:00:08.371798 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0b42170a-8b4a-4914-90bf-183ba4a7a921 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=2780ea41-3c63-427b-b6e9-e0669d77e46e,revision_number=None']} {{(pid=91829) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:00:08.375970 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-0b42170a-8b4a-4914-90bf-183ba4a7a921 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.016s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:00:08.393705 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-063b2335-c316-4bb3-8cea-0aec64b4de51 admin admin] Network 613457eb-6f6d-4604-8f6c-f2d318ff9bc5 is scheduled to be hosted by DHCP agent 8d7401c6-8951-4f2b-ace4-208761782bfc with binding_index 1 {{(pid=91829) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 25 17:00:08.403881 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-0b42170a-8b4a-4914-90bf-183ba4a7a921 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:08.408867 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [None req-0b42170a-8b4a-4914-90bf-183ba4a7a921 admin admin] 10.222.0.62 "DELETE /v2.0/security-groups/2780ea41-3c63-427b-b6e9-e0669d77e46e HTTP/1.1" status: 204 len: 168 time: 0.3853219 May 25 17:00:08.408867 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.scheduler.base_scheduler [None req-063b2335-c316-4bb3-8cea-0aec64b4de51 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-790492-4-iscsi, 613457eb-6f6d-4604-8f6c-f2d318ff9bc5) {{(pid=91829) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 17:00:08.419104 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4073d7f8-28ea-48ac-a382-cf70c87859d7 None None] Network 613457eb-6f6d-4604-8f6c-f2d318ff9bc5 requested from dv-cinder-790492-4-iscsi {{(pid=91831) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} May 25 17:00:08.426999 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-063b2335-c316-4bb3-8cea-0aec64b4de51 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:00:08.428017 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-063b2335-c316-4bb3-8cea-0aec64b4de51 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-551373'] for subnet, before_response {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:08.432384 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-54c25aaf-01e5-45d4-9c8b-4e8e4bec5c49 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3857535', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55886', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411'] for subnet, after_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:08.439929 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-b914d378-e633-47a1-9ae1-cf2386d4e4bd admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:00:08.449674 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [None req-063b2335-c316-4bb3-8cea-0aec64b4de51 admin admin] 10.222.0.62 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 845 time: 1.0461001 May 25 17:00:08.452483 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.wsgi [-] (91829) accepted ('10.222.0.62', 58254) {{(pid=91829) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:00:08.462217 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.v2.base [None req-854189aa-e1a5-4058-82ea-9de5e24d9054 admin admin] Request body: {'router': {'name': 'tempest-TestShelveInstance-1452464711-router', 'tenant_id': 'a736cc60cc2143c4b6dea99321051da5', 'external_gateway_info': {'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74'}}} {{(pid=91829) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 17:00:08.475630 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.quota.driver [None req-854189aa-e1a5-4058-82ea-9de5e24d9054 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91829) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 17:00:08.476537 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-54c25aaf-01e5-45d4-9c8b-4e8e4bec5c49 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=34034d6a-51f1-4e15-aa5b-0f79437d26f5,revision_number=None']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:00:08.478994 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-54c25aaf-01e5-45d4-9c8b-4e8e4bec5c49 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.039s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:00:08.482017 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-54c25aaf-01e5-45d4-9c8b-4e8e4bec5c49 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-551373'] for subnet, before_response {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:08.491538 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.quota.resource [None req-854189aa-e1a5-4058-82ea-9de5e24d9054 admin admin] Usage tracker for resource:router and tenant:a736cc60cc2143c4b6dea99321051da5 is out of sync, need to count used quota {{(pid=91829) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 17:00:08.492156 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [None req-54c25aaf-01e5-45d4-9c8b-4e8e4bec5c49 admin admin] 10.222.0.62 "DELETE /v2.0/subnets/34034d6a-51f1-4e15-aa5b-0f79437d26f5 HTTP/1.1" status: 204 len: 168 time: 0.6114120 May 25 17:00:08.492933 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.wsgi [-] (91830) accepted ('10.222.0.62', 58258) {{(pid=91830) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:00:08.508186 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.quota.resource [None req-854189aa-e1a5-4058-82ea-9de5e24d9054 admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=91829) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 17:00:08.519127 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.quota.driver [None req-854189aa-e1a5-4058-82ea-9de5e24d9054 admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91829) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 17:00:08.542336 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-854189aa-e1a5-4058-82ea-9de5e24d9054 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-684888', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-31042'] for router, before_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:08.544689 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-854189aa-e1a5-4058-82ea-9de5e24d9054 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-684376', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-683143', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-647018', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-31049'] for router, precommit_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:08.671263 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-854189aa-e1a5-4058-82ea-9de5e24d9054 admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:08.798469 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-9b5e3892-80f0-40db-b382-6554e70a1ecc admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3867326'] for network, before_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:08.811539 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-075457c9-1261-4590-9479-dd745cf5afe1 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp6d7ebc81-b6b5-52ec-b8f5-10a9de34bf46-613457eb-6f6d-4604-8f6c-f2d318ff9bc5', 'network_id': '613457eb-6f6d-4604-8f6c-f2d318ff9bc5', 'tenant_id': 'a736cc60cc2143c4b6dea99321051da5', 'fixed_ips': [{'subnet_id': '3fc60650-484d-4574-bb67-0e4931bc9854'}]}} from dv-cinder-790492-4-iscsi. {{(pid=91831) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} May 25 17:00:08.813100 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-075457c9-1261-4590-9479-dd745cf5afe1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3832070'] for port, before_create {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:08.988719 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a7ab14cd-3d56-402c-add5-75bdba0b8eea req-4db72acf-fcdf-4066-b318-4445cc91b2ad tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:00:08.996856 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-a7ab14cd-3d56-402c-add5-75bdba0b8eea req-4db72acf-fcdf-4066-b318-4445cc91b2ad tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/ports?device_id=d87a1395-92e0-4727-a5ed-a8dcdee587c3 HTTP/1.1" status: 200 len: 945 time: 0.4248104 May 25 17:00:09.014590 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-9b5e3892-80f0-40db-b382-6554e70a1ecc admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3858245', 'neutron.services.segments.db._delete_segments_for_network-8757892982492'] for network, precommit_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:09.033578 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.wsgi [-] (91830) accepted ('10.222.0.62', 58282) {{(pid=91830) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:00:09.051430 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.db_base_plugin_common [None req-075457c9-1261-4590-9479-dd745cf5afe1 None None] Allocated IP 172.20.0.2 (613457eb-6f6d-4604-8f6c-f2d318ff9bc5/3fc60650-484d-4574-bb67-0e4931bc9854/282005bd-4eac-4a0e-8b78-006226f21c55) {{(pid=91831) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 25 17:00:09.057578 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-a7ab14cd-3d56-402c-add5-75bdba0b8eea req-bfb414e4-98c9-4ee3-96e0-8c0e66b3ba57 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/security-groups?id=8ee5c4ed-9c60-4e39-9185-7e283704a7dc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0549026 May 25 17:00:09.065086 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-9b5e3892-80f0-40db-b382-6554e70a1ecc admin admin] Subscribe: > segment before_delete 55550000 {{(pid=91830) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 17:00:09.074487 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-9b5e3892-80f0-40db-b382-6554e70a1ecc admin admin] Subscribe: > subnet precommit_delete_associations 55550000 {{(pid=91830) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 17:00:09.075380 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-9b5e3892-80f0-40db-b382-6554e70a1ecc admin admin] Subscribe: > segment_host_mapping after_create 55550000 {{(pid=91830) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 17:00:09.075741 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-9b5e3892-80f0-40db-b382-6554e70a1ecc admin admin] Subscribe: > port after_create 55550000 {{(pid=91830) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 17:00:09.076070 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-9b5e3892-80f0-40db-b382-6554e70a1ecc admin admin] Subscribe: > port after_delete 55550000 {{(pid=91830) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 17:00:09.076422 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-9b5e3892-80f0-40db-b382-6554e70a1ecc admin admin] Subscribe: > port after_update 55550000 {{(pid=91830) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 17:00:09.076919 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-9b5e3892-80f0-40db-b382-6554e70a1ecc admin admin] Subscribe: > segment after_delete 55550000 {{(pid=91830) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 17:00:09.077245 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-9b5e3892-80f0-40db-b382-6554e70a1ecc admin admin] Subscribe: > subnet after_create 55550000 {{(pid=91830) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 17:00:09.077562 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-9b5e3892-80f0-40db-b382-6554e70a1ecc admin admin] Subscribe: > subnet after_delete 55550000 {{(pid=91830) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 17:00:09.077936 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-9b5e3892-80f0-40db-b382-6554e70a1ecc admin admin] Subscribe: > subnet after_update 55550000 {{(pid=91830) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 17:00:09.209160 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-854189aa-e1a5-4058-82ea-9de5e24d9054 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-683170', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-684906', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-31039'] for router, precommit_update {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:09.275276 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-9b5e3892-80f0-40db-b382-6554e70a1ecc admin admin] Subscribe: > subnet after_create 55550000 {{(pid=91830) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 17:00:09.275719 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-9b5e3892-80f0-40db-b382-6554e70a1ecc admin admin] Subscribe: > subnet after_delete 55550000 {{(pid=91830) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 17:00:09.276124 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-9b5e3892-80f0-40db-b382-6554e70a1ecc admin admin] Subscribe: > subnet before_create 55550000 {{(pid=91830) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 17:00:09.276781 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-9b5e3892-80f0-40db-b382-6554e70a1ecc admin admin] Subscribe: > subnet before_update 55550000 {{(pid=91830) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} May 25 17:00:09.277691 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.services.segments.db [None req-9b5e3892-80f0-40db-b382-6554e70a1ecc admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['ca95b136-0269-430f-b450-69ee5473ae7d']}} {{(pid=91830) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 17:00:09.303778 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-8a2f536a-757e-4002-a420-a17930e3b790 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:09.310821 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-075457c9-1261-4590-9479-dd745cf5afe1 None None] Notify callbacks [] for port, precommit_create {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:09.318904 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.services.segments.db [None req-9b5e3892-80f0-40db-b382-6554e70a1ecc admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '8721f8e7-e59f-46c5-9d87-1b6cc08601ef') {'for_net_delete': True} {{(pid=91830) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 17:00:09.319212 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.services.segments.db [None req-9b5e3892-80f0-40db-b382-6554e70a1ecc admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '8721f8e7-e59f-46c5-9d87-1b6cc08601ef') {} {{(pid=91830) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 17:00:09.329062 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.provisioning_blocks [None req-075457c9-1261-4590-9479-dd745cf5afe1 None None] Transition to ACTIVE for port object 282005bd-4eac-4a0e-8b78-006226f21c55 will not be triggered until provisioned by entity L2. {{(pid=91831) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 25 17:00:09.337731 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-9b5e3892-80f0-40db-b382-6554e70a1ecc admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8757892991389', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-28085034'] for segment, before_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:09.348880 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.quota.driver [None req-8a2f536a-757e-4002-a420-a17930e3b790 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91830) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 17:00:09.351275 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.provisioning_blocks [None req-075457c9-1261-4590-9479-dd745cf5afe1 None None] Transition to ACTIVE for port object 282005bd-4eac-4a0e-8b78-006226f21c55 will not be triggered until provisioned by entity DHCP. {{(pid=91831) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 25 17:00:09.357449 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [None req-8a2f536a-757e-4002-a420-a17930e3b790 admin admin] Usage tracker for resource:security_group_rule and tenant:f8a1251096204ae094f8901d46f61c19 is out of sync, need to count used quota {{(pid=91830) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 17:00:09.360442 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-075457c9-1261-4590-9479-dd745cf5afe1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8757892520915'] for port, after_create {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:09.362867 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [None req-8a2f536a-757e-4002-a420-a17930e3b790 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91830) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 17:00:09.364841 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-9b5e3892-80f0-40db-b382-6554e70a1ecc admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3809789'] for segment, precommit_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:09.370116 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:00:09.372728 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.quota.driver [None req-8a2f536a-757e-4002-a420-a17930e3b790 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91830) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 17:00:09.379612 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-9b5e3892-80f0-40db-b382-6554e70a1ecc admin admin] Releasing vlan 672 on physical network physnet1 to pool {{(pid=91830) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 25 17:00:09.380077 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-9b5e3892-80f0-40db-b382-6554e70a1ecc admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3809789', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-27483102'] for segment, after_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:09.401761 dv-cinder-790492-4-iscsi neutron-server[91830]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 25 17:00:09.401761 dv-cinder-790492-4-iscsi neutron-server[91830]: from cryptography.utils import int_from_bytes May 25 17:00:09.401761 dv-cinder-790492-4-iscsi neutron-server[91830]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 25 17:00:09.401761 dv-cinder-790492-4-iscsi neutron-server[91830]: from cryptography.utils import int_from_bytes May 25 17:00:09.401761 dv-cinder-790492-4-iscsi neutron-server[91830]: Traceback (most recent call last): May 25 17:00:09.401761 dv-cinder-790492-4-iscsi neutron-server[91830]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 25 17:00:09.401761 dv-cinder-790492-4-iscsi neutron-server[91830]: timer() May 25 17:00:09.401761 dv-cinder-790492-4-iscsi neutron-server[91830]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 25 17:00:09.401761 dv-cinder-790492-4-iscsi neutron-server[91830]: cb(*args, **kw) May 25 17:00:09.401761 dv-cinder-790492-4-iscsi neutron-server[91830]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper May 25 17:00:09.401761 dv-cinder-790492-4-iscsi neutron-server[91830]: return func(*args, **kwargs) May 25 17:00:09.401761 dv-cinder-790492-4-iscsi neutron-server[91830]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 25 17:00:09.401761 dv-cinder-790492-4-iscsi neutron-server[91830]: self._notify() May 25 17:00:09.401761 dv-cinder-790492-4-iscsi neutron-server[91830]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 25 17:00:09.401761 dv-cinder-790492-4-iscsi neutron-server[91830]: self.callback(batched_events) May 25 17:00:09.401761 dv-cinder-790492-4-iscsi neutron-server[91830]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 25 17:00:09.401761 dv-cinder-790492-4-iscsi neutron-server[91830]: event.method(event) May 25 17:00:09.401761 dv-cinder-790492-4-iscsi neutron-server[91830]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 25 17:00:09.401761 dv-cinder-790492-4-iscsi neutron-server[91830]: aggregate_id = self._get_aggregate_id(event.segment_id) May 25 17:00:09.401761 dv-cinder-790492-4-iscsi neutron-server[91830]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 25 17:00:09.401761 dv-cinder-790492-4-iscsi neutron-server[91830]: aggregate_uuid = self.p_client.list_aggregates( May 25 17:00:09.401761 dv-cinder-790492-4-iscsi neutron-server[91830]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 25 17:00:09.401761 dv-cinder-790492-4-iscsi neutron-server[91830]: return f(self, *a, **k) May 25 17:00:09.401761 dv-cinder-790492-4-iscsi neutron-server[91830]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 25 17:00:09.401761 dv-cinder-790492-4-iscsi neutron-server[91830]: return self._get(url).json() May 25 17:00:09.401761 dv-cinder-790492-4-iscsi neutron-server[91830]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 25 17:00:09.401761 dv-cinder-790492-4-iscsi neutron-server[91830]: return self._client.get(url, endpoint_filter=self._ks_filter, May 25 17:00:09.401761 dv-cinder-790492-4-iscsi neutron-server[91830]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 25 17:00:09.401761 dv-cinder-790492-4-iscsi neutron-server[91830]: return self.request(url, 'GET', **kwargs) May 25 17:00:09.401761 dv-cinder-790492-4-iscsi neutron-server[91830]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 25 17:00:09.401761 dv-cinder-790492-4-iscsi neutron-server[91830]: base_url = self.get_endpoint(auth, allow=allow, May 25 17:00:09.401761 dv-cinder-790492-4-iscsi neutron-server[91830]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 25 17:00:09.401761 dv-cinder-790492-4-iscsi neutron-server[91830]: auth = self._auth_required(auth, 'determine endpoint URL') May 25 17:00:09.401761 dv-cinder-790492-4-iscsi neutron-server[91830]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 25 17:00:09.401761 dv-cinder-790492-4-iscsi neutron-server[91830]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 25 17:00:09.401761 dv-cinder-790492-4-iscsi neutron-server[91830]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 25 17:00:09.453025 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-075457c9-1261-4590-9479-dd745cf5afe1 None None] Network 613457eb-6f6d-4604-8f6c-f2d318ff9bc5 is already hosted by enough agents. {{(pid=91831) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 25 17:00:09.457043 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.scheduler.base_scheduler [None req-075457c9-1261-4590-9479-dd745cf5afe1 None None] Resources bound (agent type, host, resource id): {{(pid=91831) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 17:00:09.464126 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.l3_dvrscheduler_db [None req-075457c9-1261-4590-9479-dd745cf5afe1 None None] Received port after_create {{(pid=91831) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 25 17:00:09.480907 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-075457c9-1261-4590-9479-dd745cf5afe1 None None] Pushing event updated for resources: {'Port': ['ID=282005bd-4eac-4a0e-8b78-006226f21c55,revision_number=1']} {{(pid=91831) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:00:09.487088 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [None req-075457c9-1261-4590-9479-dd745cf5afe1 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.117s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:00:09.518422 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-9b5e3892-80f0-40db-b382-6554e70a1ecc admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3858252', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-640806', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-551400', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-683051'] for network, after_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:09.535437 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:00:09.567122 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-9b5e3892-80f0-40db-b382-6554e70a1ecc admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-551373'] for network, before_response {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:09.581316 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9b5e3892-80f0-40db-b382-6554e70a1ecc admin admin] Pushing event deleted for resources: {'Network': ['ID=ca95b136-0269-430f-b450-69ee5473ae7d,revision_number=None']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:00:09.585600 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-9b5e3892-80f0-40db-b382-6554e70a1ecc admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.050s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:00:09.585782 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.managers [None req-075457c9-1261-4590-9479-dd745cf5afe1 None None] Attempting to bind port 282005bd-4eac-4a0e-8b78-006226f21c55 on host dv-cinder-790492-4-iscsi for vnic_type normal with profile {{(pid=91831) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 25 17:00:09.586211 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.managers [None req-075457c9-1261-4590-9479-dd745cf5afe1 None None] Attempting to bind port 282005bd-4eac-4a0e-8b78-006226f21c55 by drivers openvswitch,hyperv on host dv-cinder-790492-4-iscsi at level 0 using segments [{'id': '55bc70ae-213c-42ca-b035-b4a902044007', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 659, 'network_id': '613457eb-6f6d-4604-8f6c-f2d318ff9bc5'}] {{(pid=91831) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 25 17:00:09.586681 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-075457c9-1261-4590-9479-dd745cf5afe1 None None] Attempting to bind port 282005bd-4eac-4a0e-8b78-006226f21c55 on network 613457eb-6f6d-4604-8f6c-f2d318ff9bc5 {{(pid=91831) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 25 17:00:09.591364 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-854189aa-e1a5-4058-82ea-9de5e24d9054 admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:09.592561 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-075457c9-1261-4590-9479-dd745cf5afe1 None None] Checking agent: {'id': 'fc8251e1-071c-49f7-bc10-1337f1d37d1b', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-790492-4-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 25, 16, 50, 28), 'started_at': datetime.datetime(2021, 5, 25, 16, 50, 58), 'heartbeat_timestamp': datetime.datetime(2021, 5, 25, 16, 59, 58), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-790492-4-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=91831) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 25 17:00:09.592946 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-075457c9-1261-4590-9479-dd745cf5afe1 None None] Checking segment: {'id': '55bc70ae-213c-42ca-b035-b4a902044007', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 659, 'network_id': '613457eb-6f6d-4604-8f6c-f2d318ff9bc5'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91831) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 25 17:00:09.593356 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-075457c9-1261-4590-9479-dd745cf5afe1 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:09.594574 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-075457c9-1261-4590-9479-dd745cf5afe1 None None] Bound using segment: {'id': '55bc70ae-213c-42ca-b035-b4a902044007', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 659, 'network_id': '613457eb-6f6d-4604-8f6c-f2d318ff9bc5'} {{(pid=91831) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 25 17:00:09.594886 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.managers [None req-075457c9-1261-4590-9479-dd745cf5afe1 None None] Bound port: 282005bd-4eac-4a0e-8b78-006226f21c55, host: dv-cinder-790492-4-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '55bc70ae-213c-42ca-b035-b4a902044007', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 659, 'network_id': '613457eb-6f6d-4604-8f6c-f2d318ff9bc5'}}] {{(pid=91831) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 25 17:00:09.595267 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-075457c9-1261-4590-9479-dd745cf5afe1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3832070'] for port, before_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:09.639274 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [None req-9b5e3892-80f0-40db-b382-6554e70a1ecc admin admin] 10.222.0.62 "DELETE /v2.0/networks/ca95b136-0269-430f-b450-69ee5473ae7d HTTP/1.1" status: 204 len: 168 time: 1.1449225 May 25 17:00:09.649873 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-854189aa-e1a5-4058-82ea-9de5e24d9054 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3832070'] for port, before_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:09.676485 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-8a2f536a-757e-4002-a420-a17930e3b790 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:09.682611 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-8a2f536a-757e-4002-a420-a17930e3b790 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-640836'] for security_group, after_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:09.738970 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.db [None req-075457c9-1261-4590-9479-dd745cf5afe1 None None] For port 282005bd-4eac-4a0e-8b78-006226f21c55, host dv-cinder-790492-4-iscsi, cleared binding levels {{(pid=91831) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 25 17:00:09.739182 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-8bb5f453-1db4-45eb-a03f-b62d67afa80f admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:00:09.743855 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.db [None req-075457c9-1261-4590-9479-dd745cf5afe1 None None] For port 282005bd-4eac-4a0e-8b78-006226f21c55, host dv-cinder-790492-4-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-790492-4-iscsi',level=0,port_id=282005bd-4eac-4a0e-8b78-006226f21c55,segment=NetworkSegment(55bc70ae-213c-42ca-b035-b4a902044007),segment_id=55bc70ae-213c-42ca-b035-b4a902044007)] {{(pid=91831) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 25 17:00:09.748668 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-075457c9-1261-4590-9479-dd745cf5afe1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8757892955028', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8757892520933', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8757892521750'] for port, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:09.756646 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [None req-8a2f536a-757e-4002-a420-a17930e3b790 admin admin] 10.222.0.62 "GET /v2.0/security-groups?tenant_id=f8a1251096204ae094f8901d46f61c19&name=default HTTP/1.1" status: 200 len: 2979 time: 0.7219996 May 25 17:00:09.763342 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [None req-22acd9b5-6f41-42bb-ab6b-eb244f9b39da None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:00:09.764098 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.wsgi [-] (91830) accepted ('10.222.0.62', 58302) {{(pid=91830) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:00:09.839416 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a2f536a-757e-4002-a420-a17930e3b790 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=f3c0f076-d6c3-484e-8525-9769d568d038,revision_number=1']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:00:09.843999 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-8a2f536a-757e-4002-a420-a17930e3b790 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.105s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:00:09.862813 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-1240c444-afc7-4ead-aa90-36e375b99d36 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:09.863922 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.db_base_plugin_common [None req-854189aa-e1a5-4058-82ea-9de5e24d9054 admin admin] Allocated IP 172.27.2.75 (4364b6ab-4117-4a92-baeb-f5ee2f45bf74/b947e790-d731-4b63-afc4-4aa112afe0f6/703dfe81-5ded-48db-9e96-d09ac4afce0f) {{(pid=91829) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 25 17:00:09.871242 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-075457c9-1261-4590-9479-dd745cf5afe1 None None] Pushing event updated for resources: {'Port': ['ID=282005bd-4eac-4a0e-8b78-006226f21c55,revision_number=2']} {{(pid=91831) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:00:09.875695 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [None req-075457c9-1261-4590-9479-dd745cf5afe1 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.112s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:00:09.920241 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-1240c444-afc7-4ead-aa90-36e375b99d36 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:09.966491 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.wsgi [-] (91830) accepted ('10.222.0.62', 58308) {{(pid=91830) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:00:10.063270 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [None req-3d9a6fa5-a27c-4fad-b930-cfd775bb064c admin admin] 10.222.0.62 "GET /v2.0/security-groups?tenant_id=00ab1bb5f5df49f08ef4b15635754b71&name=default HTTP/1.1" status: 200 len: 2975 time: 0.0931122 May 25 17:00:10.064069 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.wsgi [-] (91829) accepted ('10.222.0.62', 58312) {{(pid=91829) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:00:10.065297 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-1240c444-afc7-4ead-aa90-36e375b99d36 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-640836'] for security_group, after_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:10.069272 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-e540a9dc-7eaa-44e0-a83a-b482e90117fd admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:00:10.084720 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1240c444-afc7-4ead-aa90-36e375b99d36 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=f3c0f076-d6c3-484e-8525-9769d568d038,revision_number=None']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:00:10.088185 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-1240c444-afc7-4ead-aa90-36e375b99d36 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.019s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:00:10.090726 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-1240c444-afc7-4ead-aa90-36e375b99d36 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:10.092379 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [None req-1240c444-afc7-4ead-aa90-36e375b99d36 admin admin] 10.222.0.62 "DELETE /v2.0/security-groups/f3c0f076-d6c3-484e-8525-9769d568d038 HTTP/1.1" status: 204 len: 168 time: 0.3269336 May 25 17:00:10.173190 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-854189aa-e1a5-4058-82ea-9de5e24d9054 admin admin] Notify callbacks [] for port, precommit_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:10.210855 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-309fd158-f7f2-44b8-8aa8-26df598a3fcc admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:10.241068 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-309fd158-f7f2-44b8-8aa8-26df598a3fcc admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:10.480093 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-309fd158-f7f2-44b8-8aa8-26df598a3fcc admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-640836'] for security_group, after_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:10.486318 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-79f8b12e-b5bc-4ecc-b313-244d75813d59 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:00:10.496706 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-854189aa-e1a5-4058-82ea-9de5e24d9054 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8757892520915', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28230808'] for port, after_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:10.509200 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-309fd158-f7f2-44b8-8aa8-26df598a3fcc admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=ec198040-29f5-4dbf-8437-e486f3fb935b,revision_number=None']} {{(pid=91829) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:00:10.511432 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-309fd158-f7f2-44b8-8aa8-26df598a3fcc admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.025s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:00:10.513040 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-19a928e1-aee0-48ed-9b26-5420c6279036 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:00:10.578585 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-854189aa-e1a5-4058-82ea-9de5e24d9054 admin admin] Network 4364b6ab-4117-4a92-baeb-f5ee2f45bf74 is already hosted by enough agents. {{(pid=91829) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 25 17:00:10.583804 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.scheduler.base_scheduler [None req-854189aa-e1a5-4058-82ea-9de5e24d9054 admin admin] Resources bound (agent type, host, resource id): {{(pid=91829) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 17:00:10.586352 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.l3_dvrscheduler_db [None req-854189aa-e1a5-4058-82ea-9de5e24d9054 admin admin] Received port after_create {{(pid=91829) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 25 17:00:10.649485 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-854189aa-e1a5-4058-82ea-9de5e24d9054 admin admin] Pushing event updated for resources: {'Port': ['ID=703dfe81-5ded-48db-9e96-d09ac4afce0f,revision_number=1']} {{(pid=91829) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:00:10.652430 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-854189aa-e1a5-4058-82ea-9de5e24d9054 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.139s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:00:10.661562 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-309fd158-f7f2-44b8-8aa8-26df598a3fcc admin admin] Notify callbacks [] for security_group, before_response {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:10.662680 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [None req-309fd158-f7f2-44b8-8aa8-26df598a3fcc admin admin] 10.222.0.62 "DELETE /v2.0/security-groups/ec198040-29f5-4dbf-8437-e486f3fb935b HTTP/1.1" status: 204 len: 168 time: 0.5980132 May 25 17:00:10.674007 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bd336b84-c9cf-429f-af98-a6414bb5a1a6 req-d29ebdea-33d8-42d0-b104-6b53d65b6ac9 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:00:10.675436 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-bd336b84-c9cf-429f-af98-a6414bb5a1a6 req-d29ebdea-33d8-42d0-b104-6b53d65b6ac9 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/ports?device_id=d87a1395-92e0-4727-a5ed-a8dcdee587c3 HTTP/1.1" status: 200 len: 945 time: 0.3638744 May 25 17:00:10.891915 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-bd336b84-c9cf-429f-af98-a6414bb5a1a6 req-0292f324-1e8d-404e-9285-a0d633710729 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/security-groups?id=8ee5c4ed-9c60-4e39-9185-7e283704a7dc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1548984 May 25 17:00:11.133771 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-854189aa-e1a5-4058-82ea-9de5e24d9054 admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:11.165094 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b1b70cd9-05f1-4e0c-aae7-b3e42e3376fa None None] Network 613457eb-6f6d-4604-8f6c-f2d318ff9bc5 requested from dv-cinder-790492-4-iscsi {{(pid=91831) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} May 25 17:00:11.318324 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.provisioning_blocks [None req-2f9e5e68-03a4-4a95-8b4a-63be081d0cc9 None None] Provisioning for port 282005bd-4eac-4a0e-8b78-006226f21c55 completed by entity DHCP. {{(pid=91831) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 25 17:00:11.642924 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-854189aa-e1a5-4058-82ea-9de5e24d9054 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-684881', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-683233'] for router, after_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:11.660037 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.wsgi [-] (91830) accepted ('10.222.0.62', 58384) {{(pid=91830) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:00:11.791463 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.v2.base [None req-c4745f0a-80ec-4f44-a916-14795f3ab36a admin admin] Request body: {'network': {'name': 'tempest-AttachVolumeShelveTestJSON-437778030-network', 'tenant_id': 'bbb9e99759bc47d08005f3b1e036a6cf'}} {{(pid=91830) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 17:00:11.796514 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.quota.driver [None req-c4745f0a-80ec-4f44-a916-14795f3ab36a admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91830) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 17:00:11.800455 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [None req-c4745f0a-80ec-4f44-a916-14795f3ab36a admin admin] Usage tracker for resource:network and tenant:bbb9e99759bc47d08005f3b1e036a6cf is out of sync, need to count used quota {{(pid=91830) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 17:00:11.803548 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [None req-c4745f0a-80ec-4f44-a916-14795f3ab36a admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=91830) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 17:00:11.811687 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.quota.driver [None req-c4745f0a-80ec-4f44-a916-14795f3ab36a admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91830) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 17:00:11.823995 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-c4745f0a-80ec-4f44-a916-14795f3ab36a admin admin] Made reservation on behalf of bbb9e99759bc47d08005f3b1e036a6cf for: {'network': 1} {{(pid=91830) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 25 17:00:11.826962 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-c4745f0a-80ec-4f44-a916-14795f3ab36a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-3832077'] for network, before_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:11.842435 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-c4745f0a-80ec-4f44-a916-14795f3ab36a admin admin] Notify callbacks [] for security_group, before_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:11.857101 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.quota.driver [None req-c4745f0a-80ec-4f44-a916-14795f3ab36a admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91830) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 17:00:11.860908 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [None req-c4745f0a-80ec-4f44-a916-14795f3ab36a admin admin] Usage tracker for resource:security_group_rule and tenant:bbb9e99759bc47d08005f3b1e036a6cf is out of sync, need to count used quota {{(pid=91830) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 17:00:11.863627 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [None req-c4745f0a-80ec-4f44-a916-14795f3ab36a admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91830) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 17:00:11.869668 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.quota.driver [None req-c4745f0a-80ec-4f44-a916-14795f3ab36a admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91830) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 17:00:11.872778 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-854189aa-e1a5-4058-82ea-9de5e24d9054 admin admin] Router c063ed68-292f-4e35-ba01-24f34d8a5e42 is scheduled to L3 agent a2d427c1-2d07-43e8-afbe-218c9f7d0445 with binding_index 1 {{(pid=91829) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}} May 25 17:00:11.965441 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-c4745f0a-80ec-4f44-a916-14795f3ab36a admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:11.970914 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-c4745f0a-80ec-4f44-a916-14795f3ab36a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-640836'] for security_group, after_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:11.975502 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-131d35fe-0b85-4d61-a5c4-2b01eb4645f2 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:00:12.009734 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-c4745f0a-80ec-4f44-a916-14795f3ab36a admin admin] vlan segment allocate from pool success with {'vlan_id': 695, 'physical_network': 'physnet1'} {{(pid=91830) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 25 17:00:12.020281 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c4745f0a-80ec-4f44-a916-14795f3ab36a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=61ec5b7f-e7c8-409c-8549-534927e1a78e,revision_number=1']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:00:12.023597 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-c4745f0a-80ec-4f44-a916-14795f3ab36a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.048s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:00:12.031376 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-c4745f0a-80ec-4f44-a916-14795f3ab36a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3809789'] for segment, precommit_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:12.031792 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.db.segments_db [None req-c4745f0a-80ec-4f44-a916-14795f3ab36a admin admin] Added segment a8fb0313-938a-4f5e-8ff4-96df8acd943b of type vlan for network e5be4c6a-143f-474c-a90b-37180778cefe May 25 17:00:12.065332 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-c4745f0a-80ec-4f44-a916-14795f3ab36a admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8757892541013'] for network, precommit_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:12.101262 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-c4745f0a-80ec-4f44-a916-14795f3ab36a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-640806', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-551400'] for network, after_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:12.103586 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c4745f0a-80ec-4f44-a916-14795f3ab36a admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91830) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:00:12.105083 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-c4745f0a-80ec-4f44-a916-14795f3ab36a admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-551373'] for network, before_response {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:12.129325 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:00:12.235590 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [None req-c4745f0a-80ec-4f44-a916-14795f3ab36a admin admin] 10.222.0.62 "POST /v2.0/networks HTTP/1.1" status: 201 len: 889 time: 0.5709009 May 25 17:00:12.235910 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.wsgi [-] (91829) accepted ('10.222.0.62', 58404) {{(pid=91829) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:00:12.246333 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.v2.base [None req-40a0e4fa-201e-4429-a856-9943c5ec1399 admin admin] Request body: {'subnet': {'network_id': 'e5be4c6a-143f-474c-a90b-37180778cefe', 'cidr': '172.20.0.0/28', 'name': 'tempest-AttachVolumeShelveTestJSON-437778030-subnet', 'tenant_id': 'bbb9e99759bc47d08005f3b1e036a6cf', 'enable_dhcp': True, 'ip_version': 4}} {{(pid=91829) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 17:00:12.247810 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c4745f0a-80ec-4f44-a916-14795f3ab36a admin admin] Pushing event updated for resources: {'Network': ['ID=e5be4c6a-143f-474c-a90b-37180778cefe,revision_number=1']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:00:12.250527 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-854189aa-e1a5-4058-82ea-9de5e24d9054 admin admin] Notify agent at l3_agent.dv-cinder-790492-4-iscsi the message routers_updated {{(pid=91829) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 25 17:00:12.251037 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-c4745f0a-80ec-4f44-a916-14795f3ab36a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.122s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:00:12.258623 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.quota.driver [None req-40a0e4fa-201e-4429-a856-9943c5ec1399 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91829) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 17:00:12.259925 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-897ef914-7cc9-42d0-82df-738be41f6dca None None] Sync routers for ids ['c063ed68-292f-4e35-ba01-24f34d8a5e42'] in dv-cinder-790492-4-iscsi {{(pid=91832) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 25 17:00:12.263027 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.rpc [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Network e5be4c6a-143f-474c-a90b-37180778cefe details requested by agent ovs-agent-dv-cinder-790492-4-iscsi with host dv-cinder-790492-4-iscsi {{(pid=91831) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 25 17:00:12.264054 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.quota.resource [None req-40a0e4fa-201e-4429-a856-9943c5ec1399 admin admin] Usage tracker for resource:subnet and tenant:bbb9e99759bc47d08005f3b1e036a6cf is out of sync, need to count used quota {{(pid=91829) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 17:00:12.273981 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.quota.resource [None req-40a0e4fa-201e-4429-a856-9943c5ec1399 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=91829) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 17:00:12.275871 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.db.l3_dvrscheduler_db [None req-897ef914-7cc9-42d0-82df-738be41f6dca None None] Routers {'c063ed68-292f-4e35-ba01-24f34d8a5e42'} bound to L3 agent in host dv-cinder-790492-4-iscsi {{(pid=91832) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 17:00:12.276920 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.db.l3_hamode_db [None req-897ef914-7cc9-42d0-82df-738be41f6dca None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-790492-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-05-25T16:50:28Z,description=,heartbeat_timestamp=2021-05-25T16:59:58Z,host='dv-cinder-790492-4-iscsi',id=a2d427c1-2d07-43e8-afbe-218c9f7d0445,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T16:50:28Z,topic='l3_agent')) {'router_ids': ['c063ed68-292f-4e35-ba01-24f34d8a5e42'], 'active': True} {{(pid=91832) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 17:00:12.295601 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.quota.driver [None req-40a0e4fa-201e-4429-a856-9943c5ec1399 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91829) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 17:00:12.307721 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0c236e49-3eb7-4d08-b29b-95128bc24a91 req-b3d5fac8-8d6f-4b11-9d8e-25a1eae11d61 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:00:12.309195 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-0c236e49-3eb7-4d08-b29b-95128bc24a91 req-b3d5fac8-8d6f-4b11-9d8e-25a1eae11d61 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/ports?device_id=d87a1395-92e0-4727-a5ed-a8dcdee587c3 HTTP/1.1" status: 200 len: 945 time: 0.2483532 May 25 17:00:12.311380 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-854189aa-e1a5-4058-82ea-9de5e24d9054 admin admin] Notify callbacks [] for router, before_response {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:12.313016 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [None req-854189aa-e1a5-4058-82ea-9de5e24d9054 admin admin] 10.222.0.62 "POST /v2.0/routers HTTP/1.1" status: 201 len: 920 time: 3.8582745 May 25 17:00:12.315619 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.wsgi [-] (91829) accepted ('10.222.0.62', 58408) {{(pid=91829) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:00:12.367971 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.rpc [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Device 282005bd-4eac-4a0e-8b78-006226f21c55 up at agent ovs-agent-dv-cinder-790492-4-iscsi {{(pid=91831) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 25 17:00:12.410991 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-40a0e4fa-201e-4429-a856-9943c5ec1399 admin admin] Made reservation on behalf of bbb9e99759bc47d08005f3b1e036a6cf for: {'subnet': 1} {{(pid=91829) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 25 17:00:12.413258 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-40a0e4fa-201e-4429-a856-9943c5ec1399 admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-28266129'] for subnet, before_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:12.503060 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.provisioning_blocks [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Provisioning for port 282005bd-4eac-4a0e-8b78-006226f21c55 completed by entity L2. {{(pid=91831) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 25 17:00:12.509746 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.provisioning_blocks [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Provisioning complete for port 282005bd-4eac-4a0e-8b78-006226f21c55 triggered by entity L2. {{(pid=91831) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 17:00:12.510345 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3854128'] for port, provisioning_complete {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:12.556140 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.db.l3_dvr_db [None req-897ef914-7cc9-42d0-82df-738be41f6dca None None] Set router c063ed68-292f-4e35-ba01-24f34d8a5e42 gateway port host: dv-cinder-790492-4-iscsi {{(pid=91832) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 17:00:12.570731 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.wsgi [-] (91830) accepted ('10.222.0.62', 58418) {{(pid=91830) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:00:12.652522 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-0c236e49-3eb7-4d08-b29b-95128bc24a91 req-f1d4f328-d61c-420b-bcfa-76694adebb17 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/security-groups?id=8ee5c4ed-9c60-4e39-9185-7e283704a7dc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2817390 May 25 17:00:12.679409 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3832070'] for port, before_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:12.718797 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.db [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] For port 282005bd-4eac-4a0e-8b78-006226f21c55, host dv-cinder-790492-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-790492-4-iscsi',level=0,port_id=282005bd-4eac-4a0e-8b78-006226f21c55,segment=NetworkSegment(55bc70ae-213c-42ca-b035-b4a902044007),segment_id=55bc70ae-213c-42ca-b035-b4a902044007)] {{(pid=91831) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 17:00:12.723791 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8757892955028', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8757892520933', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8757892521750'] for port, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:12.725852 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:00:12.789495 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-53d98817-a235-49a2-aa6b-6846664fab9b admin admin] Notify callbacks [] for security_group, before_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:12.804715 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Pushing event updated for resources: {'Port': ['ID=282005bd-4eac-4a0e-8b78-006226f21c55,revision_number=3']} {{(pid=91831) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:00:12.808408 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.082s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:00:12.824982 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.quota.driver [None req-53d98817-a235-49a2-aa6b-6846664fab9b admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91830) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 17:00:12.831160 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [None req-53d98817-a235-49a2-aa6b-6846664fab9b admin admin] Usage tracker for resource:security_group_rule and tenant:401678c8d37d45cd96aee987caa673a4 is out of sync, need to count used quota {{(pid=91830) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 17:00:12.835638 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [None req-53d98817-a235-49a2-aa6b-6846664fab9b admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91830) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 17:00:12.843778 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.quota.driver [None req-53d98817-a235-49a2-aa6b-6846664fab9b admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91830) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 17:00:12.900295 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.db.l3_hamode_db [None req-897ef914-7cc9-42d0-82df-738be41f6dca None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'c063ed68-292f-4e35-ba01-24f34d8a5e42', 'name': 'tempest-TestShelveInstance-1452464711-router', 'tenant_id': 'a736cc60cc2143c4b6dea99321051da5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'external_fixed_ips': [{'subnet_id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'ip_address': '172.27.2.75'}], 'enable_snat': True}, 'gw_port_id': '703dfe81-5ded-48db-9e96-d09ac4afce0f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T17:00:08Z', 'updated_at': '2021-05-25T17:00:10Z', 'revision_number': 3, 'project_id': 'a736cc60cc2143c4b6dea99321051da5', 'gw_port': {'id': '703dfe81-5ded-48db-9e96-d09ac4afce0f', 'name': '', 'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'tenant_id': '', 'mac_address': 'fa:16:3e:32:8f:aa', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'c063ed68-292f-4e35-ba01-24f34d8a5e42', 'device_owner': 'network:router_gateway', 'standard_attr_id': 268, 'fixed_ips': [{'subnet_id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'ip_address': '172.27.2.75', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:00:09Z', 'updated_at': '2021-05-25T17:00:09Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-790492-4-iscsi'}], 'dv-cinder-790492-4-iscsi', False) {} {{(pid=91832) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 17:00:12.904141 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-897ef914-7cc9-42d0-82df-738be41f6dca None None] Checking router: c063ed68-292f-4e35-ba01-24f34d8a5e42 for host: dv-cinder-790492-4-iscsi {{(pid=91832) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 25 17:00:12.904488 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-897ef914-7cc9-42d0-82df-738be41f6dca None None] Updating router c063ed68-292f-4e35-ba01-24f34d8a5e42 port 703dfe81-5ded-48db-9e96-d09ac4afce0f binding host dv-cinder-790492-4-iscsi {{(pid=91832) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} May 25 17:00:12.939150 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-53d98817-a235-49a2-aa6b-6846664fab9b admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:12.943435 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-53d98817-a235-49a2-aa6b-6846664fab9b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-640836'] for security_group, after_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:12.958953 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron_lib.callbacks.manager [None req-897ef914-7cc9-42d0-82df-738be41f6dca None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3832070'] for port, before_update {{(pid=91832) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:12.975692 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-045abec0-52a0-42a4-b917-af681be6151f admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:00:13.007523 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [None req-53d98817-a235-49a2-aa6b-6846664fab9b admin admin] 10.222.0.62 "GET /v2.0/security-groups?tenant_id=401678c8d37d45cd96aee987caa673a4&name=default HTTP/1.1" status: 200 len: 2979 time: 0.4355807 May 25 17:00:13.008380 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-53d98817-a235-49a2-aa6b-6846664fab9b admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=53029f92-1906-4459-bbae-5f879ce03f96,revision_number=1']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:00:13.010935 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.wsgi [-] (91830) accepted ('10.222.0.62', 58426) {{(pid=91830) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:00:13.026708 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-53d98817-a235-49a2-aa6b-6846664fab9b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.051s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:00:13.091240 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-c5995683-2a84-4ea4-9165-0dd7402bb9c5 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:13.119020 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-c5995683-2a84-4ea4-9165-0dd7402bb9c5 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:13.174565 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-c5995683-2a84-4ea4-9165-0dd7402bb9c5 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-640836'] for security_group, after_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:13.179619 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-6097c204-3721-40e2-b75e-41fc3bd03097 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:00:13.191947 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c5995683-2a84-4ea4-9165-0dd7402bb9c5 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=53029f92-1906-4459-bbae-5f879ce03f96,revision_number=None']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:00:13.194898 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-c5995683-2a84-4ea4-9165-0dd7402bb9c5 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.015s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:00:13.199425 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-c5995683-2a84-4ea4-9165-0dd7402bb9c5 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:13.200531 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [None req-c5995683-2a84-4ea4-9165-0dd7402bb9c5 admin admin] 10.222.0.62 "DELETE /v2.0/security-groups/53029f92-1906-4459-bbae-5f879ce03f96 HTTP/1.1" status: 204 len: 168 time: 0.1776280 May 25 17:00:13.315321 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron_lib.callbacks.manager [None req-897ef914-7cc9-42d0-82df-738be41f6dca None None] Notify callbacks [] for port, precommit_update {{(pid=91832) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:13.327403 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.db.provisioning_blocks [None req-897ef914-7cc9-42d0-82df-738be41f6dca None None] Transition to ACTIVE for port object 703dfe81-5ded-48db-9e96-d09ac4afce0f will not be triggered until provisioned by entity L2. {{(pid=91832) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 25 17:00:13.336242 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron_lib.callbacks.manager [None req-897ef914-7cc9-42d0-82df-738be41f6dca None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8757892955028', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8757892520933', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8757892521750'] for port, after_update {{(pid=91832) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:13.346530 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:00:13.413751 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c287428e-0203-44c2-b764-bf38ea5ab57f None None] Pushing event updated for resources: {'Port': ['ID=703dfe81-5ded-48db-9e96-d09ac4afce0f,revision_number=2']} {{(pid=91832) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:00:13.423241 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c287428e-0203-44c2-b764-bf38ea5ab57f None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91832) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:00:13.423578 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c287428e-0203-44c2-b764-bf38ea5ab57f None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91832) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:00:13.424137 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c287428e-0203-44c2-b764-bf38ea5ab57f None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91832) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:00:13.424641 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c287428e-0203-44c2-b764-bf38ea5ab57f None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91832) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:00:13.425134 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c287428e-0203-44c2-b764-bf38ea5ab57f None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91832) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:00:13.425886 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c287428e-0203-44c2-b764-bf38ea5ab57f None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91832) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:00:13.426044 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c287428e-0203-44c2-b764-bf38ea5ab57f None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91832) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:00:13.426537 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c287428e-0203-44c2-b764-bf38ea5ab57f None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91832) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:00:13.427050 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c287428e-0203-44c2-b764-bf38ea5ab57f None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91832) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:00:13.427531 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c287428e-0203-44c2-b764-bf38ea5ab57f None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91832) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:00:13.428024 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c287428e-0203-44c2-b764-bf38ea5ab57f None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91832) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:00:13.428401 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c287428e-0203-44c2-b764-bf38ea5ab57f None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91832) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:00:13.456666 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.plugins.ml2.managers [None req-897ef914-7cc9-42d0-82df-738be41f6dca None None] Attempting to bind port 703dfe81-5ded-48db-9e96-d09ac4afce0f on host dv-cinder-790492-4-iscsi for vnic_type normal with profile {{(pid=91832) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 25 17:00:13.457351 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.plugins.ml2.managers [None req-897ef914-7cc9-42d0-82df-738be41f6dca None None] Attempting to bind port 703dfe81-5ded-48db-9e96-d09ac4afce0f by drivers openvswitch,hyperv on host dv-cinder-790492-4-iscsi at level 0 using segments [{'id': '414a8468-1d66-4792-9e81-d8ac5ccf1512', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74'}] {{(pid=91832) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 25 17:00:13.457958 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-897ef914-7cc9-42d0-82df-738be41f6dca None None] Attempting to bind port 703dfe81-5ded-48db-9e96-d09ac4afce0f on network 4364b6ab-4117-4a92-baeb-f5ee2f45bf74 {{(pid=91832) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 25 17:00:13.463964 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-897ef914-7cc9-42d0-82df-738be41f6dca None None] Checking agent: {'id': 'fc8251e1-071c-49f7-bc10-1337f1d37d1b', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-790492-4-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 25, 16, 50, 28), 'started_at': datetime.datetime(2021, 5, 25, 16, 50, 58), 'heartbeat_timestamp': datetime.datetime(2021, 5, 25, 16, 59, 58), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-790492-4-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=91832) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 25 17:00:13.464972 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-897ef914-7cc9-42d0-82df-738be41f6dca None None] Checking segment: {'id': '414a8468-1d66-4792-9e81-d8ac5ccf1512', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91832) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 25 17:00:13.465660 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron_lib.callbacks.manager [None req-897ef914-7cc9-42d0-82df-738be41f6dca None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=91832) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:13.466341 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-897ef914-7cc9-42d0-82df-738be41f6dca None None] Bound using segment: {'id': '414a8468-1d66-4792-9e81-d8ac5ccf1512', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74'} {{(pid=91832) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 25 17:00:13.467469 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.plugins.ml2.managers [None req-897ef914-7cc9-42d0-82df-738be41f6dca None None] Bound port: 703dfe81-5ded-48db-9e96-d09ac4afce0f, host: dv-cinder-790492-4-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '414a8468-1d66-4792-9e81-d8ac5ccf1512', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74'}}] {{(pid=91832) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 25 17:00:13.467955 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron_lib.callbacks.manager [None req-897ef914-7cc9-42d0-82df-738be41f6dca None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3832070'] for port, before_update {{(pid=91832) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:13.476541 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-8b7ad329-1351-4080-af76-84380928ac8a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3832070'] for port, before_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:13.537709 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.wsgi [-] (91830) accepted ('10.222.0.62', 58438) {{(pid=91830) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:00:13.547484 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.plugins.ml2.db [None req-897ef914-7cc9-42d0-82df-738be41f6dca None None] For port 703dfe81-5ded-48db-9e96-d09ac4afce0f, host dv-cinder-790492-4-iscsi, cleared binding levels {{(pid=91832) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 25 17:00:13.551115 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.plugins.ml2.db [None req-897ef914-7cc9-42d0-82df-738be41f6dca None None] For port 703dfe81-5ded-48db-9e96-d09ac4afce0f, host dv-cinder-790492-4-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-790492-4-iscsi',level=0,port_id=703dfe81-5ded-48db-9e96-d09ac4afce0f,segment=NetworkSegment(414a8468-1d66-4792-9e81-d8ac5ccf1512),segment_id=414a8468-1d66-4792-9e81-d8ac5ccf1512)] {{(pid=91832) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 25 17:00:13.553832 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG oslo_concurrency.lockutils [None req-c287428e-0203-44c2-b764-bf38ea5ab57f None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.207s {{(pid=91832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:00:13.556418 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron_lib.callbacks.manager [None req-897ef914-7cc9-42d0-82df-738be41f6dca None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8757892955028', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8757892520933', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8757892521750'] for port, after_update {{(pid=91832) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:13.559536 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-195ff8b8-87a2-4b35-ac0c-850677ad9ecf admin admin] Notify callbacks [] for security_group, before_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:13.564315 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:00:13.574778 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.quota.driver [None req-195ff8b8-87a2-4b35-ac0c-850677ad9ecf admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91830) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 17:00:13.578943 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [None req-195ff8b8-87a2-4b35-ac0c-850677ad9ecf admin admin] Usage tracker for resource:security_group_rule and tenant:8cb2b35767144a2b8ee9a753fbe3cd9e is out of sync, need to count used quota {{(pid=91830) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 17:00:13.581938 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [None req-195ff8b8-87a2-4b35-ac0c-850677ad9ecf admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91830) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 17:00:13.587960 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.quota.driver [None req-195ff8b8-87a2-4b35-ac0c-850677ad9ecf admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91830) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 17:00:13.607175 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-40a0e4fa-201e-4429-a856-9943c5ec1399 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55886', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-27333672', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-28266119'] for subnet, after_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:13.617833 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-5d1a0334-c7d6-49ca-92c6-41e9e62f8842 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:00:13.674930 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c287428e-0203-44c2-b764-bf38ea5ab57f None None] Pushing event updated for resources: {'Port': ['ID=703dfe81-5ded-48db-9e96-d09ac4afce0f,revision_number=3']} {{(pid=91832) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:00:13.679110 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG oslo_concurrency.lockutils [None req-c287428e-0203-44c2-b764-bf38ea5ab57f None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.115s {{(pid=91832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:00:13.692110 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.db.l3_dvrscheduler_db [None req-897ef914-7cc9-42d0-82df-738be41f6dca None None] Routers {'c063ed68-292f-4e35-ba01-24f34d8a5e42'} bound to L3 agent in host dv-cinder-790492-4-iscsi {{(pid=91832) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 17:00:13.692914 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.db.l3_hamode_db [None req-897ef914-7cc9-42d0-82df-738be41f6dca None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-790492-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-05-25T16:50:28Z,description=,heartbeat_timestamp=2021-05-25T16:59:58Z,host='dv-cinder-790492-4-iscsi',id=a2d427c1-2d07-43e8-afbe-218c9f7d0445,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T16:50:28Z,topic='l3_agent')) {'router_ids': ['c063ed68-292f-4e35-ba01-24f34d8a5e42'], 'active': True} {{(pid=91832) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 17:00:13.759786 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-40a0e4fa-201e-4429-a856-9943c5ec1399 admin admin] Pushing event updated for resources: {'Subnet': ['ID=6e6b5897-e23d-4281-96cb-a6fdf9b68134,revision_number=0']} {{(pid=91829) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:00:13.762567 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-40a0e4fa-201e-4429-a856-9943c5ec1399 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.145s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:00:13.807921 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-40a0e4fa-201e-4429-a856-9943c5ec1399 admin admin] Checking segment: {'id': 'a8fb0313-938a-4f5e-8ff4-96df8acd943b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 695, 'network_id': 'e5be4c6a-143f-474c-a90b-37180778cefe'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91829) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 25 17:00:13.808269 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-40a0e4fa-201e-4429-a856-9943c5ec1399 admin admin] Network hostable DHCP agents. Network: e5be4c6a-143f-474c-a90b-37180778cefe, hostable agents: ['8d7401c6-8951-4f2b-ace4-208761782bfc'], hosted agents: [] {{(pid=91829) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 25 17:00:13.818661 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-195ff8b8-87a2-4b35-ac0c-850677ad9ecf admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:13.826817 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-195ff8b8-87a2-4b35-ac0c-850677ad9ecf admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-640836'] for security_group, after_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:13.849395 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-607d4592-b6ac-46f3-9cc3-a7f7b1d185fc admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:00:13.949208 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.db.l3_dvr_db [None req-897ef914-7cc9-42d0-82df-738be41f6dca None None] Set router c063ed68-292f-4e35-ba01-24f34d8a5e42 gateway port host: dv-cinder-790492-4-iscsi {{(pid=91832) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 17:00:13.953604 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [None req-195ff8b8-87a2-4b35-ac0c-850677ad9ecf admin admin] 10.222.0.62 "GET /v2.0/security-groups?tenant_id=8cb2b35767144a2b8ee9a753fbe3cd9e&name=default HTTP/1.1" status: 200 len: 2979 time: 0.4113083 May 25 17:00:13.954314 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.wsgi [-] (91830) accepted ('10.222.0.62', 58452) {{(pid=91830) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:00:13.995675 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-195ff8b8-87a2-4b35-ac0c-850677ad9ecf admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=9d4f905b-e388-4812-a96a-104b6c27da70,revision_number=1']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:00:14.001513 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-195ff8b8-87a2-4b35-ac0c-850677ad9ecf admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.152s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:00:14.028082 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.db_base_plugin_common [None req-8b7ad329-1351-4080-af76-84380928ac8a admin admin] Allocated IP 172.20.0.1 (613457eb-6f6d-4604-8f6c-f2d318ff9bc5/3fc60650-484d-4574-bb67-0e4931bc9854/a3cc4b79-05f1-4b3f-95e5-18e49199b00a) {{(pid=91829) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 25 17:00:14.032640 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-40a0e4fa-201e-4429-a856-9943c5ec1399 admin admin] Network e5be4c6a-143f-474c-a90b-37180778cefe is scheduled to be hosted by DHCP agent 8d7401c6-8951-4f2b-ace4-208761782bfc with binding_index 1 {{(pid=91829) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 25 17:00:14.073359 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-f209bcf0-5579-422b-99ed-3f8a41a1110a admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:14.080526 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.scheduler.base_scheduler [None req-40a0e4fa-201e-4429-a856-9943c5ec1399 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-790492-4-iscsi, e5be4c6a-143f-474c-a90b-37180778cefe) {{(pid=91829) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 17:00:14.093389 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1e9fb018-00e6-4f63-9e06-e574543bbff8 None None] Network e5be4c6a-143f-474c-a90b-37180778cefe requested from dv-cinder-790492-4-iscsi {{(pid=91831) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} May 25 17:00:14.113645 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-40a0e4fa-201e-4429-a856-9943c5ec1399 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:00:14.114294 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-40a0e4fa-201e-4429-a856-9943c5ec1399 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-551373'] for subnet, before_response {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:14.115476 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-f209bcf0-5579-422b-99ed-3f8a41a1110a admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:14.194248 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-f209bcf0-5579-422b-99ed-3f8a41a1110a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-640836'] for security_group, after_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:14.199585 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-bc31e898-55f4-4bfe-b194-4fea99dcafd2 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:00:14.211050 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f209bcf0-5579-422b-99ed-3f8a41a1110a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=9d4f905b-e388-4812-a96a-104b6c27da70,revision_number=None']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:00:14.217379 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-f209bcf0-5579-422b-99ed-3f8a41a1110a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.018s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:00:14.218241 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-f209bcf0-5579-422b-99ed-3f8a41a1110a admin admin] Notify callbacks [] for security_group, before_response {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:14.222215 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [None req-f209bcf0-5579-422b-99ed-3f8a41a1110a admin admin] 10.222.0.62 "DELETE /v2.0/security-groups/9d4f905b-e388-4812-a96a-104b6c27da70 HTTP/1.1" status: 204 len: 168 time: 0.2642207 May 25 17:00:14.274082 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.rpc [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Device 282005bd-4eac-4a0e-8b78-006226f21c55 up at agent ovs-agent-dv-cinder-790492-4-iscsi {{(pid=91831) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 25 17:00:14.299486 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.wsgi [-] (91830) accepted ('10.222.0.62', 58458) {{(pid=91830) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:00:14.299685 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [None req-40a0e4fa-201e-4429-a856-9943c5ec1399 admin admin] 10.222.0.62 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 852 time: 2.0612123 May 25 17:00:14.308147 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.v2.base [None req-4a387b10-a1ad-4a7d-a35d-3a5a156d2724 admin admin] Request body: {'router': {'name': 'tempest-AttachVolumeShelveTestJSON-437778030-router', 'tenant_id': 'bbb9e99759bc47d08005f3b1e036a6cf', 'external_gateway_info': {'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74'}}} {{(pid=91830) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 17:00:14.310226 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cf76dbbd-c98a-49fb-a8f6-647f0d473fdb req-a1ea9b99-7d85-48a3-9fe8-ffee62349cef tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:00:14.312761 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-cf76dbbd-c98a-49fb-a8f6-647f0d473fdb req-a1ea9b99-7d85-48a3-9fe8-ffee62349cef tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/ports?device_id=d87a1395-92e0-4727-a5ed-a8dcdee587c3 HTTP/1.1" status: 200 len: 945 time: 0.3897829 May 25 17:00:14.315775 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.quota.driver [None req-4a387b10-a1ad-4a7d-a35d-3a5a156d2724 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91830) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 17:00:14.330168 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [None req-4a387b10-a1ad-4a7d-a35d-3a5a156d2724 admin admin] Usage tracker for resource:router and tenant:bbb9e99759bc47d08005f3b1e036a6cf is out of sync, need to count used quota {{(pid=91830) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 17:00:14.338971 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [None req-4a387b10-a1ad-4a7d-a35d-3a5a156d2724 admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=91830) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 17:00:14.359331 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.quota.driver [None req-4a387b10-a1ad-4a7d-a35d-3a5a156d2724 admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91830) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 17:00:14.378094 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-4a387b10-a1ad-4a7d-a35d-3a5a156d2724 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-684888', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-31042'] for router, before_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:14.384422 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-4a387b10-a1ad-4a7d-a35d-3a5a156d2724 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-684376', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-683143', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-647018', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-31049'] for router, precommit_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:14.386849 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.db.l3_hamode_db [None req-897ef914-7cc9-42d0-82df-738be41f6dca None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'c063ed68-292f-4e35-ba01-24f34d8a5e42', 'name': 'tempest-TestShelveInstance-1452464711-router', 'tenant_id': 'a736cc60cc2143c4b6dea99321051da5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'external_fixed_ips': [{'subnet_id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'ip_address': '172.27.2.75'}], 'enable_snat': True}, 'gw_port_id': '703dfe81-5ded-48db-9e96-d09ac4afce0f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T17:00:08Z', 'updated_at': '2021-05-25T17:00:10Z', 'revision_number': 3, 'project_id': 'a736cc60cc2143c4b6dea99321051da5', 'gw_port': {'id': '703dfe81-5ded-48db-9e96-d09ac4afce0f', 'name': '', 'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'tenant_id': '', 'mac_address': 'fa:16:3e:32:8f:aa', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'c063ed68-292f-4e35-ba01-24f34d8a5e42', 'device_owner': 'network:router_gateway', 'standard_attr_id': 268, 'fixed_ips': [{'subnet_id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'ip_address': '172.27.2.75', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790492-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:00:09Z', 'updated_at': '2021-05-25T17:00:13Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-790492-4-iscsi'}], 'dv-cinder-790492-4-iscsi', False) {} {{(pid=91832) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 17:00:14.398496 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-897ef914-7cc9-42d0-82df-738be41f6dca None None] The sync data for ids ['c063ed68-292f-4e35-ba01-24f34d8a5e42'] in dv-cinder-790492-4-iscsi is: [{'id': 'c063ed68-292f-4e35-ba01-24f34d8a5e42', 'name': 'tempest-TestShelveInstance-1452464711-router', 'tenant_id': 'a736cc60cc2143c4b6dea99321051da5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'external_fixed_ips': [{'subnet_id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'ip_address': '172.27.2.75'}], 'enable_snat': True}, 'gw_port_id': '703dfe81-5ded-48db-9e96-d09ac4afce0f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T17:00:08Z', 'updated_at': '2021-05-25T17:00:10Z', 'revision_number': 3, 'project_id': 'a736cc60cc2143c4b6dea99321051da5', 'gw_port': {'id': '703dfe81-5ded-48db-9e96-d09ac4afce0f', 'name': '', 'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'tenant_id': '', 'mac_address': 'fa:16:3e:32:8f:aa', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'c063ed68-292f-4e35-ba01-24f34d8a5e42', 'device_owner': 'network:router_gateway', 'standard_attr_id': 268, 'fixed_ips': [{'subnet_id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'ip_address': '172.27.2.75', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790492-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:00:09Z', 'updated_at': '2021-05-25T17:00:13Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-790492-4-iscsi'}] {{(pid=91832) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 25 17:00:14.402835 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-cf76dbbd-c98a-49fb-a8f6-647f0d473fdb req-12264054-719b-4831-99f4-bbf41cc822fa tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/security-groups?id=8ee5c4ed-9c60-4e39-9185-7e283704a7dc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0763733 May 25 17:00:14.420873 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-8b7ad329-1351-4080-af76-84380928ac8a admin admin] Notify callbacks [] for port, precommit_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:14.444284 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-4a387b10-a1ad-4a7d-a35d-3a5a156d2724 admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:14.459817 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.provisioning_blocks [None req-8b7ad329-1351-4080-af76-84380928ac8a admin admin] Transition to ACTIVE for port object a3cc4b79-05f1-4b3f-95e5-18e49199b00a will not be triggered until provisioned by entity DHCP. {{(pid=91829) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 25 17:00:14.515102 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-8b7ad329-1351-4080-af76-84380928ac8a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8757892520915', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28230808'] for port, after_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:14.523148 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:00:14.646586 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.provisioning_blocks [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Provisioning complete for port 282005bd-4eac-4a0e-8b78-006226f21c55 triggered by entity L2. {{(pid=91831) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 17:00:14.646980 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3854128'] for port, provisioning_complete {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:14.681463 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8b7ad329-1351-4080-af76-84380928ac8a admin admin] Network 613457eb-6f6d-4604-8f6c-f2d318ff9bc5 is already hosted by enough agents. {{(pid=91829) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 25 17:00:14.684344 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.scheduler.base_scheduler [None req-8b7ad329-1351-4080-af76-84380928ac8a admin admin] Resources bound (agent type, host, resource id): {{(pid=91829) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 17:00:14.690448 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8b7ad329-1351-4080-af76-84380928ac8a admin admin] Received port after_create {{(pid=91829) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 25 17:00:14.795810 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8b7ad329-1351-4080-af76-84380928ac8a admin admin] Pushing event updated for resources: {'Port': ['ID=a3cc4b79-05f1-4b3f-95e5-18e49199b00a,revision_number=1']} {{(pid=91829) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:00:14.808441 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-8b7ad329-1351-4080-af76-84380928ac8a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.285s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:00:14.858560 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-8b7ad329-1351-4080-af76-84380928ac8a admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-680080'] for router_interface, before_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:15.110825 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-cbfe79ae-38f6-477b-9537-244bfa603ab4 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp6d7ebc81-b6b5-52ec-b8f5-10a9de34bf46-e5be4c6a-143f-474c-a90b-37180778cefe', 'network_id': 'e5be4c6a-143f-474c-a90b-37180778cefe', 'tenant_id': 'bbb9e99759bc47d08005f3b1e036a6cf', 'fixed_ips': [{'subnet_id': '6e6b5897-e23d-4281-96cb-a6fdf9b68134'}]}} from dv-cinder-790492-4-iscsi. {{(pid=91831) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} May 25 17:00:15.128031 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-cbfe79ae-38f6-477b-9537-244bfa603ab4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3832070'] for port, before_create {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:15.386786 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.wsgi [-] (91830) accepted ('10.222.0.62', 58486) {{(pid=91830) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:00:15.399289 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.provisioning_blocks [None req-a09fbfaf-602f-425a-af5a-b7d1c5bf1a9d None None] Provisioning for port a3cc4b79-05f1-4b3f-95e5-18e49199b00a completed by entity DHCP. {{(pid=91831) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 25 17:00:15.437457 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-8b7ad329-1351-4080-af76-84380928ac8a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3832070'] for port, before_update {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:15.491196 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-4a387b10-a1ad-4a7d-a35d-3a5a156d2724 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-683170', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-684906', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-31039'] for router, precommit_update {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:15.497650 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.provisioning_blocks [None req-a09fbfaf-602f-425a-af5a-b7d1c5bf1a9d None None] Provisioning complete for port a3cc4b79-05f1-4b3f-95e5-18e49199b00a triggered by entity DHCP. {{(pid=91831) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 17:00:15.497757 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-a09fbfaf-602f-425a-af5a-b7d1c5bf1a9d None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3854128'] for port, provisioning_complete {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:15.693081 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.plugin [None req-a09fbfaf-602f-425a-af5a-b7d1c5bf1a9d None None] Port a3cc4b79-05f1-4b3f-95e5-18e49199b00a cannot update to ACTIVE because it is not bound. {{(pid=91831) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 25 17:00:15.735950 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c76c960e-1e49-4c39-b224-29e172bcd8d7 req-3673b701-a921-4330-bd90-e4a8f03e99fa service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91830) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:00:15.737734 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-c76c960e-1e49-4c39-b224-29e172bcd8d7 req-3673b701-a921-4330-bd90-e4a8f03e99fa service neutron] 10.222.0.32 "GET /v2.0/ports?device_id=d87a1395-92e0-4727-a5ed-a8dcdee587c3 HTTP/1.1" status: 200 len: 1098 time: 0.5826967 May 25 17:00:15.843930 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-c76c960e-1e49-4c39-b224-29e172bcd8d7 req-d7de8620-67d3-461c-84f7-ed66ec82c142 service neutron] 10.222.0.32 "GET /v2.0/security-groups?id=8ee5c4ed-9c60-4e39-9185-7e283704a7dc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0892723 May 25 17:00:15.870947 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.db_base_plugin_common [None req-cbfe79ae-38f6-477b-9537-244bfa603ab4 None None] Allocated IP 172.20.0.2 (e5be4c6a-143f-474c-a90b-37180778cefe/6e6b5897-e23d-4281-96cb-a6fdf9b68134/e97f6ad1-cca3-4f59-93f4-fd63428d51f2) {{(pid=91831) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 25 17:00:15.907292 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-63d65be6-322c-49a4-82a2-d6a3bab441a9 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:15.950669 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.quota.driver [None req-63d65be6-322c-49a4-82a2-d6a3bab441a9 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91830) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 17:00:15.966139 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [None req-63d65be6-322c-49a4-82a2-d6a3bab441a9 admin admin] Usage tracker for resource:security_group_rule and tenant:c8eacc758e1743f590252b254552aefb is out of sync, need to count used quota {{(pid=91830) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 17:00:16.092028 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [None req-63d65be6-322c-49a4-82a2-d6a3bab441a9 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91830) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 17:00:16.114835 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.quota.driver [None req-63d65be6-322c-49a4-82a2-d6a3bab441a9 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91830) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 17:00:16.155199 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d7f73357-c953-4c76-b57d-a32938f5a903 req-dde039f8-c6fa-4228-9cbd-8518fa850610 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:00:16.168434 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-d7f73357-c953-4c76-b57d-a32938f5a903 req-dde039f8-c6fa-4228-9cbd-8518fa850610 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] 10.222.0.62 "GET /v2.0/networks?id=63b1f335-e2c4-48dd-886b-6be853f8a2fc HTTP/1.1" status: 200 len: 814 time: 0.4443634 May 25 17:00:16.218093 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-d7f73357-c953-4c76-b57d-a32938f5a903 req-24d50da5-e4fe-497c-a277-94e1a11fb4d0 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] 10.222.0.62 "GET /v2.0/quotas/04e8022f24e3464ab1ab7726d6a07e08 HTTP/1.1" status: 200 len: 375 time: 0.0486360 May 25 17:00:16.296858 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-4a387b10-a1ad-4a7d-a35d-3a5a156d2724 admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:16.317018 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-27448526-68a1-4702-9c79-05b67a451f7b req-927c4f36-826c-4a09-b7cb-123892cbd0ac tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:00:16.318279 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-27448526-68a1-4702-9c79-05b67a451f7b req-927c4f36-826c-4a09-b7cb-123892cbd0ac tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/ports?device_id=d87a1395-92e0-4727-a5ed-a8dcdee587c3 HTTP/1.1" status: 200 len: 945 time: 0.4254134 May 25 17:00:16.335130 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-4a387b10-a1ad-4a7d-a35d-3a5a156d2724 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3832070'] for port, before_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:16.348751 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.rpc [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Device 703dfe81-5ded-48db-9e96-d09ac4afce0f up at agent ovs-agent-dv-cinder-790492-4-iscsi {{(pid=91831) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 25 17:00:16.385068 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-8b7ad329-1351-4080-af76-84380928ac8a admin admin] Notify callbacks [] for port, precommit_update {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:16.437106 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-8b7ad329-1351-4080-af76-84380928ac8a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8757892955028', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8757892520933', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8757892521750', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28230801'] for port, after_update {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:16.476585 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.provisioning_blocks [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Provisioning for port 703dfe81-5ded-48db-9e96-d09ac4afce0f completed by entity L2. {{(pid=91831) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 25 17:00:16.490967 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.provisioning_blocks [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Provisioning complete for port 703dfe81-5ded-48db-9e96-d09ac4afce0f triggered by entity L2. {{(pid=91831) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 17:00:16.492803 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3854128'] for port, provisioning_complete {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:16.497617 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-63d65be6-322c-49a4-82a2-d6a3bab441a9 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:16.508657 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-63d65be6-322c-49a4-82a2-d6a3bab441a9 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-640836'] for security_group, after_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:16.522637 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-cf641e61-80a8-4817-a311-f6cad64596a5 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:00:16.538993 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-bb080e64-52ae-40e7-97d2-76d76a092ed5 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:00:16.580461 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.db_base_plugin_common [None req-4a387b10-a1ad-4a7d-a35d-3a5a156d2724 admin admin] Allocated IP 172.27.2.253 (4364b6ab-4117-4a92-baeb-f5ee2f45bf74/b947e790-d731-4b63-afc4-4aa112afe0f6/3bc942c3-5854-4018-b3fb-5071bf6c70c6) {{(pid=91830) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 25 17:00:16.585598 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-63d65be6-322c-49a4-82a2-d6a3bab441a9 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=d5785834-77a1-445c-a01c-50624eda1a38,revision_number=1']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:00:16.594402 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-8b7ad329-1351-4080-af76-84380928ac8a admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-549138', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-679997'] for router_interface, after_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:16.594626 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [None req-63d65be6-322c-49a4-82a2-d6a3bab441a9 admin admin] 10.222.0.62 "GET /v2.0/security-groups?tenant_id=c8eacc758e1743f590252b254552aefb&name=default HTTP/1.1" status: 200 len: 2979 time: 1.1902380 May 25 17:00:16.596467 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-63d65be6-322c-49a4-82a2-d6a3bab441a9 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.074s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:00:16.597600 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.wsgi [-] (91830) accepted ('10.222.0.62', 58528) {{(pid=91830) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:00:16.598663 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-cbfe79ae-38f6-477b-9537-244bfa603ab4 None None] Notify callbacks [] for port, precommit_create {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:16.610191 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-27448526-68a1-4702-9c79-05b67a451f7b req-90f1bc0b-fe2f-456f-8835-2a19492b8b27 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/security-groups?id=8ee5c4ed-9c60-4e39-9185-7e283704a7dc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2729001 May 25 17:00:16.630931 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.provisioning_blocks [None req-cbfe79ae-38f6-477b-9537-244bfa603ab4 None None] Transition to ACTIVE for port object e97f6ad1-cca3-4f59-93f4-fd63428d51f2 will not be triggered until provisioned by entity L2. {{(pid=91831) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 25 17:00:16.700272 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.provisioning_blocks [None req-cbfe79ae-38f6-477b-9537-244bfa603ab4 None None] Transition to ACTIVE for port object e97f6ad1-cca3-4f59-93f4-fd63428d51f2 will not be triggered until provisioned by entity DHCP. {{(pid=91831) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 25 17:00:16.771233 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-a1a6b936-fe2f-4ec5-98a4-8fa899f6677b admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:16.774507 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8b7ad329-1351-4080-af76-84380928ac8a admin admin] Pushing event updated for resources: {'Port': ['ID=a3cc4b79-05f1-4b3f-95e5-18e49199b00a,revision_number=2']} {{(pid=91829) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:00:16.777862 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-8b7ad329-1351-4080-af76-84380928ac8a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.239s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:00:16.778953 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-cbfe79ae-38f6-477b-9537-244bfa603ab4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8757892520915'] for port, after_create {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:16.797715 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-d7f73357-c953-4c76-b57d-a32938f5a903 req-252524cd-37e4-45a9-983a-5eda14a18a91 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] 10.222.0.62 "GET /v2.0/ports?tenant_id=04e8022f24e3464ab1ab7726d6a07e08&fields=id HTTP/1.1" status: 200 len: 255 time: 0.5782828 May 25 17:00:16.822159 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:00:16.847353 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-a1a6b936-fe2f-4ec5-98a4-8fa899f6677b admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:16.877476 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-cbfe79ae-38f6-477b-9537-244bfa603ab4 None None] Network e5be4c6a-143f-474c-a90b-37180778cefe is already hosted by enough agents. {{(pid=91831) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 25 17:00:16.886175 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.scheduler.base_scheduler [None req-cbfe79ae-38f6-477b-9537-244bfa603ab4 None None] Resources bound (agent type, host, resource id): {{(pid=91831) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 17:00:16.886815 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-4a387b10-a1ad-4a7d-a35d-3a5a156d2724 admin admin] Notify callbacks [] for port, precommit_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:16.889281 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cbfe79ae-38f6-477b-9537-244bfa603ab4 None None] Received port after_create {{(pid=91831) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 25 17:00:16.940169 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-a1a6b936-fe2f-4ec5-98a4-8fa899f6677b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-640836'] for security_group, after_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:16.943916 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-c24fab46-2d6b-4f01-98ba-90389b219e59 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:00:16.957038 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a1a6b936-fe2f-4ec5-98a4-8fa899f6677b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d5785834-77a1-445c-a01c-50624eda1a38,revision_number=None']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:00:16.960845 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-a1a6b936-fe2f-4ec5-98a4-8fa899f6677b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.016s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:00:16.984975 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-a1a6b936-fe2f-4ec5-98a4-8fa899f6677b admin admin] Notify callbacks [] for security_group, before_response {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:16.988294 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [None req-a1a6b936-fe2f-4ec5-98a4-8fa899f6677b admin admin] 10.222.0.62 "DELETE /v2.0/security-groups/d5785834-77a1-445c-a01c-50624eda1a38 HTTP/1.1" status: 204 len: 168 time: 0.3877223 May 25 17:00:16.988294 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-4a387b10-a1ad-4a7d-a35d-3a5a156d2724 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8757892520915', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-27483019'] for port, after_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:16.993067 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-9568e620-0c14-4ca6-9056-b9d7945a0b3a service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:00:17.020479 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8b7ad329-1351-4080-af76-84380928ac8a admin admin] Network 613457eb-6f6d-4604-8f6c-f2d318ff9bc5 is already hosted by enough agents. {{(pid=91829) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 25 17:00:17.024545 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.scheduler.base_scheduler [None req-8b7ad329-1351-4080-af76-84380928ac8a admin admin] Resources bound (agent type, host, resource id): {{(pid=91829) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 17:00:17.077522 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cbfe79ae-38f6-477b-9537-244bfa603ab4 None None] Pushing event updated for resources: {'Port': ['ID=e97f6ad1-cca3-4f59-93f4-fd63428d51f2,revision_number=1']} {{(pid=91831) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:00:17.082937 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.managers [None req-cbfe79ae-38f6-477b-9537-244bfa603ab4 None None] Attempting to bind port e97f6ad1-cca3-4f59-93f4-fd63428d51f2 on host dv-cinder-790492-4-iscsi for vnic_type normal with profile {{(pid=91831) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 25 17:00:17.085491 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.managers [None req-cbfe79ae-38f6-477b-9537-244bfa603ab4 None None] Attempting to bind port e97f6ad1-cca3-4f59-93f4-fd63428d51f2 by drivers openvswitch,hyperv on host dv-cinder-790492-4-iscsi at level 0 using segments [{'id': 'a8fb0313-938a-4f5e-8ff4-96df8acd943b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 695, 'network_id': 'e5be4c6a-143f-474c-a90b-37180778cefe'}] {{(pid=91831) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 25 17:00:17.086138 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cbfe79ae-38f6-477b-9537-244bfa603ab4 None None] Attempting to bind port e97f6ad1-cca3-4f59-93f4-fd63428d51f2 on network e5be4c6a-143f-474c-a90b-37180778cefe {{(pid=91831) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 25 17:00:17.090288 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4a387b10-a1ad-4a7d-a35d-3a5a156d2724 admin admin] Network 4364b6ab-4117-4a92-baeb-f5ee2f45bf74 is already hosted by enough agents. {{(pid=91830) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 25 17:00:17.094149 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.scheduler.base_scheduler [None req-4a387b10-a1ad-4a7d-a35d-3a5a156d2724 admin admin] Resources bound (agent type, host, resource id): {{(pid=91830) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 17:00:17.094441 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [None req-cbfe79ae-38f6-477b-9537-244bfa603ab4 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.272s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:00:17.097248 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4a387b10-a1ad-4a7d-a35d-3a5a156d2724 admin admin] Received port after_create {{(pid=91830) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 25 17:00:17.097861 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cbfe79ae-38f6-477b-9537-244bfa603ab4 None None] Checking agent: {'id': 'fc8251e1-071c-49f7-bc10-1337f1d37d1b', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-790492-4-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 25, 16, 50, 28), 'started_at': datetime.datetime(2021, 5, 25, 16, 50, 58), 'heartbeat_timestamp': datetime.datetime(2021, 5, 25, 16, 59, 58), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-790492-4-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=91831) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 25 17:00:17.098515 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cbfe79ae-38f6-477b-9537-244bfa603ab4 None None] Checking segment: {'id': 'a8fb0313-938a-4f5e-8ff4-96df8acd943b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 695, 'network_id': 'e5be4c6a-143f-474c-a90b-37180778cefe'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91831) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 25 17:00:17.099118 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-cbfe79ae-38f6-477b-9537-244bfa603ab4 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:17.099820 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cbfe79ae-38f6-477b-9537-244bfa603ab4 None None] Bound using segment: {'id': 'a8fb0313-938a-4f5e-8ff4-96df8acd943b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 695, 'network_id': 'e5be4c6a-143f-474c-a90b-37180778cefe'} {{(pid=91831) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 25 17:00:17.100498 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.managers [None req-cbfe79ae-38f6-477b-9537-244bfa603ab4 None None] Bound port: e97f6ad1-cca3-4f59-93f4-fd63428d51f2, host: dv-cinder-790492-4-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'a8fb0313-938a-4f5e-8ff4-96df8acd943b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 695, 'network_id': 'e5be4c6a-143f-474c-a90b-37180778cefe'}}] {{(pid=91831) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 25 17:00:17.101073 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-cbfe79ae-38f6-477b-9537-244bfa603ab4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3832070'] for port, before_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:17.116552 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3832070'] for port, before_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:17.141875 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.db [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] For port 703dfe81-5ded-48db-9e96-d09ac4afce0f, host dv-cinder-790492-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-790492-4-iscsi',level=0,port_id=703dfe81-5ded-48db-9e96-d09ac4afce0f,segment=NetworkSegment(414a8468-1d66-4792-9e81-d8ac5ccf1512),segment_id=414a8468-1d66-4792-9e81-d8ac5ccf1512)] {{(pid=91831) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 17:00:17.154388 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8757892955028', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8757892520933', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8757892521750'] for port, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:17.159081 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:00:17.166302 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4a387b10-a1ad-4a7d-a35d-3a5a156d2724 admin admin] Pushing event updated for resources: {'Port': ['ID=3bc942c3-5854-4018-b3fb-5071bf6c70c6,revision_number=1']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:00:17.170398 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-4a387b10-a1ad-4a7d-a35d-3a5a156d2724 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.176s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:00:17.223577 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-d7f73357-c953-4c76-b57d-a32938f5a903 req-0924cb5c-9ff8-494a-9314-26330ae8fd24 service neutron] 10.222.0.62 "GET /v2.0/networks/63b1f335-e2c4-48dd-886b-6be853f8a2fc?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4232712 May 25 17:00:17.454136 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.provisioning_blocks [None req-2212dafd-137e-4f40-b967-ce3abf744f8c None None] Provisioning complete for port a3cc4b79-05f1-4b3f-95e5-18e49199b00a triggered by entity DHCP. {{(pid=91831) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 17:00:17.454734 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-2212dafd-137e-4f40-b967-ce3abf744f8c None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3854128'] for port, provisioning_complete {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:17.559273 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Pushing event updated for resources: {'Port': ['ID=703dfe81-5ded-48db-9e96-d09ac4afce0f,revision_number=4']} {{(pid=91831) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:00:17.564022 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.405s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:00:17.571120 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.plugin [None req-2212dafd-137e-4f40-b967-ce3abf744f8c None None] Port a3cc4b79-05f1-4b3f-95e5-18e49199b00a cannot update to ACTIVE because it is not bound. {{(pid=91831) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 25 17:00:17.596647 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.db [None req-cbfe79ae-38f6-477b-9537-244bfa603ab4 None None] For port e97f6ad1-cca3-4f59-93f4-fd63428d51f2, host dv-cinder-790492-4-iscsi, cleared binding levels {{(pid=91831) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 25 17:00:17.602231 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.db [None req-cbfe79ae-38f6-477b-9537-244bfa603ab4 None None] For port e97f6ad1-cca3-4f59-93f4-fd63428d51f2, host dv-cinder-790492-4-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-790492-4-iscsi',level=0,port_id=e97f6ad1-cca3-4f59-93f4-fd63428d51f2,segment=NetworkSegment(a8fb0313-938a-4f5e-8ff4-96df8acd943b),segment_id=a8fb0313-938a-4f5e-8ff4-96df8acd943b)] {{(pid=91831) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 25 17:00:17.611680 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-cbfe79ae-38f6-477b-9537-244bfa603ab4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8757892955028', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8757892520933', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8757892521750'] for port, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:17.631949 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:00:17.640975 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-8b7ad329-1351-4080-af76-84380928ac8a admin admin] Router c063ed68-292f-4e35-ba01-24f34d8a5e42 has already been hosted by L3 agent a2d427c1-2d07-43e8-afbe-218c9f7d0445 {{(pid=91829) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 25 17:00:17.726334 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-d7f73357-c953-4c76-b57d-a32938f5a903 req-7ffe31e5-50eb-4201-97a8-1fed7b7abc5c service neutron] 10.222.0.62 "GET /v2.0/networks/63b1f335-e2c4-48dd-886b-6be853f8a2fc?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.5005915 May 25 17:00:17.783470 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-4a387b10-a1ad-4a7d-a35d-3a5a156d2724 admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:17.818834 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cbfe79ae-38f6-477b-9537-244bfa603ab4 None None] Pushing event updated for resources: {'Port': ['ID=e97f6ad1-cca3-4f59-93f4-fd63428d51f2,revision_number=2']} {{(pid=91831) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:00:17.829962 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [None req-cbfe79ae-38f6-477b-9537-244bfa603ab4 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.197s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:00:17.913354 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.wsgi [-] (91830) accepted ('10.222.0.62', 58562) {{(pid=91830) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:00:17.998825 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-edb2381a-e5ee-46a8-8065-9b206fde7426 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:18.143622 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.quota.driver [None req-edb2381a-e5ee-46a8-8065-9b206fde7426 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91830) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 17:00:18.145323 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-8b7ad329-1351-4080-af76-84380928ac8a admin admin] Notify agent at l3_agent.dv-cinder-790492-4-iscsi the message routers_updated {{(pid=91829) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 25 17:00:18.152558 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [None req-edb2381a-e5ee-46a8-8065-9b206fde7426 admin admin] Usage tracker for resource:security_group_rule and tenant:8214a15162634911b2eb45897bfb1fa2 is out of sync, need to count used quota {{(pid=91830) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 17:00:18.158114 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [None req-edb2381a-e5ee-46a8-8065-9b206fde7426 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91830) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 17:00:18.160666 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-62128191-67d4-4b78-99fb-1f4c6803dc75 None None] Sync routers for ids ['c063ed68-292f-4e35-ba01-24f34d8a5e42'] in dv-cinder-790492-4-iscsi {{(pid=91831) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 25 17:00:18.169327 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.quota.driver [None req-edb2381a-e5ee-46a8-8065-9b206fde7426 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91830) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 17:00:18.209674 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.l3_dvrscheduler_db [None req-62128191-67d4-4b78-99fb-1f4c6803dc75 None None] Routers {'c063ed68-292f-4e35-ba01-24f34d8a5e42'} bound to L3 agent in host dv-cinder-790492-4-iscsi {{(pid=91831) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 17:00:18.211347 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.l3_hamode_db [None req-62128191-67d4-4b78-99fb-1f4c6803dc75 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-790492-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-05-25T16:50:28Z,description=,heartbeat_timestamp=2021-05-25T16:59:58Z,host='dv-cinder-790492-4-iscsi',id=a2d427c1-2d07-43e8-afbe-218c9f7d0445,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T16:50:28Z,topic='l3_agent')) {'router_ids': ['c063ed68-292f-4e35-ba01-24f34d8a5e42'], 'active': True} {{(pid=91831) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 17:00:18.286655 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [None req-8b7ad329-1351-4080-af76-84380928ac8a admin admin] 10.222.0.62 "PUT /v2.0/routers/c063ed68-292f-4e35-ba01-24f34d8a5e42/add_router_interface HTTP/1.1" status: 200 len: 503 time: 5.9700279 May 25 17:00:18.289746 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-b0d67fa4-6aa1-4b22-9158-a3de90fbc0b3 req-2a523154-47e4-4782-9539-95bcc60f67aa tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] 10.222.0.62 "GET /v2.0/ports?device_id=e2dfa29d-fe86-4425-b12b-d984d7f0584a HTTP/1.1" status: 200 len: 210 time: 0.1469548 May 25 17:00:18.370656 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-111fdaf7-3069-495c-b5ca-75eddcedca45 req-fe46aaa8-97c1-4074-aa75-0bcb2c574b43 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:00:18.378588 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-111fdaf7-3069-495c-b5ca-75eddcedca45 req-fe46aaa8-97c1-4074-aa75-0bcb2c574b43 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/ports?device_id=d87a1395-92e0-4727-a5ed-a8dcdee587c3 HTTP/1.1" status: 200 len: 945 time: 0.2370813 May 25 17:00:18.446871 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-111fdaf7-3069-495c-b5ca-75eddcedca45 req-637329c1-38d4-4d3b-a127-3d7d5a8501ff tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/security-groups?id=8ee5c4ed-9c60-4e39-9185-7e283704a7dc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0672770 May 25 17:00:18.458226 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.rpc [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Device 703dfe81-5ded-48db-9e96-d09ac4afce0f up at agent ovs-agent-dv-cinder-790492-4-iscsi {{(pid=91831) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 25 17:00:18.517373 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.wsgi [-] (91829) accepted ('10.222.0.62', 58586) {{(pid=91829) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:00:18.678419 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.provisioning_blocks [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Provisioning complete for port 703dfe81-5ded-48db-9e96-d09ac4afce0f triggered by entity L2. {{(pid=91831) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 17:00:18.678796 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3854128'] for port, provisioning_complete {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:18.684108 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-cdad4274-1186-4dda-9254-bd3782906678 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:18.701175 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.quota.driver [None req-cdad4274-1186-4dda-9254-bd3782906678 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91829) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 17:00:18.706314 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.quota.resource [None req-cdad4274-1186-4dda-9254-bd3782906678 admin admin] Usage tracker for resource:security_group_rule and tenant:00d705bae4af40f7a9c1554cf364e9e9 is out of sync, need to count used quota {{(pid=91829) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 17:00:18.710417 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.quota.resource [None req-cdad4274-1186-4dda-9254-bd3782906678 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91829) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 17:00:18.720485 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.quota.driver [None req-cdad4274-1186-4dda-9254-bd3782906678 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91829) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 17:00:18.728792 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-4a387b10-a1ad-4a7d-a35d-3a5a156d2724 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-684881', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-683233'] for router, after_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:18.750275 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.l3_dvr_db [None req-62128191-67d4-4b78-99fb-1f4c6803dc75 None None] Set router c063ed68-292f-4e35-ba01-24f34d8a5e42 gateway port host: dv-cinder-790492-4-iscsi {{(pid=91831) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 17:00:18.857650 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-edb2381a-e5ee-46a8-8065-9b206fde7426 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:18.859213 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-cdad4274-1186-4dda-9254-bd3782906678 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:18.864563 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-edb2381a-e5ee-46a8-8065-9b206fde7426 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-640836'] for security_group, after_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:18.873444 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-cdad4274-1186-4dda-9254-bd3782906678 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-640836'] for security_group, after_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:18.927666 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-b90c454d-42a0-4e23-9549-5fa855794a97 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:00:18.939312 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [None req-cdad4274-1186-4dda-9254-bd3782906678 admin admin] 10.222.0.62 "GET /v2.0/security-groups?tenant_id=00d705bae4af40f7a9c1554cf364e9e9&name=default HTTP/1.1" status: 200 len: 2979 time: 0.4182937 May 25 17:00:18.939899 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.wsgi [-] (91829) accepted ('10.222.0.62', 58600) {{(pid=91829) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:00:18.942914 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-aaac0880-7342-48a7-a846-cb42c66aa576 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:00:18.951226 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [None req-edb2381a-e5ee-46a8-8065-9b206fde7426 admin admin] 10.222.0.62 "GET /v2.0/security-groups?tenant_id=8214a15162634911b2eb45897bfb1fa2&name=default HTTP/1.1" status: 200 len: 2979 time: 1.0231721 May 25 17:00:18.961726 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.wsgi [-] (91829) accepted ('10.222.0.62', 58604) {{(pid=91829) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:00:19.006508 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-edb2381a-e5ee-46a8-8065-9b206fde7426 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=fe9395d4-9e39-4360-91da-611ba1dca09d,revision_number=1']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:00:19.013059 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-edb2381a-e5ee-46a8-8065-9b206fde7426 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.070s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:00:19.074849 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cdad4274-1186-4dda-9254-bd3782906678 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=273c9b9c-100d-40d9-824a-816d93c0ad06,revision_number=1']} {{(pid=91829) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:00:19.092827 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-4a387b10-a1ad-4a7d-a35d-3a5a156d2724 admin admin] Router d2ed6ef9-f77a-4b7a-b152-3e1b9c85e1ad is scheduled to L3 agent a2d427c1-2d07-43e8-afbe-218c9f7d0445 with binding_index 1 {{(pid=91830) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}} May 25 17:00:19.136896 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-cdad4274-1186-4dda-9254-bd3782906678 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.209s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:00:19.199850 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-4111d749-51d5-465f-bce7-0696e6144945 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:19.204169 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-f9d5ca4b-4392-4b0b-bed5-62f65bdc7a26 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:19.255761 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-f9d5ca4b-4392-4b0b-bed5-62f65bdc7a26 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:19.262308 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.wsgi [-] (91829) accepted ('10.222.0.62', 58614) {{(pid=91829) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:00:19.284086 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.v2.base [None req-d4d5a7f3-bdd4-423b-998c-926193b1755f admin admin] Request body: {'network': {'name': 'tempest-TestShelveInstance-1848885781-network', 'tenant_id': '6a788f87b23b492da7fbfb18883b9d2d'}} {{(pid=91829) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 17:00:19.303981 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.quota.driver [None req-d4d5a7f3-bdd4-423b-998c-926193b1755f admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91829) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 17:00:19.308687 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-4111d749-51d5-465f-bce7-0696e6144945 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:19.323037 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c4d10ab2-e0b1-40d8-8694-0a576f63de81 None None] Network e5be4c6a-143f-474c-a90b-37180778cefe requested from dv-cinder-790492-4-iscsi {{(pid=91831) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} May 25 17:00:19.337220 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.quota.resource [None req-d4d5a7f3-bdd4-423b-998c-926193b1755f admin admin] Usage tracker for resource:network and tenant:6a788f87b23b492da7fbfb18883b9d2d is out of sync, need to count used quota {{(pid=91829) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 17:00:19.343334 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.quota.resource [None req-d4d5a7f3-bdd4-423b-998c-926193b1755f admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=91829) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 17:00:19.360754 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.quota.driver [None req-d4d5a7f3-bdd4-423b-998c-926193b1755f admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91829) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 17:00:19.386390 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-d4d5a7f3-bdd4-423b-998c-926193b1755f admin admin] Made reservation on behalf of 6a788f87b23b492da7fbfb18883b9d2d for: {'network': 1} {{(pid=91829) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 25 17:00:19.389021 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-d4d5a7f3-bdd4-423b-998c-926193b1755f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-3832077'] for network, before_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:19.395877 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-4a387b10-a1ad-4a7d-a35d-3a5a156d2724 admin admin] Notify agent at l3_agent.dv-cinder-790492-4-iscsi the message routers_updated {{(pid=91830) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 25 17:00:19.407929 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-d4d5a7f3-bdd4-423b-998c-926193b1755f admin admin] Notify callbacks [] for security_group, before_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:19.408135 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-390df57f-256e-442d-8f91-e446b02d47aa None None] Sync routers for ids ['d2ed6ef9-f77a-4b7a-b152-3e1b9c85e1ad'] in dv-cinder-790492-4-iscsi {{(pid=91832) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 25 17:00:19.424080 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.db.l3_dvrscheduler_db [None req-390df57f-256e-442d-8f91-e446b02d47aa None None] Routers {'d2ed6ef9-f77a-4b7a-b152-3e1b9c85e1ad'} bound to L3 agent in host dv-cinder-790492-4-iscsi {{(pid=91832) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 17:00:19.425178 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.db.l3_hamode_db [None req-390df57f-256e-442d-8f91-e446b02d47aa None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-790492-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-05-25T16:50:28Z,description=,heartbeat_timestamp=2021-05-25T16:59:58Z,host='dv-cinder-790492-4-iscsi',id=a2d427c1-2d07-43e8-afbe-218c9f7d0445,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T16:50:28Z,topic='l3_agent')) {'router_ids': ['d2ed6ef9-f77a-4b7a-b152-3e1b9c85e1ad'], 'active': True} {{(pid=91832) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 17:00:19.427214 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.quota.driver [None req-d4d5a7f3-bdd4-423b-998c-926193b1755f admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91829) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 17:00:19.431547 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.quota.resource [None req-d4d5a7f3-bdd4-423b-998c-926193b1755f admin admin] Usage tracker for resource:security_group_rule and tenant:6a788f87b23b492da7fbfb18883b9d2d is out of sync, need to count used quota {{(pid=91829) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 17:00:19.436169 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-f9d5ca4b-4392-4b0b-bed5-62f65bdc7a26 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-640836'] for security_group, after_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:19.445747 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.quota.resource [None req-d4d5a7f3-bdd4-423b-998c-926193b1755f admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91829) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 17:00:19.446953 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-4a387b10-a1ad-4a7d-a35d-3a5a156d2724 admin admin] Notify callbacks [] for router, before_response {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:19.448438 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [None req-4a387b10-a1ad-4a7d-a35d-3a5a156d2724 admin admin] 10.222.0.62 "POST /v2.0/routers HTTP/1.1" status: 201 len: 928 time: 5.1475410 May 25 17:00:19.449586 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-df8828d1-1bba-4754-8ebc-1c3d57f825a9 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:00:19.451313 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.wsgi [-] (91830) accepted ('10.222.0.62', 58622) {{(pid=91830) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:00:19.464702 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f9d5ca4b-4392-4b0b-bed5-62f65bdc7a26 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=fe9395d4-9e39-4360-91da-611ba1dca09d,revision_number=None']} {{(pid=91829) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:00:19.476295 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.quota.driver [None req-d4d5a7f3-bdd4-423b-998c-926193b1755f admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91829) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 17:00:19.479144 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-f9d5ca4b-4392-4b0b-bed5-62f65bdc7a26 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.030s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:00:19.490357 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-4111d749-51d5-465f-bce7-0696e6144945 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-640836'] for security_group, after_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:19.498720 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-4111d749-51d5-465f-bce7-0696e6144945 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:19.513276 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [None req-4111d749-51d5-465f-bce7-0696e6144945 admin admin] 10.222.0.62 "DELETE /v2.0/security-groups/273c9b9c-100d-40d9-824a-816d93c0ad06 HTTP/1.1" status: 204 len: 168 time: 0.5701251 May 25 17:00:19.610026 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.provisioning_blocks [None req-e9396749-3ef6-4cc9-b63a-8eec72544612 None None] Provisioning for port e97f6ad1-cca3-4f59-93f4-fd63428d51f2 completed by entity DHCP. {{(pid=91831) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 25 17:00:19.610584 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-74acfdc4-5fb6-4ef2-9be0-b52c684435a9 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:00:19.638261 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.l3_hamode_db [None req-62128191-67d4-4b78-99fb-1f4c6803dc75 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'c063ed68-292f-4e35-ba01-24f34d8a5e42', 'name': 'tempest-TestShelveInstance-1452464711-router', 'tenant_id': 'a736cc60cc2143c4b6dea99321051da5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'external_fixed_ips': [{'subnet_id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'ip_address': '172.27.2.75'}], 'enable_snat': True}, 'gw_port_id': '703dfe81-5ded-48db-9e96-d09ac4afce0f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T17:00:08Z', 'updated_at': '2021-05-25T17:00:15Z', 'revision_number': 4, 'project_id': 'a736cc60cc2143c4b6dea99321051da5', 'gw_port': {'id': '703dfe81-5ded-48db-9e96-d09ac4afce0f', 'name': '', 'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'tenant_id': '', 'mac_address': 'fa:16:3e:32:8f:aa', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c063ed68-292f-4e35-ba01-24f34d8a5e42', 'device_owner': 'network:router_gateway', 'standard_attr_id': 268, 'fixed_ips': [{'subnet_id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'ip_address': '172.27.2.75', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790492-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:00:09Z', 'updated_at': '2021-05-25T17:00:17Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-790492-4-iscsi', '_interfaces': [{'id': 'a3cc4b79-05f1-4b3f-95e5-18e49199b00a', 'name': '', 'network_id': '613457eb-6f6d-4604-8f6c-f2d318ff9bc5', 'tenant_id': 'a736cc60cc2143c4b6dea99321051da5', 'mac_address': 'fa:16:3e:c6:46:19', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'c063ed68-292f-4e35-ba01-24f34d8a5e42', 'device_owner': 'network:router_interface', 'standard_attr_id': 282, 'fixed_ips': [{'subnet_id': '3fc60650-484d-4574-bb67-0e4931bc9854', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:00:13Z', 'updated_at': '2021-05-25T17:00:15Z', 'revision_number': 2, 'project_id': 'a736cc60cc2143c4b6dea99321051da5', 'subnets': [{'id': '3fc60650-484d-4574-bb67-0e4931bc9854', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-790492-4-iscsi', False) {} {{(pid=91831) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 17:00:19.649131 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-62128191-67d4-4b78-99fb-1f4c6803dc75 None None] Checking router: c063ed68-292f-4e35-ba01-24f34d8a5e42 for host: dv-cinder-790492-4-iscsi {{(pid=91831) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 25 17:00:19.649386 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-62128191-67d4-4b78-99fb-1f4c6803dc75 None None] Updating router c063ed68-292f-4e35-ba01-24f34d8a5e42 port a3cc4b79-05f1-4b3f-95e5-18e49199b00a binding host dv-cinder-790492-4-iscsi {{(pid=91831) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} May 25 17:00:19.685386 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-f9d5ca4b-4392-4b0b-bed5-62f65bdc7a26 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:19.694472 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.db.l3_dvr_db [None req-390df57f-256e-442d-8f91-e446b02d47aa None None] Set router d2ed6ef9-f77a-4b7a-b152-3e1b9c85e1ad gateway port host: dv-cinder-790492-4-iscsi {{(pid=91832) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 17:00:19.702381 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [None req-f9d5ca4b-4392-4b0b-bed5-62f65bdc7a26 admin admin] 10.222.0.62 "DELETE /v2.0/security-groups/fe9395d4-9e39-4360-91da-611ba1dca09d HTTP/1.1" status: 204 len: 168 time: 0.7253530 May 25 17:00:19.746854 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4111d749-51d5-465f-bce7-0696e6144945 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=273c9b9c-100d-40d9-824a-816d93c0ad06,revision_number=None']} {{(pid=91829) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:00:19.757018 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-45324e09-6752-497c-85a8-85f36a6a2470 req-1d68b3a9-ff3d-4dc5-950f-903ed14bdd67 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] 10.222.0.62 "GET /v2.0/ports?device_id=e2dfa29d-fe86-4425-b12b-d984d7f0584a HTTP/1.1" status: 200 len: 210 time: 0.2701867 May 25 17:00:19.764842 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-4111d749-51d5-465f-bce7-0696e6144945 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.155s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:00:19.831129 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-894be6b1-214e-4ccd-bfda-f2946f1cd65d req-0327f851-f85b-4844-8069-1f9296068e51 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:00:19.832712 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-894be6b1-214e-4ccd-bfda-f2946f1cd65d req-0327f851-f85b-4844-8069-1f9296068e51 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/ports?device_id=d87a1395-92e0-4727-a5ed-a8dcdee587c3 HTTP/1.1" status: 200 len: 945 time: 0.2030671 May 25 17:00:19.945037 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-894be6b1-214e-4ccd-bfda-f2946f1cd65d req-b4600ab9-8322-41b1-8380-3def1ed865d0 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/security-groups?id=8ee5c4ed-9c60-4e39-9185-7e283704a7dc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0964625 May 25 17:00:19.949281 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-d4d5a7f3-bdd4-423b-998c-926193b1755f admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:19.959093 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-d4d5a7f3-bdd4-423b-998c-926193b1755f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-640836'] for security_group, after_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:19.974333 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-d4d5a7f3-bdd4-423b-998c-926193b1755f admin admin] vlan segment allocate from pool success with {'vlan_id': 698, 'physical_network': 'physnet1'} {{(pid=91829) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 25 17:00:19.986346 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-d4d5a7f3-bdd4-423b-998c-926193b1755f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3809789'] for segment, precommit_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:19.986918 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.db.segments_db [None req-d4d5a7f3-bdd4-423b-998c-926193b1755f admin admin] Added segment cb1a8cf9-1f34-483f-8b10-2d2767734b93 of type vlan for network b3bf2911-47e9-4eda-9fe8-ec380a12f536 May 25 17:00:20.017581 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-d4d5a7f3-bdd4-423b-998c-926193b1755f admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8757892541013'] for network, precommit_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:20.025949 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-62128191-67d4-4b78-99fb-1f4c6803dc75 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3832070'] for port, before_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:20.050632 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-b0b32c7c-1058-46da-a16c-e33c8a0a9d67 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:00:20.062216 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-d4d5a7f3-bdd4-423b-998c-926193b1755f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-640806', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-551400'] for network, after_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:20.067274 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d4d5a7f3-bdd4-423b-998c-926193b1755f admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:00:20.068085 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-d4d5a7f3-bdd4-423b-998c-926193b1755f admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-551373'] for network, before_response {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:20.137743 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d4d5a7f3-bdd4-423b-998c-926193b1755f admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=53122d9f-c7a0-4593-a2bf-ee307f9f6354,revision_number=1']} {{(pid=91829) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:00:20.157083 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-d4d5a7f3-bdd4-423b-998c-926193b1755f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.106s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:00:20.157669 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-c782518b-460a-4ee1-bf39-d008796d4efa admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.082s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:00:20.338515 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [None req-d4d5a7f3-bdd4-423b-998c-926193b1755f admin admin] 10.222.0.62 "POST /v2.0/networks HTTP/1.1" status: 201 len: 882 time: 1.0668724 May 25 17:00:20.347876 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.wsgi [-] (91830) accepted ('10.222.0.62', 58642) {{(pid=91830) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:00:20.425633 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d4d5a7f3-bdd4-423b-998c-926193b1755f admin admin] Pushing event updated for resources: {'Network': ['ID=b3bf2911-47e9-4eda-9fe8-ec380a12f536,revision_number=1']} {{(pid=91829) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:00:20.426735 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.v2.base [None req-1afd865b-682f-465c-a85f-61637a8516fb admin admin] Request body: {'subnet': {'network_id': 'b3bf2911-47e9-4eda-9fe8-ec380a12f536', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestShelveInstance-1848885781-subnet', 'tenant_id': '6a788f87b23b492da7fbfb18883b9d2d', 'ip_version': 4}} {{(pid=91830) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 17:00:20.439625 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-d4d5a7f3-bdd4-423b-998c-926193b1755f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.282s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:00:20.450990 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.quota.driver [None req-1afd865b-682f-465c-a85f-61637a8516fb admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91830) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 17:00:20.463825 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.wsgi [-] (91829) accepted ('10.222.0.62', 58650) {{(pid=91829) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:00:20.470371 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [None req-1afd865b-682f-465c-a85f-61637a8516fb admin admin] Usage tracker for resource:subnet and tenant:6a788f87b23b492da7fbfb18883b9d2d is out of sync, need to count used quota {{(pid=91830) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 17:00:20.476122 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [None req-1afd865b-682f-465c-a85f-61637a8516fb admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=91830) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 17:00:20.493038 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-74b37ef9-a91f-4321-9a8e-326e7e007923 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:20.500862 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.quota.driver [None req-1afd865b-682f-465c-a85f-61637a8516fb admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91830) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 17:00:20.514694 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.db.l3_hamode_db [None req-390df57f-256e-442d-8f91-e446b02d47aa None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd2ed6ef9-f77a-4b7a-b152-3e1b9c85e1ad', 'name': 'tempest-AttachVolumeShelveTestJSON-437778030-router', 'tenant_id': 'bbb9e99759bc47d08005f3b1e036a6cf', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'external_fixed_ips': [{'subnet_id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'ip_address': '172.27.2.253'}], 'enable_snat': True}, 'gw_port_id': '3bc942c3-5854-4018-b3fb-5071bf6c70c6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T17:00:14Z', 'updated_at': '2021-05-25T17:00:17Z', 'revision_number': 3, 'project_id': 'bbb9e99759bc47d08005f3b1e036a6cf', 'gw_port': {'id': '3bc942c3-5854-4018-b3fb-5071bf6c70c6', 'name': '', 'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'tenant_id': '', 'mac_address': 'fa:16:3e:da:a2:c4', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd2ed6ef9-f77a-4b7a-b152-3e1b9c85e1ad', 'device_owner': 'network:router_gateway', 'standard_attr_id': 294, 'fixed_ips': [{'subnet_id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'ip_address': '172.27.2.253', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:00:16Z', 'updated_at': '2021-05-25T17:00:16Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-790492-4-iscsi'}], 'dv-cinder-790492-4-iscsi', False) {} {{(pid=91832) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 17:00:20.523046 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.quota.driver [None req-74b37ef9-a91f-4321-9a8e-326e7e007923 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91829) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 17:00:20.525154 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-390df57f-256e-442d-8f91-e446b02d47aa None None] Checking router: d2ed6ef9-f77a-4b7a-b152-3e1b9c85e1ad for host: dv-cinder-790492-4-iscsi {{(pid=91832) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 25 17:00:20.526505 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-390df57f-256e-442d-8f91-e446b02d47aa None None] Updating router d2ed6ef9-f77a-4b7a-b152-3e1b9c85e1ad port 3bc942c3-5854-4018-b3fb-5071bf6c70c6 binding host dv-cinder-790492-4-iscsi {{(pid=91832) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} May 25 17:00:20.527061 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.quota.resource [None req-74b37ef9-a91f-4321-9a8e-326e7e007923 admin admin] Usage tracker for resource:security_group_rule and tenant:fdb066397b55472cb48e4fbeb425fa5b is out of sync, need to count used quota {{(pid=91829) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 17:00:20.530687 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.quota.resource [None req-74b37ef9-a91f-4321-9a8e-326e7e007923 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91829) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 17:00:20.536710 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.quota.driver [None req-74b37ef9-a91f-4321-9a8e-326e7e007923 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91829) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 17:00:20.608216 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-1afd865b-682f-465c-a85f-61637a8516fb admin admin] Made reservation on behalf of 6a788f87b23b492da7fbfb18883b9d2d for: {'subnet': 1} {{(pid=91830) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 25 17:00:20.616571 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-1afd865b-682f-465c-a85f-61637a8516fb admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1152763'] for subnet, before_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:20.656713 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron_lib.callbacks.manager [None req-390df57f-256e-442d-8f91-e446b02d47aa None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3832070'] for port, before_update {{(pid=91832) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:20.657556 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-74b37ef9-a91f-4321-9a8e-326e7e007923 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:20.662720 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-74b37ef9-a91f-4321-9a8e-326e7e007923 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-640836'] for security_group, after_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:20.685505 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-62128191-67d4-4b78-99fb-1f4c6803dc75 None None] Notify callbacks [] for port, precommit_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:20.693706 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-f9d5ca4b-4392-4b0b-bed5-62f65bdc7a26 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:00:20.699297 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.provisioning_blocks [None req-62128191-67d4-4b78-99fb-1f4c6803dc75 None None] Transition to ACTIVE for port object a3cc4b79-05f1-4b3f-95e5-18e49199b00a will not be triggered until provisioned by entity L2. {{(pid=91831) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 25 17:00:20.704037 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [None req-74b37ef9-a91f-4321-9a8e-326e7e007923 admin admin] 10.222.0.62 "GET /v2.0/security-groups?tenant_id=fdb066397b55472cb48e4fbeb425fa5b&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2390761 May 25 17:00:20.706587 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.wsgi [-] (91829) accepted ('10.222.0.62', 58656) {{(pid=91829) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:00:20.711282 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.rpc [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Device e97f6ad1-cca3-4f59-93f4-fd63428d51f2 up at agent ovs-agent-dv-cinder-790492-4-iscsi {{(pid=91831) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 25 17:00:20.776411 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.rpc [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Network b3bf2911-47e9-4eda-9fe8-ec380a12f536 details requested by agent ovs-agent-dv-cinder-790492-4-iscsi with host dv-cinder-790492-4-iscsi {{(pid=91831) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 25 17:00:20.780968 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-74b37ef9-a91f-4321-9a8e-326e7e007923 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=51d06e71-e9d9-433f-aa3c-21e93bb7c559,revision_number=1']} {{(pid=91829) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:00:20.829467 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-74b37ef9-a91f-4321-9a8e-326e7e007923 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91829) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:00:20.829823 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-74b37ef9-a91f-4321-9a8e-326e7e007923 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91829) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:00:20.830386 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-74b37ef9-a91f-4321-9a8e-326e7e007923 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91829) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:00:20.831057 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-74b37ef9-a91f-4321-9a8e-326e7e007923 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91829) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:00:20.831449 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-74b37ef9-a91f-4321-9a8e-326e7e007923 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91829) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:00:20.831842 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-74b37ef9-a91f-4321-9a8e-326e7e007923 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91829) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:00:20.832176 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-74b37ef9-a91f-4321-9a8e-326e7e007923 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91829) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:00:20.832509 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-74b37ef9-a91f-4321-9a8e-326e7e007923 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91829) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:00:20.832837 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-74b37ef9-a91f-4321-9a8e-326e7e007923 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91829) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:00:20.834097 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-74b37ef9-a91f-4321-9a8e-326e7e007923 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91829) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:00:20.834445 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-74b37ef9-a91f-4321-9a8e-326e7e007923 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91829) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:00:20.834780 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-74b37ef9-a91f-4321-9a8e-326e7e007923 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91829) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:00:20.842326 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-74b37ef9-a91f-4321-9a8e-326e7e007923 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.149s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:00:20.874215 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-64e1e318-06a7-47e4-b1bc-f947af94a6e1 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:20.938774 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-62128191-67d4-4b78-99fb-1f4c6803dc75 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8757892955028', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8757892520933', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8757892521750'] for port, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:20.945158 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-64e1e318-06a7-47e4-b1bc-f947af94a6e1 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:20.946195 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [None req-0807fb8f-5b83-4d56-9158-4cca2c2c8edc None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:00:21.158793 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-92bf2b50-3595-45cd-8402-ee193734f57a req-a47d265b-8a8d-4783-a74e-d65ea9b43bce tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] 10.222.0.62 "GET /v2.0/ports?device_id=e2dfa29d-fe86-4425-b12b-d984d7f0584a HTTP/1.1" status: 200 len: 210 time: 0.1309729 May 25 17:00:21.200593 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-64e1e318-06a7-47e4-b1bc-f947af94a6e1 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-640836'] for security_group, after_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:21.204143 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.provisioning_blocks [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Provisioning for port e97f6ad1-cca3-4f59-93f4-fd63428d51f2 completed by entity L2. {{(pid=91831) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 25 17:00:21.204533 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:00:21.215706 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.provisioning_blocks [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Provisioning complete for port e97f6ad1-cca3-4f59-93f4-fd63428d51f2 triggered by entity L2. {{(pid=91831) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 17:00:21.216380 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3854128'] for port, provisioning_complete {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:21.231550 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-64e1e318-06a7-47e4-b1bc-f947af94a6e1 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=51d06e71-e9d9-433f-aa3c-21e93bb7c559,revision_number=None']} {{(pid=91829) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:00:21.234486 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-64e1e318-06a7-47e4-b1bc-f947af94a6e1 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.030s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:00:21.315755 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-16c7f921-9ac3-4a93-8dd9-90ee7d84d9fd admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3832070'] for port, before_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:21.332183 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-64e1e318-06a7-47e4-b1bc-f947af94a6e1 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:21.336374 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [None req-64e1e318-06a7-47e4-b1bc-f947af94a6e1 admin admin] 10.222.0.62 "DELETE /v2.0/security-groups/51d06e71-e9d9-433f-aa3c-21e93bb7c559 HTTP/1.1" status: 204 len: 168 time: 0.6280439 May 25 17:00:21.377724 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e9101153-5e25-4fac-abb9-0864bdb48ee3 req-20ba6884-c147-4d82-93a2-a5a98d123ef2 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:00:21.385281 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-e9101153-5e25-4fac-abb9-0864bdb48ee3 req-20ba6884-c147-4d82-93a2-a5a98d123ef2 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/ports?device_id=d87a1395-92e0-4727-a5ed-a8dcdee587c3 HTTP/1.1" status: 200 len: 945 time: 0.1562114 May 25 17:00:21.489381 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron_lib.callbacks.manager [None req-390df57f-256e-442d-8f91-e446b02d47aa None None] Notify callbacks [] for port, precommit_update {{(pid=91832) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:21.505976 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-e9101153-5e25-4fac-abb9-0864bdb48ee3 req-8cd7f3cb-d455-4f6c-9976-e76249df4e1a tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/security-groups?id=8ee5c4ed-9c60-4e39-9185-7e283704a7dc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1196945 May 25 17:00:21.529084 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.db.provisioning_blocks [None req-390df57f-256e-442d-8f91-e446b02d47aa None None] Transition to ACTIVE for port object 3bc942c3-5854-4018-b3fb-5071bf6c70c6 will not be triggered until provisioned by entity L2. {{(pid=91832) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 25 17:00:21.543934 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron_lib.callbacks.manager [None req-390df57f-256e-442d-8f91-e446b02d47aa None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8757892955028', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8757892520933', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8757892521750'] for port, after_update {{(pid=91832) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:21.556002 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG oslo_concurrency.lockutils [None req-51357222-7415-4581-9103-dae32eea8cff None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:00:21.585202 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.managers [None req-62128191-67d4-4b78-99fb-1f4c6803dc75 None None] Attempting to bind port a3cc4b79-05f1-4b3f-95e5-18e49199b00a on host dv-cinder-790492-4-iscsi for vnic_type normal with profile {{(pid=91831) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 25 17:00:21.585202 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.managers [None req-62128191-67d4-4b78-99fb-1f4c6803dc75 None None] Attempting to bind port a3cc4b79-05f1-4b3f-95e5-18e49199b00a by drivers openvswitch,hyperv on host dv-cinder-790492-4-iscsi at level 0 using segments [{'id': '55bc70ae-213c-42ca-b035-b4a902044007', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 659, 'network_id': '613457eb-6f6d-4604-8f6c-f2d318ff9bc5'}] {{(pid=91831) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 25 17:00:21.585848 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-62128191-67d4-4b78-99fb-1f4c6803dc75 None None] Attempting to bind port a3cc4b79-05f1-4b3f-95e5-18e49199b00a on network 613457eb-6f6d-4604-8f6c-f2d318ff9bc5 {{(pid=91831) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 25 17:00:21.631136 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-62128191-67d4-4b78-99fb-1f4c6803dc75 None None] Checking agent: {'id': 'fc8251e1-071c-49f7-bc10-1337f1d37d1b', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-790492-4-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 25, 16, 50, 28), 'started_at': datetime.datetime(2021, 5, 25, 16, 50, 58), 'heartbeat_timestamp': datetime.datetime(2021, 5, 25, 16, 59, 58), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-790492-4-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=91831) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 25 17:00:21.631714 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-62128191-67d4-4b78-99fb-1f4c6803dc75 None None] Checking segment: {'id': '55bc70ae-213c-42ca-b035-b4a902044007', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 659, 'network_id': '613457eb-6f6d-4604-8f6c-f2d318ff9bc5'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91831) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 25 17:00:21.632293 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-62128191-67d4-4b78-99fb-1f4c6803dc75 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:21.632693 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-62128191-67d4-4b78-99fb-1f4c6803dc75 None None] Bound using segment: {'id': '55bc70ae-213c-42ca-b035-b4a902044007', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 659, 'network_id': '613457eb-6f6d-4604-8f6c-f2d318ff9bc5'} {{(pid=91831) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 25 17:00:21.633212 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.managers [None req-62128191-67d4-4b78-99fb-1f4c6803dc75 None None] Bound port: a3cc4b79-05f1-4b3f-95e5-18e49199b00a, host: dv-cinder-790492-4-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '55bc70ae-213c-42ca-b035-b4a902044007', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 659, 'network_id': '613457eb-6f6d-4604-8f6c-f2d318ff9bc5'}}] {{(pid=91831) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 25 17:00:21.635705 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-62128191-67d4-4b78-99fb-1f4c6803dc75 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3832070'] for port, before_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:21.657939 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3fb13473-a2bf-442d-9fa8-c8caea6a2af0 None None] Pushing event updated for resources: {'Port': ['ID=a3cc4b79-05f1-4b3f-95e5-18e49199b00a,revision_number=3']} {{(pid=91831) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:00:21.700240 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3fb13473-a2bf-442d-9fa8-c8caea6a2af0 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91831) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:00:21.700797 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3fb13473-a2bf-442d-9fa8-c8caea6a2af0 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91831) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:00:21.700874 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3fb13473-a2bf-442d-9fa8-c8caea6a2af0 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91831) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:00:21.701205 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3fb13473-a2bf-442d-9fa8-c8caea6a2af0 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91831) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:00:21.701533 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3fb13473-a2bf-442d-9fa8-c8caea6a2af0 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91831) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:00:21.701858 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3fb13473-a2bf-442d-9fa8-c8caea6a2af0 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91831) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:00:21.715515 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3fb13473-a2bf-442d-9fa8-c8caea6a2af0 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91831) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:00:21.715845 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3fb13473-a2bf-442d-9fa8-c8caea6a2af0 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91831) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:00:21.716188 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3fb13473-a2bf-442d-9fa8-c8caea6a2af0 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91831) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:00:21.716517 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3fb13473-a2bf-442d-9fa8-c8caea6a2af0 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91831) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:00:21.716907 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3fb13473-a2bf-442d-9fa8-c8caea6a2af0 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91831) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:00:21.717275 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3fb13473-a2bf-442d-9fa8-c8caea6a2af0 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91831) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:00:21.721971 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [None req-3fb13473-a2bf-442d-9fa8-c8caea6a2af0 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.776s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:00:21.749895 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.plugins.ml2.managers [None req-390df57f-256e-442d-8f91-e446b02d47aa None None] Attempting to bind port 3bc942c3-5854-4018-b3fb-5071bf6c70c6 on host dv-cinder-790492-4-iscsi for vnic_type normal with profile {{(pid=91832) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 25 17:00:21.753245 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.plugins.ml2.managers [None req-390df57f-256e-442d-8f91-e446b02d47aa None None] Attempting to bind port 3bc942c3-5854-4018-b3fb-5071bf6c70c6 by drivers openvswitch,hyperv on host dv-cinder-790492-4-iscsi at level 0 using segments [{'id': '414a8468-1d66-4792-9e81-d8ac5ccf1512', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74'}] {{(pid=91832) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 25 17:00:21.753697 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-390df57f-256e-442d-8f91-e446b02d47aa None None] Attempting to bind port 3bc942c3-5854-4018-b3fb-5071bf6c70c6 on network 4364b6ab-4117-4a92-baeb-f5ee2f45bf74 {{(pid=91832) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 25 17:00:21.761827 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5d577993-7c36-4f17-9599-70c105d0c2a3 None None] Pushing event updated for resources: {'Port': ['ID=3bc942c3-5854-4018-b3fb-5071bf6c70c6,revision_number=2']} {{(pid=91832) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:00:21.771010 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG oslo_concurrency.lockutils [None req-5d577993-7c36-4f17-9599-70c105d0c2a3 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.215s {{(pid=91832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:00:21.783429 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-390df57f-256e-442d-8f91-e446b02d47aa None None] Checking agent: {'id': 'fc8251e1-071c-49f7-bc10-1337f1d37d1b', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-790492-4-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 25, 16, 50, 28), 'started_at': datetime.datetime(2021, 5, 25, 16, 50, 58), 'heartbeat_timestamp': datetime.datetime(2021, 5, 25, 16, 59, 58), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-790492-4-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=91832) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 25 17:00:21.784244 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-390df57f-256e-442d-8f91-e446b02d47aa None None] Checking segment: {'id': '414a8468-1d66-4792-9e81-d8ac5ccf1512', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91832) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 25 17:00:21.784850 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron_lib.callbacks.manager [None req-390df57f-256e-442d-8f91-e446b02d47aa None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=91832) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:21.785503 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-390df57f-256e-442d-8f91-e446b02d47aa None None] Bound using segment: {'id': '414a8468-1d66-4792-9e81-d8ac5ccf1512', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74'} {{(pid=91832) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 25 17:00:21.786206 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.plugins.ml2.managers [None req-390df57f-256e-442d-8f91-e446b02d47aa None None] Bound port: 3bc942c3-5854-4018-b3fb-5071bf6c70c6, host: dv-cinder-790492-4-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '414a8468-1d66-4792-9e81-d8ac5ccf1512', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74'}}] {{(pid=91832) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 25 17:00:21.786737 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron_lib.callbacks.manager [None req-390df57f-256e-442d-8f91-e446b02d47aa None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3832070'] for port, before_update {{(pid=91832) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:21.888614 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.db [None req-62128191-67d4-4b78-99fb-1f4c6803dc75 None None] For port a3cc4b79-05f1-4b3f-95e5-18e49199b00a, host dv-cinder-790492-4-iscsi, cleared binding levels {{(pid=91831) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 25 17:00:21.892389 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.db [None req-62128191-67d4-4b78-99fb-1f4c6803dc75 None None] For port a3cc4b79-05f1-4b3f-95e5-18e49199b00a, host dv-cinder-790492-4-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-790492-4-iscsi',level=0,port_id=a3cc4b79-05f1-4b3f-95e5-18e49199b00a,segment=NetworkSegment(55bc70ae-213c-42ca-b035-b4a902044007),segment_id=55bc70ae-213c-42ca-b035-b4a902044007)] {{(pid=91831) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 25 17:00:21.901713 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-62128191-67d4-4b78-99fb-1f4c6803dc75 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8757892955028', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8757892520933', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8757892521750'] for port, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:21.915812 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:00:21.930980 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.plugins.ml2.db [None req-390df57f-256e-442d-8f91-e446b02d47aa None None] For port 3bc942c3-5854-4018-b3fb-5071bf6c70c6, host dv-cinder-790492-4-iscsi, cleared binding levels {{(pid=91832) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 25 17:00:21.938822 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.plugins.ml2.db [None req-390df57f-256e-442d-8f91-e446b02d47aa None None] For port 3bc942c3-5854-4018-b3fb-5071bf6c70c6, host dv-cinder-790492-4-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-790492-4-iscsi',level=0,port_id=3bc942c3-5854-4018-b3fb-5071bf6c70c6,segment=NetworkSegment(414a8468-1d66-4792-9e81-d8ac5ccf1512),segment_id=414a8468-1d66-4792-9e81-d8ac5ccf1512)] {{(pid=91832) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 25 17:00:21.950834 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron_lib.callbacks.manager [None req-390df57f-256e-442d-8f91-e446b02d47aa None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8757892955028', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8757892520933', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8757892521750'] for port, after_update {{(pid=91832) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:21.964641 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG oslo_concurrency.lockutils [None req-c287428e-0203-44c2-b764-bf38ea5ab57f None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:00:21.986095 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3832070'] for port, before_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:22.036120 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.db_base_plugin_common [None req-16c7f921-9ac3-4a93-8dd9-90ee7d84d9fd admin admin] Allocated IP 172.20.0.1 (e5be4c6a-143f-474c-a90b-37180778cefe/6e6b5897-e23d-4281-96cb-a6fdf9b68134/735e7c1b-31b2-48e2-b2b7-538c31dbffb6) {{(pid=91830) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 25 17:00:22.079463 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.l3_dvrscheduler_db [None req-62128191-67d4-4b78-99fb-1f4c6803dc75 None None] Routers {'c063ed68-292f-4e35-ba01-24f34d8a5e42'} bound to L3 agent in host dv-cinder-790492-4-iscsi {{(pid=91831) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 17:00:22.088187 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.l3_hamode_db [None req-62128191-67d4-4b78-99fb-1f4c6803dc75 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-790492-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-05-25T16:50:28Z,description=,heartbeat_timestamp=2021-05-25T16:59:58Z,host='dv-cinder-790492-4-iscsi',id=a2d427c1-2d07-43e8-afbe-218c9f7d0445,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T16:50:28Z,topic='l3_agent')) {'router_ids': ['c063ed68-292f-4e35-ba01-24f34d8a5e42'], 'active': True} {{(pid=91831) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 17:00:22.130695 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.db.l3_dvrscheduler_db [None req-390df57f-256e-442d-8f91-e446b02d47aa None None] Routers {'d2ed6ef9-f77a-4b7a-b152-3e1b9c85e1ad'} bound to L3 agent in host dv-cinder-790492-4-iscsi {{(pid=91832) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 17:00:22.131292 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.db.l3_hamode_db [None req-390df57f-256e-442d-8f91-e446b02d47aa None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-790492-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-05-25T16:50:28Z,description=,heartbeat_timestamp=2021-05-25T16:59:58Z,host='dv-cinder-790492-4-iscsi',id=a2d427c1-2d07-43e8-afbe-218c9f7d0445,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T16:50:28Z,topic='l3_agent')) {'router_ids': ['d2ed6ef9-f77a-4b7a-b152-3e1b9c85e1ad'], 'active': True} {{(pid=91832) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 17:00:22.273744 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5d577993-7c36-4f17-9599-70c105d0c2a3 None None] Pushing event updated for resources: {'Port': ['ID=3bc942c3-5854-4018-b3fb-5071bf6c70c6,revision_number=3']} {{(pid=91832) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:00:22.469580 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.db.l3_dvr_db [None req-390df57f-256e-442d-8f91-e446b02d47aa None None] Set router d2ed6ef9-f77a-4b7a-b152-3e1b9c85e1ad gateway port host: dv-cinder-790492-4-iscsi {{(pid=91832) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 17:00:22.507645 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-1afd865b-682f-465c-a85f-61637a8516fb admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55886', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-28085051', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-1152749'] for subnet, after_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:22.543055 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-ec184a5e-a2a8-426b-a2f1-162ad256f17b admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:00:22.668093 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.l3_dvr_db [None req-62128191-67d4-4b78-99fb-1f4c6803dc75 None None] Set router c063ed68-292f-4e35-ba01-24f34d8a5e42 gateway port host: dv-cinder-790492-4-iscsi {{(pid=91831) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 17:00:22.709898 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d7f73357-c953-4c76-b57d-a32938f5a903 req-b04a7ce3-1597-4656-bfcb-58c25b92e010 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=91830) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:00:22.713815 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-d7f73357-c953-4c76-b57d-a32938f5a903 req-b04a7ce3-1597-4656-bfcb-58c25b92e010 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] 10.222.0.32 "GET /v2.0/networks?id=63b1f335-e2c4-48dd-886b-6be853f8a2fc HTTP/1.1" status: 200 len: 814 time: 0.6380308 May 25 17:00:22.737675 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-16c7f921-9ac3-4a93-8dd9-90ee7d84d9fd admin admin] Notify callbacks [] for port, precommit_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:22.766750 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.v2.base [req-d7f73357-c953-4c76-b57d-a32938f5a903 req-7369b2c7-0e07-4a2c-a1a4-6ce7fc2f8c9d tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] Request body: {'port': {'device_id': 'e2dfa29d-fe86-4425-b12b-d984d7f0584a', 'network_id': '63b1f335-e2c4-48dd-886b-6be853f8a2fc', 'admin_state_up': True, 'tenant_id': '04e8022f24e3464ab1ab7726d6a07e08'}} {{(pid=91830) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 17:00:22.798736 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1afd865b-682f-465c-a85f-61637a8516fb admin admin] Pushing event updated for resources: {'Subnet': ['ID=04a2fff9-c99b-4a81-8cff-a0e02839c1f9,revision_number=0']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:00:22.801359 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG oslo_concurrency.lockutils [None req-5d577993-7c36-4f17-9599-70c105d0c2a3 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.837s {{(pid=91832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:00:22.813716 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-01fcd26c-16fb-40d3-8837-35a2ad7b9971 req-66f34ca1-4790-4523-92b7-3efcc445e995 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] 10.222.0.62 "GET /v2.0/ports?device_id=e2dfa29d-fe86-4425-b12b-d984d7f0584a HTTP/1.1" status: 200 len: 210 time: 0.4102914 May 25 17:00:22.888829 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1afd865b-682f-465c-a85f-61637a8516fb admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91830) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:00:22.888829 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1afd865b-682f-465c-a85f-61637a8516fb admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91830) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:00:22.891246 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1afd865b-682f-465c-a85f-61637a8516fb admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91830) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:00:22.891246 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1afd865b-682f-465c-a85f-61637a8516fb admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91830) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:00:22.891438 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1afd865b-682f-465c-a85f-61637a8516fb admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91830) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:00:22.894337 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1afd865b-682f-465c-a85f-61637a8516fb admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91830) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:00:22.899169 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1afd865b-682f-465c-a85f-61637a8516fb admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91830) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:00:22.899169 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1afd865b-682f-465c-a85f-61637a8516fb admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91830) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:00:22.899467 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1afd865b-682f-465c-a85f-61637a8516fb admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91830) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:00:22.901032 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1afd865b-682f-465c-a85f-61637a8516fb admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91830) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:00:22.901378 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1afd865b-682f-465c-a85f-61637a8516fb admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91830) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:00:22.901898 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1afd865b-682f-465c-a85f-61637a8516fb admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91830) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:00:22.914087 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-1afd865b-682f-465c-a85f-61637a8516fb admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.371s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:00:22.943240 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3fb13473-a2bf-442d-9fa8-c8caea6a2af0 None None] Pushing event updated for resources: {'Port': ['ID=a3cc4b79-05f1-4b3f-95e5-18e49199b00a,revision_number=4']} {{(pid=91831) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:00:22.956687 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [None req-3fb13473-a2bf-442d-9fa8-c8caea6a2af0 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 1.041s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:00:23.033849 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.db [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] For port e97f6ad1-cca3-4f59-93f4-fd63428d51f2, host dv-cinder-790492-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-790492-4-iscsi',level=0,port_id=e97f6ad1-cca3-4f59-93f4-fd63428d51f2,segment=NetworkSegment(a8fb0313-938a-4f5e-8ff4-96df8acd943b),segment_id=a8fb0313-938a-4f5e-8ff4-96df8acd943b)] {{(pid=91831) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 17:00:23.080424 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5c11a13c-173a-4e72-8444-343b96a65d74 req-fe36c540-0c1d-46b1-a61d-bc67f81b0cac tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:00:23.089510 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1afd865b-682f-465c-a85f-61637a8516fb admin admin] Checking segment: {'id': 'cb1a8cf9-1f34-483f-8b10-2d2767734b93', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 698, 'network_id': 'b3bf2911-47e9-4eda-9fe8-ec380a12f536'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91830) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 25 17:00:23.090071 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1afd865b-682f-465c-a85f-61637a8516fb admin admin] Network hostable DHCP agents. Network: b3bf2911-47e9-4eda-9fe8-ec380a12f536, hostable agents: ['8d7401c6-8951-4f2b-ace4-208761782bfc'], hosted agents: [] {{(pid=91830) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 25 17:00:23.092138 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-5c11a13c-173a-4e72-8444-343b96a65d74 req-fe36c540-0c1d-46b1-a61d-bc67f81b0cac tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/ports?device_id=d87a1395-92e0-4727-a5ed-a8dcdee587c3 HTTP/1.1" status: 200 len: 945 time: 0.2765360 May 25 17:00:23.117801 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.provisioning_blocks [None req-16c7f921-9ac3-4a93-8dd9-90ee7d84d9fd admin admin] Transition to ACTIVE for port object 735e7c1b-31b2-48e2-b2b7-538c31dbffb6 will not be triggered until provisioned by entity DHCP. {{(pid=91830) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 25 17:00:23.118721 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.db.l3_hamode_db [None req-390df57f-256e-442d-8f91-e446b02d47aa None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd2ed6ef9-f77a-4b7a-b152-3e1b9c85e1ad', 'name': 'tempest-AttachVolumeShelveTestJSON-437778030-router', 'tenant_id': 'bbb9e99759bc47d08005f3b1e036a6cf', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'external_fixed_ips': [{'subnet_id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'ip_address': '172.27.2.253'}], 'enable_snat': True}, 'gw_port_id': '3bc942c3-5854-4018-b3fb-5071bf6c70c6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T17:00:14Z', 'updated_at': '2021-05-25T17:00:17Z', 'revision_number': 3, 'project_id': 'bbb9e99759bc47d08005f3b1e036a6cf', 'gw_port': {'id': '3bc942c3-5854-4018-b3fb-5071bf6c70c6', 'name': '', 'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'tenant_id': '', 'mac_address': 'fa:16:3e:da:a2:c4', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd2ed6ef9-f77a-4b7a-b152-3e1b9c85e1ad', 'device_owner': 'network:router_gateway', 'standard_attr_id': 294, 'fixed_ips': [{'subnet_id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'ip_address': '172.27.2.253', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790492-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:00:16Z', 'updated_at': '2021-05-25T17:00:21Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-790492-4-iscsi'}], 'dv-cinder-790492-4-iscsi', False) {} {{(pid=91832) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 17:00:23.126893 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-390df57f-256e-442d-8f91-e446b02d47aa None None] The sync data for ids ['d2ed6ef9-f77a-4b7a-b152-3e1b9c85e1ad'] in dv-cinder-790492-4-iscsi is: [{'id': 'd2ed6ef9-f77a-4b7a-b152-3e1b9c85e1ad', 'name': 'tempest-AttachVolumeShelveTestJSON-437778030-router', 'tenant_id': 'bbb9e99759bc47d08005f3b1e036a6cf', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'external_fixed_ips': [{'subnet_id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'ip_address': '172.27.2.253'}], 'enable_snat': True}, 'gw_port_id': '3bc942c3-5854-4018-b3fb-5071bf6c70c6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T17:00:14Z', 'updated_at': '2021-05-25T17:00:17Z', 'revision_number': 3, 'project_id': 'bbb9e99759bc47d08005f3b1e036a6cf', 'gw_port': {'id': '3bc942c3-5854-4018-b3fb-5071bf6c70c6', 'name': '', 'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'tenant_id': '', 'mac_address': 'fa:16:3e:da:a2:c4', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd2ed6ef9-f77a-4b7a-b152-3e1b9c85e1ad', 'device_owner': 'network:router_gateway', 'standard_attr_id': 294, 'fixed_ips': [{'subnet_id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'ip_address': '172.27.2.253', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790492-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:00:16Z', 'updated_at': '2021-05-25T17:00:21Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-790492-4-iscsi'}] {{(pid=91832) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 25 17:00:23.187929 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8757892955028', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8757892520933', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8757892521750'] for port, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:23.197648 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [None req-f399796c-18b1-40a1-9b3b-7652a1e298bd None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:00:23.199086 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1afd865b-682f-465c-a85f-61637a8516fb admin admin] Network b3bf2911-47e9-4eda-9fe8-ec380a12f536 is scheduled to be hosted by DHCP agent 8d7401c6-8951-4f2b-ace4-208761782bfc with binding_index 1 {{(pid=91830) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 25 17:00:23.223267 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-5c11a13c-173a-4e72-8444-343b96a65d74 req-57f5bcc0-8b59-49d7-a464-3066723596ae tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/security-groups?id=8ee5c4ed-9c60-4e39-9185-7e283704a7dc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1196635 May 25 17:00:23.250851 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.scheduler.base_scheduler [None req-1afd865b-682f-465c-a85f-61637a8516fb admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-790492-4-iscsi, b3bf2911-47e9-4eda-9fe8-ec380a12f536) {{(pid=91830) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 17:00:23.336433 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1afd865b-682f-465c-a85f-61637a8516fb admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=91830) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:00:23.337063 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-1afd865b-682f-465c-a85f-61637a8516fb admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-551373'] for subnet, before_response {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:23.356466 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-de3091a1-d66d-41fd-9498-a6d6216ad0b2 None None] Network b3bf2911-47e9-4eda-9fe8-ec380a12f536 requested from dv-cinder-790492-4-iscsi {{(pid=91831) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} May 25 17:00:23.394958 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [None req-1afd865b-682f-465c-a85f-61637a8516fb admin admin] 10.222.0.62 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 845 time: 3.0458438 May 25 17:00:23.397635 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.wsgi [-] (91829) accepted ('10.222.0.62', 58746) {{(pid=91829) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:00:23.405564 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.v2.base [None req-84afc747-434e-44e8-9eae-c644a6d90f3e admin admin] Request body: {'router': {'name': 'tempest-TestShelveInstance-1848885781-router', 'tenant_id': '6a788f87b23b492da7fbfb18883b9d2d', 'external_gateway_info': {'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74'}}} {{(pid=91829) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 17:00:23.416281 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.quota.driver [None req-84afc747-434e-44e8-9eae-c644a6d90f3e admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91829) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 17:00:23.423804 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.quota.resource [None req-84afc747-434e-44e8-9eae-c644a6d90f3e admin admin] Usage tracker for resource:router and tenant:6a788f87b23b492da7fbfb18883b9d2d is out of sync, need to count used quota {{(pid=91829) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 17:00:23.431179 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.quota.resource [None req-84afc747-434e-44e8-9eae-c644a6d90f3e admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=91829) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 17:00:23.437659 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.quota.driver [req-d7f73357-c953-4c76-b57d-a32938f5a903 req-7369b2c7-0e07-4a2c-a1a4-6ce7fc2f8c9d tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91830) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 17:00:23.442816 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [req-d7f73357-c953-4c76-b57d-a32938f5a903 req-7369b2c7-0e07-4a2c-a1a4-6ce7fc2f8c9d tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] Usage tracker for resource:port and tenant:04e8022f24e3464ab1ab7726d6a07e08 is out of sync, need to count used quota {{(pid=91830) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 17:00:23.446889 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.quota.driver [None req-84afc747-434e-44e8-9eae-c644a6d90f3e admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91829) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 17:00:23.447163 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [req-d7f73357-c953-4c76-b57d-a32938f5a903 req-7369b2c7-0e07-4a2c-a1a4-6ce7fc2f8c9d tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] Quota usage for port was recalculated. Used quota:1. {{(pid=91830) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 17:00:23.455088 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.quota.driver [req-d7f73357-c953-4c76-b57d-a32938f5a903 req-7369b2c7-0e07-4a2c-a1a4-6ce7fc2f8c9d tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] Attempting to reserve 1 items for resource port. Total usage: 1; quota limit: 500; headroom:499 {{(pid=91830) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 17:00:23.481240 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-d7f73357-c953-4c76-b57d-a32938f5a903 req-7369b2c7-0e07-4a2c-a1a4-6ce7fc2f8c9d tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] Made reservation on behalf of 04e8022f24e3464ab1ab7726d6a07e08 for: {'port': 1} {{(pid=91830) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 25 17:00:23.488905 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [req-d7f73357-c953-4c76-b57d-a32938f5a903 req-7369b2c7-0e07-4a2c-a1a4-6ce7fc2f8c9d tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3832070'] for port, before_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:23.584039 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-84afc747-434e-44e8-9eae-c644a6d90f3e admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-684888', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-31042'] for router, before_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:23.601227 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-84afc747-434e-44e8-9eae-c644a6d90f3e admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-684376', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-683143', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-647018', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-31049'] for router, precommit_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:23.631579 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-84afc747-434e-44e8-9eae-c644a6d90f3e admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:23.918396 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.db_base_plugin_common [req-d7f73357-c953-4c76-b57d-a32938f5a903 req-7369b2c7-0e07-4a2c-a1a4-6ce7fc2f8c9d tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] Allocated IP 172.20.0.14 (63b1f335-e2c4-48dd-886b-6be853f8a2fc/b0baa944-cafe-48a4-861a-dae28947b9f0/46a1adbe-ec54-4c57-aa7a-9f257475e01c) {{(pid=91830) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 25 17:00:23.996724 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Pushing event updated for resources: {'Port': ['ID=e97f6ad1-cca3-4f59-93f4-fd63428d51f2,revision_number=3']} {{(pid=91831) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:00:24.010001 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.812s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:00:24.180633 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [req-d7f73357-c953-4c76-b57d-a32938f5a903 req-7369b2c7-0e07-4a2c-a1a4-6ce7fc2f8c9d tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] Notify callbacks [] for port, precommit_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:24.204259 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-16c7f921-9ac3-4a93-8dd9-90ee7d84d9fd admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8757892520915', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-27483019'] for port, after_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:24.224865 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-8dbd849d-a3ea-44e3-91be-f6e8be2ff101 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:00:24.238507 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.l3_hamode_db [None req-62128191-67d4-4b78-99fb-1f4c6803dc75 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'c063ed68-292f-4e35-ba01-24f34d8a5e42', 'name': 'tempest-TestShelveInstance-1452464711-router', 'tenant_id': 'a736cc60cc2143c4b6dea99321051da5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'external_fixed_ips': [{'subnet_id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'ip_address': '172.27.2.75'}], 'enable_snat': True}, 'gw_port_id': '703dfe81-5ded-48db-9e96-d09ac4afce0f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T17:00:08Z', 'updated_at': '2021-05-25T17:00:15Z', 'revision_number': 4, 'project_id': 'a736cc60cc2143c4b6dea99321051da5', 'gw_port': {'id': '703dfe81-5ded-48db-9e96-d09ac4afce0f', 'name': '', 'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'tenant_id': '', 'mac_address': 'fa:16:3e:32:8f:aa', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c063ed68-292f-4e35-ba01-24f34d8a5e42', 'device_owner': 'network:router_gateway', 'standard_attr_id': 268, 'fixed_ips': [{'subnet_id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'ip_address': '172.27.2.75', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790492-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:00:09Z', 'updated_at': '2021-05-25T17:00:17Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-790492-4-iscsi', '_interfaces': [{'id': 'a3cc4b79-05f1-4b3f-95e5-18e49199b00a', 'name': '', 'network_id': '613457eb-6f6d-4604-8f6c-f2d318ff9bc5', 'tenant_id': 'a736cc60cc2143c4b6dea99321051da5', 'mac_address': 'fa:16:3e:c6:46:19', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'c063ed68-292f-4e35-ba01-24f34d8a5e42', 'device_owner': 'network:router_interface', 'standard_attr_id': 282, 'fixed_ips': [{'subnet_id': '3fc60650-484d-4574-bb67-0e4931bc9854', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790492-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:00:13Z', 'updated_at': '2021-05-25T17:00:21Z', 'revision_number': 4, 'project_id': 'a736cc60cc2143c4b6dea99321051da5', 'subnets': [{'id': '3fc60650-484d-4574-bb67-0e4931bc9854', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-790492-4-iscsi', False) {} {{(pid=91831) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 17:00:24.244026 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-62128191-67d4-4b78-99fb-1f4c6803dc75 None None] The sync data for ids ['c063ed68-292f-4e35-ba01-24f34d8a5e42'] in dv-cinder-790492-4-iscsi is: [{'id': 'c063ed68-292f-4e35-ba01-24f34d8a5e42', 'name': 'tempest-TestShelveInstance-1452464711-router', 'tenant_id': 'a736cc60cc2143c4b6dea99321051da5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'external_fixed_ips': [{'subnet_id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'ip_address': '172.27.2.75'}], 'enable_snat': True}, 'gw_port_id': '703dfe81-5ded-48db-9e96-d09ac4afce0f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T17:00:08Z', 'updated_at': '2021-05-25T17:00:15Z', 'revision_number': 4, 'project_id': 'a736cc60cc2143c4b6dea99321051da5', 'gw_port': {'id': '703dfe81-5ded-48db-9e96-d09ac4afce0f', 'name': '', 'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'tenant_id': '', 'mac_address': 'fa:16:3e:32:8f:aa', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c063ed68-292f-4e35-ba01-24f34d8a5e42', 'device_owner': 'network:router_gateway', 'standard_attr_id': 268, 'fixed_ips': [{'subnet_id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'ip_address': '172.27.2.75', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790492-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:00:09Z', 'updated_at': '2021-05-25T17:00:17Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-790492-4-iscsi', '_interfaces': [{'id': 'a3cc4b79-05f1-4b3f-95e5-18e49199b00a', 'name': '', 'network_id': '613457eb-6f6d-4604-8f6c-f2d318ff9bc5', 'tenant_id': 'a736cc60cc2143c4b6dea99321051da5', 'mac_address': 'fa:16:3e:c6:46:19', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'c063ed68-292f-4e35-ba01-24f34d8a5e42', 'device_owner': 'network:router_interface', 'standard_attr_id': 282, 'fixed_ips': [{'subnet_id': '3fc60650-484d-4574-bb67-0e4931bc9854', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790492-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:00:13Z', 'updated_at': '2021-05-25T17:00:21Z', 'revision_number': 4, 'project_id': 'a736cc60cc2143c4b6dea99321051da5', 'subnets': [{'id': '3fc60650-484d-4574-bb67-0e4931bc9854', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=91831) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 25 17:00:24.259467 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-339aa0cb-86be-4552-866a-55dd5c0bb7f2 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp6d7ebc81-b6b5-52ec-b8f5-10a9de34bf46-b3bf2911-47e9-4eda-9fe8-ec380a12f536', 'network_id': 'b3bf2911-47e9-4eda-9fe8-ec380a12f536', 'tenant_id': '6a788f87b23b492da7fbfb18883b9d2d', 'fixed_ips': [{'subnet_id': '04a2fff9-c99b-4a81-8cff-a0e02839c1f9'}]}} from dv-cinder-790492-4-iscsi. {{(pid=91831) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} May 25 17:00:24.260408 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-339aa0cb-86be-4552-866a-55dd5c0bb7f2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3832070'] for port, before_create {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:24.345845 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-26afa224-a36b-40df-adea-72e69cc54888 req-cf189e6a-6729-4959-9a6f-1f697a950d12 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] 10.222.0.62 "GET /v2.0/ports?device_id=e2dfa29d-fe86-4425-b12b-d984d7f0584a HTTP/1.1" status: 200 len: 210 time: 0.1244011 May 25 17:00:24.356158 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-84afc747-434e-44e8-9eae-c644a6d90f3e admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-683170', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-684906', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-31039'] for router, precommit_update {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:24.385982 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-16c7f921-9ac3-4a93-8dd9-90ee7d84d9fd admin admin] Pushing event updated for resources: {'Port': ['ID=735e7c1b-31b2-48e2-b2b7-538c31dbffb6,revision_number=1']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:00:24.392325 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-16c7f921-9ac3-4a93-8dd9-90ee7d84d9fd admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.168s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:00:24.415217 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-584791c1-e171-45df-9cd5-d0b7abc87fd1 req-707458b1-ee47-449c-b9b7-0b5ffe9d9796 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:00:24.424220 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-584791c1-e171-45df-9cd5-d0b7abc87fd1 req-707458b1-ee47-449c-b9b7-0b5ffe9d9796 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/ports?device_id=58da9205-0212-4daa-996c-1eef64a2b702 HTTP/1.1" status: 200 len: 945 time: 0.9543228 May 25 17:00:24.428394 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-16c7f921-9ac3-4a93-8dd9-90ee7d84d9fd admin admin] Network e5be4c6a-143f-474c-a90b-37180778cefe is already hosted by enough agents. {{(pid=91830) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 25 17:00:24.437028 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.scheduler.base_scheduler [None req-16c7f921-9ac3-4a93-8dd9-90ee7d84d9fd admin admin] Resources bound (agent type, host, resource id): {{(pid=91830) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 17:00:24.443645 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.l3_dvrscheduler_db [None req-16c7f921-9ac3-4a93-8dd9-90ee7d84d9fd admin admin] Received port after_create {{(pid=91830) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 25 17:00:24.563647 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [req-d7f73357-c953-4c76-b57d-a32938f5a903 req-7369b2c7-0e07-4a2c-a1a4-6ce7fc2f8c9d tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8757892520915', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-27483019'] for port, after_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:24.600769 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:00:24.749801 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7369b2c7-0e07-4a2c-a1a4-6ce7fc2f8c9d tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] Pushing event updated for resources: {'Port': ['ID=46a1adbe-ec54-4c57-aa7a-9f257475e01c,revision_number=1']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:00:24.769472 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-7369b2c7-0e07-4a2c-a1a4-6ce7fc2f8c9d tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.168s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:00:24.806695 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-16c7f921-9ac3-4a93-8dd9-90ee7d84d9fd admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-680080'] for router_interface, before_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:24.816917 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-d7f73357-c953-4c76-b57d-a32938f5a903 req-7369b2c7-0e07-4a2c-a1a4-6ce7fc2f8c9d tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] Network 63b1f335-e2c4-48dd-886b-6be853f8a2fc is already hosted by enough agents. {{(pid=91830) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 25 17:00:24.819378 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.scheduler.base_scheduler [req-d7f73357-c953-4c76-b57d-a32938f5a903 req-7369b2c7-0e07-4a2c-a1a4-6ce7fc2f8c9d tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] Resources bound (agent type, host, resource id): {{(pid=91830) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 17:00:24.822419 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-584791c1-e171-45df-9cd5-d0b7abc87fd1 req-32c9070b-077a-4d27-8b23-762342c69f0e tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/security-groups?id=8ee5c4ed-9c60-4e39-9185-7e283704a7dc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3971901 May 25 17:00:24.826753 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.l3_dvrscheduler_db [req-d7f73357-c953-4c76-b57d-a32938f5a903 req-7369b2c7-0e07-4a2c-a1a4-6ce7fc2f8c9d tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] Received port after_create {{(pid=91830) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 25 17:00:24.828704 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.db_base_plugin_common [None req-339aa0cb-86be-4552-866a-55dd5c0bb7f2 None None] Allocated IP 172.20.0.2 (b3bf2911-47e9-4eda-9fe8-ec380a12f536/04a2fff9-c99b-4a81-8cff-a0e02839c1f9/85d0b73a-29b1-4d99-843e-521434d55130) {{(pid=91831) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 25 17:00:25.028566 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d7f73357-c953-4c76-b57d-a32938f5a903 req-7369b2c7-0e07-4a2c-a1a4-6ce7fc2f8c9d tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=91830) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:00:25.029244 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [req-d7f73357-c953-4c76-b57d-a32938f5a903 req-7369b2c7-0e07-4a2c-a1a4-6ce7fc2f8c9d tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-178712'] for port, before_response {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:25.063637 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.provisioning_blocks [None req-92341137-726b-4d77-b2fa-eeefb5e7c9f8 None None] Provisioning for port 735e7c1b-31b2-48e2-b2b7-538c31dbffb6 completed by entity DHCP. {{(pid=91831) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 25 17:00:25.082678 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.provisioning_blocks [None req-92341137-726b-4d77-b2fa-eeefb5e7c9f8 None None] Provisioning complete for port 735e7c1b-31b2-48e2-b2b7-538c31dbffb6 triggered by entity DHCP. {{(pid=91831) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 17:00:25.082678 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-92341137-726b-4d77-b2fa-eeefb5e7c9f8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3854128'] for port, provisioning_complete {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:25.083951 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-d7f73357-c953-4c76-b57d-a32938f5a903 req-7369b2c7-0e07-4a2c-a1a4-6ce7fc2f8c9d tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] 10.222.0.32 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 2.3360736 May 25 17:00:25.177486 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.plugin [None req-92341137-726b-4d77-b2fa-eeefb5e7c9f8 None None] Port 735e7c1b-31b2-48e2-b2b7-538c31dbffb6 cannot update to ACTIVE because it is not bound. {{(pid=91831) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 25 17:00:25.261246 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-84afc747-434e-44e8-9eae-c644a6d90f3e admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:25.321112 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-16c7f921-9ac3-4a93-8dd9-90ee7d84d9fd admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3832070'] for port, before_update {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:25.365773 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-b136cd96-2ac3-41a9-a08d-6b810f608741 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:25.388024 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-84afc747-434e-44e8-9eae-c644a6d90f3e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3832070'] for port, before_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:25.440183 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-339aa0cb-86be-4552-866a-55dd5c0bb7f2 None None] Notify callbacks [] for port, precommit_create {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:25.480574 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.provisioning_blocks [None req-339aa0cb-86be-4552-866a-55dd5c0bb7f2 None None] Transition to ACTIVE for port object 85d0b73a-29b1-4d99-843e-521434d55130 will not be triggered until provisioned by entity L2. {{(pid=91831) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 25 17:00:25.540507 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.provisioning_blocks [None req-339aa0cb-86be-4552-866a-55dd5c0bb7f2 None None] Transition to ACTIVE for port object 85d0b73a-29b1-4d99-843e-521434d55130 will not be triggered until provisioned by entity DHCP. {{(pid=91831) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 25 17:00:25.548635 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-339aa0cb-86be-4552-866a-55dd5c0bb7f2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8757892520915'] for port, after_create {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:25.559140 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:00:25.667398 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.rpc [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Device e97f6ad1-cca3-4f59-93f4-fd63428d51f2 up at agent ovs-agent-dv-cinder-790492-4-iscsi {{(pid=91831) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 25 17:00:25.701048 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.db [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] get_ports_and_sgs() called for port_ids ['c4b9c0f2-e3d5-4fff-9b3c-a9175b027fb5'] {{(pid=91831) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 25 17:00:25.734801 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.v2.base [req-d7f73357-c953-4c76-b57d-a32938f5a903 req-7233908d-3846-4713-9fa0-be18a7b01f89 service neutron] Request body: {'port': {'device_id': 'e2dfa29d-fe86-4425-b12b-d984d7f0584a', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-79049'}} {{(pid=91830) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 17:00:25.817438 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-339aa0cb-86be-4552-866a-55dd5c0bb7f2 None None] Pushing event updated for resources: {'Port': ['ID=85d0b73a-29b1-4d99-843e-521434d55130,revision_number=1']} {{(pid=91831) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:00:25.899129 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [None req-339aa0cb-86be-4552-866a-55dd5c0bb7f2 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.344s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:00:25.911319 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.wsgi [-] (91829) accepted ('10.222.0.62', 58824) {{(pid=91829) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:00:25.934391 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-339aa0cb-86be-4552-866a-55dd5c0bb7f2 None None] Network b3bf2911-47e9-4eda-9fe8-ec380a12f536 is already hosted by enough agents. {{(pid=91831) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 25 17:00:25.941873 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.scheduler.base_scheduler [None req-339aa0cb-86be-4552-866a-55dd5c0bb7f2 None None] Resources bound (agent type, host, resource id): {{(pid=91831) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 17:00:25.966969 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.db_base_plugin_common [None req-84afc747-434e-44e8-9eae-c644a6d90f3e admin admin] Allocated IP 172.27.2.5 (4364b6ab-4117-4a92-baeb-f5ee2f45bf74/b947e790-d731-4b63-afc4-4aa112afe0f6/f2ed4d81-44b1-4fbd-a5db-c3ed5a03b7de) {{(pid=91829) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 25 17:00:25.971703 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.l3_dvrscheduler_db [None req-339aa0cb-86be-4552-866a-55dd5c0bb7f2 None None] Received port after_create {{(pid=91831) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 25 17:00:25.992191 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7f94f40d-9e3e-422a-a23c-f62e6f3f9fd9 req-5a4e2186-66bb-4272-b698-3b98e981bdf4 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:00:26.001469 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-7f94f40d-9e3e-422a-a23c-f62e6f3f9fd9 req-5a4e2186-66bb-4272-b698-3b98e981bdf4 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] 10.222.0.62 "GET /v2.0/ports?device_id=e2dfa29d-fe86-4425-b12b-d984d7f0584a HTTP/1.1" status: 200 len: 932 time: 0.3366742 May 25 17:00:26.039793 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [req-d7f73357-c953-4c76-b57d-a32938f5a903 req-7233908d-3846-4713-9fa0-be18a7b01f89 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3832070'] for port, before_update {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:26.153509 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.managers [None req-339aa0cb-86be-4552-866a-55dd5c0bb7f2 None None] Attempting to bind port 85d0b73a-29b1-4d99-843e-521434d55130 on host dv-cinder-790492-4-iscsi for vnic_type normal with profile {{(pid=91831) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 25 17:00:26.154124 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.managers [None req-339aa0cb-86be-4552-866a-55dd5c0bb7f2 None None] Attempting to bind port 85d0b73a-29b1-4d99-843e-521434d55130 by drivers openvswitch,hyperv on host dv-cinder-790492-4-iscsi at level 0 using segments [{'id': 'cb1a8cf9-1f34-483f-8b10-2d2767734b93', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 698, 'network_id': 'b3bf2911-47e9-4eda-9fe8-ec380a12f536'}] {{(pid=91831) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 25 17:00:26.154460 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-339aa0cb-86be-4552-866a-55dd5c0bb7f2 None None] Attempting to bind port 85d0b73a-29b1-4d99-843e-521434d55130 on network b3bf2911-47e9-4eda-9fe8-ec380a12f536 {{(pid=91831) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 25 17:00:26.169132 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-339aa0cb-86be-4552-866a-55dd5c0bb7f2 None None] Checking agent: {'id': 'fc8251e1-071c-49f7-bc10-1337f1d37d1b', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-790492-4-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 25, 16, 50, 28), 'started_at': datetime.datetime(2021, 5, 25, 16, 50, 58), 'heartbeat_timestamp': datetime.datetime(2021, 5, 25, 16, 59, 58), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-790492-4-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=91831) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 25 17:00:26.169513 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-339aa0cb-86be-4552-866a-55dd5c0bb7f2 None None] Checking segment: {'id': 'cb1a8cf9-1f34-483f-8b10-2d2767734b93', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 698, 'network_id': 'b3bf2911-47e9-4eda-9fe8-ec380a12f536'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91831) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 25 17:00:26.169938 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-339aa0cb-86be-4552-866a-55dd5c0bb7f2 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:26.170388 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-339aa0cb-86be-4552-866a-55dd5c0bb7f2 None None] Bound using segment: {'id': 'cb1a8cf9-1f34-483f-8b10-2d2767734b93', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 698, 'network_id': 'b3bf2911-47e9-4eda-9fe8-ec380a12f536'} {{(pid=91831) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 25 17:00:26.171501 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.managers [None req-339aa0cb-86be-4552-866a-55dd5c0bb7f2 None None] Bound port: 85d0b73a-29b1-4d99-843e-521434d55130, host: dv-cinder-790492-4-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'cb1a8cf9-1f34-483f-8b10-2d2767734b93', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 698, 'network_id': 'b3bf2911-47e9-4eda-9fe8-ec380a12f536'}}] {{(pid=91831) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 25 17:00:26.171876 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-339aa0cb-86be-4552-866a-55dd5c0bb7f2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3832070'] for port, before_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:26.188262 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.provisioning_blocks [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Provisioning complete for port e97f6ad1-cca3-4f59-93f4-fd63428d51f2 triggered by entity L2. {{(pid=91831) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 17:00:26.189131 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3854128'] for port, provisioning_complete {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:26.203585 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-7f94f40d-9e3e-422a-a23c-f62e6f3f9fd9 req-627de8c9-6cbc-4a50-8c18-fcd917278e03 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] 10.222.0.62 "GET /v2.0/security-groups?id=f73b90a2-df48-48fb-99e0-5dd4d6a63a15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1937850 May 25 17:00:26.350866 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-921ab9bd-3a65-426a-99a5-52dfed281460 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:26.389178 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.quota.driver [None req-921ab9bd-3a65-426a-99a5-52dfed281460 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91829) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 17:00:26.409298 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.quota.resource [None req-921ab9bd-3a65-426a-99a5-52dfed281460 admin admin] Usage tracker for resource:security_group_rule and tenant:c8a3db7b8f35414cad752af68ae0f8e3 is out of sync, need to count used quota {{(pid=91829) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 17:00:26.424999 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.quota.resource [None req-921ab9bd-3a65-426a-99a5-52dfed281460 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91829) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 17:00:26.460302 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-16c7f921-9ac3-4a93-8dd9-90ee7d84d9fd admin admin] Notify callbacks [] for port, precommit_update {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:26.466780 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-16c7f921-9ac3-4a93-8dd9-90ee7d84d9fd admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8757892955028', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8757892520933', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8757892521750', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-27483010'] for port, after_update {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:26.474043 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.quota.driver [None req-921ab9bd-3a65-426a-99a5-52dfed281460 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91829) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 17:00:26.506426 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.db [None req-339aa0cb-86be-4552-866a-55dd5c0bb7f2 None None] For port 85d0b73a-29b1-4d99-843e-521434d55130, host dv-cinder-790492-4-iscsi, cleared binding levels {{(pid=91831) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 25 17:00:26.524565 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.db [None req-339aa0cb-86be-4552-866a-55dd5c0bb7f2 None None] For port 85d0b73a-29b1-4d99-843e-521434d55130, host dv-cinder-790492-4-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-790492-4-iscsi',level=0,port_id=85d0b73a-29b1-4d99-843e-521434d55130,segment=NetworkSegment(cb1a8cf9-1f34-483f-8b10-2d2767734b93),segment_id=cb1a8cf9-1f34-483f-8b10-2d2767734b93)] {{(pid=91831) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 25 17:00:26.532011 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.rpc [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Device a3cc4b79-05f1-4b3f-95e5-18e49199b00a up at agent ovs-agent-dv-cinder-790492-4-iscsi {{(pid=91831) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 25 17:00:26.532212 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-84afc747-434e-44e8-9eae-c644a6d90f3e admin admin] Notify callbacks [] for port, precommit_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:26.535551 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:00:26.568883 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-16c7f921-9ac3-4a93-8dd9-90ee7d84d9fd admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-549138', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-679997'] for router_interface, after_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:26.575960 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-339aa0cb-86be-4552-866a-55dd5c0bb7f2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8757892955028', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8757892520933', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8757892521750'] for port, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:26.585458 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:00:26.692494 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-84afc747-434e-44e8-9eae-c644a6d90f3e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8757892520915', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28230808'] for port, after_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:26.714793 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-854189aa-e1a5-4058-82ea-9de5e24d9054 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:00:26.719180 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-16c7f921-9ac3-4a93-8dd9-90ee7d84d9fd admin admin] Pushing event updated for resources: {'Port': ['ID=735e7c1b-31b2-48e2-b2b7-538c31dbffb6,revision_number=2']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:00:26.728256 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-16c7f921-9ac3-4a93-8dd9-90ee7d84d9fd admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.193s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:00:26.735145 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.db.resource_extend [req-d7f73357-c953-4c76-b57d-a32938f5a903 req-7233908d-3846-4713-9fa0-be18a7b01f89 service neutron] It took 0.10 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=91830) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}} May 25 17:00:26.831171 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-339aa0cb-86be-4552-866a-55dd5c0bb7f2 None None] Pushing event updated for resources: {'Port': ['ID=85d0b73a-29b1-4d99-843e-521434d55130,revision_number=2']} {{(pid=91831) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:00:26.840942 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [None req-339aa0cb-86be-4552-866a-55dd5c0bb7f2 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.255s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:00:26.856134 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.provisioning_blocks [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Provisioning for port a3cc4b79-05f1-4b3f-95e5-18e49199b00a completed by entity L2. {{(pid=91831) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 25 17:00:26.868618 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.provisioning_blocks [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Provisioning complete for port a3cc4b79-05f1-4b3f-95e5-18e49199b00a triggered by entity L2. {{(pid=91831) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 17:00:26.869148 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3854128'] for port, provisioning_complete {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:26.911714 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-921ab9bd-3a65-426a-99a5-52dfed281460 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:26.957060 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-921ab9bd-3a65-426a-99a5-52dfed281460 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-640836'] for security_group, after_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:26.974222 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-84afc747-434e-44e8-9eae-c644a6d90f3e admin admin] Network 4364b6ab-4117-4a92-baeb-f5ee2f45bf74 is already hosted by enough agents. {{(pid=91829) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 25 17:00:26.975796 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.scheduler.base_scheduler [None req-84afc747-434e-44e8-9eae-c644a6d90f3e admin admin] Resources bound (agent type, host, resource id): {{(pid=91829) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 17:00:26.982357 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.l3_dvrscheduler_db [None req-84afc747-434e-44e8-9eae-c644a6d90f3e admin admin] Received port after_create {{(pid=91829) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 25 17:00:27.026204 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.notifiers.nova [req-d7f73357-c953-4c76-b57d-a32938f5a903 req-7233908d-3846-4713-9fa0-be18a7b01f89 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 46a1adbe-ec54-4c57-aa7a-9f257475e01c {{(pid=91830) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} May 25 17:00:27.033293 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-16c7f921-9ac3-4a93-8dd9-90ee7d84d9fd admin admin] Network e5be4c6a-143f-474c-a90b-37180778cefe is already hosted by enough agents. {{(pid=91830) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 25 17:00:27.036886 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.scheduler.base_scheduler [None req-16c7f921-9ac3-4a93-8dd9-90ee7d84d9fd admin admin] Resources bound (agent type, host, resource id): {{(pid=91830) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 17:00:27.042255 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3832070'] for port, before_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:27.044308 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [req-d7f73357-c953-4c76-b57d-a32938f5a903 req-7233908d-3846-4713-9fa0-be18a7b01f89 service neutron] Notify callbacks [] for port, precommit_update {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:27.136921 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.db [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] For port a3cc4b79-05f1-4b3f-95e5-18e49199b00a, host dv-cinder-790492-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-790492-4-iscsi',level=0,port_id=a3cc4b79-05f1-4b3f-95e5-18e49199b00a,segment=NetworkSegment(55bc70ae-213c-42ca-b035-b4a902044007),segment_id=55bc70ae-213c-42ca-b035-b4a902044007)] {{(pid=91831) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 17:00:27.145448 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8757892955028', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8757892520933', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8757892521750'] for port, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:27.146377 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.rpc [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Device 3bc942c3-5854-4018-b3fb-5071bf6c70c6 up at agent ovs-agent-dv-cinder-790492-4-iscsi {{(pid=91831) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 25 17:00:27.190958 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:00:27.203682 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [None req-921ab9bd-3a65-426a-99a5-52dfed281460 admin admin] 10.222.0.62 "GET /v2.0/security-groups?tenant_id=c8a3db7b8f35414cad752af68ae0f8e3&name=default HTTP/1.1" status: 200 len: 2979 time: 1.2859161 May 25 17:00:27.204440 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-84afc747-434e-44e8-9eae-c644a6d90f3e admin admin] Pushing event updated for resources: {'Port': ['ID=f2ed4d81-44b1-4fbd-a5db-c3ed5a03b7de,revision_number=1']} {{(pid=91829) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:00:27.207232 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.wsgi [-] (91829) accepted ('10.222.0.62', 58838) {{(pid=91829) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:00:27.281854 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-84afc747-434e-44e8-9eae-c644a6d90f3e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.567s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:00:27.282360 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-1553ffb3-c81a-460d-8cb7-d926a83ef7f8 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.307s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:00:27.295429 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Pushing event updated for resources: {'Port': ['ID=a3cc4b79-05f1-4b3f-95e5-18e49199b00a,revision_number=5']} {{(pid=91831) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:00:27.298702 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.108s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:00:27.318972 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.provisioning_blocks [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Provisioning for port 3bc942c3-5854-4018-b3fb-5071bf6c70c6 completed by entity L2. {{(pid=91831) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 25 17:00:27.325029 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.provisioning_blocks [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Provisioning complete for port 3bc942c3-5854-4018-b3fb-5071bf6c70c6 triggered by entity L2. {{(pid=91831) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 17:00:27.325346 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3854128'] for port, provisioning_complete {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:27.422410 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-921ab9bd-3a65-426a-99a5-52dfed281460 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=25443e1b-514c-44a4-96df-61e8e863f6f2,revision_number=1']} {{(pid=91829) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:00:27.429294 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-921ab9bd-3a65-426a-99a5-52dfed281460 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.147s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:00:27.455734 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-16c7f921-9ac3-4a93-8dd9-90ee7d84d9fd admin admin] Router d2ed6ef9-f77a-4b7a-b152-3e1b9c85e1ad has already been hosted by L3 agent a2d427c1-2d07-43e8-afbe-218c9f7d0445 {{(pid=91830) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 25 17:00:27.459528 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.provisioning_blocks [req-d7f73357-c953-4c76-b57d-a32938f5a903 req-7233908d-3846-4713-9fa0-be18a7b01f89 service neutron] Transition to ACTIVE for port object 46a1adbe-ec54-4c57-aa7a-9f257475e01c will not be triggered until provisioned by entity L2. {{(pid=91830) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 25 17:00:27.465872 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [req-d7f73357-c953-4c76-b57d-a32938f5a903 req-7233908d-3846-4713-9fa0-be18a7b01f89 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8757892955028', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8757892520933', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8757892521750', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-27483010'] for port, after_update {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:27.480275 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3832070'] for port, before_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:27.497773 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.db [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] For port 3bc942c3-5854-4018-b3fb-5071bf6c70c6, host dv-cinder-790492-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-790492-4-iscsi',level=0,port_id=3bc942c3-5854-4018-b3fb-5071bf6c70c6,segment=NetworkSegment(414a8468-1d66-4792-9e81-d8ac5ccf1512),segment_id=414a8468-1d66-4792-9e81-d8ac5ccf1512)] {{(pid=91831) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 17:00:27.502958 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8757892955028', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8757892520933', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8757892521750'] for port, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:27.504912 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:00:27.524451 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-16c7f921-9ac3-4a93-8dd9-90ee7d84d9fd admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:00:27.564628 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-3193bc9c-c6e6-4e3b-83fd-44c4279eff8f admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:27.581610 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.provisioning_blocks [None req-bd73fd78-025d-48c1-b5f2-714c6c493244 None None] Provisioning complete for port 735e7c1b-31b2-48e2-b2b7-538c31dbffb6 triggered by entity DHCP. {{(pid=91831) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 17:00:27.582016 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-bd73fd78-025d-48c1-b5f2-714c6c493244 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3854128'] for port, provisioning_complete {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:27.599745 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-3193bc9c-c6e6-4e3b-83fd-44c4279eff8f admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:27.669368 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.plugin [None req-bd73fd78-025d-48c1-b5f2-714c6c493244 None None] Port 735e7c1b-31b2-48e2-b2b7-538c31dbffb6 cannot update to ACTIVE because it is not bound. {{(pid=91831) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 25 17:00:27.682776 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7233908d-3846-4713-9fa0-be18a7b01f89 service neutron] Pushing event updated for resources: {'Port': ['ID=46a1adbe-ec54-4c57-aa7a-9f257475e01c,revision_number=2']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:00:27.690972 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Pushing event updated for resources: {'Port': ['ID=3bc942c3-5854-4018-b3fb-5071bf6c70c6,revision_number=4']} {{(pid=91831) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:00:27.694670 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.190s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:00:27.699525 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-ac8241ca-a24e-4a58-ad31-2c79d3ed1053 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:27.713041 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-7233908d-3846-4713-9fa0-be18a7b01f89 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.189s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:00:27.768050 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-3193bc9c-c6e6-4e3b-83fd-44c4279eff8f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-640836'] for security_group, after_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:27.773417 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-e5f43353-e6f4-4a15-b99b-9e86b7a47b18 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:00:27.787619 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.rpc [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Device 85d0b73a-29b1-4d99-843e-521434d55130 up at agent ovs-agent-dv-cinder-790492-4-iscsi {{(pid=91831) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 25 17:00:27.802256 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3193bc9c-c6e6-4e3b-83fd-44c4279eff8f admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=25443e1b-514c-44a4-96df-61e8e863f6f2,revision_number=None']} {{(pid=91829) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:00:27.809000 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-3193bc9c-c6e6-4e3b-83fd-44c4279eff8f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.035s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:00:27.821568 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9faf165f-f50f-41ff-9709-400e0529d4a3 req-4b76c0e4-ef4f-448c-9052-68eeb978c20a tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:00:27.822261 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-9faf165f-f50f-41ff-9709-400e0529d4a3 req-4b76c0e4-ef4f-448c-9052-68eeb978c20a tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] 10.222.0.62 "GET /v2.0/ports?device_id=e2dfa29d-fe86-4425-b12b-d984d7f0584a HTTP/1.1" status: 200 len: 944 time: 0.3957877 May 25 17:00:27.872653 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-84afc747-434e-44e8-9eae-c644a6d90f3e admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:27.891248 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-16c7f921-9ac3-4a93-8dd9-90ee7d84d9fd admin admin] Notify agent at l3_agent.dv-cinder-790492-4-iscsi the message routers_updated {{(pid=91830) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 25 17:00:27.897849 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [None req-16c7f921-9ac3-4a93-8dd9-90ee7d84d9fd admin admin] 10.222.0.62 "PUT /v2.0/routers/d2ed6ef9-f77a-4b7a-b152-3e1b9c85e1ad/add_router_interface HTTP/1.1" status: 200 len: 503 time: 8.4452379 May 25 17:00:27.905977 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.plugins.ml2.managers [req-d7f73357-c953-4c76-b57d-a32938f5a903 req-7233908d-3846-4713-9fa0-be18a7b01f89 service neutron] Attempting to bind port 46a1adbe-ec54-4c57-aa7a-9f257475e01c on host hv-cinder-79049 for vnic_type normal with profile {{(pid=91830) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 25 17:00:27.906546 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.plugins.ml2.managers [req-d7f73357-c953-4c76-b57d-a32938f5a903 req-7233908d-3846-4713-9fa0-be18a7b01f89 service neutron] Attempting to bind port 46a1adbe-ec54-4c57-aa7a-9f257475e01c by drivers openvswitch,hyperv on host hv-cinder-79049 at level 0 using segments [{'id': '7d7273c2-c6dd-43fe-83a8-cb776d48dc70', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 651, 'network_id': '63b1f335-e2c4-48dd-886b-6be853f8a2fc'}] {{(pid=91830) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 25 17:00:27.907936 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d7f73357-c953-4c76-b57d-a32938f5a903 req-7233908d-3846-4713-9fa0-be18a7b01f89 service neutron] Attempting to bind port 46a1adbe-ec54-4c57-aa7a-9f257475e01c on network 63b1f335-e2c4-48dd-886b-6be853f8a2fc {{(pid=91830) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 25 17:00:27.913638 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d7f73357-c953-4c76-b57d-a32938f5a903 req-7233908d-3846-4713-9fa0-be18a7b01f89 service neutron] Port 46a1adbe-ec54-4c57-aa7a-9f257475e01c on network 63b1f335-e2c4-48dd-886b-6be853f8a2fc not bound, no agent of type Open vSwitch agent registered on host hv-cinder-79049 {{(pid=91830) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 25 17:00:27.914393 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d7f73357-c953-4c76-b57d-a32938f5a903 req-7233908d-3846-4713-9fa0-be18a7b01f89 service neutron] Attempting to bind port 46a1adbe-ec54-4c57-aa7a-9f257475e01c on network 63b1f335-e2c4-48dd-886b-6be853f8a2fc {{(pid=91830) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 25 17:00:27.923056 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d7f73357-c953-4c76-b57d-a32938f5a903 req-7233908d-3846-4713-9fa0-be18a7b01f89 service neutron] Checking agent: {'id': '3a1fdee1-bff0-49fb-b470-e13b95ee1b4d', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-79049', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 25, 16, 56, 32), 'started_at': datetime.datetime(2021, 5, 25, 16, 56, 32), 'heartbeat_timestamp': datetime.datetime(2021, 5, 25, 17, 0, 2), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=91830) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 25 17:00:27.923629 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d7f73357-c953-4c76-b57d-a32938f5a903 req-7233908d-3846-4713-9fa0-be18a7b01f89 service neutron] Checking segment: {'id': '7d7273c2-c6dd-43fe-83a8-cb776d48dc70', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 651, 'network_id': '63b1f335-e2c4-48dd-886b-6be853f8a2fc'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91830) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 25 17:00:27.926354 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d7f73357-c953-4c76-b57d-a32938f5a903 req-7233908d-3846-4713-9fa0-be18a7b01f89 service neutron] Bound using segment: {'id': '7d7273c2-c6dd-43fe-83a8-cb776d48dc70', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 651, 'network_id': '63b1f335-e2c4-48dd-886b-6be853f8a2fc'} {{(pid=91830) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 25 17:00:27.926914 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.plugins.ml2.managers [req-d7f73357-c953-4c76-b57d-a32938f5a903 req-7233908d-3846-4713-9fa0-be18a7b01f89 service neutron] Bound port: 46a1adbe-ec54-4c57-aa7a-9f257475e01c, host: hv-cinder-79049, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '7d7273c2-c6dd-43fe-83a8-cb776d48dc70', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 651, 'network_id': '63b1f335-e2c4-48dd-886b-6be853f8a2fc'}}] {{(pid=91830) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 25 17:00:27.927433 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [req-d7f73357-c953-4c76-b57d-a32938f5a903 req-7233908d-3846-4713-9fa0-be18a7b01f89 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3832070'] for port, before_update {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:27.934556 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-21c8749e-47ee-42d9-a802-101367556f62 None None] Sync routers for ids ['d2ed6ef9-f77a-4b7a-b152-3e1b9c85e1ad'] in dv-cinder-790492-4-iscsi {{(pid=91831) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 25 17:00:27.989725 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.l3_dvrscheduler_db [None req-21c8749e-47ee-42d9-a802-101367556f62 None None] Routers {'d2ed6ef9-f77a-4b7a-b152-3e1b9c85e1ad'} bound to L3 agent in host dv-cinder-790492-4-iscsi {{(pid=91831) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 17:00:27.989866 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-3193bc9c-c6e6-4e3b-83fd-44c4279eff8f admin admin] Notify callbacks [] for security_group, before_response {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:27.991202 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [None req-3193bc9c-c6e6-4e3b-83fd-44c4279eff8f admin admin] 10.222.0.62 "DELETE /v2.0/security-groups/25443e1b-514c-44a4-96df-61e8e863f6f2 HTTP/1.1" status: 204 len: 168 time: 0.7117317 May 25 17:00:27.991904 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.l3_hamode_db [None req-21c8749e-47ee-42d9-a802-101367556f62 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-790492-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 4},created_at=2021-05-25T16:50:28Z,description=,heartbeat_timestamp=2021-05-25T17:00:28Z,host='dv-cinder-790492-4-iscsi',id=a2d427c1-2d07-43e8-afbe-218c9f7d0445,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T16:50:28Z,topic='l3_agent')) {'router_ids': ['d2ed6ef9-f77a-4b7a-b152-3e1b9c85e1ad'], 'active': True} {{(pid=91831) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 17:00:28.004442 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-9faf165f-f50f-41ff-9709-400e0529d4a3 req-9090c8fc-6b3e-4d80-8458-fcbaa46cae7f tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] 10.222.0.62 "GET /v2.0/security-groups?id=f73b90a2-df48-48fb-99e0-5dd4d6a63a15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1741838 May 25 17:00:28.102491 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.provisioning_blocks [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Provisioning for port 85d0b73a-29b1-4d99-843e-521434d55130 completed by entity L2. {{(pid=91831) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 25 17:00:28.107841 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:28.119671 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.rpc [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Device a3cc4b79-05f1-4b3f-95e5-18e49199b00a up at agent ovs-agent-dv-cinder-790492-4-iscsi {{(pid=91831) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 25 17:00:28.143728 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.plugins.ml2.db [req-d7f73357-c953-4c76-b57d-a32938f5a903 req-7233908d-3846-4713-9fa0-be18a7b01f89 service neutron] For port 46a1adbe-ec54-4c57-aa7a-9f257475e01c, host hv-cinder-79049, cleared binding levels {{(pid=91830) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 25 17:00:28.149971 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.plugins.ml2.db [req-d7f73357-c953-4c76-b57d-a32938f5a903 req-7233908d-3846-4713-9fa0-be18a7b01f89 service neutron] For port 46a1adbe-ec54-4c57-aa7a-9f257475e01c, host hv-cinder-79049, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79049',level=0,port_id=46a1adbe-ec54-4c57-aa7a-9f257475e01c,segment=NetworkSegment(7d7273c2-c6dd-43fe-83a8-cb776d48dc70),segment_id=7d7273c2-c6dd-43fe-83a8-cb776d48dc70)] {{(pid=91830) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 25 17:00:28.159329 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [req-d7f73357-c953-4c76-b57d-a32938f5a903 req-7233908d-3846-4713-9fa0-be18a7b01f89 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8757892955028', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8757892520933', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8757892521750', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-27483010'] for port, after_update {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:28.185253 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:00:28.343962 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d7f73357-c953-4c76-b57d-a32938f5a903 req-7233908d-3846-4713-9fa0-be18a7b01f89 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91830) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:00:28.344585 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [req-d7f73357-c953-4c76-b57d-a32938f5a903 req-7233908d-3846-4713-9fa0-be18a7b01f89 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-178712'] for port, before_response {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:28.351878 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-d7f73357-c953-4c76-b57d-a32938f5a903 req-7233908d-3846-4713-9fa0-be18a7b01f89 service neutron] 10.222.0.32 "PUT /v2.0/ports/46a1adbe-ec54-4c57-aa7a-9f257475e01c HTTP/1.1" status: 200 len: 1094 time: 2.6204624 May 25 17:00:28.352983 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'e2dfa29d-fe86-4425-b12b-d984d7f0584a', 'tag': '46a1adbe-ec54-4c57-aa7a-9f257475e01c'}] {{(pid=91830) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 25 17:00:28.390109 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7233908d-3846-4713-9fa0-be18a7b01f89 service neutron] Pushing event updated for resources: {'Port': ['ID=46a1adbe-ec54-4c57-aa7a-9f257475e01c,revision_number=3']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:00:28.421158 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-7233908d-3846-4713-9fa0-be18a7b01f89 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.246s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:00:28.442937 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c7c253d9-ef9b-4d35-a6fa-bf578d58658b None None] Network b3bf2911-47e9-4eda-9fe8-ec380a12f536 requested from dv-cinder-790492-4-iscsi {{(pid=91831) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} May 25 17:00:28.457664 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'e2dfa29d-fe86-4425-b12b-d984d7f0584a', 'tag': '46a1adbe-ec54-4c57-aa7a-9f257475e01c', 'status': 'completed', 'code': 200} May 25 17:00:28.520509 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-84afc747-434e-44e8-9eae-c644a6d90f3e admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-684881', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-683233'] for router, after_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:28.643853 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.provisioning_blocks [None req-c91819b5-6e14-4d37-a4d3-3507b6bc3f02 None None] Provisioning for port 85d0b73a-29b1-4d99-843e-521434d55130 completed by entity DHCP. {{(pid=91831) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 25 17:00:28.653931 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d7f73357-c953-4c76-b57d-a32938f5a903 req-738f6df6-5fe6-494e-91d8-a32919575478 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91830) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:00:28.656052 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.provisioning_blocks [None req-c91819b5-6e14-4d37-a4d3-3507b6bc3f02 None None] Provisioning complete for port 85d0b73a-29b1-4d99-843e-521434d55130 triggered by entity DHCP. {{(pid=91831) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 17:00:28.656441 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-c91819b5-6e14-4d37-a4d3-3507b6bc3f02 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3854128'] for port, provisioning_complete {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:28.657362 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-d7f73357-c953-4c76-b57d-a32938f5a903 req-738f6df6-5fe6-494e-91d8-a32919575478 service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=04e8022f24e3464ab1ab7726d6a07e08&device_id=e2dfa29d-fe86-4425-b12b-d984d7f0584a HTTP/1.1" status: 200 len: 1097 time: 0.1717391 May 25 17:00:28.714311 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-0a55eb4a-8b57-4233-84d6-6b423b4ed6db None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:28.735818 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.l3_dvr_db [None req-21c8749e-47ee-42d9-a802-101367556f62 None None] Set router d2ed6ef9-f77a-4b7a-b152-3e1b9c85e1ad gateway port host: dv-cinder-790492-4-iscsi {{(pid=91831) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 17:00:28.790068 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.provisioning_blocks [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Provisioning complete for port a3cc4b79-05f1-4b3f-95e5-18e49199b00a triggered by entity L2. {{(pid=91831) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 17:00:28.790364 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3854128'] for port, provisioning_complete {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:28.843493 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.wsgi [-] (91830) accepted ('10.222.0.62', 58872) {{(pid=91830) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:00:28.850302 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.v2.base [None req-13c33fa7-9bd1-4749-82a5-c83f8a21275c tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Request body: {'security_group': {'name': 'tempest-securitygroup--1861546255', 'description': 'tempest-description--442514036'}} {{(pid=91830) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 17:00:28.858244 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.quota.driver [None req-13c33fa7-9bd1-4749-82a5-c83f8a21275c tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91830) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 17:00:28.862522 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [None req-13c33fa7-9bd1-4749-82a5-c83f8a21275c tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Usage tracker for resource:security_group and tenant:bbb9e99759bc47d08005f3b1e036a6cf is out of sync, need to count used quota {{(pid=91830) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 17:00:28.867266 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [None req-13c33fa7-9bd1-4749-82a5-c83f8a21275c tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Quota usage for security_group was recalculated. Used quota:1. {{(pid=91830) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 17:00:28.875610 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.quota.driver [None req-13c33fa7-9bd1-4749-82a5-c83f8a21275c tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=91830) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 17:00:28.888033 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-13c33fa7-9bd1-4749-82a5-c83f8a21275c tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Notify callbacks [] for security_group, before_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:28.919612 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.quota.driver [None req-13c33fa7-9bd1-4749-82a5-c83f8a21275c tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91830) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 17:00:28.930385 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [None req-13c33fa7-9bd1-4749-82a5-c83f8a21275c tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Usage tracker for resource:security_group_rule and tenant:bbb9e99759bc47d08005f3b1e036a6cf is out of sync, need to count used quota {{(pid=91830) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 17:00:28.934827 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [None req-13c33fa7-9bd1-4749-82a5-c83f8a21275c tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=91830) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 17:00:28.941391 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.quota.driver [None req-13c33fa7-9bd1-4749-82a5-c83f8a21275c tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=91830) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 17:00:28.969405 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-ad2bded7-2657-4e8e-9a47-2103fbf9d228 req-32003504-36e7-43c1-bb34-d5ac0a078663 service neutron] 10.222.0.32 "GET /v2.0/ports?device_id=58da9205-0212-4daa-996c-1eef64a2b702&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.3407021 May 25 17:00:28.970405 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-84afc747-434e-44e8-9eae-c644a6d90f3e admin admin] Router efdd8e5d-d3d0-40ed-9f26-6c99ecf4debd is scheduled to L3 agent a2d427c1-2d07-43e8-afbe-218c9f7d0445 with binding_index 1 {{(pid=91829) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}} May 25 17:00:29.105233 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-13c33fa7-9bd1-4749-82a5-c83f8a21275c tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Notify callbacks [] for security_group, precommit_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:29.110930 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-13c33fa7-9bd1-4749-82a5-c83f8a21275c tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-640836'] for security_group, after_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:29.117452 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:00:29.167597 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-13c33fa7-9bd1-4749-82a5-c83f8a21275c tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Pushing event updated for resources: {'SecurityGroup': ['ID=fdd3b3f1-a2cb-4432-9874-c1d04f64207b,revision_number=1']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:00:29.182122 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-13c33fa7-9bd1-4749-82a5-c83f8a21275c tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.064s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:00:29.245730 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-13c33fa7-9bd1-4749-82a5-c83f8a21275c tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Notify callbacks [] for security_group, before_response {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:29.247321 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [None req-13c33fa7-9bd1-4749-82a5-c83f8a21275c tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1779 time: 0.4019616 May 25 17:00:29.271893 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.wsgi [-] (91830) accepted ('10.222.0.62', 58890) {{(pid=91830) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:00:29.275958 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-d7f73357-c953-4c76-b57d-a32938f5a903 req-7939b19d-d334-4cd2-aa42-7a1069b7e8d4 service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=46a1adbe-ec54-4c57-aa7a-9f257475e01c HTTP/1.1" status: 200 len: 217 time: 0.0926182 May 25 17:00:29.280401 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.v2.base [None req-4e415b23-a6fb-40cb-a053-c531f639ad54 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Request body: {'security_group_rule': {'security_group_id': 'fdd3b3f1-a2cb-4432-9874-c1d04f64207b', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=91830) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 17:00:29.289060 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.quota.driver [None req-4e415b23-a6fb-40cb-a053-c531f639ad54 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91830) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 17:00:29.326207 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-84afc747-434e-44e8-9eae-c644a6d90f3e admin admin] Notify agent at l3_agent.dv-cinder-790492-4-iscsi the message routers_updated {{(pid=91829) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 25 17:00:29.336577 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3cd86284-f1ba-4c8d-bd76-03137339ff04 None None] Sync routers for ids ['efdd8e5d-d3d0-40ed-9f26-6c99ecf4debd'] in dv-cinder-790492-4-iscsi {{(pid=91832) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 25 17:00:29.347666 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [None req-4e415b23-a6fb-40cb-a053-c531f639ad54 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Usage tracker for resource:security_group_rule and tenant:bbb9e99759bc47d08005f3b1e036a6cf is out of sync, need to count used quota {{(pid=91830) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 17:00:29.351345 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3cd86284-f1ba-4c8d-bd76-03137339ff04 None None] Routers {'efdd8e5d-d3d0-40ed-9f26-6c99ecf4debd'} bound to L3 agent in host dv-cinder-790492-4-iscsi {{(pid=91832) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 17:00:29.351977 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [None req-4e415b23-a6fb-40cb-a053-c531f639ad54 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=91830) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 17:00:29.353517 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.db.l3_hamode_db [None req-3cd86284-f1ba-4c8d-bd76-03137339ff04 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-790492-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 4},created_at=2021-05-25T16:50:28Z,description=,heartbeat_timestamp=2021-05-25T17:00:28Z,host='dv-cinder-790492-4-iscsi',id=a2d427c1-2d07-43e8-afbe-218c9f7d0445,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T16:50:28Z,topic='l3_agent')) {'router_ids': ['efdd8e5d-d3d0-40ed-9f26-6c99ecf4debd'], 'active': True} {{(pid=91832) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 17:00:29.361573 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.quota.driver [None req-4e415b23-a6fb-40cb-a053-c531f639ad54 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=91830) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 17:00:29.362938 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-84afc747-434e-44e8-9eae-c644a6d90f3e admin admin] Notify callbacks [] for router, before_response {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:29.367702 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [None req-84afc747-434e-44e8-9eae-c644a6d90f3e admin admin] 10.222.0.62 "POST /v2.0/routers HTTP/1.1" status: 201 len: 919 time: 5.9658895 May 25 17:00:29.367702 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.wsgi [-] (91829) accepted ('10.222.0.62', 58898) {{(pid=91829) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:00:29.387798 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-4e415b23-a6fb-40cb-a053-c531f639ad54 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Notify callbacks [] for security_group_rule, before_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:29.439461 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-c91819b5-6e14-4d37-a4d3-3507b6bc3f02 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3832070'] for port, before_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:29.488174 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d7f73357-c953-4c76-b57d-a32938f5a903 req-45b336af-f140-4456-b58b-4da435ea7785 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91830) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:00:29.489693 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-d7f73357-c953-4c76-b57d-a32938f5a903 req-45b336af-f140-4456-b58b-4da435ea7785 service neutron] 10.222.0.32 "GET /v2.0/subnets?id=b0baa944-cafe-48a4-861a-dae28947b9f0 HTTP/1.1" status: 200 len: 854 time: 0.1967518 May 25 17:00:29.537385 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7b99b92d-76f9-4bbe-ab2f-a0710e7e2873 req-0b905e29-0417-432e-a57e-91c07a54dcaf tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:00:29.556302 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-7b99b92d-76f9-4bbe-ab2f-a0710e7e2873 req-0b905e29-0417-432e-a57e-91c07a54dcaf tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] 10.222.0.62 "GET /v2.0/ports?device_id=e2dfa29d-fe86-4425-b12b-d984d7f0584a HTTP/1.1" status: 200 len: 944 time: 0.3556912 May 25 17:00:29.564714 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ad2bded7-2657-4e8e-9a47-2103fbf9d228 req-b2f96042-9d7f-49b6-8817-3f0642713d90 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:00:29.570488 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-ad2bded7-2657-4e8e-9a47-2103fbf9d228 req-b2f96042-9d7f-49b6-8817-3f0642713d90 service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=734df673f8b3484d80f35a45fbce9d5e&device_id=58da9205-0212-4daa-996c-1eef64a2b702 HTTP/1.1" status: 200 len: 1098 time: 0.3687701 May 25 17:00:29.665943 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-d7f73357-c953-4c76-b57d-a32938f5a903 req-aa8f8371-7de3-444f-b192-7e8f1d5e8b7a service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=63b1f335-e2c4-48dd-886b-6be853f8a2fc&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.1684508 May 25 17:00:29.667568 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.db [None req-c91819b5-6e14-4d37-a4d3-3507b6bc3f02 None None] For port 85d0b73a-29b1-4d99-843e-521434d55130, host dv-cinder-790492-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-790492-4-iscsi',level=0,port_id=85d0b73a-29b1-4d99-843e-521434d55130,segment=NetworkSegment(cb1a8cf9-1f34-483f-8b10-2d2767734b93),segment_id=cb1a8cf9-1f34-483f-8b10-2d2767734b93)] {{(pid=91831) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 17:00:29.687287 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.db.l3_dvr_db [None req-3cd86284-f1ba-4c8d-bd76-03137339ff04 None None] Set router efdd8e5d-d3d0-40ed-9f26-6c99ecf4debd gateway port host: dv-cinder-790492-4-iscsi {{(pid=91832) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 17:00:29.713168 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.rpc [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Device 3bc942c3-5854-4018-b3fb-5071bf6c70c6 up at agent ovs-agent-dv-cinder-790492-4-iscsi {{(pid=91831) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 25 17:00:29.736273 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-4e415b23-a6fb-40cb-a053-c531f639ad54 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:29.778501 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-c91819b5-6e14-4d37-a4d3-3507b6bc3f02 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8757892955028', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8757892520933', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8757892521750'] for port, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:29.822472 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [None req-075457c9-1261-4590-9479-dd745cf5afe1 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:00:29.864610 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-4e415b23-a6fb-40cb-a053-c531f639ad54 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-640874'] for security_group_rule, after_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:29.874083 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:00:29.914558 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ad2bded7-2657-4e8e-9a47-2103fbf9d228 req-3bde813e-2178-4098-a79f-cb673fc7f54c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:00:29.917306 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-ad2bded7-2657-4e8e-9a47-2103fbf9d228 req-3bde813e-2178-4098-a79f-cb673fc7f54c service neutron] 10.222.0.32 "GET /v2.0/networks?id=55a46372-d583-4435-a0f6-b9397668217d HTTP/1.1" status: 200 len: 919 time: 0.2179985 May 25 17:00:29.918849 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4e415b23-a6fb-40cb-a053-c531f639ad54 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=b94cc702-15e3-4ba3-8d65-e338f90f4b5b,revision_number=0']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:00:29.935256 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-4e415b23-a6fb-40cb-a053-c531f639ad54 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.060s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:00:29.957359 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-4e415b23-a6fb-40cb-a053-c531f639ad54 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Notify callbacks [] for security_group_rule, before_response {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:29.958476 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [None req-4e415b23-a6fb-40cb-a053-c531f639ad54 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.6851468 May 25 17:00:29.970462 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.wsgi [-] (91830) accepted ('10.222.0.62', 58904) {{(pid=91830) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:00:29.985675 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.v2.base [None req-b0bff771-3a8c-4531-b3b4-15d6264369c1 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Request body: {'security_group_rule': {'security_group_id': 'fdd3b3f1-a2cb-4432-9874-c1d04f64207b', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=91830) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 17:00:30.042303 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.quota.driver [None req-b0bff771-3a8c-4531-b3b4-15d6264369c1 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91830) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 17:00:30.055676 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c91819b5-6e14-4d37-a4d3-3507b6bc3f02 None None] Pushing event updated for resources: {'Port': ['ID=85d0b73a-29b1-4d99-843e-521434d55130,revision_number=3']} {{(pid=91831) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:00:30.059762 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [None req-c91819b5-6e14-4d37-a4d3-3507b6bc3f02 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.237s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:00:30.070389 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [None req-b0bff771-3a8c-4531-b3b4-15d6264369c1 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Usage tracker for resource:security_group_rule and tenant:bbb9e99759bc47d08005f3b1e036a6cf is out of sync, need to count used quota {{(pid=91830) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 17:00:30.078497 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [None req-b0bff771-3a8c-4531-b3b4-15d6264369c1 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Quota usage for security_group_rule was recalculated. Used quota:7. {{(pid=91830) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 17:00:30.097399 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-d7f73357-c953-4c76-b57d-a32938f5a903 req-381ffcdd-3150-41ae-bc22-cbc6ea31d4ab service neutron] 10.222.0.32 "GET /v2.0/networks/63b1f335-e2c4-48dd-886b-6be853f8a2fc?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4190953 May 25 17:00:30.106770 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.quota.driver [None req-b0bff771-3a8c-4531-b3b4-15d6264369c1 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 7; quota limit: 100; headroom:93 {{(pid=91830) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 17:00:30.120534 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.provisioning_blocks [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Provisioning complete for port 3bc942c3-5854-4018-b3fb-5071bf6c70c6 triggered by entity L2. {{(pid=91831) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 17:00:30.120929 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3854128'] for port, provisioning_complete {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:30.140389 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-ad2bded7-2657-4e8e-9a47-2103fbf9d228 req-f9c024f8-ff57-427b-8f90-92be54f9bbd2 service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=60078444-24b6-4560-b0a7-7802c4f8f2f8 HTTP/1.1" status: 200 len: 217 time: 0.2031655 May 25 17:00:30.197014 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.db.l3_hamode_db [None req-3cd86284-f1ba-4c8d-bd76-03137339ff04 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'efdd8e5d-d3d0-40ed-9f26-6c99ecf4debd', 'name': 'tempest-TestShelveInstance-1848885781-router', 'tenant_id': '6a788f87b23b492da7fbfb18883b9d2d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'external_fixed_ips': [{'subnet_id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'ip_address': '172.27.2.5'}], 'enable_snat': True}, 'gw_port_id': 'f2ed4d81-44b1-4fbd-a5db-c3ed5a03b7de', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T17:00:23Z', 'updated_at': '2021-05-25T17:00:27Z', 'revision_number': 3, 'project_id': '6a788f87b23b492da7fbfb18883b9d2d', 'gw_port': {'id': 'f2ed4d81-44b1-4fbd-a5db-c3ed5a03b7de', 'name': '', 'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'tenant_id': '', 'mac_address': 'fa:16:3e:f1:11:4f', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'efdd8e5d-d3d0-40ed-9f26-6c99ecf4debd', 'device_owner': 'network:router_gateway', 'standard_attr_id': 323, 'fixed_ips': [{'subnet_id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'ip_address': '172.27.2.5', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:00:25Z', 'updated_at': '2021-05-25T17:00:26Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-790492-4-iscsi'}], 'dv-cinder-790492-4-iscsi', False) {} {{(pid=91832) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 17:00:30.207159 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3cd86284-f1ba-4c8d-bd76-03137339ff04 None None] Checking router: efdd8e5d-d3d0-40ed-9f26-6c99ecf4debd for host: dv-cinder-790492-4-iscsi {{(pid=91832) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 25 17:00:30.210926 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3cd86284-f1ba-4c8d-bd76-03137339ff04 None None] Updating router efdd8e5d-d3d0-40ed-9f26-6c99ecf4debd port f2ed4d81-44b1-4fbd-a5db-c3ed5a03b7de binding host dv-cinder-790492-4-iscsi {{(pid=91832) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} May 25 17:00:30.242200 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-7b99b92d-76f9-4bbe-ab2f-a0710e7e2873 req-4afc1217-f97a-43b8-a650-9a1ca68a536b tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] 10.222.0.62 "GET /v2.0/security-groups?id=f73b90a2-df48-48fb-99e0-5dd4d6a63a15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.6850047 May 25 17:00:30.270725 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.l3_hamode_db [None req-21c8749e-47ee-42d9-a802-101367556f62 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd2ed6ef9-f77a-4b7a-b152-3e1b9c85e1ad', 'name': 'tempest-AttachVolumeShelveTestJSON-437778030-router', 'tenant_id': 'bbb9e99759bc47d08005f3b1e036a6cf', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'external_fixed_ips': [{'subnet_id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'ip_address': '172.27.2.253'}], 'enable_snat': True}, 'gw_port_id': '3bc942c3-5854-4018-b3fb-5071bf6c70c6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T17:00:14Z', 'updated_at': '2021-05-25T17:00:25Z', 'revision_number': 4, 'project_id': 'bbb9e99759bc47d08005f3b1e036a6cf', 'gw_port': {'id': '3bc942c3-5854-4018-b3fb-5071bf6c70c6', 'name': '', 'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'tenant_id': '', 'mac_address': 'fa:16:3e:da:a2:c4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd2ed6ef9-f77a-4b7a-b152-3e1b9c85e1ad', 'device_owner': 'network:router_gateway', 'standard_attr_id': 294, 'fixed_ips': [{'subnet_id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'ip_address': '172.27.2.253', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790492-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:00:16Z', 'updated_at': '2021-05-25T17:00:27Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-790492-4-iscsi', '_interfaces': [{'id': '735e7c1b-31b2-48e2-b2b7-538c31dbffb6', 'name': '', 'network_id': 'e5be4c6a-143f-474c-a90b-37180778cefe', 'tenant_id': 'bbb9e99759bc47d08005f3b1e036a6cf', 'mac_address': 'fa:16:3e:9a:dc:e1', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd2ed6ef9-f77a-4b7a-b152-3e1b9c85e1ad', 'device_owner': 'network:router_interface', 'standard_attr_id': 319, 'fixed_ips': [{'subnet_id': '6e6b5897-e23d-4281-96cb-a6fdf9b68134', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:00:21Z', 'updated_at': '2021-05-25T17:00:25Z', 'revision_number': 2, 'project_id': 'bbb9e99759bc47d08005f3b1e036a6cf', 'subnets': [{'id': '6e6b5897-e23d-4281-96cb-a6fdf9b68134', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-790492-4-iscsi', False) {} {{(pid=91831) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 17:00:30.278835 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-21c8749e-47ee-42d9-a802-101367556f62 None None] Checking router: d2ed6ef9-f77a-4b7a-b152-3e1b9c85e1ad for host: dv-cinder-790492-4-iscsi {{(pid=91831) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 25 17:00:30.279295 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-21c8749e-47ee-42d9-a802-101367556f62 None None] Updating router d2ed6ef9-f77a-4b7a-b152-3e1b9c85e1ad port 735e7c1b-31b2-48e2-b2b7-538c31dbffb6 binding host dv-cinder-790492-4-iscsi {{(pid=91831) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} May 25 17:00:30.321303 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-57f11b47-1f51-4191-b7c9-af248a48372c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:30.378021 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron_lib.callbacks.manager [None req-3cd86284-f1ba-4c8d-bd76-03137339ff04 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3832070'] for port, before_update {{(pid=91832) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:30.492299 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-21c8749e-47ee-42d9-a802-101367556f62 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3832070'] for port, before_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:30.513715 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-b0bff771-3a8c-4531-b3b4-15d6264369c1 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Notify callbacks [] for security_group_rule, before_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:30.597466 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-b0bff771-3a8c-4531-b3b4-15d6264369c1 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:30.604678 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ad2bded7-2657-4e8e-9a47-2103fbf9d228 req-dd74ca28-c3d1-4e7a-b5d8-118cf0d586a8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:00:30.605851 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-ad2bded7-2657-4e8e-9a47-2103fbf9d228 req-dd74ca28-c3d1-4e7a-b5d8-118cf0d586a8 service neutron] 10.222.0.32 "GET /v2.0/subnets?id=927bd65a-c4de-491b-b501-302852f4c784 HTTP/1.1" status: 200 len: 858 time: 0.4379284 May 25 17:00:30.620312 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-b0bff771-3a8c-4531-b3b4-15d6264369c1 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-640874'] for security_group_rule, after_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:30.633206 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:00:30.653741 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b0bff771-3a8c-4531-b3b4-15d6264369c1 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=e97fbc09-a3cd-47ee-b203-2bbb3f895c61,revision_number=0']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:00:30.673090 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-b0bff771-3a8c-4531-b3b4-15d6264369c1 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.040s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:00:30.697726 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-d7f73357-c953-4c76-b57d-a32938f5a903 req-a5a5aeb4-0b03-4c54-95e6-8b26bfc87b96 service neutron] 10.222.0.32 "GET /v2.0/networks/63b1f335-e2c4-48dd-886b-6be853f8a2fc?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.5883942 May 25 17:00:30.709381 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-b0bff771-3a8c-4531-b3b4-15d6264369c1 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Notify callbacks [] for security_group_rule, before_response {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:30.711022 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [None req-b0bff771-3a8c-4531-b3b4-15d6264369c1 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.7363958 May 25 17:00:30.714456 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.wsgi [-] (91830) accepted ('10.222.0.62', 58922) {{(pid=91830) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:00:30.723741 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.v2.base [None req-858f32af-939b-4134-b6d9-232fefb45db7 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Request body: {'floatingip': {'floating_network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74'}} {{(pid=91830) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 17:00:30.734358 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.provisioning_blocks [None req-aed57d28-b67c-4981-833e-7f592129a995 None None] Provisioning complete for port 85d0b73a-29b1-4d99-843e-521434d55130 triggered by entity DHCP. {{(pid=91831) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 17:00:30.734881 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-aed57d28-b67c-4981-833e-7f592129a995 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3854128'] for port, provisioning_complete {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:30.754089 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.quota.driver [None req-858f32af-939b-4134-b6d9-232fefb45db7 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91830) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 17:00:30.758427 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [None req-858f32af-939b-4134-b6d9-232fefb45db7 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Usage tracker for resource:floatingip and tenant:bbb9e99759bc47d08005f3b1e036a6cf is out of sync, need to count used quota {{(pid=91830) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 17:00:30.762487 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [None req-858f32af-939b-4134-b6d9-232fefb45db7 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Quota usage for floatingip was recalculated. Used quota:0. {{(pid=91830) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 17:00:30.825236 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.quota.driver [None req-858f32af-939b-4134-b6d9-232fefb45db7 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Attempting to reserve 1 items for resource floatingip. Total usage: 0; quota limit: 50; headroom:50 {{(pid=91830) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 17:00:30.848508 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-858f32af-939b-4134-b6d9-232fefb45db7 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Notify callbacks [] for floatingip, before_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:30.867899 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-ad2bded7-2657-4e8e-9a47-2103fbf9d228 req-eba144ee-2a6e-4adf-a287-6bf3747ddb7a service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=55a46372-d583-4435-a0f6-b9397668217d&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.2478530 May 25 17:00:30.875114 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron_lib.callbacks.manager [None req-3cd86284-f1ba-4c8d-bd76-03137339ff04 None None] Notify callbacks [] for port, precommit_update {{(pid=91832) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:30.893350 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.db.provisioning_blocks [None req-3cd86284-f1ba-4c8d-bd76-03137339ff04 None None] Transition to ACTIVE for port object f2ed4d81-44b1-4fbd-a5db-c3ed5a03b7de will not be triggered until provisioned by entity L2. {{(pid=91832) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 25 17:00:30.901633 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron_lib.callbacks.manager [None req-3cd86284-f1ba-4c8d-bd76-03137339ff04 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8757892955028', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8757892520933', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8757892521750'] for port, after_update {{(pid=91832) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:30.906446 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:00:30.954752 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ac68e815-55dd-437b-a6a9-f44be36b4b7e req-fcbf6ae2-b43d-407a-a79c-a4c89c48f9bc service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91830) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:00:30.956546 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-ac68e815-55dd-437b-a6a9-f44be36b4b7e req-fcbf6ae2-b43d-407a-a79c-a4c89c48f9bc service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=04e8022f24e3464ab1ab7726d6a07e08&device_id=e2dfa29d-fe86-4425-b12b-d984d7f0584a HTTP/1.1" status: 200 len: 1097 time: 0.1909173 May 25 17:00:30.993511 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4626dc60-aafb-46df-8b04-f2467b8f81fa None None] Pushing event updated for resources: {'Port': ['ID=f2ed4d81-44b1-4fbd-a5db-c3ed5a03b7de,revision_number=2']} {{(pid=91832) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:00:30.996970 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG oslo_concurrency.lockutils [None req-4626dc60-aafb-46df-8b04-f2467b8f81fa None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.090s {{(pid=91832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:00:31.026711 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.plugins.ml2.managers [None req-3cd86284-f1ba-4c8d-bd76-03137339ff04 None None] Attempting to bind port f2ed4d81-44b1-4fbd-a5db-c3ed5a03b7de on host dv-cinder-790492-4-iscsi for vnic_type normal with profile {{(pid=91832) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 25 17:00:31.027302 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.plugins.ml2.managers [None req-3cd86284-f1ba-4c8d-bd76-03137339ff04 None None] Attempting to bind port f2ed4d81-44b1-4fbd-a5db-c3ed5a03b7de by drivers openvswitch,hyperv on host dv-cinder-790492-4-iscsi at level 0 using segments [{'id': '414a8468-1d66-4792-9e81-d8ac5ccf1512', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74'}] {{(pid=91832) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 25 17:00:31.027892 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3cd86284-f1ba-4c8d-bd76-03137339ff04 None None] Attempting to bind port f2ed4d81-44b1-4fbd-a5db-c3ed5a03b7de on network 4364b6ab-4117-4a92-baeb-f5ee2f45bf74 {{(pid=91832) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 25 17:00:31.035491 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3cd86284-f1ba-4c8d-bd76-03137339ff04 None None] Checking agent: {'id': 'fc8251e1-071c-49f7-bc10-1337f1d37d1b', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-790492-4-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 25, 16, 50, 28), 'started_at': datetime.datetime(2021, 5, 25, 16, 50, 58), 'heartbeat_timestamp': datetime.datetime(2021, 5, 25, 17, 0, 28), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-790492-4-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=91832) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 25 17:00:31.036347 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3cd86284-f1ba-4c8d-bd76-03137339ff04 None None] Checking segment: {'id': '414a8468-1d66-4792-9e81-d8ac5ccf1512', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91832) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 25 17:00:31.036973 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron_lib.callbacks.manager [None req-3cd86284-f1ba-4c8d-bd76-03137339ff04 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=91832) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:31.037586 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3cd86284-f1ba-4c8d-bd76-03137339ff04 None None] Bound using segment: {'id': '414a8468-1d66-4792-9e81-d8ac5ccf1512', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74'} {{(pid=91832) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 25 17:00:31.038206 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.plugins.ml2.managers [None req-3cd86284-f1ba-4c8d-bd76-03137339ff04 None None] Bound port: f2ed4d81-44b1-4fbd-a5db-c3ed5a03b7de, host: dv-cinder-790492-4-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '414a8468-1d66-4792-9e81-d8ac5ccf1512', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74'}}] {{(pid=91832) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 25 17:00:31.038662 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron_lib.callbacks.manager [None req-3cd86284-f1ba-4c8d-bd76-03137339ff04 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3832070'] for port, before_update {{(pid=91832) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:31.121219 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.plugins.ml2.db [None req-3cd86284-f1ba-4c8d-bd76-03137339ff04 None None] For port f2ed4d81-44b1-4fbd-a5db-c3ed5a03b7de, host dv-cinder-790492-4-iscsi, cleared binding levels {{(pid=91832) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 25 17:00:31.124466 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.plugins.ml2.db [None req-3cd86284-f1ba-4c8d-bd76-03137339ff04 None None] For port f2ed4d81-44b1-4fbd-a5db-c3ed5a03b7de, host dv-cinder-790492-4-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-790492-4-iscsi',level=0,port_id=f2ed4d81-44b1-4fbd-a5db-c3ed5a03b7de,segment=NetworkSegment(414a8468-1d66-4792-9e81-d8ac5ccf1512),segment_id=414a8468-1d66-4792-9e81-d8ac5ccf1512)] {{(pid=91832) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 25 17:00:31.131147 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron_lib.callbacks.manager [None req-3cd86284-f1ba-4c8d-bd76-03137339ff04 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8757892955028', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8757892520933', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8757892521750'] for port, after_update {{(pid=91832) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:31.136151 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG oslo_concurrency.lockutils [None req-5d577993-7c36-4f17-9599-70c105d0c2a3 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:00:31.161115 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-858f32af-939b-4134-b6d9-232fefb45db7 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3832070'] for port, before_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:31.205751 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ac68e815-55dd-437b-a6a9-f44be36b4b7e req-0bc8693b-d6a4-4462-8ecc-b41aeb979822 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91830) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:00:31.207329 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-ac68e815-55dd-437b-a6a9-f44be36b4b7e req-0bc8693b-d6a4-4462-8ecc-b41aeb979822 service neutron] 10.222.0.32 "GET /v2.0/networks?id=63b1f335-e2c4-48dd-886b-6be853f8a2fc HTTP/1.1" status: 200 len: 915 time: 0.2356825 May 25 17:00:31.222088 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3cd86284-f1ba-4c8d-bd76-03137339ff04 None None] Routers {'efdd8e5d-d3d0-40ed-9f26-6c99ecf4debd'} bound to L3 agent in host dv-cinder-790492-4-iscsi {{(pid=91832) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 17:00:31.222811 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.db.l3_hamode_db [None req-3cd86284-f1ba-4c8d-bd76-03137339ff04 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-790492-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 4},created_at=2021-05-25T16:50:28Z,description=,heartbeat_timestamp=2021-05-25T17:00:28Z,host='dv-cinder-790492-4-iscsi',id=a2d427c1-2d07-43e8-afbe-218c9f7d0445,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T16:50:28Z,topic='l3_agent')) {'router_ids': ['efdd8e5d-d3d0-40ed-9f26-6c99ecf4debd'], 'active': True} {{(pid=91832) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 17:00:31.290662 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-ad2bded7-2657-4e8e-9a47-2103fbf9d228 req-0480d6a0-f8d5-4050-a6ec-1e0f0db0e318 service neutron] 10.222.0.32 "GET /v2.0/networks/55a46372-d583-4435-a0f6-b9397668217d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4043717 May 25 17:00:31.375311 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-ac68e815-55dd-437b-a6a9-f44be36b4b7e req-a6bd1438-e258-4691-9478-81bba52853f0 service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=46a1adbe-ec54-4c57-aa7a-9f257475e01c HTTP/1.1" status: 200 len: 217 time: 0.1606371 May 25 17:00:31.402496 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4626dc60-aafb-46df-8b04-f2467b8f81fa None None] Pushing event updated for resources: {'Port': ['ID=f2ed4d81-44b1-4fbd-a5db-c3ed5a03b7de,revision_number=3']} {{(pid=91832) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:00:31.406737 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-21c8749e-47ee-42d9-a802-101367556f62 None None] Notify callbacks [] for port, precommit_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:31.421357 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.provisioning_blocks [None req-21c8749e-47ee-42d9-a802-101367556f62 None None] Transition to ACTIVE for port object 735e7c1b-31b2-48e2-b2b7-538c31dbffb6 will not be triggered until provisioned by entity L2. {{(pid=91831) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 25 17:00:31.430123 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG oslo_concurrency.lockutils [None req-4626dc60-aafb-46df-8b04-f2467b8f81fa None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.294s {{(pid=91832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:00:31.433954 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-21c8749e-47ee-42d9-a802-101367556f62 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8757892955028', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8757892520933', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8757892521750'] for port, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:31.441259 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:00:31.614401 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ac68e815-55dd-437b-a6a9-f44be36b4b7e req-014878c8-760a-4512-b7f3-420f8ada088a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91830) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:00:31.617179 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-ac68e815-55dd-437b-a6a9-f44be36b4b7e req-014878c8-760a-4512-b7f3-420f8ada088a service neutron] 10.222.0.32 "GET /v2.0/subnets?id=b0baa944-cafe-48a4-861a-dae28947b9f0 HTTP/1.1" status: 200 len: 854 time: 0.2209837 May 25 17:00:31.712761 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-ad2bded7-2657-4e8e-9a47-2103fbf9d228 req-65c98708-82fe-4d7a-badb-c3217296ebd0 service neutron] 10.222.0.32 "GET /v2.0/networks/55a46372-d583-4435-a0f6-b9397668217d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.4032505 May 25 17:00:31.723120 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.db.l3_dvr_db [None req-3cd86284-f1ba-4c8d-bd76-03137339ff04 None None] Set router efdd8e5d-d3d0-40ed-9f26-6c99ecf4debd gateway port host: dv-cinder-790492-4-iscsi {{(pid=91832) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 17:00:31.742955 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.rpc [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Device 85d0b73a-29b1-4d99-843e-521434d55130 up at agent ovs-agent-dv-cinder-790492-4-iscsi {{(pid=91831) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 25 17:00:31.759253 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-ac68e815-55dd-437b-a6a9-f44be36b4b7e req-1b54c266-f32a-445f-9938-3a9849fe0d34 service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=63b1f335-e2c4-48dd-886b-6be853f8a2fc&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.1279435 May 25 17:00:31.798287 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.db_base_plugin_common [None req-858f32af-939b-4134-b6d9-232fefb45db7 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Allocated IP 172.27.2.190 (4364b6ab-4117-4a92-baeb-f5ee2f45bf74/b947e790-d731-4b63-afc4-4aa112afe0f6/79c058e5-5666-4bcc-810c-a46796e283b0) {{(pid=91830) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 25 17:00:31.807502 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4ab4d9ba-2f68-4214-a4f4-a30840f53de0 None None] Pushing event updated for resources: {'Port': ['ID=735e7c1b-31b2-48e2-b2b7-538c31dbffb6,revision_number=3']} {{(pid=91831) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:00:31.818791 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [None req-4ab4d9ba-2f68-4214-a4f4-a30840f53de0 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.378s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:00:31.985012 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0d5c85c3-9a9c-421e-86b0-9f4d2d3cdf26 req-e07d9848-e488-4ba2-8fdd-26790db4d75b tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:00:31.988300 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-0d5c85c3-9a9c-421e-86b0-9f4d2d3cdf26 req-e07d9848-e488-4ba2-8fdd-26790db4d75b tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/ports?device_id=58da9205-0212-4daa-996c-1eef64a2b702 HTTP/1.1" status: 200 len: 945 time: 0.7447355 May 25 17:00:32.084665 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.managers [None req-21c8749e-47ee-42d9-a802-101367556f62 None None] Attempting to bind port 735e7c1b-31b2-48e2-b2b7-538c31dbffb6 on host dv-cinder-790492-4-iscsi for vnic_type normal with profile {{(pid=91831) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 25 17:00:32.085046 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.managers [None req-21c8749e-47ee-42d9-a802-101367556f62 None None] Attempting to bind port 735e7c1b-31b2-48e2-b2b7-538c31dbffb6 by drivers openvswitch,hyperv on host dv-cinder-790492-4-iscsi at level 0 using segments [{'id': 'a8fb0313-938a-4f5e-8ff4-96df8acd943b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 695, 'network_id': 'e5be4c6a-143f-474c-a90b-37180778cefe'}] {{(pid=91831) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 25 17:00:32.085415 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-21c8749e-47ee-42d9-a802-101367556f62 None None] Attempting to bind port 735e7c1b-31b2-48e2-b2b7-538c31dbffb6 on network e5be4c6a-143f-474c-a90b-37180778cefe {{(pid=91831) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 25 17:00:32.093002 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-21c8749e-47ee-42d9-a802-101367556f62 None None] Checking agent: {'id': 'fc8251e1-071c-49f7-bc10-1337f1d37d1b', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-790492-4-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 25, 16, 50, 28), 'started_at': datetime.datetime(2021, 5, 25, 16, 50, 58), 'heartbeat_timestamp': datetime.datetime(2021, 5, 25, 17, 0, 28), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-790492-4-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=91831) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 25 17:00:32.093578 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-21c8749e-47ee-42d9-a802-101367556f62 None None] Checking segment: {'id': 'a8fb0313-938a-4f5e-8ff4-96df8acd943b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 695, 'network_id': 'e5be4c6a-143f-474c-a90b-37180778cefe'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91831) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 25 17:00:32.094020 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-21c8749e-47ee-42d9-a802-101367556f62 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:32.094422 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-21c8749e-47ee-42d9-a802-101367556f62 None None] Bound using segment: {'id': 'a8fb0313-938a-4f5e-8ff4-96df8acd943b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 695, 'network_id': 'e5be4c6a-143f-474c-a90b-37180778cefe'} {{(pid=91831) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 25 17:00:32.094903 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.managers [None req-21c8749e-47ee-42d9-a802-101367556f62 None None] Bound port: 735e7c1b-31b2-48e2-b2b7-538c31dbffb6, host: dv-cinder-790492-4-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'a8fb0313-938a-4f5e-8ff4-96df8acd943b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 695, 'network_id': 'e5be4c6a-143f-474c-a90b-37180778cefe'}}] {{(pid=91831) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 25 17:00:32.095284 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-21c8749e-47ee-42d9-a802-101367556f62 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3832070'] for port, before_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:32.106671 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-0d5c85c3-9a9c-421e-86b0-9f4d2d3cdf26 req-290ac3ce-298d-497b-a954-3cf673e93e18 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/security-groups?id=8ee5c4ed-9c60-4e39-9185-7e283704a7dc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0879779 May 25 17:00:32.145016 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.provisioning_blocks [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Provisioning complete for port 85d0b73a-29b1-4d99-843e-521434d55130 triggered by entity L2. {{(pid=91831) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 17:00:32.145405 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3854128'] for port, provisioning_complete {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:32.177704 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4ba373f6-df12-4514-adb3-1fb52384b93f req-1a2d9954-90d6-40b2-b435-cffa93326f54 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:00:32.179301 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-4ba373f6-df12-4514-adb3-1fb52384b93f req-1a2d9954-90d6-40b2-b435-cffa93326f54 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] 10.222.0.62 "GET /v2.0/ports?device_id=e2dfa29d-fe86-4425-b12b-d984d7f0584a HTTP/1.1" status: 200 len: 944 time: 0.4731925 May 25 17:00:32.238411 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-ac68e815-55dd-437b-a6a9-f44be36b4b7e req-ac34f515-cefe-4a02-ba70-21cffb341855 service neutron] 10.222.0.32 "GET /v2.0/networks/63b1f335-e2c4-48dd-886b-6be853f8a2fc?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2314880 May 25 17:00:32.248247 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.db [None req-21c8749e-47ee-42d9-a802-101367556f62 None None] For port 735e7c1b-31b2-48e2-b2b7-538c31dbffb6, host dv-cinder-790492-4-iscsi, cleared binding levels {{(pid=91831) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 25 17:00:32.252464 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.db [None req-21c8749e-47ee-42d9-a802-101367556f62 None None] For port 735e7c1b-31b2-48e2-b2b7-538c31dbffb6, host dv-cinder-790492-4-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-790492-4-iscsi',level=0,port_id=735e7c1b-31b2-48e2-b2b7-538c31dbffb6,segment=NetworkSegment(a8fb0313-938a-4f5e-8ff4-96df8acd943b),segment_id=a8fb0313-938a-4f5e-8ff4-96df8acd943b)] {{(pid=91831) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 25 17:00:32.268019 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-858f32af-939b-4134-b6d9-232fefb45db7 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Notify callbacks [] for port, precommit_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:32.273994 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-be7579e0-8835-4775-a346-c87d7efa41ac admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3832070'] for port, before_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:32.277675 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.db.l3_hamode_db [None req-3cd86284-f1ba-4c8d-bd76-03137339ff04 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'efdd8e5d-d3d0-40ed-9f26-6c99ecf4debd', 'name': 'tempest-TestShelveInstance-1848885781-router', 'tenant_id': '6a788f87b23b492da7fbfb18883b9d2d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'external_fixed_ips': [{'subnet_id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'ip_address': '172.27.2.5'}], 'enable_snat': True}, 'gw_port_id': 'f2ed4d81-44b1-4fbd-a5db-c3ed5a03b7de', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T17:00:23Z', 'updated_at': '2021-05-25T17:00:27Z', 'revision_number': 3, 'project_id': '6a788f87b23b492da7fbfb18883b9d2d', 'gw_port': {'id': 'f2ed4d81-44b1-4fbd-a5db-c3ed5a03b7de', 'name': '', 'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'tenant_id': '', 'mac_address': 'fa:16:3e:f1:11:4f', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'efdd8e5d-d3d0-40ed-9f26-6c99ecf4debd', 'device_owner': 'network:router_gateway', 'standard_attr_id': 323, 'fixed_ips': [{'subnet_id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'ip_address': '172.27.2.5', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790492-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:00:25Z', 'updated_at': '2021-05-25T17:00:31Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-790492-4-iscsi'}], 'dv-cinder-790492-4-iscsi', False) {} {{(pid=91832) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 17:00:32.282314 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3cd86284-f1ba-4c8d-bd76-03137339ff04 None None] The sync data for ids ['efdd8e5d-d3d0-40ed-9f26-6c99ecf4debd'] in dv-cinder-790492-4-iscsi is: [{'id': 'efdd8e5d-d3d0-40ed-9f26-6c99ecf4debd', 'name': 'tempest-TestShelveInstance-1848885781-router', 'tenant_id': '6a788f87b23b492da7fbfb18883b9d2d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'external_fixed_ips': [{'subnet_id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'ip_address': '172.27.2.5'}], 'enable_snat': True}, 'gw_port_id': 'f2ed4d81-44b1-4fbd-a5db-c3ed5a03b7de', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T17:00:23Z', 'updated_at': '2021-05-25T17:00:27Z', 'revision_number': 3, 'project_id': '6a788f87b23b492da7fbfb18883b9d2d', 'gw_port': {'id': 'f2ed4d81-44b1-4fbd-a5db-c3ed5a03b7de', 'name': '', 'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'tenant_id': '', 'mac_address': 'fa:16:3e:f1:11:4f', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'efdd8e5d-d3d0-40ed-9f26-6c99ecf4debd', 'device_owner': 'network:router_gateway', 'standard_attr_id': 323, 'fixed_ips': [{'subnet_id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'ip_address': '172.27.2.5', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790492-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:00:25Z', 'updated_at': '2021-05-25T17:00:31Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-790492-4-iscsi'}] {{(pid=91832) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 25 17:00:32.293151 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-21c8749e-47ee-42d9-a802-101367556f62 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8757892955028', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8757892520933', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8757892521750'] for port, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:32.305690 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-858f32af-939b-4134-b6d9-232fefb45db7 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8757892520915', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-27483019'] for port, after_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:32.311794 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-4a387b10-a1ad-4a7d-a35d-3a5a156d2724 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:00:32.311938 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [None req-3fb13473-a2bf-442d-9fa8-c8caea6a2af0 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:00:32.326313 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-4ba373f6-df12-4514-adb3-1fb52384b93f req-c1f51b98-8999-43a9-9e6b-21171628d09d tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] 10.222.0.62 "GET /v2.0/security-groups?id=f73b90a2-df48-48fb-99e0-5dd4d6a63a15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1353772 May 25 17:00:32.380312 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-858f32af-939b-4134-b6d9-232fefb45db7 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Network 4364b6ab-4117-4a92-baeb-f5ee2f45bf74 is already hosted by enough agents. {{(pid=91830) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 25 17:00:32.384385 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.scheduler.base_scheduler [None req-858f32af-939b-4134-b6d9-232fefb45db7 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Resources bound (agent type, host, resource id): {{(pid=91830) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 17:00:32.390271 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.l3_dvrscheduler_db [None req-858f32af-939b-4134-b6d9-232fefb45db7 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Received port after_create {{(pid=91830) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 25 17:00:32.421333 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.l3_dvrscheduler_db [None req-21c8749e-47ee-42d9-a802-101367556f62 None None] Routers {'d2ed6ef9-f77a-4b7a-b152-3e1b9c85e1ad'} bound to L3 agent in host dv-cinder-790492-4-iscsi {{(pid=91831) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 17:00:32.422300 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.l3_hamode_db [None req-21c8749e-47ee-42d9-a802-101367556f62 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-790492-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 4},created_at=2021-05-25T16:50:28Z,description=,heartbeat_timestamp=2021-05-25T17:00:28Z,host='dv-cinder-790492-4-iscsi',id=a2d427c1-2d07-43e8-afbe-218c9f7d0445,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T16:50:28Z,topic='l3_agent')) {'router_ids': ['d2ed6ef9-f77a-4b7a-b152-3e1b9c85e1ad'], 'active': True} {{(pid=91831) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 17:00:32.539138 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-858f32af-939b-4134-b6d9-232fefb45db7 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Notify callbacks [] for floatingip, precommit_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:32.549045 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-858f32af-939b-4134-b6d9-232fefb45db7 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Pushing event updated for resources: {'Port': ['ID=79c058e5-5666-4bcc-810c-a46796e283b0,revision_number=1']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:00:32.549940 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4ab4d9ba-2f68-4214-a4f4-a30840f53de0 None None] Pushing event updated for resources: {'Port': ['ID=735e7c1b-31b2-48e2-b2b7-538c31dbffb6,revision_number=4']} {{(pid=91831) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:00:32.552751 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-858f32af-939b-4134-b6d9-232fefb45db7 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.242s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:00:32.564271 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [None req-4ab4d9ba-2f68-4214-a4f4-a30840f53de0 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.253s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:00:32.579341 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.db_base_plugin_common [None req-be7579e0-8835-4775-a346-c87d7efa41ac admin admin] Allocated IP 172.20.0.1 (b3bf2911-47e9-4eda-9fe8-ec380a12f536/04a2fff9-c99b-4a81-8cff-a0e02839c1f9/a713d455-65c7-40a2-ac4c-0b352efc4cd0) {{(pid=91829) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 25 17:00:32.671417 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-858f32af-939b-4134-b6d9-232fefb45db7 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3832070'] for port, before_update {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:32.781972 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.l3_dvr_db [None req-21c8749e-47ee-42d9-a802-101367556f62 None None] Set router d2ed6ef9-f77a-4b7a-b152-3e1b9c85e1ad gateway port host: dv-cinder-790492-4-iscsi {{(pid=91831) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 17:00:32.807266 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-be7579e0-8835-4775-a346-c87d7efa41ac admin admin] Notify callbacks [] for port, precommit_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:32.829647 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.provisioning_blocks [None req-be7579e0-8835-4775-a346-c87d7efa41ac admin admin] Transition to ACTIVE for port object a713d455-65c7-40a2-ac4c-0b352efc4cd0 will not be triggered until provisioned by entity DHCP. {{(pid=91829) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 25 17:00:32.857061 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-be7579e0-8835-4775-a346-c87d7efa41ac admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8757892520915', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28230808'] for port, after_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:32.864251 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-84afc747-434e-44e8-9eae-c644a6d90f3e admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:00:32.939702 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-be7579e0-8835-4775-a346-c87d7efa41ac admin admin] Pushing event updated for resources: {'Port': ['ID=a713d455-65c7-40a2-ac4c-0b352efc4cd0,revision_number=1']} {{(pid=91829) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:00:32.944718 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-be7579e0-8835-4775-a346-c87d7efa41ac admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.080s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:00:32.953601 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-be7579e0-8835-4775-a346-c87d7efa41ac admin admin] Network b3bf2911-47e9-4eda-9fe8-ec380a12f536 is already hosted by enough agents. {{(pid=91829) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 25 17:00:32.955733 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.scheduler.base_scheduler [None req-be7579e0-8835-4775-a346-c87d7efa41ac admin admin] Resources bound (agent type, host, resource id): {{(pid=91829) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 17:00:32.958231 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.l3_dvrscheduler_db [None req-be7579e0-8835-4775-a346-c87d7efa41ac admin admin] Received port after_create {{(pid=91829) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 25 17:00:33.051197 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-858f32af-939b-4134-b6d9-232fefb45db7 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Notify callbacks [] for port, precommit_update {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:33.055224 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-be7579e0-8835-4775-a346-c87d7efa41ac admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-680080'] for router_interface, before_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:33.057750 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-858f32af-939b-4134-b6d9-232fefb45db7 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8757892955028', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8757892520933', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8757892521750', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-27483010'] for port, after_update {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:33.064725 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-489a5ab3-bf21-41bc-b210-0415fae48d65 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:00:33.266411 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.l3_hamode_db [None req-21c8749e-47ee-42d9-a802-101367556f62 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd2ed6ef9-f77a-4b7a-b152-3e1b9c85e1ad', 'name': 'tempest-AttachVolumeShelveTestJSON-437778030-router', 'tenant_id': 'bbb9e99759bc47d08005f3b1e036a6cf', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'external_fixed_ips': [{'subnet_id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'ip_address': '172.27.2.253'}], 'enable_snat': True}, 'gw_port_id': '3bc942c3-5854-4018-b3fb-5071bf6c70c6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T17:00:14Z', 'updated_at': '2021-05-25T17:00:25Z', 'revision_number': 4, 'project_id': 'bbb9e99759bc47d08005f3b1e036a6cf', 'gw_port': {'id': '3bc942c3-5854-4018-b3fb-5071bf6c70c6', 'name': '', 'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'tenant_id': '', 'mac_address': 'fa:16:3e:da:a2:c4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd2ed6ef9-f77a-4b7a-b152-3e1b9c85e1ad', 'device_owner': 'network:router_gateway', 'standard_attr_id': 294, 'fixed_ips': [{'subnet_id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'ip_address': '172.27.2.253', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790492-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:00:16Z', 'updated_at': '2021-05-25T17:00:27Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-790492-4-iscsi', '_interfaces': [{'id': '735e7c1b-31b2-48e2-b2b7-538c31dbffb6', 'name': '', 'network_id': 'e5be4c6a-143f-474c-a90b-37180778cefe', 'tenant_id': 'bbb9e99759bc47d08005f3b1e036a6cf', 'mac_address': 'fa:16:3e:9a:dc:e1', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd2ed6ef9-f77a-4b7a-b152-3e1b9c85e1ad', 'device_owner': 'network:router_interface', 'standard_attr_id': 319, 'fixed_ips': [{'subnet_id': '6e6b5897-e23d-4281-96cb-a6fdf9b68134', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790492-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:00:21Z', 'updated_at': '2021-05-25T17:00:32Z', 'revision_number': 4, 'project_id': 'bbb9e99759bc47d08005f3b1e036a6cf', 'subnets': [{'id': '6e6b5897-e23d-4281-96cb-a6fdf9b68134', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-790492-4-iscsi', False) {} {{(pid=91831) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 17:00:33.271801 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-21c8749e-47ee-42d9-a802-101367556f62 None None] The sync data for ids ['d2ed6ef9-f77a-4b7a-b152-3e1b9c85e1ad'] in dv-cinder-790492-4-iscsi is: [{'id': 'd2ed6ef9-f77a-4b7a-b152-3e1b9c85e1ad', 'name': 'tempest-AttachVolumeShelveTestJSON-437778030-router', 'tenant_id': 'bbb9e99759bc47d08005f3b1e036a6cf', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'external_fixed_ips': [{'subnet_id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'ip_address': '172.27.2.253'}], 'enable_snat': True}, 'gw_port_id': '3bc942c3-5854-4018-b3fb-5071bf6c70c6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T17:00:14Z', 'updated_at': '2021-05-25T17:00:25Z', 'revision_number': 4, 'project_id': 'bbb9e99759bc47d08005f3b1e036a6cf', 'gw_port': {'id': '3bc942c3-5854-4018-b3fb-5071bf6c70c6', 'name': '', 'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'tenant_id': '', 'mac_address': 'fa:16:3e:da:a2:c4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd2ed6ef9-f77a-4b7a-b152-3e1b9c85e1ad', 'device_owner': 'network:router_gateway', 'standard_attr_id': 294, 'fixed_ips': [{'subnet_id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'ip_address': '172.27.2.253', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790492-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:00:16Z', 'updated_at': '2021-05-25T17:00:27Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-790492-4-iscsi', '_interfaces': [{'id': '735e7c1b-31b2-48e2-b2b7-538c31dbffb6', 'name': '', 'network_id': 'e5be4c6a-143f-474c-a90b-37180778cefe', 'tenant_id': 'bbb9e99759bc47d08005f3b1e036a6cf', 'mac_address': 'fa:16:3e:9a:dc:e1', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd2ed6ef9-f77a-4b7a-b152-3e1b9c85e1ad', 'device_owner': 'network:router_interface', 'standard_attr_id': 319, 'fixed_ips': [{'subnet_id': '6e6b5897-e23d-4281-96cb-a6fdf9b68134', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790492-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:00:21Z', 'updated_at': '2021-05-25T17:00:32Z', 'revision_number': 4, 'project_id': 'bbb9e99759bc47d08005f3b1e036a6cf', 'subnets': [{'id': '6e6b5897-e23d-4281-96cb-a6fdf9b68134', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=91831) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 25 17:00:33.418151 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-858f32af-939b-4134-b6d9-232fefb45db7 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Pushing event updated for resources: {'Port': ['ID=79c058e5-5666-4bcc-810c-a46796e283b0,revision_number=2']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:00:33.418383 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.provisioning_blocks [None req-f6d56ffe-7209-42e2-aee9-162430bf8a2f None None] Provisioning for port a713d455-65c7-40a2-ac4c-0b352efc4cd0 completed by entity DHCP. {{(pid=91831) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 25 17:00:33.421008 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-858f32af-939b-4134-b6d9-232fefb45db7 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.356s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:00:33.431622 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-858f32af-939b-4134-b6d9-232fefb45db7 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-683033'] for floatingip, after_update {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:33.435663 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.provisioning_blocks [None req-f6d56ffe-7209-42e2-aee9-162430bf8a2f None None] Provisioning complete for port a713d455-65c7-40a2-ac4c-0b352efc4cd0 triggered by entity DHCP. {{(pid=91831) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 17:00:33.436437 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-f6d56ffe-7209-42e2-aee9-162430bf8a2f None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3854128'] for port, provisioning_complete {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:33.442874 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-be7579e0-8835-4775-a346-c87d7efa41ac admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3832070'] for port, before_update {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:33.470231 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-858f32af-939b-4134-b6d9-232fefb45db7 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-178712'] for floatingip, before_response {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:33.480028 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [None req-858f32af-939b-4134-b6d9-232fefb45db7 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 693 time: 2.7631240 May 25 17:00:33.539927 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8b08cebd-dbc7-45fd-94f9-2838377524ef req-f32f0b4e-a22f-4a27-87f4-59df2b1a4fcb tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:00:33.541499 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-8b08cebd-dbc7-45fd-94f9-2838377524ef req-f32f0b4e-a22f-4a27-87f4-59df2b1a4fcb tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/ports?device_id=58da9205-0212-4daa-996c-1eef64a2b702 HTTP/1.1" status: 200 len: 945 time: 0.2336152 May 25 17:00:33.548905 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.plugin [None req-f6d56ffe-7209-42e2-aee9-162430bf8a2f None None] Port a713d455-65c7-40a2-ac4c-0b352efc4cd0 cannot update to ACTIVE because it is not bound. {{(pid=91831) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 25 17:00:33.703503 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.rpc [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Device 735e7c1b-31b2-48e2-b2b7-538c31dbffb6 up at agent ovs-agent-dv-cinder-790492-4-iscsi {{(pid=91831) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 25 17:00:33.774812 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.provisioning_blocks [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Provisioning for port 735e7c1b-31b2-48e2-b2b7-538c31dbffb6 completed by entity L2. {{(pid=91831) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 25 17:00:33.779063 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-8b08cebd-dbc7-45fd-94f9-2838377524ef req-55ed43c2-4dae-4170-bdf1-13beb0bff642 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/security-groups?id=8ee5c4ed-9c60-4e39-9185-7e283704a7dc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2260222 May 25 17:00:33.779989 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.provisioning_blocks [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Provisioning complete for port 735e7c1b-31b2-48e2-b2b7-538c31dbffb6 triggered by entity L2. {{(pid=91831) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 17:00:33.780401 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3854128'] for port, provisioning_complete {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:33.848501 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7e282f22-c4b4-43a9-bb7e-dbae904cb76e req-09f86efb-51ef-4cd2-b0b9-020bab4c377f tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:00:33.850600 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-7e282f22-c4b4-43a9-bb7e-dbae904cb76e req-09f86efb-51ef-4cd2-b0b9-020bab4c377f tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] 10.222.0.62 "GET /v2.0/ports?device_id=e2dfa29d-fe86-4425-b12b-d984d7f0584a HTTP/1.1" status: 200 len: 944 time: 0.2760611 May 25 17:00:33.857440 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-be7579e0-8835-4775-a346-c87d7efa41ac admin admin] Notify callbacks [] for port, precommit_update {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:33.877857 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-be7579e0-8835-4775-a346-c87d7efa41ac admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8757892955028', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8757892520933', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8757892521750', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28230801'] for port, after_update {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:33.910945 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:00:33.923784 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3832070'] for port, before_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:33.957041 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.db [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] For port 735e7c1b-31b2-48e2-b2b7-538c31dbffb6, host dv-cinder-790492-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-790492-4-iscsi',level=0,port_id=735e7c1b-31b2-48e2-b2b7-538c31dbffb6,segment=NetworkSegment(a8fb0313-938a-4f5e-8ff4-96df8acd943b),segment_id=a8fb0313-938a-4f5e-8ff4-96df8acd943b)] {{(pid=91831) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 17:00:33.963371 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8757892955028', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8757892520933', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8757892521750'] for port, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:33.964333 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.rpc [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Device f2ed4d81-44b1-4fbd-a5db-c3ed5a03b7de up at agent ovs-agent-dv-cinder-790492-4-iscsi {{(pid=91831) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 25 17:00:33.988678 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:00:34.086416 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-7e282f22-c4b4-43a9-bb7e-dbae904cb76e req-c96c2ee1-49e9-43f9-9ce7-f0f5cd480051 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] 10.222.0.62 "GET /v2.0/security-groups?id=f73b90a2-df48-48fb-99e0-5dd4d6a63a15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2268612 May 25 17:00:34.093029 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Pushing event updated for resources: {'Port': ['ID=735e7c1b-31b2-48e2-b2b7-538c31dbffb6,revision_number=5']} {{(pid=91831) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:00:34.103297 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.114s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:00:34.108367 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-be7579e0-8835-4775-a346-c87d7efa41ac admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-549138', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-679997'] for router_interface, after_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:34.109554 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.provisioning_blocks [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Provisioning for port f2ed4d81-44b1-4fbd-a5db-c3ed5a03b7de completed by entity L2. {{(pid=91831) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 25 17:00:34.117272 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.provisioning_blocks [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Provisioning complete for port f2ed4d81-44b1-4fbd-a5db-c3ed5a03b7de triggered by entity L2. {{(pid=91831) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 17:00:34.124951 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3854128'] for port, provisioning_complete {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:34.131143 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-be7579e0-8835-4775-a346-c87d7efa41ac admin admin] Pushing event updated for resources: {'Port': ['ID=a713d455-65c7-40a2-ac4c-0b352efc4cd0,revision_number=2']} {{(pid=91829) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:00:34.148706 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-be7579e0-8835-4775-a346-c87d7efa41ac admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.238s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:00:34.152080 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-f1a5dfda-eabb-4edc-8b23-252bfc5118e4 req-d462dbb1-0346-40e0-a41f-dab1faa6cbca tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/security-groups?name=tempest-securitygroup--1861546255&fields=id&tenant_id=bbb9e99759bc47d08005f3b1e036a6cf HTTP/1.1" status: 200 len: 267 time: 0.2456803 May 25 17:00:34.285231 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3832070'] for port, before_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:34.315315 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.db [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] For port f2ed4d81-44b1-4fbd-a5db-c3ed5a03b7de, host dv-cinder-790492-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-790492-4-iscsi',level=0,port_id=f2ed4d81-44b1-4fbd-a5db-c3ed5a03b7de,segment=NetworkSegment(414a8468-1d66-4792-9e81-d8ac5ccf1512),segment_id=414a8468-1d66-4792-9e81-d8ac5ccf1512)] {{(pid=91831) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 17:00:34.335971 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8757892955028', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8757892520933', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8757892521750'] for port, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:34.341408 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:00:34.399002 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-be7579e0-8835-4775-a346-c87d7efa41ac admin admin] Network b3bf2911-47e9-4eda-9fe8-ec380a12f536 is already hosted by enough agents. {{(pid=91829) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 25 17:00:34.399443 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:34.401282 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.scheduler.base_scheduler [None req-be7579e0-8835-4775-a346-c87d7efa41ac admin admin] Resources bound (agent type, host, resource id): {{(pid=91829) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 17:00:34.409560 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f1a5dfda-eabb-4edc-8b23-252bfc5118e4 req-17d8b184-4cdc-4057-8ec3-17808bf09985 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:00:34.411116 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-f1a5dfda-eabb-4edc-8b23-252bfc5118e4 req-17d8b184-4cdc-4057-8ec3-17808bf09985 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/networks?id=e5be4c6a-143f-474c-a90b-37180778cefe HTTP/1.1" status: 200 len: 816 time: 0.2496364 May 25 17:00:34.424296 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Pushing event updated for resources: {'Port': ['ID=f2ed4d81-44b1-4fbd-a5db-c3ed5a03b7de,revision_number=4']} {{(pid=91831) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:00:34.427755 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.086s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:00:34.487714 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-ac68e815-55dd-437b-a6a9-f44be36b4b7e req-c12325c0-5344-4660-b12e-a80d90d05149 service neutron] 10.222.0.32 "GET /v2.0/networks/63b1f335-e2c4-48dd-886b-6be853f8a2fc?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1673179 May 25 17:00:34.502010 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-f1a5dfda-eabb-4edc-8b23-252bfc5118e4 req-fe783f06-31c4-48e1-a6c6-77fbdd62b318 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/quotas/bbb9e99759bc47d08005f3b1e036a6cf HTTP/1.1" status: 200 len: 375 time: 0.0829985 May 25 17:00:34.666618 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-be7579e0-8835-4775-a346-c87d7efa41ac admin admin] Router efdd8e5d-d3d0-40ed-9f26-6c99ecf4debd has already been hosted by L3 agent a2d427c1-2d07-43e8-afbe-218c9f7d0445 {{(pid=91829) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 25 17:00:34.677997 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.provisioning_blocks [None req-8336a7ac-4842-4e1c-8269-8f704b05aa2c None None] Provisioning complete for port a713d455-65c7-40a2-ac4c-0b352efc4cd0 triggered by entity DHCP. {{(pid=91831) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 17:00:34.678372 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-8336a7ac-4842-4e1c-8269-8f704b05aa2c None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3854128'] for port, provisioning_complete {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:34.680662 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-f1a5dfda-eabb-4edc-8b23-252bfc5118e4 req-9f330dad-aa39-4cca-b8b8-290fdb13b3a1 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/ports?tenant_id=bbb9e99759bc47d08005f3b1e036a6cf&fields=id HTTP/1.1" status: 200 len: 348 time: 0.1708825 May 25 17:00:34.736189 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.plugin [None req-8336a7ac-4842-4e1c-8269-8f704b05aa2c None None] Port a713d455-65c7-40a2-ac4c-0b352efc4cd0 cannot update to ACTIVE because it is not bound. {{(pid=91831) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 25 17:00:35.017034 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-f1a5dfda-eabb-4edc-8b23-252bfc5118e4 req-b0b35d52-4c7a-44a3-9dab-cd91166c5c71 service neutron] 10.222.0.62 "GET /v2.0/networks/e5be4c6a-143f-474c-a90b-37180778cefe?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2763937 May 25 17:00:35.018019 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-be7579e0-8835-4775-a346-c87d7efa41ac admin admin] Notify agent at l3_agent.dv-cinder-790492-4-iscsi the message routers_updated {{(pid=91829) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 25 17:00:35.057183 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [None req-be7579e0-8835-4775-a346-c87d7efa41ac admin admin] 10.222.0.62 "PUT /v2.0/routers/efdd8e5d-d3d0-40ed-9f26-6c99ecf4debd/add_router_interface HTTP/1.1" status: 200 len: 503 time: 5.6884549 May 25 17:00:35.134196 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-22e6ff36-1e56-415a-be8c-2a378c326581 req-9c487261-85ba-4bd6-8efe-f3655b08635d tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:00:35.135685 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-22e6ff36-1e56-415a-be8c-2a378c326581 req-9c487261-85ba-4bd6-8efe-f3655b08635d tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/ports?device_id=58da9205-0212-4daa-996c-1eef64a2b702 HTTP/1.1" status: 200 len: 945 time: 0.2387969 May 25 17:00:35.148888 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.db.agents_db [None req-504cb04f-4543-46c1-8db7-349e21db7634 None None] Agent healthcheck: found 6 active agents {{(pid=91832) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} May 25 17:00:35.208594 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-f1a5dfda-eabb-4edc-8b23-252bfc5118e4 req-5981bb8f-0ed0-4609-a3cb-2384a25957cd service neutron] 10.222.0.62 "GET /v2.0/networks/e5be4c6a-143f-474c-a90b-37180778cefe?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1822729 May 25 17:00:35.215708 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-22e6ff36-1e56-415a-be8c-2a378c326581 req-2a9e7827-b81b-46e9-b66e-2043d6abe90d tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/security-groups?id=8ee5c4ed-9c60-4e39-9185-7e283704a7dc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0636301 May 25 17:00:35.429121 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7149dbe0-20d7-44b2-b8e3-929cdd1a206d req-0c1aa47c-a054-4613-a29e-ff8c26c420d1 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:00:35.431121 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-7149dbe0-20d7-44b2-b8e3-929cdd1a206d req-0c1aa47c-a054-4613-a29e-ff8c26c420d1 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] 10.222.0.62 "GET /v2.0/ports?device_id=e2dfa29d-fe86-4425-b12b-d984d7f0584a HTTP/1.1" status: 200 len: 944 time: 0.1204708 May 25 17:00:35.480119 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-7149dbe0-20d7-44b2-b8e3-929cdd1a206d req-ebbe409a-982e-4139-b2fd-657318e49dde tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] 10.222.0.62 "GET /v2.0/security-groups?id=f73b90a2-df48-48fb-99e0-5dd4d6a63a15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0435357 May 25 17:00:35.579239 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-2f61eb6f-b8b1-4dd5-b1f1-696da7628ba6 req-06c3a799-2479-488a-93c8-5625fbebed3c tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/ports?device_id=3ead96ee-e427-4e87-9879-a1cdf303f894 HTTP/1.1" status: 200 len: 210 time: 0.0470729 May 25 17:00:35.687702 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.rpc [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Device 735e7c1b-31b2-48e2-b2b7-538c31dbffb6 up at agent ovs-agent-dv-cinder-790492-4-iscsi {{(pid=91831) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 25 17:00:35.770071 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.provisioning_blocks [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Provisioning complete for port 735e7c1b-31b2-48e2-b2b7-538c31dbffb6 triggered by entity L2. {{(pid=91831) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 17:00:35.770370 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3854128'] for port, provisioning_complete {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:35.815333 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-55cd17b2-20e7-4472-8906-6a809ecac7fd None None] Sync routers for ids ['efdd8e5d-d3d0-40ed-9f26-6c99ecf4debd'] in dv-cinder-790492-4-iscsi {{(pid=91831) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 25 17:00:35.844449 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.l3_dvrscheduler_db [None req-55cd17b2-20e7-4472-8906-6a809ecac7fd None None] Routers {'efdd8e5d-d3d0-40ed-9f26-6c99ecf4debd'} bound to L3 agent in host dv-cinder-790492-4-iscsi {{(pid=91831) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 17:00:35.845099 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.l3_hamode_db [None req-55cd17b2-20e7-4472-8906-6a809ecac7fd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-790492-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 4},created_at=2021-05-25T16:50:28Z,description=,heartbeat_timestamp=2021-05-25T17:00:28Z,host='dv-cinder-790492-4-iscsi',id=a2d427c1-2d07-43e8-afbe-218c9f7d0445,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T16:50:28Z,topic='l3_agent')) {'router_ids': ['efdd8e5d-d3d0-40ed-9f26-6c99ecf4debd'], 'active': True} {{(pid=91831) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 17:00:35.878549 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.wsgi [-] (91830) accepted ('10.222.0.62', 59006) {{(pid=91830) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:00:35.883783 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.v2.base [None req-71e0aadb-a35e-423b-b404-63f6c1f3552d tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-1915957469', 'description': 'tempest-secgroup-smoke-1915957469 description', 'project_id': 'a736cc60cc2143c4b6dea99321051da5'}} {{(pid=91830) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 17:00:35.889663 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.quota.driver [None req-71e0aadb-a35e-423b-b404-63f6c1f3552d tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91830) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 17:00:35.894054 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [None req-71e0aadb-a35e-423b-b404-63f6c1f3552d tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] Usage tracker for resource:security_group and tenant:a736cc60cc2143c4b6dea99321051da5 is out of sync, need to count used quota {{(pid=91830) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 17:00:35.897175 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [None req-71e0aadb-a35e-423b-b404-63f6c1f3552d tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] Quota usage for security_group was recalculated. Used quota:1. {{(pid=91830) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 17:00:35.903938 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.quota.driver [None req-71e0aadb-a35e-423b-b404-63f6c1f3552d tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=91830) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 17:00:35.915741 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-71e0aadb-a35e-423b-b404-63f6c1f3552d tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] Notify callbacks [] for security_group, before_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:35.938456 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.quota.driver [None req-71e0aadb-a35e-423b-b404-63f6c1f3552d tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91830) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 17:00:35.942683 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [None req-71e0aadb-a35e-423b-b404-63f6c1f3552d tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] Usage tracker for resource:security_group_rule and tenant:a736cc60cc2143c4b6dea99321051da5 is out of sync, need to count used quota {{(pid=91830) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 17:00:35.946905 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [None req-71e0aadb-a35e-423b-b404-63f6c1f3552d tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=91830) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 17:00:35.953201 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.quota.driver [None req-71e0aadb-a35e-423b-b404-63f6c1f3552d tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=91830) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 17:00:36.035383 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-71e0aadb-a35e-423b-b404-63f6c1f3552d tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] Notify callbacks [] for security_group, precommit_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:36.039826 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-71e0aadb-a35e-423b-b404-63f6c1f3552d tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-640836'] for security_group, after_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:36.043741 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-c5995683-2a84-4ea4-9165-0dd7402bb9c5 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:00:36.086300 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-71e0aadb-a35e-423b-b404-63f6c1f3552d tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] Pushing event updated for resources: {'SecurityGroup': ['ID=1468f899-860c-4905-aee3-f13adc83d0a4,revision_number=1']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:00:36.099857 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-71e0aadb-a35e-423b-b404-63f6c1f3552d tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.056s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:00:36.101243 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-71e0aadb-a35e-423b-b404-63f6c1f3552d tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] Notify callbacks [] for security_group, before_response {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:36.103017 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [None req-71e0aadb-a35e-423b-b404-63f6c1f3552d tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] 10.222.0.62 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1794 time: 0.2234163 May 25 17:00:36.104667 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.rpc [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Device f2ed4d81-44b1-4fbd-a5db-c3ed5a03b7de up at agent ovs-agent-dv-cinder-790492-4-iscsi {{(pid=91831) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 25 17:00:36.105983 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.wsgi [-] (91829) accepted ('10.222.0.62', 59012) {{(pid=91829) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:00:36.111565 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.v2.base [None req-f874312f-1856-4dbb-bd54-d61abbabcff0 tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] Request body: {'security_group_rule': {'security_group_id': '1468f899-860c-4905-aee3-f13adc83d0a4', 'project_id': 'a736cc60cc2143c4b6dea99321051da5', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=91829) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 17:00:36.117664 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.quota.driver [None req-f874312f-1856-4dbb-bd54-d61abbabcff0 tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91829) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 17:00:36.121754 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.quota.resource [None req-f874312f-1856-4dbb-bd54-d61abbabcff0 tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] Usage tracker for resource:security_group_rule and tenant:a736cc60cc2143c4b6dea99321051da5 is out of sync, need to count used quota {{(pid=91829) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 17:00:36.125540 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.quota.resource [None req-f874312f-1856-4dbb-bd54-d61abbabcff0 tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=91829) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 17:00:36.132541 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.quota.driver [None req-f874312f-1856-4dbb-bd54-d61abbabcff0 tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=91829) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 17:00:36.151382 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-f874312f-1856-4dbb-bd54-d61abbabcff0 tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] Notify callbacks [] for security_group_rule, before_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:36.181503 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.l3_dvr_db [None req-55cd17b2-20e7-4472-8906-6a809ecac7fd None None] Set router efdd8e5d-d3d0-40ed-9f26-6c99ecf4debd gateway port host: dv-cinder-790492-4-iscsi {{(pid=91831) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 17:00:36.272212 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-f874312f-1856-4dbb-bd54-d61abbabcff0 tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:36.281084 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-f874312f-1856-4dbb-bd54-d61abbabcff0 tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-640874'] for security_group_rule, after_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:36.286070 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:00:36.307153 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f874312f-1856-4dbb-bd54-d61abbabcff0 tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=0844aed1-d532-4fa5-898a-8fa7af4bd021,revision_number=0']} {{(pid=91829) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:00:36.320375 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-f874312f-1856-4dbb-bd54-d61abbabcff0 tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.034s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:00:36.350119 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-f874312f-1856-4dbb-bd54-d61abbabcff0 tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] Notify callbacks [] for security_group_rule, before_response {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:36.354041 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [None req-f874312f-1856-4dbb-bd54-d61abbabcff0 tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] 10.222.0.62 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.2447200 May 25 17:00:36.355013 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.wsgi [-] (91830) accepted ('10.222.0.62', 59018) {{(pid=91830) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:00:36.363536 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2d5110ac-b5aa-4079-abfa-43be5bede66a req-c30b777c-1d8f-464a-b650-ea5b17afdcfc service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:00:36.363749 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.v2.base [None req-caf41cba-bbc8-49fc-8dde-8c628e609ccb tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] Request body: {'security_group_rule': {'security_group_id': '1468f899-860c-4905-aee3-f13adc83d0a4', 'project_id': 'a736cc60cc2143c4b6dea99321051da5', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=91830) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 17:00:36.365407 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-2d5110ac-b5aa-4079-abfa-43be5bede66a req-c30b777c-1d8f-464a-b650-ea5b17afdcfc service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=734df673f8b3484d80f35a45fbce9d5e&device_id=58da9205-0212-4daa-996c-1eef64a2b702 HTTP/1.1" status: 200 len: 1098 time: 0.1498215 May 25 17:00:36.370564 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.quota.driver [None req-caf41cba-bbc8-49fc-8dde-8c628e609ccb tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91830) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 17:00:36.390636 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.provisioning_blocks [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Provisioning complete for port f2ed4d81-44b1-4fbd-a5db-c3ed5a03b7de triggered by entity L2. {{(pid=91831) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 17:00:36.391196 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3854128'] for port, provisioning_complete {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:36.391937 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [None req-caf41cba-bbc8-49fc-8dde-8c628e609ccb tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] Usage tracker for resource:security_group_rule and tenant:a736cc60cc2143c4b6dea99321051da5 is out of sync, need to count used quota {{(pid=91830) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 17:00:36.400878 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [None req-caf41cba-bbc8-49fc-8dde-8c628e609ccb tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] Quota usage for security_group_rule was recalculated. Used quota:7. {{(pid=91830) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 17:00:36.423444 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.quota.driver [None req-caf41cba-bbc8-49fc-8dde-8c628e609ccb tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 7; quota limit: 100; headroom:93 {{(pid=91830) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 17:00:36.463232 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-caf41cba-bbc8-49fc-8dde-8c628e609ccb tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] Notify callbacks [] for security_group_rule, before_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:36.644030 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-caf41cba-bbc8-49fc-8dde-8c628e609ccb tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:36.654200 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-caf41cba-bbc8-49fc-8dde-8c628e609ccb tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-640874'] for security_group_rule, after_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:36.661649 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:00:36.694042 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-caf41cba-bbc8-49fc-8dde-8c628e609ccb tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] Notify callbacks [] for security_group_rule, before_response {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:36.696515 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [None req-caf41cba-bbc8-49fc-8dde-8c628e609ccb tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] 10.222.0.62 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.3402994 May 25 17:00:36.698998 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-caf41cba-bbc8-49fc-8dde-8c628e609ccb tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=996afc45-59a2-40cf-ad9d-7b63082c5bc7,revision_number=0']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:00:36.701084 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.wsgi [-] (91829) accepted ('10.222.0.62', 59030) {{(pid=91829) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:00:36.704027 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-caf41cba-bbc8-49fc-8dde-8c628e609ccb tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.042s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:00:36.736364 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.v2.base [None req-32aa12bf-0b66-4533-8939-7a3b6367bcba tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] Request body: {'security_group_rule': {'security_group_id': '1468f899-860c-4905-aee3-f13adc83d0a4', 'project_id': 'a736cc60cc2143c4b6dea99321051da5', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=91829) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 17:00:36.739547 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.l3_hamode_db [None req-55cd17b2-20e7-4472-8906-6a809ecac7fd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'efdd8e5d-d3d0-40ed-9f26-6c99ecf4debd', 'name': 'tempest-TestShelveInstance-1848885781-router', 'tenant_id': '6a788f87b23b492da7fbfb18883b9d2d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'external_fixed_ips': [{'subnet_id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'ip_address': '172.27.2.5'}], 'enable_snat': True}, 'gw_port_id': 'f2ed4d81-44b1-4fbd-a5db-c3ed5a03b7de', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T17:00:23Z', 'updated_at': '2021-05-25T17:00:33Z', 'revision_number': 4, 'project_id': '6a788f87b23b492da7fbfb18883b9d2d', 'gw_port': {'id': 'f2ed4d81-44b1-4fbd-a5db-c3ed5a03b7de', 'name': '', 'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'tenant_id': '', 'mac_address': 'fa:16:3e:f1:11:4f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'efdd8e5d-d3d0-40ed-9f26-6c99ecf4debd', 'device_owner': 'network:router_gateway', 'standard_attr_id': 323, 'fixed_ips': [{'subnet_id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'ip_address': '172.27.2.5', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790492-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:00:25Z', 'updated_at': '2021-05-25T17:00:34Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-790492-4-iscsi', '_interfaces': [{'id': 'a713d455-65c7-40a2-ac4c-0b352efc4cd0', 'name': '', 'network_id': 'b3bf2911-47e9-4eda-9fe8-ec380a12f536', 'tenant_id': '6a788f87b23b492da7fbfb18883b9d2d', 'mac_address': 'fa:16:3e:ed:ec:93', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'efdd8e5d-d3d0-40ed-9f26-6c99ecf4debd', 'device_owner': 'network:router_interface', 'standard_attr_id': 335, 'fixed_ips': [{'subnet_id': '04a2fff9-c99b-4a81-8cff-a0e02839c1f9', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:00:32Z', 'updated_at': '2021-05-25T17:00:33Z', 'revision_number': 2, 'project_id': '6a788f87b23b492da7fbfb18883b9d2d', 'subnets': [{'id': '04a2fff9-c99b-4a81-8cff-a0e02839c1f9', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-790492-4-iscsi', False) {} {{(pid=91831) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 17:00:36.744522 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-55cd17b2-20e7-4472-8906-6a809ecac7fd None None] Checking router: efdd8e5d-d3d0-40ed-9f26-6c99ecf4debd for host: dv-cinder-790492-4-iscsi {{(pid=91831) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 25 17:00:36.744875 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-55cd17b2-20e7-4472-8906-6a809ecac7fd None None] Updating router efdd8e5d-d3d0-40ed-9f26-6c99ecf4debd port a713d455-65c7-40a2-ac4c-0b352efc4cd0 binding host dv-cinder-790492-4-iscsi {{(pid=91831) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} May 25 17:00:36.756620 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.quota.driver [None req-32aa12bf-0b66-4533-8939-7a3b6367bcba tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91829) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 17:00:36.763753 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.quota.resource [None req-32aa12bf-0b66-4533-8939-7a3b6367bcba tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] Usage tracker for resource:security_group_rule and tenant:a736cc60cc2143c4b6dea99321051da5 is out of sync, need to count used quota {{(pid=91829) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 17:00:36.773416 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.quota.resource [None req-32aa12bf-0b66-4533-8939-7a3b6367bcba tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] Quota usage for security_group_rule was recalculated. Used quota:8. {{(pid=91829) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 17:00:36.793296 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.quota.driver [None req-32aa12bf-0b66-4533-8939-7a3b6367bcba tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 8; quota limit: 100; headroom:92 {{(pid=91829) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 17:00:36.798353 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-55cd17b2-20e7-4472-8906-6a809ecac7fd None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3832070'] for port, before_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:36.845207 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2d5110ac-b5aa-4079-abfa-43be5bede66a req-2ac78ac0-2e36-4dad-ac5f-3ab834057439 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:00:36.846804 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-2d5110ac-b5aa-4079-abfa-43be5bede66a req-2ac78ac0-2e36-4dad-ac5f-3ab834057439 service neutron] 10.222.0.32 "GET /v2.0/networks?id=55a46372-d583-4435-a0f6-b9397668217d HTTP/1.1" status: 200 len: 919 time: 0.4718304 May 25 17:00:36.849533 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-32aa12bf-0b66-4533-8939-7a3b6367bcba tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] Notify callbacks [] for security_group_rule, before_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:36.919559 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6000eced-2a85-4f5f-9992-b50a7312d8da req-d035f367-871a-4384-97d6-c810d08f6848 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:00:36.921015 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-6000eced-2a85-4f5f-9992-b50a7312d8da req-d035f367-871a-4384-97d6-c810d08f6848 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/ports?device_id=58da9205-0212-4daa-996c-1eef64a2b702 HTTP/1.1" status: 200 len: 945 time: 0.4224920 May 25 17:00:36.968923 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-68f6a709-4fd1-47a6-b1a1-c632840b8c5e req-1bbcdefc-2658-440c-b08c-00c934799a8a tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:00:36.970355 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-68f6a709-4fd1-47a6-b1a1-c632840b8c5e req-1bbcdefc-2658-440c-b08c-00c934799a8a tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] 10.222.0.62 "GET /v2.0/ports?device_id=e2dfa29d-fe86-4425-b12b-d984d7f0584a HTTP/1.1" status: 200 len: 944 time: 0.3091533 May 25 17:00:36.971541 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-2d5110ac-b5aa-4079-abfa-43be5bede66a req-9d33a390-ded8-4e92-849b-06ae0b88703d service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=60078444-24b6-4560-b0a7-7802c4f8f2f8 HTTP/1.1" status: 200 len: 217 time: 0.1152873 May 25 17:00:37.097018 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-6000eced-2a85-4f5f-9992-b50a7312d8da req-c2a4ade2-71c5-4bff-8b12-ef3b223d6a8a tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/security-groups?id=8ee5c4ed-9c60-4e39-9185-7e283704a7dc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1606147 May 25 17:00:37.118413 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-68f6a709-4fd1-47a6-b1a1-c632840b8c5e req-c3a58ed9-e671-42df-a34c-4b07105534c8 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] 10.222.0.62 "GET /v2.0/security-groups?id=f73b90a2-df48-48fb-99e0-5dd4d6a63a15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1384854 May 25 17:00:37.121927 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-32aa12bf-0b66-4533-8939-7a3b6367bcba tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:37.123872 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2d5110ac-b5aa-4079-abfa-43be5bede66a req-47ae128c-4fff-4885-80f3-dc098a6e3ff6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:00:37.125277 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-2d5110ac-b5aa-4079-abfa-43be5bede66a req-47ae128c-4fff-4885-80f3-dc098a6e3ff6 service neutron] 10.222.0.32 "GET /v2.0/subnets?id=927bd65a-c4de-491b-b501-302852f4c784 HTTP/1.1" status: 200 len: 858 time: 0.1398695 May 25 17:00:37.127199 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-32aa12bf-0b66-4533-8939-7a3b6367bcba tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-640874'] for security_group_rule, after_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:37.129234 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-f874312f-1856-4dbb-bd54-d61abbabcff0 tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:00:37.167562 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-55cd17b2-20e7-4472-8906-6a809ecac7fd None None] Notify callbacks [] for port, precommit_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:37.181591 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.provisioning_blocks [None req-55cd17b2-20e7-4472-8906-6a809ecac7fd None None] Transition to ACTIVE for port object a713d455-65c7-40a2-ac4c-0b352efc4cd0 will not be triggered until provisioned by entity L2. {{(pid=91831) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 25 17:00:37.189125 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-55cd17b2-20e7-4472-8906-6a809ecac7fd None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8757892955028', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8757892520933', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8757892521750'] for port, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:37.194580 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:00:37.198407 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-32aa12bf-0b66-4533-8939-7a3b6367bcba tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=a49a1bc7-d60f-4bb9-ac8c-ba16b15b7ecf,revision_number=0']} {{(pid=91829) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:00:37.200828 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-32aa12bf-0b66-4533-8939-7a3b6367bcba tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.072s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:00:37.218462 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-2d5110ac-b5aa-4079-abfa-43be5bede66a req-8c8399f4-5db0-4f25-b356-49af5754c52a service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=55a46372-d583-4435-a0f6-b9397668217d&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0729887 May 25 17:00:37.248461 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-32aa12bf-0b66-4533-8939-7a3b6367bcba tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] Notify callbacks [] for security_group_rule, before_response {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:37.249765 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [None req-32aa12bf-0b66-4533-8939-7a3b6367bcba tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] 10.222.0.62 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.5338678 May 25 17:00:37.253174 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.wsgi [-] (91830) accepted ('10.222.0.62', 59036) {{(pid=91830) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:00:37.269975 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.v2.base [None req-8c430eea-25ad-4f86-b0a0-5ae115c739f7 tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] Request body: {'security_group_rule': {'security_group_id': '1468f899-860c-4905-aee3-f13adc83d0a4', 'project_id': 'a736cc60cc2143c4b6dea99321051da5', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=91830) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 17:00:37.282642 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.quota.driver [None req-8c430eea-25ad-4f86-b0a0-5ae115c739f7 tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91830) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 17:00:37.288665 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [None req-8c430eea-25ad-4f86-b0a0-5ae115c739f7 tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] Usage tracker for resource:security_group_rule and tenant:a736cc60cc2143c4b6dea99321051da5 is out of sync, need to count used quota {{(pid=91830) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 17:00:37.293333 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [None req-8c430eea-25ad-4f86-b0a0-5ae115c739f7 tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] Quota usage for security_group_rule was recalculated. Used quota:9. {{(pid=91830) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 17:00:37.308281 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.quota.driver [None req-8c430eea-25ad-4f86-b0a0-5ae115c739f7 tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 9; quota limit: 100; headroom:91 {{(pid=91830) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 17:00:37.345440 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-8c430eea-25ad-4f86-b0a0-5ae115c739f7 tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] Notify callbacks [] for security_group_rule, before_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:37.390937 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7eee7a75-fb73-4d08-a0db-eb89e624b25f None None] Pushing event updated for resources: {'Port': ['ID=a713d455-65c7-40a2-ac4c-0b352efc4cd0,revision_number=3']} {{(pid=91831) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:00:37.393540 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [None req-7eee7a75-fb73-4d08-a0db-eb89e624b25f None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.199s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:00:37.397564 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-2d5110ac-b5aa-4079-abfa-43be5bede66a req-b5b8878b-0efd-43ce-99bb-7f813ad4fd48 service neutron] 10.222.0.32 "GET /v2.0/networks/55a46372-d583-4435-a0f6-b9397668217d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1708920 May 25 17:00:37.449144 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-8c430eea-25ad-4f86-b0a0-5ae115c739f7 tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:37.453654 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-8c430eea-25ad-4f86-b0a0-5ae115c739f7 tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-640874'] for security_group_rule, after_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:37.456055 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-caf41cba-bbc8-49fc-8dde-8c628e609ccb tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:00:37.474364 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.managers [None req-55cd17b2-20e7-4472-8906-6a809ecac7fd None None] Attempting to bind port a713d455-65c7-40a2-ac4c-0b352efc4cd0 on host dv-cinder-790492-4-iscsi for vnic_type normal with profile {{(pid=91831) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 25 17:00:37.474837 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.managers [None req-55cd17b2-20e7-4472-8906-6a809ecac7fd None None] Attempting to bind port a713d455-65c7-40a2-ac4c-0b352efc4cd0 by drivers openvswitch,hyperv on host dv-cinder-790492-4-iscsi at level 0 using segments [{'id': 'cb1a8cf9-1f34-483f-8b10-2d2767734b93', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 698, 'network_id': 'b3bf2911-47e9-4eda-9fe8-ec380a12f536'}] {{(pid=91831) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 25 17:00:37.475406 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-55cd17b2-20e7-4472-8906-6a809ecac7fd None None] Attempting to bind port a713d455-65c7-40a2-ac4c-0b352efc4cd0 on network b3bf2911-47e9-4eda-9fe8-ec380a12f536 {{(pid=91831) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 25 17:00:37.485090 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8c430eea-25ad-4f86-b0a0-5ae115c739f7 tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=6686e60a-e3ec-4102-942f-a55cd98f5c6c,revision_number=0']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:00:37.486691 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-55cd17b2-20e7-4472-8906-6a809ecac7fd None None] Checking agent: {'id': 'fc8251e1-071c-49f7-bc10-1337f1d37d1b', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-790492-4-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 25, 16, 50, 28), 'started_at': datetime.datetime(2021, 5, 25, 16, 50, 58), 'heartbeat_timestamp': datetime.datetime(2021, 5, 25, 17, 0, 28), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-790492-4-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=91831) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 25 17:00:37.487243 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-55cd17b2-20e7-4472-8906-6a809ecac7fd None None] Checking segment: {'id': 'cb1a8cf9-1f34-483f-8b10-2d2767734b93', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 698, 'network_id': 'b3bf2911-47e9-4eda-9fe8-ec380a12f536'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91831) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 25 17:00:37.488727 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-8c430eea-25ad-4f86-b0a0-5ae115c739f7 tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.032s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:00:37.489326 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-55cd17b2-20e7-4472-8906-6a809ecac7fd None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:37.489748 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-55cd17b2-20e7-4472-8906-6a809ecac7fd None None] Bound using segment: {'id': 'cb1a8cf9-1f34-483f-8b10-2d2767734b93', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 698, 'network_id': 'b3bf2911-47e9-4eda-9fe8-ec380a12f536'} {{(pid=91831) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 25 17:00:37.490332 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.managers [None req-55cd17b2-20e7-4472-8906-6a809ecac7fd None None] Bound port: a713d455-65c7-40a2-ac4c-0b352efc4cd0, host: dv-cinder-790492-4-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'cb1a8cf9-1f34-483f-8b10-2d2767734b93', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 698, 'network_id': 'b3bf2911-47e9-4eda-9fe8-ec380a12f536'}}] {{(pid=91831) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 25 17:00:37.490740 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-55cd17b2-20e7-4472-8906-6a809ecac7fd None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3832070'] for port, before_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:37.500056 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-8c430eea-25ad-4f86-b0a0-5ae115c739f7 tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] Notify callbacks [] for security_group_rule, before_response {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:37.505965 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [None req-8c430eea-25ad-4f86-b0a0-5ae115c739f7 tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] 10.222.0.62 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.2464309 May 25 17:00:37.507108 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.wsgi [-] (91830) accepted ('10.222.0.62', 59040) {{(pid=91830) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:00:37.517547 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.v2.base [None req-e368f62d-18a4-4050-890c-3ff97963f4aa tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] Request body: {'security_group_rule': {'security_group_id': '1468f899-860c-4905-aee3-f13adc83d0a4', 'project_id': 'a736cc60cc2143c4b6dea99321051da5', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=91830) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 17:00:37.524165 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.quota.driver [None req-e368f62d-18a4-4050-890c-3ff97963f4aa tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91830) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 17:00:37.536042 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-7df9cc07-0db0-444d-b7f6-05af43c4965c req-c9696cd8-234b-407b-966e-5ef51b099940 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/ports?device_id=3ead96ee-e427-4e87-9879-a1cdf303f894 HTTP/1.1" status: 200 len: 210 time: 0.1072299 May 25 17:00:37.558336 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [None req-e368f62d-18a4-4050-890c-3ff97963f4aa tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] Usage tracker for resource:security_group_rule and tenant:a736cc60cc2143c4b6dea99321051da5 is out of sync, need to count used quota {{(pid=91830) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 17:00:37.562559 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [None req-e368f62d-18a4-4050-890c-3ff97963f4aa tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] Quota usage for security_group_rule was recalculated. Used quota:10. {{(pid=91830) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 17:00:37.568532 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.quota.driver [None req-e368f62d-18a4-4050-890c-3ff97963f4aa tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 10; quota limit: 100; headroom:90 {{(pid=91830) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 17:00:37.594483 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.db.securitygroups_db [None req-e368f62d-18a4-4050-890c-3ff97963f4aa tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] Project a736cc60cc2143c4b6dea99321051da5 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. May 25 17:00:37.609796 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-e368f62d-18a4-4050-890c-3ff97963f4aa tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] Notify callbacks [] for security_group_rule, before_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:37.643136 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-2d5110ac-b5aa-4079-abfa-43be5bede66a req-b0807fa3-969b-445f-b121-3c3d1984f8c4 service neutron] 10.222.0.32 "GET /v2.0/networks/55a46372-d583-4435-a0f6-b9397668217d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2358484 May 25 17:00:37.699801 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.db [None req-55cd17b2-20e7-4472-8906-6a809ecac7fd None None] For port a713d455-65c7-40a2-ac4c-0b352efc4cd0, host dv-cinder-790492-4-iscsi, cleared binding levels {{(pid=91831) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 25 17:00:37.703092 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.db [None req-55cd17b2-20e7-4472-8906-6a809ecac7fd None None] For port a713d455-65c7-40a2-ac4c-0b352efc4cd0, host dv-cinder-790492-4-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-790492-4-iscsi',level=0,port_id=a713d455-65c7-40a2-ac4c-0b352efc4cd0,segment=NetworkSegment(cb1a8cf9-1f34-483f-8b10-2d2767734b93),segment_id=cb1a8cf9-1f34-483f-8b10-2d2767734b93)] {{(pid=91831) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 25 17:00:37.709868 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-55cd17b2-20e7-4472-8906-6a809ecac7fd None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8757892955028', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8757892520933', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8757892521750'] for port, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:37.716938 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [None req-339aa0cb-86be-4552-866a-55dd5c0bb7f2 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:00:37.727905 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-e368f62d-18a4-4050-890c-3ff97963f4aa tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:37.733370 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-e368f62d-18a4-4050-890c-3ff97963f4aa tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-640874'] for security_group_rule, after_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:37.733370 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-8c430eea-25ad-4f86-b0a0-5ae115c739f7 tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:00:37.818550 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.l3_dvrscheduler_db [None req-55cd17b2-20e7-4472-8906-6a809ecac7fd None None] Routers {'efdd8e5d-d3d0-40ed-9f26-6c99ecf4debd'} bound to L3 agent in host dv-cinder-790492-4-iscsi {{(pid=91831) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 17:00:37.820535 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.l3_hamode_db [None req-55cd17b2-20e7-4472-8906-6a809ecac7fd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-790492-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 4},created_at=2021-05-25T16:50:28Z,description=,heartbeat_timestamp=2021-05-25T17:00:28Z,host='dv-cinder-790492-4-iscsi',id=a2d427c1-2d07-43e8-afbe-218c9f7d0445,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T16:50:28Z,topic='l3_agent')) {'router_ids': ['efdd8e5d-d3d0-40ed-9f26-6c99ecf4debd'], 'active': True} {{(pid=91831) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 17:00:37.825751 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e368f62d-18a4-4050-890c-3ff97963f4aa tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=3fc24843-ad86-4581-8306-d90a281a7806,revision_number=0']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:00:37.835506 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-e368f62d-18a4-4050-890c-3ff97963f4aa tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.097s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:00:37.855820 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-e368f62d-18a4-4050-890c-3ff97963f4aa tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] Notify callbacks [] for security_group_rule, before_response {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:37.857297 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [None req-e368f62d-18a4-4050-890c-3ff97963f4aa tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] 10.222.0.62 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 774 time: 0.3489330 May 25 17:00:37.860958 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.wsgi [-] (91830) accepted ('10.222.0.62', 59054) {{(pid=91830) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:00:37.869956 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.v2.base [None req-0ea706e3-9b8a-44a9-9c81-0b82fc15f8d5 tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] Request body: {'security_group_rule': {'security_group_id': '1468f899-860c-4905-aee3-f13adc83d0a4', 'project_id': 'a736cc60cc2143c4b6dea99321051da5', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=91830) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 17:00:37.886708 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.quota.driver [None req-0ea706e3-9b8a-44a9-9c81-0b82fc15f8d5 tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91830) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 17:00:37.895991 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [None req-0ea706e3-9b8a-44a9-9c81-0b82fc15f8d5 tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] Usage tracker for resource:security_group_rule and tenant:a736cc60cc2143c4b6dea99321051da5 is out of sync, need to count used quota {{(pid=91830) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 17:00:37.903370 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [None req-0ea706e3-9b8a-44a9-9c81-0b82fc15f8d5 tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] Quota usage for security_group_rule was recalculated. Used quota:11. {{(pid=91830) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 17:00:37.915419 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.quota.driver [None req-0ea706e3-9b8a-44a9-9c81-0b82fc15f8d5 tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 11; quota limit: 100; headroom:89 {{(pid=91830) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 17:00:37.944064 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.db.securitygroups_db [None req-0ea706e3-9b8a-44a9-9c81-0b82fc15f8d5 tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] Project a736cc60cc2143c4b6dea99321051da5 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. May 25 17:00:37.956502 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-0ea706e3-9b8a-44a9-9c81-0b82fc15f8d5 tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] Notify callbacks [] for security_group_rule, before_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:37.993374 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7eee7a75-fb73-4d08-a0db-eb89e624b25f None None] Pushing event updated for resources: {'Port': ['ID=a713d455-65c7-40a2-ac4c-0b352efc4cd0,revision_number=4']} {{(pid=91831) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:00:38.021281 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [None req-7eee7a75-fb73-4d08-a0db-eb89e624b25f None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.304s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:00:38.125989 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-0ea706e3-9b8a-44a9-9c81-0b82fc15f8d5 tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:38.137776 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-0ea706e3-9b8a-44a9-9c81-0b82fc15f8d5 tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-640874'] for security_group_rule, after_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:38.159121 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-4e415b23-a6fb-40cb-a053-c531f639ad54 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:00:38.194069 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f1a5dfda-eabb-4edc-8b23-252bfc5118e4 req-e041b492-f43f-4dd7-9967-c12f0892df0c tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:00:38.196268 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-f1a5dfda-eabb-4edc-8b23-252bfc5118e4 req-e041b492-f43f-4dd7-9967-c12f0892df0c tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.32 "GET /v2.0/networks?id=e5be4c6a-143f-474c-a90b-37180778cefe HTTP/1.1" status: 200 len: 816 time: 0.4347298 May 25 17:00:38.213808 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0ea706e3-9b8a-44a9-9c81-0b82fc15f8d5 tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=0547df4d-abcf-4c50-9498-f638a78fb5df,revision_number=0']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:00:38.222498 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-0ea706e3-9b8a-44a9-9c81-0b82fc15f8d5 tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.064s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:00:38.233229 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-0ea706e3-9b8a-44a9-9c81-0b82fc15f8d5 tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] Notify callbacks [] for security_group_rule, before_response {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:38.236778 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [None req-0ea706e3-9b8a-44a9-9c81-0b82fc15f8d5 tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] 10.222.0.62 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 773 time: 0.3747666 May 25 17:00:38.325993 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.l3_dvr_db [None req-55cd17b2-20e7-4472-8906-6a809ecac7fd None None] Set router efdd8e5d-d3d0-40ed-9f26-6c99ecf4debd gateway port host: dv-cinder-790492-4-iscsi {{(pid=91831) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 17:00:38.349973 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.wsgi [-] (91830) accepted ('10.222.0.62', 59076) {{(pid=91830) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:00:38.499541 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-f1a5dfda-eabb-4edc-8b23-252bfc5118e4 req-d559112e-41eb-4b71-9401-aaef1c9aba2d tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.32 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=bbb9e99759bc47d08005f3b1e036a6cf HTTP/1.1" status: 200 len: 380 time: 0.2854698 May 25 17:00:38.545941 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-2154e6a4-a75a-42c8-8b69-3091867c75f4 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:38.552135 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.v2.base [req-f1a5dfda-eabb-4edc-8b23-252bfc5118e4 req-84b3f358-d6ad-4264-bf76-810b33627178 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Request body: {'port': {'device_id': '3ead96ee-e427-4e87-9879-a1cdf303f894', 'network_id': 'e5be4c6a-143f-474c-a90b-37180778cefe', 'admin_state_up': True, 'tenant_id': 'bbb9e99759bc47d08005f3b1e036a6cf', 'security_groups': ['fdd3b3f1-a2cb-4432-9874-c1d04f64207b']}} {{(pid=91829) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 17:00:38.582608 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.quota.driver [None req-2154e6a4-a75a-42c8-8b69-3091867c75f4 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91830) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 17:00:38.589479 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [None req-2154e6a4-a75a-42c8-8b69-3091867c75f4 admin admin] Usage tracker for resource:security_group_rule and tenant:c449b33b93eb425884c0649921f84c9a is out of sync, need to count used quota {{(pid=91830) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 17:00:38.593710 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [None req-2154e6a4-a75a-42c8-8b69-3091867c75f4 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91830) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 17:00:38.602006 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.quota.driver [None req-2154e6a4-a75a-42c8-8b69-3091867c75f4 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91830) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 17:00:38.743332 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-2154e6a4-a75a-42c8-8b69-3091867c75f4 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:38.749025 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-2154e6a4-a75a-42c8-8b69-3091867c75f4 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-640836'] for security_group, after_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:38.761673 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-13c33fa7-9bd1-4749-82a5-c83f8a21275c tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:00:38.825289 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [None req-2154e6a4-a75a-42c8-8b69-3091867c75f4 admin admin] 10.222.0.62 "GET /v2.0/security-groups?tenant_id=c449b33b93eb425884c0649921f84c9a&name=default HTTP/1.1" status: 200 len: 2979 time: 0.4730070 May 25 17:00:38.827652 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2154e6a4-a75a-42c8-8b69-3091867c75f4 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=f72d6dc9-45f1-4b3d-9db4-c1c934a1538c,revision_number=1']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:00:38.829470 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.wsgi [-] (91829) accepted ('10.222.0.62', 59128) {{(pid=91829) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:00:38.833538 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-2154e6a4-a75a-42c8-8b69-3091867c75f4 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.072s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:00:38.856742 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.quota.driver [req-f1a5dfda-eabb-4edc-8b23-252bfc5118e4 req-84b3f358-d6ad-4264-bf76-810b33627178 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91829) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 17:00:38.869050 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1771b70d-efbc-433f-845f-64ff120097ef req-909ff307-4e4f-4eb7-b059-db77ef6465ce tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:00:38.870549 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-1771b70d-efbc-433f-845f-64ff120097ef req-909ff307-4e4f-4eb7-b059-db77ef6465ce tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/ports?device_id=58da9205-0212-4daa-996c-1eef64a2b702 HTTP/1.1" status: 200 len: 945 time: 0.5395648 May 25 17:00:38.877143 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.l3_hamode_db [None req-55cd17b2-20e7-4472-8906-6a809ecac7fd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'efdd8e5d-d3d0-40ed-9f26-6c99ecf4debd', 'name': 'tempest-TestShelveInstance-1848885781-router', 'tenant_id': '6a788f87b23b492da7fbfb18883b9d2d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'external_fixed_ips': [{'subnet_id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'ip_address': '172.27.2.5'}], 'enable_snat': True}, 'gw_port_id': 'f2ed4d81-44b1-4fbd-a5db-c3ed5a03b7de', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T17:00:23Z', 'updated_at': '2021-05-25T17:00:33Z', 'revision_number': 4, 'project_id': '6a788f87b23b492da7fbfb18883b9d2d', 'gw_port': {'id': 'f2ed4d81-44b1-4fbd-a5db-c3ed5a03b7de', 'name': '', 'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'tenant_id': '', 'mac_address': 'fa:16:3e:f1:11:4f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'efdd8e5d-d3d0-40ed-9f26-6c99ecf4debd', 'device_owner': 'network:router_gateway', 'standard_attr_id': 323, 'fixed_ips': [{'subnet_id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'ip_address': '172.27.2.5', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790492-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:00:25Z', 'updated_at': '2021-05-25T17:00:34Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-790492-4-iscsi', '_interfaces': [{'id': 'a713d455-65c7-40a2-ac4c-0b352efc4cd0', 'name': '', 'network_id': 'b3bf2911-47e9-4eda-9fe8-ec380a12f536', 'tenant_id': '6a788f87b23b492da7fbfb18883b9d2d', 'mac_address': 'fa:16:3e:ed:ec:93', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'efdd8e5d-d3d0-40ed-9f26-6c99ecf4debd', 'device_owner': 'network:router_interface', 'standard_attr_id': 335, 'fixed_ips': [{'subnet_id': '04a2fff9-c99b-4a81-8cff-a0e02839c1f9', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790492-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:00:32Z', 'updated_at': '2021-05-25T17:00:37Z', 'revision_number': 4, 'project_id': '6a788f87b23b492da7fbfb18883b9d2d', 'subnets': [{'id': '04a2fff9-c99b-4a81-8cff-a0e02839c1f9', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-790492-4-iscsi', False) {} {{(pid=91831) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 17:00:38.877819 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c4cc52b0-02ec-4395-87a6-bf25e36f2867 req-0fe4bf6c-2849-4132-9cf3-34a8e2cd4762 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:00:38.879408 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-c4cc52b0-02ec-4395-87a6-bf25e36f2867 req-0fe4bf6c-2849-4132-9cf3-34a8e2cd4762 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] 10.222.0.62 "GET /v2.0/ports?device_id=e2dfa29d-fe86-4425-b12b-d984d7f0584a HTTP/1.1" status: 200 len: 944 time: 0.5052660 May 25 17:00:38.883090 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-55cd17b2-20e7-4472-8906-6a809ecac7fd None None] The sync data for ids ['efdd8e5d-d3d0-40ed-9f26-6c99ecf4debd'] in dv-cinder-790492-4-iscsi is: [{'id': 'efdd8e5d-d3d0-40ed-9f26-6c99ecf4debd', 'name': 'tempest-TestShelveInstance-1848885781-router', 'tenant_id': '6a788f87b23b492da7fbfb18883b9d2d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'external_fixed_ips': [{'subnet_id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'ip_address': '172.27.2.5'}], 'enable_snat': True}, 'gw_port_id': 'f2ed4d81-44b1-4fbd-a5db-c3ed5a03b7de', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T17:00:23Z', 'updated_at': '2021-05-25T17:00:33Z', 'revision_number': 4, 'project_id': '6a788f87b23b492da7fbfb18883b9d2d', 'gw_port': {'id': 'f2ed4d81-44b1-4fbd-a5db-c3ed5a03b7de', 'name': '', 'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'tenant_id': '', 'mac_address': 'fa:16:3e:f1:11:4f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'efdd8e5d-d3d0-40ed-9f26-6c99ecf4debd', 'device_owner': 'network:router_gateway', 'standard_attr_id': 323, 'fixed_ips': [{'subnet_id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'ip_address': '172.27.2.5', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790492-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:00:25Z', 'updated_at': '2021-05-25T17:00:34Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-790492-4-iscsi', '_interfaces': [{'id': 'a713d455-65c7-40a2-ac4c-0b352efc4cd0', 'name': '', 'network_id': 'b3bf2911-47e9-4eda-9fe8-ec380a12f536', 'tenant_id': '6a788f87b23b492da7fbfb18883b9d2d', 'mac_address': 'fa:16:3e:ed:ec:93', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'efdd8e5d-d3d0-40ed-9f26-6c99ecf4debd', 'device_owner': 'network:router_interface', 'standard_attr_id': 335, 'fixed_ips': [{'subnet_id': '04a2fff9-c99b-4a81-8cff-a0e02839c1f9', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790492-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:00:32Z', 'updated_at': '2021-05-25T17:00:37Z', 'revision_number': 4, 'project_id': '6a788f87b23b492da7fbfb18883b9d2d', 'subnets': [{'id': '04a2fff9-c99b-4a81-8cff-a0e02839c1f9', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=91831) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 25 17:00:38.885583 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.quota.resource [req-f1a5dfda-eabb-4edc-8b23-252bfc5118e4 req-84b3f358-d6ad-4264-bf76-810b33627178 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Usage tracker for resource:port and tenant:bbb9e99759bc47d08005f3b1e036a6cf is out of sync, need to count used quota {{(pid=91829) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 17:00:38.901389 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.quota.resource [req-f1a5dfda-eabb-4edc-8b23-252bfc5118e4 req-84b3f358-d6ad-4264-bf76-810b33627178 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Quota usage for port was recalculated. Used quota:3. {{(pid=91829) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 17:00:38.955647 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.quota.driver [req-f1a5dfda-eabb-4edc-8b23-252bfc5118e4 req-84b3f358-d6ad-4264-bf76-810b33627178 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Attempting to reserve 1 items for resource port. Total usage: 3; quota limit: 500; headroom:497 {{(pid=91829) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 17:00:39.040845 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-1771b70d-efbc-433f-845f-64ff120097ef req-6f28cf25-7c90-4725-b1e5-0deab47e200f tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/security-groups?id=8ee5c4ed-9c60-4e39-9185-7e283704a7dc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1574087 May 25 17:00:39.049225 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-f1a5dfda-eabb-4edc-8b23-252bfc5118e4 req-84b3f358-d6ad-4264-bf76-810b33627178 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Made reservation on behalf of bbb9e99759bc47d08005f3b1e036a6cf for: {'port': 1} {{(pid=91829) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 25 17:00:39.052697 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [req-f1a5dfda-eabb-4edc-8b23-252bfc5118e4 req-84b3f358-d6ad-4264-bf76-810b33627178 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3832070'] for port, before_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:39.085946 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-c4cc52b0-02ec-4395-87a6-bf25e36f2867 req-e57c5647-58fb-4ecf-8825-deba81660509 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] 10.222.0.62 "GET /v2.0/security-groups?id=f73b90a2-df48-48fb-99e0-5dd4d6a63a15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1786287 May 25 17:00:39.096950 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-20a16cf6-d3ab-4f8c-baa7-54ac1656d365 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:39.316195 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-20a16cf6-d3ab-4f8c-baa7-54ac1656d365 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:39.352712 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-d371fcef-a61c-4578-9909-e2b7b6cdd0f8 req-513b5c17-46ea-49f2-847a-2f38b15fb1a0 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/ports?device_id=3ead96ee-e427-4e87-9879-a1cdf303f894 HTTP/1.1" status: 200 len: 210 time: 0.0880103 May 25 17:00:39.481206 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-20a16cf6-d3ab-4f8c-baa7-54ac1656d365 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-640836'] for security_group, after_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:39.509387 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-d84540da-8977-4576-869d-8f01f0ad5f3e admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:00:39.526776 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-20a16cf6-d3ab-4f8c-baa7-54ac1656d365 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=f72d6dc9-45f1-4b3d-9db4-c1c934a1538c,revision_number=None']} {{(pid=91829) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:00:39.536172 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-20a16cf6-d3ab-4f8c-baa7-54ac1656d365 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.030s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:00:39.547083 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-20a16cf6-d3ab-4f8c-baa7-54ac1656d365 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:39.548201 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [None req-20a16cf6-d3ab-4f8c-baa7-54ac1656d365 admin admin] 10.222.0.62 "DELETE /v2.0/security-groups/f72d6dc9-45f1-4b3d-9db4-c1c934a1538c HTTP/1.1" status: 204 len: 168 time: 0.7146509 May 25 17:00:39.549478 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.db_base_plugin_common [req-f1a5dfda-eabb-4edc-8b23-252bfc5118e4 req-84b3f358-d6ad-4264-bf76-810b33627178 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Allocated IP 172.20.0.13 (e5be4c6a-143f-474c-a90b-37180778cefe/6e6b5897-e23d-4281-96cb-a6fdf9b68134/b7d643d2-c7f2-4e49-8125-5c5ec0b9d463) {{(pid=91829) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 25 17:00:39.757072 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.rpc [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Device a713d455-65c7-40a2-ac4c-0b352efc4cd0 up at agent ovs-agent-dv-cinder-790492-4-iscsi {{(pid=91831) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 25 17:00:39.841311 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [req-f1a5dfda-eabb-4edc-8b23-252bfc5118e4 req-84b3f358-d6ad-4264-bf76-810b33627178 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Notify callbacks [] for port, precommit_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:39.850154 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.provisioning_blocks [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Provisioning for port a713d455-65c7-40a2-ac4c-0b352efc4cd0 completed by entity L2. {{(pid=91831) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 25 17:00:39.856190 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.provisioning_blocks [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Provisioning complete for port a713d455-65c7-40a2-ac4c-0b352efc4cd0 triggered by entity L2. {{(pid=91831) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 17:00:39.856774 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3854128'] for port, provisioning_complete {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:39.879002 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.provisioning_blocks [req-f1a5dfda-eabb-4edc-8b23-252bfc5118e4 req-84b3f358-d6ad-4264-bf76-810b33627178 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Transition to ACTIVE for port object b7d643d2-c7f2-4e49-8125-5c5ec0b9d463 will not be triggered until provisioned by entity DHCP. {{(pid=91829) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 25 17:00:39.930398 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [req-f1a5dfda-eabb-4edc-8b23-252bfc5118e4 req-84b3f358-d6ad-4264-bf76-810b33627178 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8757892520915', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28230808'] for port, after_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:39.940919 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:00:40.022603 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3832070'] for port, before_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:40.080648 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.db [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] For port a713d455-65c7-40a2-ac4c-0b352efc4cd0, host dv-cinder-790492-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-790492-4-iscsi',level=0,port_id=a713d455-65c7-40a2-ac4c-0b352efc4cd0,segment=NetworkSegment(cb1a8cf9-1f34-483f-8b10-2d2767734b93),segment_id=cb1a8cf9-1f34-483f-8b10-2d2767734b93)] {{(pid=91831) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 17:00:40.086738 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8757892955028', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8757892520933', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8757892521750'] for port, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:40.091226 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:00:40.104187 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-f1a5dfda-eabb-4edc-8b23-252bfc5118e4 req-84b3f358-d6ad-4264-bf76-810b33627178 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Network e5be4c6a-143f-474c-a90b-37180778cefe is already hosted by enough agents. {{(pid=91829) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 25 17:00:40.117043 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.scheduler.base_scheduler [req-f1a5dfda-eabb-4edc-8b23-252bfc5118e4 req-84b3f358-d6ad-4264-bf76-810b33627178 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Resources bound (agent type, host, resource id): {{(pid=91829) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 17:00:40.122453 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.l3_dvrscheduler_db [req-f1a5dfda-eabb-4edc-8b23-252bfc5118e4 req-84b3f358-d6ad-4264-bf76-810b33627178 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Received port after_create {{(pid=91829) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 25 17:00:40.220960 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-84b3f358-d6ad-4264-bf76-810b33627178 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Pushing event updated for resources: {'Port': ['ID=b7d643d2-c7f2-4e49-8125-5c5ec0b9d463,revision_number=1']} {{(pid=91829) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:00:40.257251 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Pushing event updated for resources: {'Port': ['ID=a713d455-65c7-40a2-ac4c-0b352efc4cd0,revision_number=5']} {{(pid=91831) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:00:40.260260 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-84b3f358-d6ad-4264-bf76-810b33627178 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.305s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:00:40.263477 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.175s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:00:40.303995 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f1a5dfda-eabb-4edc-8b23-252bfc5118e4 req-84b3f358-d6ad-4264-bf76-810b33627178 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:00:40.313177 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [req-f1a5dfda-eabb-4edc-8b23-252bfc5118e4 req-84b3f358-d6ad-4264-bf76-810b33627178 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-178712', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-551373'] for port, before_response {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:40.334005 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.rpc [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Device 46a1adbe-ec54-4c57-aa7a-9f257475e01c details requested by agent hyperv_hv-cinder-79049 with host hv-cinder-79049 {{(pid=91831) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 25 17:00:40.495086 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-f1a5dfda-eabb-4edc-8b23-252bfc5118e4 req-84b3f358-d6ad-4264-bf76-810b33627178 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.32 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 1.9743893 May 25 17:00:40.535981 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.v2.base [req-f1a5dfda-eabb-4edc-8b23-252bfc5118e4 req-aa9adaab-1c7d-4401-87d9-7e0864e39231 service neutron] Request body: {'port': {'device_id': '3ead96ee-e427-4e87-9879-a1cdf303f894', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-79049'}} {{(pid=91829) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 17:00:40.632803 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.db [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] For port 46a1adbe-ec54-4c57-aa7a-9f257475e01c, host hv-cinder-79049, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79049',level=0,port_id=46a1adbe-ec54-4c57-aa7a-9f257475e01c,segment=NetworkSegment(7d7273c2-c6dd-43fe-83a8-cb776d48dc70),segment_id=7d7273c2-c6dd-43fe-83a8-cb776d48dc70)] {{(pid=91831) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 17:00:40.650758 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.provisioning_blocks [None req-966926a2-e121-43e6-9029-f88f88b35093 None None] Provisioning for port b7d643d2-c7f2-4e49-8125-5c5ec0b9d463 completed by entity DHCP. {{(pid=91831) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 25 17:00:40.662947 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.rpc [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Returning: {'device': '46a1adbe-ec54-4c57-aa7a-9f257475e01c', 'network_id': '63b1f335-e2c4-48dd-886b-6be853f8a2fc', 'port_id': '46a1adbe-ec54-4c57-aa7a-9f257475e01c', 'mac_address': 'fa:16:3e:ea:5c:31', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 651, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'b0baa944-cafe-48a4-861a-dae28947b9f0', 'ip_address': '172.20.0.14'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=91831) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 25 17:00:40.698466 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ebefb3b2-e162-42d8-a527-b42e0f5b9e88 req-9b344cd8-1c66-4088-8c53-9f49fb972be0 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:00:40.702806 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.provisioning_blocks [None req-966926a2-e121-43e6-9029-f88f88b35093 None None] Provisioning complete for port b7d643d2-c7f2-4e49-8125-5c5ec0b9d463 triggered by entity DHCP. {{(pid=91831) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 17:00:40.705437 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-ebefb3b2-e162-42d8-a527-b42e0f5b9e88 req-9b344cd8-1c66-4088-8c53-9f49fb972be0 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] 10.222.0.62 "GET /v2.0/ports?device_id=e2dfa29d-fe86-4425-b12b-d984d7f0584a HTTP/1.1" status: 200 len: 944 time: 0.3494656 May 25 17:00:40.706050 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-966926a2-e121-43e6-9029-f88f88b35093 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3854128'] for port, provisioning_complete {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:40.714117 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-08bfab51-2240-4383-8cd2-e32dbc4d8c50 req-8277653c-c5e1-4af2-9c6f-4aaf7eb73916 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:00:40.715555 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-08bfab51-2240-4383-8cd2-e32dbc4d8c50 req-8277653c-c5e1-4af2-9c6f-4aaf7eb73916 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/ports?device_id=58da9205-0212-4daa-996c-1eef64a2b702 HTTP/1.1" status: 200 len: 945 time: 0.3646505 May 25 17:00:40.717332 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [req-f1a5dfda-eabb-4edc-8b23-252bfc5118e4 req-aa9adaab-1c7d-4401-87d9-7e0864e39231 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3832070'] for port, before_update {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:40.843525 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3832070'] for port, before_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:40.879201 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-ebefb3b2-e162-42d8-a527-b42e0f5b9e88 req-6a35789b-72f1-4f1f-8c76-3767723e363b tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] 10.222.0.62 "GET /v2.0/security-groups?id=f73b90a2-df48-48fb-99e0-5dd4d6a63a15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1729927 May 25 17:00:40.882532 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-08bfab51-2240-4383-8cd2-e32dbc4d8c50 req-d4fd431a-a73c-4868-86b0-8c004f716c04 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/security-groups?id=8ee5c4ed-9c60-4e39-9185-7e283704a7dc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1375358 May 25 17:00:40.890261 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.plugin [None req-966926a2-e121-43e6-9029-f88f88b35093 None None] Port b7d643d2-c7f2-4e49-8125-5c5ec0b9d463 cannot update to ACTIVE because it is not bound. {{(pid=91831) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 25 17:00:40.897387 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.notifiers.nova [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 46a1adbe-ec54-4c57-aa7a-9f257475e01c {{(pid=91831) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} May 25 17:00:40.939021 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.db [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] For port 46a1adbe-ec54-4c57-aa7a-9f257475e01c, host hv-cinder-79049, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79049',level=0,port_id=46a1adbe-ec54-4c57-aa7a-9f257475e01c,segment=NetworkSegment(7d7273c2-c6dd-43fe-83a8-cb776d48dc70),segment_id=7d7273c2-c6dd-43fe-83a8-cb776d48dc70)] {{(pid=91831) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 17:00:40.946886 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8757892955028', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8757892520933', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8757892521750'] for port, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:40.948676 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [None req-cbfe79ae-38f6-477b-9537-244bfa603ab4 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:00:41.121619 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Pushing event updated for resources: {'Port': ['ID=46a1adbe-ec54-4c57-aa7a-9f257475e01c,revision_number=4']} {{(pid=91831) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:00:41.137956 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.189s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:00:41.164781 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.wsgi [-] (91830) accepted ('10.222.0.62', 59234) {{(pid=91830) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:00:41.252569 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a36d2611-b30d-40fa-8dad-8a06472ed521 req-779e5e58-2bdb-48a3-bf1d-e401fe0f64bf tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:00:41.253319 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.quota.resource [req-a36d2611-b30d-40fa-8dad-8a06472ed521 req-779e5e58-2bdb-48a3-bf1d-e401fe0f64bf tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Synchronizing usage tracker for tenant:bbb9e99759bc47d08005f3b1e036a6cf on resource:port {{(pid=91829) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 25 17:00:41.290970 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.v2.base [None req-e49171c6-de5e-48a8-b5f8-c92d36e6f56b admin admin] Request body: {'network': {'name': 'tempest-VolumesSnapshotTestJSON-809682230-network', 'tenant_id': '1314f62bcf90411cadb06fa2d9392828'}} {{(pid=91830) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 17:00:41.298085 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.quota.driver [None req-e49171c6-de5e-48a8-b5f8-c92d36e6f56b admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91830) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 17:00:41.305002 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [None req-e49171c6-de5e-48a8-b5f8-c92d36e6f56b admin admin] Usage tracker for resource:network and tenant:1314f62bcf90411cadb06fa2d9392828 is out of sync, need to count used quota {{(pid=91830) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 17:00:41.308035 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [None req-e49171c6-de5e-48a8-b5f8-c92d36e6f56b admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=91830) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 17:00:41.315737 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.quota.driver [None req-e49171c6-de5e-48a8-b5f8-c92d36e6f56b admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91830) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 17:00:41.329342 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.quota.resource [req-a36d2611-b30d-40fa-8dad-8a06472ed521 req-779e5e58-2bdb-48a3-bf1d-e401fe0f64bf tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Unset dirty status for tenant:bbb9e99759bc47d08005f3b1e036a6cf on resource:port {{(pid=91829) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 25 17:00:41.329556 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-e49171c6-de5e-48a8-b5f8-c92d36e6f56b admin admin] Made reservation on behalf of 1314f62bcf90411cadb06fa2d9392828 for: {'network': 1} {{(pid=91830) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 25 17:00:41.330498 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-a36d2611-b30d-40fa-8dad-8a06472ed521 req-779e5e58-2bdb-48a3-bf1d-e401fe0f64bf tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/ports?device_id=3ead96ee-e427-4e87-9879-a1cdf303f894 HTTP/1.1" status: 200 len: 932 time: 0.2168217 May 25 17:00:41.331672 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-e49171c6-de5e-48a8-b5f8-c92d36e6f56b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-3832077'] for network, before_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:41.336472 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.notifiers.nova [req-f1a5dfda-eabb-4edc-8b23-252bfc5118e4 req-aa9adaab-1c7d-4401-87d9-7e0864e39231 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id b7d643d2-c7f2-4e49-8125-5c5ec0b9d463 {{(pid=91829) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} May 25 17:00:41.344788 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-e49171c6-de5e-48a8-b5f8-c92d36e6f56b admin admin] Notify callbacks [] for security_group, before_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:41.345477 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [req-f1a5dfda-eabb-4edc-8b23-252bfc5118e4 req-aa9adaab-1c7d-4401-87d9-7e0864e39231 service neutron] Notify callbacks [] for port, precommit_update {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:41.360728 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.quota.driver [None req-e49171c6-de5e-48a8-b5f8-c92d36e6f56b admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91830) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 17:00:41.365263 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [None req-e49171c6-de5e-48a8-b5f8-c92d36e6f56b admin admin] Usage tracker for resource:security_group_rule and tenant:1314f62bcf90411cadb06fa2d9392828 is out of sync, need to count used quota {{(pid=91830) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 17:00:41.368923 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [None req-e49171c6-de5e-48a8-b5f8-c92d36e6f56b admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91830) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 17:00:41.384635 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.quota.driver [None req-e49171c6-de5e-48a8-b5f8-c92d36e6f56b admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91830) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 17:00:41.393238 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.provisioning_blocks [req-f1a5dfda-eabb-4edc-8b23-252bfc5118e4 req-aa9adaab-1c7d-4401-87d9-7e0864e39231 service neutron] Transition to ACTIVE for port object b7d643d2-c7f2-4e49-8125-5c5ec0b9d463 will not be triggered until provisioned by entity L2. {{(pid=91829) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 25 17:00:41.397201 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [req-f1a5dfda-eabb-4edc-8b23-252bfc5118e4 req-aa9adaab-1c7d-4401-87d9-7e0864e39231 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8757892955028', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8757892520933', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8757892521750', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28230801'] for port, after_update {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:41.405399 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-a36d2611-b30d-40fa-8dad-8a06472ed521 req-40e1abae-4416-4d62-86fe-8ec94c8561cb tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/security-groups?id=fdd3b3f1-a2cb-4432-9874-c1d04f64207b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0644186 May 25 17:00:41.406955 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-42905d27-cfb2-4b93-8c1c-2dd7aa37f822 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:00:41.477129 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-e49171c6-de5e-48a8-b5f8-c92d36e6f56b admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:41.486289 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-e49171c6-de5e-48a8-b5f8-c92d36e6f56b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-640836'] for security_group, after_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:41.495790 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-33c9ba35-e221-4bb6-8268-4d1900424f27 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:00:41.509304 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-e49171c6-de5e-48a8-b5f8-c92d36e6f56b admin admin] vlan segment allocate from pool success with {'vlan_id': 654, 'physical_network': 'physnet1'} {{(pid=91830) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 25 17:00:41.524144 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.db [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] get_ports_and_sgs() called for port_ids ['46a1adbe-ec54-4c57-aa7a-9f257475e01c'] {{(pid=91831) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 25 17:00:41.535025 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-e49171c6-de5e-48a8-b5f8-c92d36e6f56b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3809789'] for segment, precommit_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:41.535356 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.db.segments_db [None req-e49171c6-de5e-48a8-b5f8-c92d36e6f56b admin admin] Added segment bba065e2-1e75-4ab9-bc0e-e3037ef57277 of type vlan for network c8b64023-a7f5-4c0f-847b-8a8aef981caa May 25 17:00:41.536870 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e49171c6-de5e-48a8-b5f8-c92d36e6f56b admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b5f47757-8dd4-4226-9a13-ca15ee498213,revision_number=1']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:00:41.544300 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-e49171c6-de5e-48a8-b5f8-c92d36e6f56b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.049s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:00:41.569663 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aa9adaab-1c7d-4401-87d9-7e0864e39231 service neutron] Pushing event updated for resources: {'Port': ['ID=b7d643d2-c7f2-4e49-8125-5c5ec0b9d463,revision_number=2']} {{(pid=91829) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:00:41.578419 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-e49171c6-de5e-48a8-b5f8-c92d36e6f56b admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8757892541013'] for network, precommit_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:41.608085 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-aa9adaab-1c7d-4401-87d9-7e0864e39231 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.200s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:00:41.673753 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-e49171c6-de5e-48a8-b5f8-c92d36e6f56b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-640806', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-551400'] for network, after_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:41.676740 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e49171c6-de5e-48a8-b5f8-c92d36e6f56b admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91830) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:00:41.677722 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-e49171c6-de5e-48a8-b5f8-c92d36e6f56b admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-551373'] for network, before_response {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:41.687519 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:00:41.740235 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.rpc [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Device a713d455-65c7-40a2-ac4c-0b352efc4cd0 up at agent ovs-agent-dv-cinder-790492-4-iscsi {{(pid=91831) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 25 17:00:41.747901 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.plugins.ml2.managers [req-f1a5dfda-eabb-4edc-8b23-252bfc5118e4 req-aa9adaab-1c7d-4401-87d9-7e0864e39231 service neutron] Attempting to bind port b7d643d2-c7f2-4e49-8125-5c5ec0b9d463 on host hv-cinder-79049 for vnic_type normal with profile {{(pid=91829) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 25 17:00:41.748974 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.plugins.ml2.managers [req-f1a5dfda-eabb-4edc-8b23-252bfc5118e4 req-aa9adaab-1c7d-4401-87d9-7e0864e39231 service neutron] Attempting to bind port b7d643d2-c7f2-4e49-8125-5c5ec0b9d463 by drivers openvswitch,hyperv on host hv-cinder-79049 at level 0 using segments [{'id': 'a8fb0313-938a-4f5e-8ff4-96df8acd943b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 695, 'network_id': 'e5be4c6a-143f-474c-a90b-37180778cefe'}] {{(pid=91829) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 25 17:00:41.749516 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f1a5dfda-eabb-4edc-8b23-252bfc5118e4 req-aa9adaab-1c7d-4401-87d9-7e0864e39231 service neutron] Attempting to bind port b7d643d2-c7f2-4e49-8125-5c5ec0b9d463 on network e5be4c6a-143f-474c-a90b-37180778cefe {{(pid=91829) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 25 17:00:41.756274 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f1a5dfda-eabb-4edc-8b23-252bfc5118e4 req-aa9adaab-1c7d-4401-87d9-7e0864e39231 service neutron] Port b7d643d2-c7f2-4e49-8125-5c5ec0b9d463 on network e5be4c6a-143f-474c-a90b-37180778cefe not bound, no agent of type Open vSwitch agent registered on host hv-cinder-79049 {{(pid=91829) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 25 17:00:41.756820 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f1a5dfda-eabb-4edc-8b23-252bfc5118e4 req-aa9adaab-1c7d-4401-87d9-7e0864e39231 service neutron] Attempting to bind port b7d643d2-c7f2-4e49-8125-5c5ec0b9d463 on network e5be4c6a-143f-474c-a90b-37180778cefe {{(pid=91829) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 25 17:00:41.764943 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f1a5dfda-eabb-4edc-8b23-252bfc5118e4 req-aa9adaab-1c7d-4401-87d9-7e0864e39231 service neutron] Checking agent: {'id': '3a1fdee1-bff0-49fb-b470-e13b95ee1b4d', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-79049', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 25, 16, 56, 32), 'started_at': datetime.datetime(2021, 5, 25, 16, 56, 32), 'heartbeat_timestamp': datetime.datetime(2021, 5, 25, 17, 0, 34), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=91829) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 25 17:00:41.765487 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f1a5dfda-eabb-4edc-8b23-252bfc5118e4 req-aa9adaab-1c7d-4401-87d9-7e0864e39231 service neutron] Checking segment: {'id': 'a8fb0313-938a-4f5e-8ff4-96df8acd943b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 695, 'network_id': 'e5be4c6a-143f-474c-a90b-37180778cefe'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91829) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 25 17:00:41.766053 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f1a5dfda-eabb-4edc-8b23-252bfc5118e4 req-aa9adaab-1c7d-4401-87d9-7e0864e39231 service neutron] Bound using segment: {'id': 'a8fb0313-938a-4f5e-8ff4-96df8acd943b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 695, 'network_id': 'e5be4c6a-143f-474c-a90b-37180778cefe'} {{(pid=91829) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 25 17:00:41.766804 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.plugins.ml2.managers [req-f1a5dfda-eabb-4edc-8b23-252bfc5118e4 req-aa9adaab-1c7d-4401-87d9-7e0864e39231 service neutron] Bound port: b7d643d2-c7f2-4e49-8125-5c5ec0b9d463, host: hv-cinder-79049, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'a8fb0313-938a-4f5e-8ff4-96df8acd943b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 695, 'network_id': 'e5be4c6a-143f-474c-a90b-37180778cefe'}}] {{(pid=91829) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 25 17:00:41.767303 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [req-f1a5dfda-eabb-4edc-8b23-252bfc5118e4 req-aa9adaab-1c7d-4401-87d9-7e0864e39231 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3832070'] for port, before_update {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:41.824936 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e49171c6-de5e-48a8-b5f8-c92d36e6f56b admin admin] Pushing event updated for resources: {'Network': ['ID=c8b64023-a7f5-4c0f-847b-8a8aef981caa,revision_number=1']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:00:41.829219 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [None req-e49171c6-de5e-48a8-b5f8-c92d36e6f56b admin admin] 10.222.0.62 "POST /v2.0/networks HTTP/1.1" status: 201 len: 886 time: 0.6630461 May 25 17:00:41.830335 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-e49171c6-de5e-48a8-b5f8-c92d36e6f56b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.143s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:00:41.833069 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.wsgi [-] (91830) accepted ('10.222.0.62', 59246) {{(pid=91830) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:00:41.851369 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.v2.base [None req-b0a2fec5-ca0e-4fa1-bef6-be2eb0b6e8b9 admin admin] Request body: {'subnet': {'network_id': 'c8b64023-a7f5-4c0f-847b-8a8aef981caa', 'cidr': '172.20.0.0/28', 'name': 'tempest-VolumesSnapshotTestJSON-809682230-subnet', 'tenant_id': '1314f62bcf90411cadb06fa2d9392828', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=91830) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 17:00:41.861659 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.quota.driver [None req-b0a2fec5-ca0e-4fa1-bef6-be2eb0b6e8b9 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91830) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 17:00:41.874556 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [None req-b0a2fec5-ca0e-4fa1-bef6-be2eb0b6e8b9 admin admin] Usage tracker for resource:subnet and tenant:1314f62bcf90411cadb06fa2d9392828 is out of sync, need to count used quota {{(pid=91830) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 17:00:41.881253 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [None req-b0a2fec5-ca0e-4fa1-bef6-be2eb0b6e8b9 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=91830) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 17:00:41.900836 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.quota.driver [None req-b0a2fec5-ca0e-4fa1-bef6-be2eb0b6e8b9 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91830) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 17:00:41.912167 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.rpc [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Network c8b64023-a7f5-4c0f-847b-8a8aef981caa details requested by agent ovs-agent-dv-cinder-790492-4-iscsi with host dv-cinder-790492-4-iscsi {{(pid=91831) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 25 17:00:41.936054 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-b0a2fec5-ca0e-4fa1-bef6-be2eb0b6e8b9 admin admin] Made reservation on behalf of 1314f62bcf90411cadb06fa2d9392828 for: {'subnet': 1} {{(pid=91830) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 25 17:00:41.938717 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-b0a2fec5-ca0e-4fa1-bef6-be2eb0b6e8b9 admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1152763'] for subnet, before_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:41.983494 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.plugins.ml2.db [req-f1a5dfda-eabb-4edc-8b23-252bfc5118e4 req-aa9adaab-1c7d-4401-87d9-7e0864e39231 service neutron] For port b7d643d2-c7f2-4e49-8125-5c5ec0b9d463, host hv-cinder-79049, cleared binding levels {{(pid=91829) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 25 17:00:41.989318 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.plugins.ml2.db [req-f1a5dfda-eabb-4edc-8b23-252bfc5118e4 req-aa9adaab-1c7d-4401-87d9-7e0864e39231 service neutron] For port b7d643d2-c7f2-4e49-8125-5c5ec0b9d463, host hv-cinder-79049, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79049',level=0,port_id=b7d643d2-c7f2-4e49-8125-5c5ec0b9d463,segment=NetworkSegment(a8fb0313-938a-4f5e-8ff4-96df8acd943b),segment_id=a8fb0313-938a-4f5e-8ff4-96df8acd943b)] {{(pid=91829) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 25 17:00:41.996128 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [req-f1a5dfda-eabb-4edc-8b23-252bfc5118e4 req-aa9adaab-1c7d-4401-87d9-7e0864e39231 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8757892955028', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8757892520933', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8757892521750', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28230801'] for port, after_update {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:42.003907 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:00:42.089124 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aa9adaab-1c7d-4401-87d9-7e0864e39231 service neutron] Pushing event updated for resources: {'Port': ['ID=b7d643d2-c7f2-4e49-8125-5c5ec0b9d463,revision_number=3']} {{(pid=91829) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:00:42.153095 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-aa9adaab-1c7d-4401-87d9-7e0864e39231 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.149s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:00:42.213594 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.provisioning_blocks [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Provisioning complete for port a713d455-65c7-40a2-ac4c-0b352efc4cd0 triggered by entity L2. {{(pid=91831) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 17:00:42.214218 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3854128'] for port, provisioning_complete {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:42.256801 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f1a5dfda-eabb-4edc-8b23-252bfc5118e4 req-aa9adaab-1c7d-4401-87d9-7e0864e39231 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:00:42.257433 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [req-f1a5dfda-eabb-4edc-8b23-252bfc5118e4 req-aa9adaab-1c7d-4401-87d9-7e0864e39231 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-178712', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-551373'] for port, before_response {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:42.265625 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-f1a5dfda-eabb-4edc-8b23-252bfc5118e4 req-aa9adaab-1c7d-4401-87d9-7e0864e39231 service neutron] 10.222.0.32 "PUT /v2.0/ports/b7d643d2-c7f2-4e49-8125-5c5ec0b9d463 HTTP/1.1" status: 200 len: 1094 time: 1.7566926 May 25 17:00:42.266386 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '3ead96ee-e427-4e87-9879-a1cdf303f894', 'tag': 'b7d643d2-c7f2-4e49-8125-5c5ec0b9d463'}] {{(pid=91829) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 25 17:00:42.441595 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-910b7c0d-cf2a-451b-bc61-7d779c6e075b req-3cd52e94-f0e1-4acc-862a-2da555c80667 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:00:42.443112 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-910b7c0d-cf2a-451b-bc61-7d779c6e075b req-3cd52e94-f0e1-4acc-862a-2da555c80667 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] 10.222.0.62 "GET /v2.0/ports?device_id=e2dfa29d-fe86-4425-b12b-d984d7f0584a HTTP/1.1" status: 200 len: 945 time: 0.3498263 May 25 17:00:42.454193 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7c7c5731-ad12-4818-80cf-a600e5071a0b req-d2b0bfd8-1ed0-44dd-a3ab-3f0616f0ce8b tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:00:42.455732 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-7c7c5731-ad12-4818-80cf-a600e5071a0b req-d2b0bfd8-1ed0-44dd-a3ab-3f0616f0ce8b tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/ports?device_id=58da9205-0212-4daa-996c-1eef64a2b702 HTTP/1.1" status: 200 len: 945 time: 0.3687632 May 25 17:00:42.524182 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-910b7c0d-cf2a-451b-bc61-7d779c6e075b req-d12d2cb0-5568-4a0b-b003-6d28d9820f7f tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] 10.222.0.62 "GET /v2.0/security-groups?id=f73b90a2-df48-48fb-99e0-5dd4d6a63a15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0673993 May 25 17:00:42.546365 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-7c7c5731-ad12-4818-80cf-a600e5071a0b req-eb188c33-4f06-486a-91b2-a20900ceb2a7 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/security-groups?id=8ee5c4ed-9c60-4e39-9185-7e283704a7dc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0583918 May 25 17:00:42.549611 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f1a5dfda-eabb-4edc-8b23-252bfc5118e4 req-5451032c-6d36-40ff-b4ba-3842b87112b6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:00:42.551318 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-f1a5dfda-eabb-4edc-8b23-252bfc5118e4 req-5451032c-6d36-40ff-b4ba-3842b87112b6 service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=bbb9e99759bc47d08005f3b1e036a6cf&device_id=3ead96ee-e427-4e87-9879-a1cdf303f894 HTTP/1.1" status: 200 len: 1097 time: 0.2397296 May 25 17:00:42.604252 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-b0a2fec5-ca0e-4fa1-bef6-be2eb0b6e8b9 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55886', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-28085051', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-1152749'] for subnet, after_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:42.609455 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:00:42.614782 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '3ead96ee-e427-4e87-9879-a1cdf303f894', 'tag': 'b7d643d2-c7f2-4e49-8125-5c5ec0b9d463', 'status': 'completed', 'code': 200} May 25 17:00:42.629540 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-f1a5dfda-eabb-4edc-8b23-252bfc5118e4 req-e9eb902f-33a7-422d-86c8-9479aa50e785 service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=b7d643d2-c7f2-4e49-8125-5c5ec0b9d463 HTTP/1.1" status: 200 len: 217 time: 0.0705416 May 25 17:00:42.680364 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b0a2fec5-ca0e-4fa1-bef6-be2eb0b6e8b9 admin admin] Pushing event updated for resources: {'Subnet': ['ID=e21793ea-1820-4ec5-b3fc-a7d9b7129124,revision_number=0']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:00:42.682921 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-b0a2fec5-ca0e-4fa1-bef6-be2eb0b6e8b9 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.073s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:00:42.688950 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b0a2fec5-ca0e-4fa1-bef6-be2eb0b6e8b9 admin admin] Checking segment: {'id': 'bba065e2-1e75-4ab9-bc0e-e3037ef57277', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 654, 'network_id': 'c8b64023-a7f5-4c0f-847b-8a8aef981caa'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91830) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 25 17:00:42.689296 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b0a2fec5-ca0e-4fa1-bef6-be2eb0b6e8b9 admin admin] Network hostable DHCP agents. Network: c8b64023-a7f5-4c0f-847b-8a8aef981caa, hostable agents: ['8d7401c6-8951-4f2b-ace4-208761782bfc'], hosted agents: [] {{(pid=91830) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 25 17:00:42.705596 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b0a2fec5-ca0e-4fa1-bef6-be2eb0b6e8b9 admin admin] Network c8b64023-a7f5-4c0f-847b-8a8aef981caa is scheduled to be hosted by DHCP agent 8d7401c6-8951-4f2b-ace4-208761782bfc with binding_index 1 {{(pid=91830) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 25 17:00:42.714796 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.scheduler.base_scheduler [None req-b0a2fec5-ca0e-4fa1-bef6-be2eb0b6e8b9 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-790492-4-iscsi, c8b64023-a7f5-4c0f-847b-8a8aef981caa) {{(pid=91830) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 17:00:42.726803 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-470a2569-190e-4232-a4c1-7ac748ab1813 None None] Network c8b64023-a7f5-4c0f-847b-8a8aef981caa requested from dv-cinder-790492-4-iscsi {{(pid=91831) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} May 25 17:00:42.727168 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b0a2fec5-ca0e-4fa1-bef6-be2eb0b6e8b9 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=91830) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:00:42.727756 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-b0a2fec5-ca0e-4fa1-bef6-be2eb0b6e8b9 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-551373'] for subnet, before_response {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:42.759104 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [None req-b0a2fec5-ca0e-4fa1-bef6-be2eb0b6e8b9 admin admin] 10.222.0.62 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 850 time: 0.9113386 May 25 17:00:42.759339 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f1a5dfda-eabb-4edc-8b23-252bfc5118e4 req-ada28563-5c0c-46ac-9fb1-2e80e63d6ca1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:00:42.759339 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-f1a5dfda-eabb-4edc-8b23-252bfc5118e4 req-ada28563-5c0c-46ac-9fb1-2e80e63d6ca1 service neutron] 10.222.0.32 "GET /v2.0/subnets?id=6e6b5897-e23d-4281-96cb-a6fdf9b68134 HTTP/1.1" status: 200 len: 855 time: 0.1181421 May 25 17:00:42.829304 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7ec70404-a782-4373-b13d-5d864ac30731 req-efd1e309-bacc-4767-bb6b-3f00de2d746c tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:00:42.830951 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-7ec70404-a782-4373-b13d-5d864ac30731 req-efd1e309-bacc-4767-bb6b-3f00de2d746c tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/ports?device_id=3ead96ee-e427-4e87-9879-a1cdf303f894 HTTP/1.1" status: 200 len: 944 time: 0.1611590 May 25 17:00:42.901784 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-7ec70404-a782-4373-b13d-5d864ac30731 req-13ded68a-1327-4683-8279-25816310728c tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/security-groups?id=fdd3b3f1-a2cb-4432-9874-c1d04f64207b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0565283 May 25 17:00:42.912185 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f1a5dfda-eabb-4edc-8b23-252bfc5118e4 req-3ad6f637-1889-46b6-8c4f-428cf450db1d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:00:42.914230 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-f1a5dfda-eabb-4edc-8b23-252bfc5118e4 req-3ad6f637-1889-46b6-8c4f-428cf450db1d service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=e5be4c6a-143f-474c-a90b-37180778cefe&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.1482017 May 25 17:00:43.034502 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7e318e49-0f76-44d3-99a4-26fa2f8c730a None None] Network c8b64023-a7f5-4c0f-847b-8a8aef981caa requested from dv-cinder-790492-4-iscsi {{(pid=91831) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} May 25 17:00:43.084227 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-f1a5dfda-eabb-4edc-8b23-252bfc5118e4 req-7a16c972-e1ec-4728-9bd2-1c30310771c6 service neutron] 10.222.0.32 "GET /v2.0/networks/e5be4c6a-143f-474c-a90b-37180778cefe?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1577888 May 25 17:00:43.232044 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-f1a5dfda-eabb-4edc-8b23-252bfc5118e4 req-c6861187-bee6-4dbe-8b53-7bcaa20f3a03 service neutron] 10.222.0.32 "GET /v2.0/networks/e5be4c6a-143f-474c-a90b-37180778cefe?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1384721 May 25 17:00:43.362539 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cb118984-1a12-471b-a715-5c22b63b6486 req-e495ae46-8d7e-402f-a49e-d9511f1f1568 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:00:43.364001 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-cb118984-1a12-471b-a715-5c22b63b6486 req-e495ae46-8d7e-402f-a49e-d9511f1f1568 service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=bbb9e99759bc47d08005f3b1e036a6cf&device_id=3ead96ee-e427-4e87-9879-a1cdf303f894 HTTP/1.1" status: 200 len: 1097 time: 0.0717981 May 25 17:00:43.503517 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cb118984-1a12-471b-a715-5c22b63b6486 req-9c67bc2e-e5e0-4bd2-842b-0cf34ff99f37 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:00:43.505279 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-cb118984-1a12-471b-a715-5c22b63b6486 req-9c67bc2e-e5e0-4bd2-842b-0cf34ff99f37 service neutron] 10.222.0.32 "GET /v2.0/networks?id=e5be4c6a-143f-474c-a90b-37180778cefe HTTP/1.1" status: 200 len: 917 time: 0.1343045 May 25 17:00:43.590101 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-cb118984-1a12-471b-a715-5c22b63b6486 req-1e43892c-06bd-46ac-8254-8f1ea74276f7 service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=b7d643d2-c7f2-4e49-8125-5c5ec0b9d463 HTTP/1.1" status: 200 len: 217 time: 0.0745068 May 25 17:00:43.720776 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cb118984-1a12-471b-a715-5c22b63b6486 req-ca35804e-bf20-40eb-923f-4e1b2af86af8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:00:43.722210 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-cb118984-1a12-471b-a715-5c22b63b6486 req-ca35804e-bf20-40eb-923f-4e1b2af86af8 service neutron] 10.222.0.32 "GET /v2.0/subnets?id=6e6b5897-e23d-4281-96cb-a6fdf9b68134 HTTP/1.1" status: 200 len: 855 time: 0.1244993 May 25 17:00:43.889782 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f32bdfab-3252-44ff-b8eb-aee9e0bc5488 req-31d3a130-e8c5-42ff-a1ec-9110abc0de76 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:00:43.891311 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-f32bdfab-3252-44ff-b8eb-aee9e0bc5488 req-31d3a130-e8c5-42ff-a1ec-9110abc0de76 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] 10.222.0.62 "GET /v2.0/ports?device_id=e2dfa29d-fe86-4425-b12b-d984d7f0584a HTTP/1.1" status: 200 len: 945 time: 0.2113187 May 25 17:00:43.921866 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bf6a60fd-9fce-4a08-9ac9-4bec0f7efb25 req-bcd34f02-f499-40ca-a18d-1b05577b11a4 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:00:43.923312 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-bf6a60fd-9fce-4a08-9ac9-4bec0f7efb25 req-bcd34f02-f499-40ca-a18d-1b05577b11a4 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/ports?device_id=58da9205-0212-4daa-996c-1eef64a2b702 HTTP/1.1" status: 200 len: 945 time: 0.2092361 May 25 17:00:43.925051 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cb118984-1a12-471b-a715-5c22b63b6486 req-e4a67a76-1d03-4ad7-9b75-23db36eec798 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:00:43.926309 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-cb118984-1a12-471b-a715-5c22b63b6486 req-e4a67a76-1d03-4ad7-9b75-23db36eec798 service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=e5be4c6a-143f-474c-a90b-37180778cefe&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.1571386 May 25 17:00:44.129024 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-f32bdfab-3252-44ff-b8eb-aee9e0bc5488 req-de56cc87-54d4-4c6e-8675-d4fcb95cc2ad tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] 10.222.0.62 "GET /v2.0/security-groups?id=f73b90a2-df48-48fb-99e0-5dd4d6a63a15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2313788 May 25 17:00:44.156943 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-bf6a60fd-9fce-4a08-9ac9-4bec0f7efb25 req-73747bc2-b511-4b9c-b8a4-a468124ab0a9 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/security-groups?id=8ee5c4ed-9c60-4e39-9185-7e283704a7dc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2248375 May 25 17:00:44.207326 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-cb118984-1a12-471b-a715-5c22b63b6486 req-c1219993-8df9-4208-8b39-73f8774ae156 service neutron] 10.222.0.32 "GET /v2.0/networks/e5be4c6a-143f-474c-a90b-37180778cefe?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2717280 May 25 17:00:44.373823 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.wsgi [-] (91830) accepted ('10.222.0.62', 59322) {{(pid=91830) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:00:44.377527 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.rpc [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Device 46a1adbe-ec54-4c57-aa7a-9f257475e01c up at agent hyperv_hv-cinder-79049 {{(pid=91831) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 25 17:00:44.425938 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1bb8d7f0-9e2a-4015-a564-f39f77d8d9a2 req-e704290c-912e-4d3c-9420-fd1b7ed257ed tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:00:44.427436 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-1bb8d7f0-9e2a-4015-a564-f39f77d8d9a2 req-e704290c-912e-4d3c-9420-fd1b7ed257ed tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/ports?device_id=3ead96ee-e427-4e87-9879-a1cdf303f894 HTTP/1.1" status: 200 len: 944 time: 0.1752527 May 25 17:00:44.471102 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-cb118984-1a12-471b-a715-5c22b63b6486 req-8563f3de-5293-4c75-8907-99df10762b4f service neutron] 10.222.0.32 "GET /v2.0/networks/e5be4c6a-143f-474c-a90b-37180778cefe?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2445011 May 25 17:00:44.503406 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-1bb8d7f0-9e2a-4015-a564-f39f77d8d9a2 req-d962dfaf-8941-454f-9429-0570b3e4cbac tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/security-groups?id=fdd3b3f1-a2cb-4432-9874-c1d04f64207b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0628436 May 25 17:00:44.521761 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.provisioning_blocks [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Provisioning for port 46a1adbe-ec54-4c57-aa7a-9f257475e01c completed by entity L2. {{(pid=91831) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 25 17:00:44.541408 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.provisioning_blocks [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Provisioning complete for port 46a1adbe-ec54-4c57-aa7a-9f257475e01c triggered by entity L2. {{(pid=91831) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 17:00:44.542069 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3854128'] for port, provisioning_complete {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:44.594848 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-1d5e1f16-4c21-4a24-af84-fa780644a59b admin admin] Notify callbacks [] for security_group, before_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:44.613207 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.quota.driver [None req-1d5e1f16-4c21-4a24-af84-fa780644a59b admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91830) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 17:00:44.617761 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [None req-1d5e1f16-4c21-4a24-af84-fa780644a59b admin admin] Usage tracker for resource:security_group_rule and tenant:9e6c1a17bcad48d39cb4cc6f0f2142d6 is out of sync, need to count used quota {{(pid=91830) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 17:00:44.620799 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [None req-1d5e1f16-4c21-4a24-af84-fa780644a59b admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91830) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 17:00:44.627340 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.quota.driver [None req-1d5e1f16-4c21-4a24-af84-fa780644a59b admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91830) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 17:00:44.738299 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3832070'] for port, before_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:44.766786 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-1d5e1f16-4c21-4a24-af84-fa780644a59b admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:44.772162 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-1d5e1f16-4c21-4a24-af84-fa780644a59b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-640836'] for security_group, after_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:44.774044 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'e2dfa29d-fe86-4425-b12b-d984d7f0584a', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '46a1adbe-ec54-4c57-aa7a-9f257475e01c'}] {{(pid=91831) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 25 17:00:44.785029 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.db [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] For port 46a1adbe-ec54-4c57-aa7a-9f257475e01c, host hv-cinder-79049, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79049',level=0,port_id=46a1adbe-ec54-4c57-aa7a-9f257475e01c,segment=NetworkSegment(7d7273c2-c6dd-43fe-83a8-cb776d48dc70),segment_id=7d7273c2-c6dd-43fe-83a8-cb776d48dc70)] {{(pid=91831) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 17:00:44.790242 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8757892955028', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8757892520933', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8757892521750'] for port, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:44.794153 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [None req-339aa0cb-86be-4552-866a-55dd5c0bb7f2 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:00:44.800944 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-edb2381a-e5ee-46a8-8065-9b206fde7426 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:00:44.859330 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [None req-1d5e1f16-4c21-4a24-af84-fa780644a59b admin admin] 10.222.0.62 "GET /v2.0/security-groups?tenant_id=9e6c1a17bcad48d39cb4cc6f0f2142d6&name=default HTTP/1.1" status: 200 len: 2979 time: 0.4842479 May 25 17:00:44.862011 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1d5e1f16-4c21-4a24-af84-fa780644a59b admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=7706c946-7b17-4103-8eaa-f3a479372217,revision_number=1']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:00:44.862344 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.wsgi [-] (91829) accepted ('10.222.0.62', 59344) {{(pid=91829) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:00:44.871517 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-1d5e1f16-4c21-4a24-af84-fa780644a59b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.071s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:00:44.878537 dv-cinder-790492-4-iscsi neutron-server[91831]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'e2dfa29d-fe86-4425-b12b-d984d7f0584a', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '46a1adbe-ec54-4c57-aa7a-9f257475e01c', 'code': 200} May 25 17:00:44.924585 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Pushing event updated for resources: {'Port': ['ID=46a1adbe-ec54-4c57-aa7a-9f257475e01c,revision_number=5']} {{(pid=91831) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:00:44.934588 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.139s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:00:44.979086 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-8b168949-d4c7-42c6-ab59-0549e6c63c4c admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:45.011283 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-8b168949-d4c7-42c6-ab59-0549e6c63c4c admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:45.196182 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.wsgi [-] (91830) accepted ('10.222.0.62', 59374) {{(pid=91830) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:00:45.283560 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9e16c5b0-58c3-4ce1-aecc-1ff3e767d46b req-bfc98b6f-267a-4f7d-ac93-362f92018279 tempest-VolumesSnapshotTestJSON-991813121 tempest-VolumesSnapshotTestJSON-991813121-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:00:45.285124 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-9e16c5b0-58c3-4ce1-aecc-1ff3e767d46b req-bfc98b6f-267a-4f7d-ac93-362f92018279 tempest-VolumesSnapshotTestJSON-991813121 tempest-VolumesSnapshotTestJSON-991813121-project] 10.222.0.62 "GET /v2.0/networks?id=c8b64023-a7f5-4c0f-847b-8a8aef981caa HTTP/1.1" status: 200 len: 813 time: 0.2487822 May 25 17:00:45.366663 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-9e16c5b0-58c3-4ce1-aecc-1ff3e767d46b req-7f6ec60e-e9a1-4bb1-a421-cb4d05b59e8a tempest-VolumesSnapshotTestJSON-991813121 tempest-VolumesSnapshotTestJSON-991813121-project] 10.222.0.62 "GET /v2.0/quotas/1314f62bcf90411cadb06fa2d9392828 HTTP/1.1" status: 200 len: 375 time: 0.0261579 May 25 17:00:45.435728 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-9e16c5b0-58c3-4ce1-aecc-1ff3e767d46b req-f504ea3a-afaa-4caf-bbed-57eb016e0959 tempest-VolumesSnapshotTestJSON-991813121 tempest-VolumesSnapshotTestJSON-991813121-project] 10.222.0.62 "GET /v2.0/ports?tenant_id=1314f62bcf90411cadb06fa2d9392828&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0627775 May 25 17:00:45.468895 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-8b168949-d4c7-42c6-ab59-0549e6c63c4c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-640836'] for security_group, after_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:45.477030 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-7c925fe4-0161-44c2-8d1b-f24cf920aca9 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:00:45.516565 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-067c680e-5f73-4c53-838e-82b4f9fa0974 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:45.532065 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.quota.driver [None req-067c680e-5f73-4c53-838e-82b4f9fa0974 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91830) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 17:00:45.537489 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [None req-067c680e-5f73-4c53-838e-82b4f9fa0974 admin admin] Usage tracker for resource:security_group_rule and tenant:415f0c3ec878400da7885b5071f8bb36 is out of sync, need to count used quota {{(pid=91830) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 17:00:45.541572 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [None req-067c680e-5f73-4c53-838e-82b4f9fa0974 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91830) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 17:00:45.548106 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.quota.driver [None req-067c680e-5f73-4c53-838e-82b4f9fa0974 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91830) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 17:00:45.553284 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-69a236de-aed2-40bd-8909-ab1d79a9e0e4 req-02263789-6146-4d37-9afd-c4d0fd58daad service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:00:45.555053 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-69a236de-aed2-40bd-8909-ab1d79a9e0e4 req-02263789-6146-4d37-9afd-c4d0fd58daad service neutron] 10.222.0.32 "GET /v2.0/ports?device_id=e2dfa29d-fe86-4425-b12b-d984d7f0584a HTTP/1.1" status: 200 len: 1099 time: 0.4238813 May 25 17:00:45.570724 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8b168949-d4c7-42c6-ab59-0549e6c63c4c admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=7706c946-7b17-4103-8eaa-f3a479372217,revision_number=None']} {{(pid=91829) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:00:45.628414 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-8b168949-d4c7-42c6-ab59-0549e6c63c4c admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.151s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:00:45.641792 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-8b168949-d4c7-42c6-ab59-0549e6c63c4c admin admin] Notify callbacks [] for security_group, before_response {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:45.643291 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [None req-8b168949-d4c7-42c6-ab59-0549e6c63c4c admin admin] 10.222.0.62 "DELETE /v2.0/security-groups/7706c946-7b17-4103-8eaa-f3a479372217 HTTP/1.1" status: 204 len: 168 time: 0.7799454 May 25 17:00:45.652185 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2e471758-4841-4aff-b995-b1c9051d3f87 req-56aae59b-43a2-4b22-ae7c-f9f8dc07d29a tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:00:45.653647 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-2e471758-4841-4aff-b995-b1c9051d3f87 req-56aae59b-43a2-4b22-ae7c-f9f8dc07d29a tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] 10.222.0.62 "GET /v2.0/ports?device_id=e2dfa29d-fe86-4425-b12b-d984d7f0584a HTTP/1.1" status: 200 len: 946 time: 0.3667889 May 25 17:00:45.658386 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-067c680e-5f73-4c53-838e-82b4f9fa0974 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:45.665830 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-067c680e-5f73-4c53-838e-82b4f9fa0974 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-640836'] for security_group, after_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:45.681013 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-e49171c6-de5e-48a8-b5f8-c92d36e6f56b admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:00:45.716117 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.quota.resource [req-69a236de-aed2-40bd-8909-ab1d79a9e0e4 req-daa7d5ed-1f54-472e-bab1-5d816254dcbd service neutron] Synchronizing usage tracker for tenant:12246d52c80446878be3d905fa93ac95 on resource:security_group {{(pid=91829) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 25 17:00:45.736185 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-9e16c5b0-58c3-4ce1-aecc-1ff3e767d46b req-2c257cc4-9ec4-4118-9c17-7bd3be627a01 service neutron] 10.222.0.62 "GET /v2.0/networks/c8b64023-a7f5-4c0f-847b-8a8aef981caa?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2930589 May 25 17:00:45.736925 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [None req-067c680e-5f73-4c53-838e-82b4f9fa0974 admin admin] 10.222.0.62 "GET /v2.0/security-groups?tenant_id=415f0c3ec878400da7885b5071f8bb36&name=default HTTP/1.1" status: 200 len: 2979 time: 0.5396307 May 25 17:00:45.739140 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-067c680e-5f73-4c53-838e-82b4f9fa0974 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b1c5257c-843b-442c-bf29-0be54581aaae,revision_number=1']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:00:45.742189 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.wsgi [-] (91830) accepted ('10.222.0.62', 59392) {{(pid=91830) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:00:45.745283 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-067c680e-5f73-4c53-838e-82b4f9fa0974 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.065s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:00:45.815351 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-5752b679-5a62-4bf5-9da9-3da21aeeba64 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:45.852912 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-5752b679-5a62-4bf5-9da9-3da21aeeba64 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:45.866395 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-2e471758-4841-4aff-b995-b1c9051d3f87 req-c40163fa-8cb9-4a03-a680-93c407a924e1 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] 10.222.0.62 "GET /v2.0/security-groups?id=f73b90a2-df48-48fb-99e0-5dd4d6a63a15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1972158 May 25 17:00:45.869438 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.quota.resource [req-69a236de-aed2-40bd-8909-ab1d79a9e0e4 req-daa7d5ed-1f54-472e-bab1-5d816254dcbd service neutron] Unset dirty status for tenant:12246d52c80446878be3d905fa93ac95 on resource:security_group {{(pid=91829) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 25 17:00:45.870541 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-69a236de-aed2-40bd-8909-ab1d79a9e0e4 req-daa7d5ed-1f54-472e-bab1-5d816254dcbd service neutron] 10.222.0.32 "GET /v2.0/security-groups?id=f73b90a2-df48-48fb-99e0-5dd4d6a63a15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2666621 May 25 17:00:45.927384 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-5752b679-5a62-4bf5-9da9-3da21aeeba64 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-640836'] for security_group, after_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:45.938407 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-50d2169b-a7cb-4d88-bbda-3f4254321d15 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:00:45.947191 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-9e16c5b0-58c3-4ce1-aecc-1ff3e767d46b req-4c41cd57-fdfa-42f9-960e-7ae183344a46 service neutron] 10.222.0.62 "GET /v2.0/networks/c8b64023-a7f5-4c0f-847b-8a8aef981caa?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2073998 May 25 17:00:45.972923 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5752b679-5a62-4bf5-9da9-3da21aeeba64 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b1c5257c-843b-442c-bf29-0be54581aaae,revision_number=None']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:00:45.984877 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-5752b679-5a62-4bf5-9da9-3da21aeeba64 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.047s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:00:45.998648 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-5752b679-5a62-4bf5-9da9-3da21aeeba64 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:46.001944 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [None req-5752b679-5a62-4bf5-9da9-3da21aeeba64 admin admin] 10.222.0.62 "DELETE /v2.0/security-groups/b1c5257c-843b-442c-bf29-0be54581aaae HTTP/1.1" status: 204 len: 168 time: 0.2567956 May 25 17:00:46.058902 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.wsgi [-] (91830) accepted ('10.222.0.62', 59402) {{(pid=91830) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:00:46.158806 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aef33ebd-cac2-4a77-8462-9e3008181067 req-3a8bd7c3-fdd7-4bb9-bfbe-1c5e4a90d5bb tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:00:46.166657 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-aef33ebd-cac2-4a77-8462-9e3008181067 req-3a8bd7c3-fdd7-4bb9-bfbe-1c5e4a90d5bb tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/ports?device_id=58da9205-0212-4daa-996c-1eef64a2b702 HTTP/1.1" status: 200 len: 945 time: 0.1371057 May 25 17:00:46.276084 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.wsgi [-] (91830) accepted ('10.222.0.62', 59420) {{(pid=91830) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:00:46.291332 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-aef33ebd-cac2-4a77-8462-9e3008181067 req-230c46e7-43e0-40a3-acb9-a5b2e3c0615f tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/security-groups?id=8ee5c4ed-9c60-4e39-9185-7e283704a7dc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1237974 May 25 17:00:46.340102 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d27ac6b4-d3f2-4f94-8375-4d05fe79c855 req-df1952c3-d71b-4cde-af58-9cc2751bb259 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:00:46.342299 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-88e27a08-4bd5-4f51-ac46-d18de6f819f8 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:46.345539 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-d27ac6b4-d3f2-4f94-8375-4d05fe79c855 req-df1952c3-d71b-4cde-af58-9cc2751bb259 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/ports?device_id=3ead96ee-e427-4e87-9879-a1cdf303f894 HTTP/1.1" status: 200 len: 944 time: 0.1556978 May 25 17:00:46.390729 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.rpc [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Device b7d643d2-c7f2-4e49-8125-5c5ec0b9d463 details requested by agent hyperv_hv-cinder-79049 with host hv-cinder-79049 {{(pid=91831) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 25 17:00:46.395924 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.quota.driver [None req-88e27a08-4bd5-4f51-ac46-d18de6f819f8 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91830) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 17:00:46.413131 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [None req-88e27a08-4bd5-4f51-ac46-d18de6f819f8 admin admin] Usage tracker for resource:security_group_rule and tenant:9e0266022c504c598d8e961beb944574 is out of sync, need to count used quota {{(pid=91830) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 17:00:46.420195 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [None req-88e27a08-4bd5-4f51-ac46-d18de6f819f8 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91830) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 17:00:46.432501 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.quota.driver [None req-88e27a08-4bd5-4f51-ac46-d18de6f819f8 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91830) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 17:00:46.487725 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-1c900b68-0c6b-4bc3-bfd9-fbc79b774861 req-63cdce28-9c82-4601-8343-8a733a7c07f4 tempest-VolumesSnapshotTestJSON-991813121 tempest-VolumesSnapshotTestJSON-991813121-project] 10.222.0.62 "GET /v2.0/ports?device_id=5cf3f093-ba27-473b-93f8-52a5bb9d9ec8 HTTP/1.1" status: 200 len: 210 time: 0.1363254 May 25 17:00:46.533383 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-d27ac6b4-d3f2-4f94-8375-4d05fe79c855 req-7014e2ab-0199-4e16-acf9-f367a86debe5 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/security-groups?id=fdd3b3f1-a2cb-4432-9874-c1d04f64207b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1832814 May 25 17:00:46.563259 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-88e27a08-4bd5-4f51-ac46-d18de6f819f8 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:46.569330 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-88e27a08-4bd5-4f51-ac46-d18de6f819f8 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-640836'] for security_group, after_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:46.656801 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.db [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] For port b7d643d2-c7f2-4e49-8125-5c5ec0b9d463, host hv-cinder-79049, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79049',level=0,port_id=b7d643d2-c7f2-4e49-8125-5c5ec0b9d463,segment=NetworkSegment(a8fb0313-938a-4f5e-8ff4-96df8acd943b),segment_id=a8fb0313-938a-4f5e-8ff4-96df8acd943b)] {{(pid=91831) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 17:00:46.673355 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.rpc [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Returning: {'device': 'b7d643d2-c7f2-4e49-8125-5c5ec0b9d463', 'network_id': 'e5be4c6a-143f-474c-a90b-37180778cefe', 'port_id': 'b7d643d2-c7f2-4e49-8125-5c5ec0b9d463', 'mac_address': 'fa:16:3e:a8:69:d8', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 695, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '6e6b5897-e23d-4281-96cb-a6fdf9b68134', 'ip_address': '172.20.0.13'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=91831) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 25 17:00:46.679773 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-c4745f0a-80ec-4f44-a916-14795f3ab36a admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:00:46.719991 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-744ea5b9-4b62-4151-8bce-dacd54b8d064 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:46.747325 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3832070'] for port, before_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:46.754678 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [None req-88e27a08-4bd5-4f51-ac46-d18de6f819f8 admin admin] 10.222.0.62 "GET /v2.0/security-groups?tenant_id=9e0266022c504c598d8e961beb944574&name=default HTTP/1.1" status: 200 len: 2979 time: 0.4815614 May 25 17:00:46.757255 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.wsgi [-] (91829) accepted ('10.222.0.62', 59434) {{(pid=91829) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:00:46.759349 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.quota.driver [None req-744ea5b9-4b62-4151-8bce-dacd54b8d064 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91830) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 17:00:46.765554 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-88e27a08-4bd5-4f51-ac46-d18de6f819f8 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=d1348f04-aebf-42a0-9fcb-8b88b180d56b,revision_number=1']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:00:46.768948 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [None req-744ea5b9-4b62-4151-8bce-dacd54b8d064 admin admin] Usage tracker for resource:security_group_rule and tenant:67af5c6ddb7e43cb83deb9f01f02002a is out of sync, need to count used quota {{(pid=91830) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 17:00:46.772936 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-88e27a08-4bd5-4f51-ac46-d18de6f819f8 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.093s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:00:46.775298 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [None req-744ea5b9-4b62-4151-8bce-dacd54b8d064 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91830) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 17:00:46.783078 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.quota.driver [None req-744ea5b9-4b62-4151-8bce-dacd54b8d064 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91830) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 17:00:46.786235 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.notifiers.nova [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id b7d643d2-c7f2-4e49-8125-5c5ec0b9d463 {{(pid=91831) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} May 25 17:00:46.807392 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.db [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] For port b7d643d2-c7f2-4e49-8125-5c5ec0b9d463, host hv-cinder-79049, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79049',level=0,port_id=b7d643d2-c7f2-4e49-8125-5c5ec0b9d463,segment=NetworkSegment(a8fb0313-938a-4f5e-8ff4-96df8acd943b),segment_id=a8fb0313-938a-4f5e-8ff4-96df8acd943b)] {{(pid=91831) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 17:00:46.818237 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8757892955028', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8757892520933', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8757892521750'] for port, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:46.821163 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.001s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:00:46.897618 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Pushing event updated for resources: {'Port': ['ID=b7d643d2-c7f2-4e49-8125-5c5ec0b9d463,revision_number=4']} {{(pid=91831) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:00:46.905359 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-b12f583a-485e-41c3-869b-3986b1f921a4 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:46.912391 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.091s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:00:46.919289 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-744ea5b9-4b62-4151-8bce-dacd54b8d064 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:46.924764 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-744ea5b9-4b62-4151-8bce-dacd54b8d064 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-640836'] for security_group, after_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:46.936647 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-b12f583a-485e-41c3-869b-3986b1f921a4 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:46.946356 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:00:46.990932 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [None req-744ea5b9-4b62-4151-8bce-dacd54b8d064 admin admin] 10.222.0.62 "GET /v2.0/security-groups?tenant_id=67af5c6ddb7e43cb83deb9f01f02002a&name=default HTTP/1.1" status: 200 len: 2979 time: 0.9305713 May 25 17:00:46.992903 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-744ea5b9-4b62-4151-8bce-dacd54b8d064 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=0be9b59f-cfe2-452b-a465-f397f8c739df,revision_number=1']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:00:47.003439 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.wsgi [-] (91830) accepted ('10.222.0.62', 59442) {{(pid=91830) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:00:47.009995 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-744ea5b9-4b62-4151-8bce-dacd54b8d064 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.064s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:00:47.128924 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-713faad3-aab5-46ac-be11-d6529d57d9bd admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:47.163803 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-713faad3-aab5-46ac-be11-d6529d57d9bd admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:47.180328 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-b12f583a-485e-41c3-869b-3986b1f921a4 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-640836'] for security_group, after_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:47.187161 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-c791cf4c-8a35-4eac-9ff1-928c0f12b241 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:00:47.202731 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b12f583a-485e-41c3-869b-3986b1f921a4 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d1348f04-aebf-42a0-9fcb-8b88b180d56b,revision_number=None']} {{(pid=91829) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:00:47.206378 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-b12f583a-485e-41c3-869b-3986b1f921a4 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.019s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:00:47.211805 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-b12f583a-485e-41c3-869b-3986b1f921a4 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:47.215527 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [None req-b12f583a-485e-41c3-869b-3986b1f921a4 admin admin] 10.222.0.62 "DELETE /v2.0/security-groups/d1348f04-aebf-42a0-9fcb-8b88b180d56b HTTP/1.1" status: 204 len: 168 time: 0.4542518 May 25 17:00:47.239952 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3fefb4fa-f979-4647-a40c-c8f8ba7eae56 req-8686429a-e025-424a-994e-e670cf22e99d tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:00:47.247200 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-3fefb4fa-f979-4647-a40c-c8f8ba7eae56 req-8686429a-e025-424a-994e-e670cf22e99d tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] 10.222.0.62 "GET /v2.0/ports?device_id=e2dfa29d-fe86-4425-b12b-d984d7f0584a HTTP/1.1" status: 200 len: 946 time: 0.2202842 May 25 17:00:47.250480 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-713faad3-aab5-46ac-be11-d6529d57d9bd admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-640836'] for security_group, after_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:47.258444 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-92d1c8b1-0f52-4de8-bc40-cb6d6d572a22 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:00:47.273541 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-713faad3-aab5-46ac-be11-d6529d57d9bd admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=0be9b59f-cfe2-452b-a465-f397f8c739df,revision_number=None']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:00:47.293783 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-713faad3-aab5-46ac-be11-d6529d57d9bd admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.035s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:00:47.301834 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-3fefb4fa-f979-4647-a40c-c8f8ba7eae56 req-a8f6e32d-193d-476d-a2e7-74fdddce1194 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] 10.222.0.62 "GET /v2.0/security-groups?id=f73b90a2-df48-48fb-99e0-5dd4d6a63a15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0531535 May 25 17:00:47.307141 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-713faad3-aab5-46ac-be11-d6529d57d9bd admin admin] Notify callbacks [] for security_group, before_response {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:47.308348 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [None req-713faad3-aab5-46ac-be11-d6529d57d9bd admin admin] 10.222.0.62 "DELETE /v2.0/security-groups/0be9b59f-cfe2-452b-a465-f397f8c739df HTTP/1.1" status: 204 len: 168 time: 0.3036361 May 25 17:00:47.408243 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.db [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] get_ports_and_sgs() called for port_ids ['b7d643d2-c7f2-4e49-8125-5c5ec0b9d463'] {{(pid=91831) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 25 17:00:47.516371 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cfd4590b-61df-4a6d-a40e-eeb923305e41 req-cd5a7178-d102-4f59-810c-633d2a58205d tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:00:47.518538 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-cfd4590b-61df-4a6d-a40e-eeb923305e41 req-cd5a7178-d102-4f59-810c-633d2a58205d tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/ports?device_id=58da9205-0212-4daa-996c-1eef64a2b702 HTTP/1.1" status: 200 len: 945 time: 0.0972779 May 25 17:00:47.654720 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-cfd4590b-61df-4a6d-a40e-eeb923305e41 req-c9f05eb3-7c6d-44aa-abec-32faab72e9e1 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/security-groups?id=8ee5c4ed-9c60-4e39-9185-7e283704a7dc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1300080 May 25 17:00:47.801583 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-388c0ac7-cd0b-40ea-9e71-574f0af71f84 req-74b268f2-549a-4d39-a06f-1d6cd022589e tempest-VolumesSnapshotTestJSON-991813121 tempest-VolumesSnapshotTestJSON-991813121-project] 10.222.0.62 "GET /v2.0/ports?device_id=5cf3f093-ba27-473b-93f8-52a5bb9d9ec8 HTTP/1.1" status: 200 len: 210 time: 0.1018710 May 25 17:00:47.964803 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.wsgi [-] (91830) accepted ('10.222.0.62', 59474) {{(pid=91830) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:00:47.986184 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.wsgi [-] (91830) accepted ('10.222.0.62', 59478) {{(pid=91830) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:00:48.038720 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-a6bdf409-711a-4746-84a2-516ea30594c6 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:48.054641 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-6a999bb3-2bd0-46f3-83e4-4b9c3807da27 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:48.074435 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.quota.driver [None req-a6bdf409-711a-4746-84a2-516ea30594c6 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91830) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 17:00:48.082848 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.quota.driver [None req-6a999bb3-2bd0-46f3-83e4-4b9c3807da27 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91830) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 17:00:48.085274 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [None req-a6bdf409-711a-4746-84a2-516ea30594c6 admin admin] Usage tracker for resource:security_group_rule and tenant:9e7db2d6742843d6b55ca623b21a525c is out of sync, need to count used quota {{(pid=91830) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 17:00:48.087877 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8e2c96e8-d3c8-449d-8a73-18004f51c7f0 req-15a58bee-36ac-41a1-976a-cff299969ec4 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:00:48.089502 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-8e2c96e8-d3c8-449d-8a73-18004f51c7f0 req-15a58bee-36ac-41a1-976a-cff299969ec4 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/ports?device_id=3ead96ee-e427-4e87-9879-a1cdf303f894 HTTP/1.1" status: 200 len: 945 time: 0.2906840 May 25 17:00:48.096924 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [None req-a6bdf409-711a-4746-84a2-516ea30594c6 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91830) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 17:00:48.104347 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [None req-6a999bb3-2bd0-46f3-83e4-4b9c3807da27 admin admin] Usage tracker for resource:security_group_rule and tenant:99c017ac0c34416cb49bb747fd244d44 is out of sync, need to count used quota {{(pid=91830) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 17:00:48.108584 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [None req-6a999bb3-2bd0-46f3-83e4-4b9c3807da27 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91830) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 17:00:48.117329 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.quota.driver [None req-a6bdf409-711a-4746-84a2-516ea30594c6 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91830) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 17:00:48.120233 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.quota.driver [None req-6a999bb3-2bd0-46f3-83e4-4b9c3807da27 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91830) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 17:00:48.174053 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-8e2c96e8-d3c8-449d-8a73-18004f51c7f0 req-51943448-cab8-4660-a155-c89fe819ad04 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/security-groups?id=fdd3b3f1-a2cb-4432-9874-c1d04f64207b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0768707 May 25 17:00:48.197144 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9e16c5b0-58c3-4ce1-aecc-1ff3e767d46b req-71b234cb-460e-4a81-86df-069a46fb3fbf tempest-VolumesSnapshotTestJSON-991813121 tempest-VolumesSnapshotTestJSON-991813121-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:00:48.198757 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-9e16c5b0-58c3-4ce1-aecc-1ff3e767d46b req-71b234cb-460e-4a81-86df-069a46fb3fbf tempest-VolumesSnapshotTestJSON-991813121 tempest-VolumesSnapshotTestJSON-991813121-project] 10.222.0.32 "GET /v2.0/networks?id=c8b64023-a7f5-4c0f-847b-8a8aef981caa HTTP/1.1" status: 200 len: 813 time: 0.2276595 May 25 17:00:48.216941 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.v2.base [req-9e16c5b0-58c3-4ce1-aecc-1ff3e767d46b req-a6bb6379-3969-400c-a15b-808aca021783 tempest-VolumesSnapshotTestJSON-991813121 tempest-VolumesSnapshotTestJSON-991813121-project] Request body: {'port': {'device_id': '5cf3f093-ba27-473b-93f8-52a5bb9d9ec8', 'network_id': 'c8b64023-a7f5-4c0f-847b-8a8aef981caa', 'admin_state_up': True, 'tenant_id': '1314f62bcf90411cadb06fa2d9392828'}} {{(pid=91829) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 17:00:48.310901 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-6a999bb3-2bd0-46f3-83e4-4b9c3807da27 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:48.312865 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-a6bdf409-711a-4746-84a2-516ea30594c6 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:48.317553 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-6a999bb3-2bd0-46f3-83e4-4b9c3807da27 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-640836'] for security_group, after_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:48.337582 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-3a28ccce-c1b4-40cc-ba06-3820a0c7dd7c admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:00:48.384654 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-a6bdf409-711a-4746-84a2-516ea30594c6 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-640836'] for security_group, after_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:48.396632 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.wsgi [-] (91829) accepted ('10.222.0.62', 59500) {{(pid=91829) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:00:48.396815 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [None req-6a999bb3-2bd0-46f3-83e4-4b9c3807da27 admin admin] 10.222.0.62 "GET /v2.0/security-groups?tenant_id=99c017ac0c34416cb49bb747fd244d44&name=default HTTP/1.1" status: 200 len: 2979 time: 0.4060998 May 25 17:00:48.418807 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6a999bb3-2bd0-46f3-83e4-4b9c3807da27 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=9d81559f-6940-46a5-8259-ab6a86f5fecf,revision_number=1']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:00:48.424840 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-6a999bb3-2bd0-46f3-83e4-4b9c3807da27 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.087s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:00:48.426626 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-713faad3-aab5-46ac-be11-d6529d57d9bd admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.007s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:00:48.472913 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [None req-a6bdf409-711a-4746-84a2-516ea30594c6 admin admin] 10.222.0.62 "GET /v2.0/security-groups?tenant_id=9e7db2d6742843d6b55ca623b21a525c&name=default HTTP/1.1" status: 200 len: 2979 time: 0.5043902 May 25 17:00:48.473012 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.wsgi [-] (91830) accepted ('10.222.0.62', 59504) {{(pid=91830) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:00:48.475986 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a6bdf409-711a-4746-84a2-516ea30594c6 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=71a47f84-5067-4953-aa56-2050ee36df03,revision_number=1']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:00:48.493852 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-a6bdf409-711a-4746-84a2-516ea30594c6 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.068s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:00:48.524906 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.quota.driver [req-9e16c5b0-58c3-4ce1-aecc-1ff3e767d46b req-a6bb6379-3969-400c-a15b-808aca021783 tempest-VolumesSnapshotTestJSON-991813121 tempest-VolumesSnapshotTestJSON-991813121-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91829) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 17:00:48.528836 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.quota.resource [req-9e16c5b0-58c3-4ce1-aecc-1ff3e767d46b req-a6bb6379-3969-400c-a15b-808aca021783 tempest-VolumesSnapshotTestJSON-991813121 tempest-VolumesSnapshotTestJSON-991813121-project] Usage tracker for resource:port and tenant:1314f62bcf90411cadb06fa2d9392828 is out of sync, need to count used quota {{(pid=91829) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 17:00:48.548051 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.quota.resource [req-9e16c5b0-58c3-4ce1-aecc-1ff3e767d46b req-a6bb6379-3969-400c-a15b-808aca021783 tempest-VolumesSnapshotTestJSON-991813121 tempest-VolumesSnapshotTestJSON-991813121-project] Quota usage for port was recalculated. Used quota:0. {{(pid=91829) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 17:00:48.552042 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-2b7b0f3a-d76e-4118-8b08-2f04c29c7334 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:48.582199 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.quota.driver [req-9e16c5b0-58c3-4ce1-aecc-1ff3e767d46b req-a6bb6379-3969-400c-a15b-808aca021783 tempest-VolumesSnapshotTestJSON-991813121 tempest-VolumesSnapshotTestJSON-991813121-project] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=91829) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 17:00:48.589513 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-2b7b0f3a-d76e-4118-8b08-2f04c29c7334 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:48.590380 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-3a7f6ee1-08e8-4089-906d-660c3d17b3aa admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:48.636329 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-3a7f6ee1-08e8-4089-906d-660c3d17b3aa admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:48.655099 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-9e16c5b0-58c3-4ce1-aecc-1ff3e767d46b req-a6bb6379-3969-400c-a15b-808aca021783 tempest-VolumesSnapshotTestJSON-991813121 tempest-VolumesSnapshotTestJSON-991813121-project] Made reservation on behalf of 1314f62bcf90411cadb06fa2d9392828 for: {'port': 1} {{(pid=91829) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 25 17:00:48.657292 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-2b7b0f3a-d76e-4118-8b08-2f04c29c7334 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-640836'] for security_group, after_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:48.659287 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [req-9e16c5b0-58c3-4ce1-aecc-1ff3e767d46b req-a6bb6379-3969-400c-a15b-808aca021783 tempest-VolumesSnapshotTestJSON-991813121 tempest-VolumesSnapshotTestJSON-991813121-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3832070'] for port, before_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:48.662983 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-88e27a08-4bd5-4f51-ac46-d18de6f819f8 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:00:48.675648 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2b7b0f3a-d76e-4118-8b08-2f04c29c7334 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=71a47f84-5067-4953-aa56-2050ee36df03,revision_number=None']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:00:48.678085 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-2b7b0f3a-d76e-4118-8b08-2f04c29c7334 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.015s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:00:48.687978 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-2b7b0f3a-d76e-4118-8b08-2f04c29c7334 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:48.689509 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [None req-2b7b0f3a-d76e-4118-8b08-2f04c29c7334 admin admin] 10.222.0.62 "DELETE /v2.0/security-groups/71a47f84-5067-4953-aa56-2050ee36df03 HTTP/1.1" status: 204 len: 168 time: 0.2156324 May 25 17:00:48.769567 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-947a9547-5f3c-4590-b139-ea9ca6da24c6 req-e4efa185-a982-417b-b54f-e8b3c760873e tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:00:48.771183 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-947a9547-5f3c-4590-b139-ea9ca6da24c6 req-e4efa185-a982-417b-b54f-e8b3c760873e tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] 10.222.0.62 "GET /v2.0/ports?device_id=e2dfa29d-fe86-4425-b12b-d984d7f0584a HTTP/1.1" status: 200 len: 946 time: 0.3204300 May 25 17:00:48.915851 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-947a9547-5f3c-4590-b139-ea9ca6da24c6 req-3ef66a89-3af7-4a0a-9ce8-96dc58938f84 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] 10.222.0.62 "GET /v2.0/security-groups?id=f73b90a2-df48-48fb-99e0-5dd4d6a63a15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1356552 May 25 17:00:48.958379 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-3a7f6ee1-08e8-4089-906d-660c3d17b3aa admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-640836'] for security_group, after_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:48.965464 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-20a16cf6-d3ab-4f8c-baa7-54ac1656d365 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:00:48.994749 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3a7f6ee1-08e8-4089-906d-660c3d17b3aa admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=9d81559f-6940-46a5-8259-ab6a86f5fecf,revision_number=None']} {{(pid=91829) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:00:48.997042 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-3a7f6ee1-08e8-4089-906d-660c3d17b3aa admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.032s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:00:49.062688 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.db_base_plugin_common [req-9e16c5b0-58c3-4ce1-aecc-1ff3e767d46b req-a6bb6379-3969-400c-a15b-808aca021783 tempest-VolumesSnapshotTestJSON-991813121 tempest-VolumesSnapshotTestJSON-991813121-project] Allocated IP 172.20.0.5 (c8b64023-a7f5-4c0f-847b-8a8aef981caa/e21793ea-1820-4ec5-b3fc-a7d9b7129124/041fa5ca-9be5-4356-af06-2fe633a19ad8) {{(pid=91829) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 25 17:00:49.077949 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-3a7f6ee1-08e8-4089-906d-660c3d17b3aa admin admin] Notify callbacks [] for security_group, before_response {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:49.077949 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [None req-3a7f6ee1-08e8-4089-906d-660c3d17b3aa admin admin] 10.222.0.62 "DELETE /v2.0/security-groups/9d81559f-6940-46a5-8259-ab6a86f5fecf HTTP/1.1" status: 204 len: 168 time: 0.6793294 May 25 17:00:49.095205 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-01784a1a-f0e4-43c1-adeb-cd307725ff31 req-183a1d55-e96f-4eca-a869-8fded628bb91 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:00:49.096680 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-01784a1a-f0e4-43c1-adeb-cd307725ff31 req-183a1d55-e96f-4eca-a869-8fded628bb91 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/ports?device_id=58da9205-0212-4daa-996c-1eef64a2b702 HTTP/1.1" status: 200 len: 945 time: 0.2874475 May 25 17:00:49.098199 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.quota.resource [req-40afd1d8-09e3-4d72-a49e-fd47261f9eee req-ef6e23a0-ff10-40d1-a9ea-febdd7f7bec8 tempest-VolumesSnapshotTestJSON-991813121 tempest-VolumesSnapshotTestJSON-991813121-project] Synchronizing usage tracker for tenant:1314f62bcf90411cadb06fa2d9392828 on resource:port {{(pid=91829) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 25 17:00:49.164476 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.quota.resource [req-40afd1d8-09e3-4d72-a49e-fd47261f9eee req-ef6e23a0-ff10-40d1-a9ea-febdd7f7bec8 tempest-VolumesSnapshotTestJSON-991813121 tempest-VolumesSnapshotTestJSON-991813121-project] Unset dirty status for tenant:1314f62bcf90411cadb06fa2d9392828 on resource:port {{(pid=91829) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 25 17:00:49.165611 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-40afd1d8-09e3-4d72-a49e-fd47261f9eee req-ef6e23a0-ff10-40d1-a9ea-febdd7f7bec8 tempest-VolumesSnapshotTestJSON-991813121 tempest-VolumesSnapshotTestJSON-991813121-project] 10.222.0.62 "GET /v2.0/ports?device_id=5cf3f093-ba27-473b-93f8-52a5bb9d9ec8 HTTP/1.1" status: 200 len: 210 time: 0.1426315 May 25 17:00:49.202471 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-01784a1a-f0e4-43c1-adeb-cd307725ff31 req-a49f54c4-697f-4551-9fdb-ad7e9f2da321 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/security-groups?id=8ee5c4ed-9c60-4e39-9185-7e283704a7dc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0982175 May 25 17:00:49.465850 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [req-9e16c5b0-58c3-4ce1-aecc-1ff3e767d46b req-a6bb6379-3969-400c-a15b-808aca021783 tempest-VolumesSnapshotTestJSON-991813121 tempest-VolumesSnapshotTestJSON-991813121-project] Notify callbacks [] for port, precommit_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:49.516815 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-37820fb9-1eb6-408d-a0ab-06aaa9d15892 req-284bb93b-5f6f-4024-8447-d3d9ad984bbd tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:00:49.523639 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-37820fb9-1eb6-408d-a0ab-06aaa9d15892 req-284bb93b-5f6f-4024-8447-d3d9ad984bbd tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/ports?device_id=3ead96ee-e427-4e87-9879-a1cdf303f894 HTTP/1.1" status: 200 len: 945 time: 0.1508615 May 25 17:00:49.562824 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [req-9e16c5b0-58c3-4ce1-aecc-1ff3e767d46b req-a6bb6379-3969-400c-a15b-808aca021783 tempest-VolumesSnapshotTestJSON-991813121 tempest-VolumesSnapshotTestJSON-991813121-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8757892520915', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28230808'] for port, after_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:49.576239 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-aa9adaab-1c7d-4401-87d9-7e0864e39231 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:00:49.655050 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-37820fb9-1eb6-408d-a0ab-06aaa9d15892 req-24e86ad2-f5b4-474e-acc4-89a081761b91 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/security-groups?id=fdd3b3f1-a2cb-4432-9874-c1d04f64207b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1304116 May 25 17:00:49.668126 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-9e16c5b0-58c3-4ce1-aecc-1ff3e767d46b req-a6bb6379-3969-400c-a15b-808aca021783 tempest-VolumesSnapshotTestJSON-991813121 tempest-VolumesSnapshotTestJSON-991813121-project] Network c8b64023-a7f5-4c0f-847b-8a8aef981caa is already hosted by enough agents. {{(pid=91829) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 25 17:00:49.676061 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.scheduler.base_scheduler [req-9e16c5b0-58c3-4ce1-aecc-1ff3e767d46b req-a6bb6379-3969-400c-a15b-808aca021783 tempest-VolumesSnapshotTestJSON-991813121 tempest-VolumesSnapshotTestJSON-991813121-project] Resources bound (agent type, host, resource id): {{(pid=91829) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 17:00:49.683800 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.l3_dvrscheduler_db [req-9e16c5b0-58c3-4ce1-aecc-1ff3e767d46b req-a6bb6379-3969-400c-a15b-808aca021783 tempest-VolumesSnapshotTestJSON-991813121 tempest-VolumesSnapshotTestJSON-991813121-project] Received port after_create {{(pid=91829) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 25 17:00:49.742303 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a6bb6379-3969-400c-a15b-808aca021783 tempest-VolumesSnapshotTestJSON-991813121 tempest-VolumesSnapshotTestJSON-991813121-project] Pushing event updated for resources: {'Port': ['ID=041fa5ca-9be5-4356-af06-2fe633a19ad8,revision_number=1']} {{(pid=91829) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:00:49.745667 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-a6bb6379-3969-400c-a15b-808aca021783 tempest-VolumesSnapshotTestJSON-991813121 tempest-VolumesSnapshotTestJSON-991813121-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.170s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:00:49.785120 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9e16c5b0-58c3-4ce1-aecc-1ff3e767d46b req-a6bb6379-3969-400c-a15b-808aca021783 tempest-VolumesSnapshotTestJSON-991813121 tempest-VolumesSnapshotTestJSON-991813121-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:00:49.786369 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [req-9e16c5b0-58c3-4ce1-aecc-1ff3e767d46b req-a6bb6379-3969-400c-a15b-808aca021783 tempest-VolumesSnapshotTestJSON-991813121 tempest-VolumesSnapshotTestJSON-991813121-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-178712', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-551373'] for port, before_response {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:49.813045 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-9e16c5b0-58c3-4ce1-aecc-1ff3e767d46b req-a6bb6379-3969-400c-a15b-808aca021783 tempest-VolumesSnapshotTestJSON-991813121 tempest-VolumesSnapshotTestJSON-991813121-project] 10.222.0.32 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 1.6041303 May 25 17:00:49.836162 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.v2.base [req-9e16c5b0-58c3-4ce1-aecc-1ff3e767d46b req-c3f8ff20-c736-45cb-8b95-10c55816ffa9 service neutron] Request body: {'port': {'device_id': '5cf3f093-ba27-473b-93f8-52a5bb9d9ec8', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-79049'}} {{(pid=91829) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 17:00:50.012584 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [req-9e16c5b0-58c3-4ce1-aecc-1ff3e767d46b req-c3f8ff20-c736-45cb-8b95-10c55816ffa9 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3832070'] for port, before_update {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:50.400088 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.rpc [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Device b7d643d2-c7f2-4e49-8125-5c5ec0b9d463 up at agent hyperv_hv-cinder-79049 {{(pid=91831) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 25 17:00:50.497486 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.provisioning_blocks [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Provisioning for port b7d643d2-c7f2-4e49-8125-5c5ec0b9d463 completed by entity L2. {{(pid=91831) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 25 17:00:50.506568 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.provisioning_blocks [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Provisioning complete for port b7d643d2-c7f2-4e49-8125-5c5ec0b9d463 triggered by entity L2. {{(pid=91831) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 17:00:50.507741 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3854128'] for port, provisioning_complete {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:50.690354 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3832070'] for port, before_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:50.725653 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.db [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] For port b7d643d2-c7f2-4e49-8125-5c5ec0b9d463, host hv-cinder-79049, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79049',level=0,port_id=b7d643d2-c7f2-4e49-8125-5c5ec0b9d463,segment=NetworkSegment(a8fb0313-938a-4f5e-8ff4-96df8acd943b),segment_id=a8fb0313-938a-4f5e-8ff4-96df8acd943b)] {{(pid=91831) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 17:00:50.727024 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '3ead96ee-e427-4e87-9879-a1cdf303f894', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'b7d643d2-c7f2-4e49-8125-5c5ec0b9d463'}] {{(pid=91831) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 25 17:00:50.729557 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a9c74c3c-2f88-40fd-a725-ae5b9eb1468e req-d070a046-1434-428a-b772-2aaf78e4b249 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:00:50.731244 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-a9c74c3c-2f88-40fd-a725-ae5b9eb1468e req-d070a046-1434-428a-b772-2aaf78e4b249 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/ports?device_id=58da9205-0212-4daa-996c-1eef64a2b702 HTTP/1.1" status: 200 len: 945 time: 0.2292325 May 25 17:00:50.738896 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8757892955028', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8757892520933', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8757892521750'] for port, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:50.749455 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:00:50.777873 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6c9eb318-59e8-4ecf-aa92-b0f59fa586c4 req-1b07d295-bda3-4bca-b905-8cf3ea099979 tempest-VolumesSnapshotTestJSON-991813121 tempest-VolumesSnapshotTestJSON-991813121-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:00:50.784039 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-6c9eb318-59e8-4ecf-aa92-b0f59fa586c4 req-1b07d295-bda3-4bca-b905-8cf3ea099979 tempest-VolumesSnapshotTestJSON-991813121 tempest-VolumesSnapshotTestJSON-991813121-project] 10.222.0.62 "GET /v2.0/ports?device_id=5cf3f093-ba27-473b-93f8-52a5bb9d9ec8 HTTP/1.1" status: 200 len: 931 time: 0.3644061 May 25 17:00:50.843490 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Pushing event updated for resources: {'Port': ['ID=b7d643d2-c7f2-4e49-8125-5c5ec0b9d463,revision_number=5']} {{(pid=91831) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:00:50.846729 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.097s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:00:50.944564 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-6c9eb318-59e8-4ecf-aa92-b0f59fa586c4 req-8b215753-031b-49fd-9614-13f95ca7d004 tempest-VolumesSnapshotTestJSON-991813121 tempest-VolumesSnapshotTestJSON-991813121-project] 10.222.0.62 "GET /v2.0/security-groups?id=b5f47757-8dd4-4226-9a13-ca15ee498213&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1597333 May 25 17:00:50.960826 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-a9c74c3c-2f88-40fd-a725-ae5b9eb1468e req-9b0c6cbd-adfa-494a-bce7-a8be96665a98 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/security-groups?id=8ee5c4ed-9c60-4e39-9185-7e283704a7dc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2173228 May 25 17:00:50.980547 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.notifiers.nova [req-9e16c5b0-58c3-4ce1-aecc-1ff3e767d46b req-c3f8ff20-c736-45cb-8b95-10c55816ffa9 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 041fa5ca-9be5-4356-af06-2fe633a19ad8 {{(pid=91829) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} May 25 17:00:51.005053 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [req-9e16c5b0-58c3-4ce1-aecc-1ff3e767d46b req-c3f8ff20-c736-45cb-8b95-10c55816ffa9 service neutron] Notify callbacks [] for port, precommit_update {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:51.029146 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.provisioning_blocks [req-9e16c5b0-58c3-4ce1-aecc-1ff3e767d46b req-c3f8ff20-c736-45cb-8b95-10c55816ffa9 service neutron] Transition to ACTIVE for port object 041fa5ca-9be5-4356-af06-2fe633a19ad8 will not be triggered until provisioned by entity L2. {{(pid=91829) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 25 17:00:51.037598 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [req-9e16c5b0-58c3-4ce1-aecc-1ff3e767d46b req-c3f8ff20-c736-45cb-8b95-10c55816ffa9 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8757892955028', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8757892520933', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8757892521750', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28230801'] for port, after_update {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:51.053308 dv-cinder-790492-4-iscsi neutron-server[91831]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '3ead96ee-e427-4e87-9879-a1cdf303f894', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'b7d643d2-c7f2-4e49-8125-5c5ec0b9d463', 'code': 200} May 25 17:00:51.055660 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:00:51.316263 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c3f8ff20-c736-45cb-8b95-10c55816ffa9 service neutron] Pushing event updated for resources: {'Port': ['ID=041fa5ca-9be5-4356-af06-2fe633a19ad8,revision_number=2']} {{(pid=91829) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:00:51.326816 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-c3f8ff20-c736-45cb-8b95-10c55816ffa9 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.269s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:00:51.380213 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-15dec294-fcfb-4a72-9118-cbecdd34479f req-91fbe497-6845-49b8-ac2a-f594133dfcb2 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:00:51.385380 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-15dec294-fcfb-4a72-9118-cbecdd34479f req-91fbe497-6845-49b8-ac2a-f594133dfcb2 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/ports?device_id=3ead96ee-e427-4e87-9879-a1cdf303f894 HTTP/1.1" status: 200 len: 946 time: 0.2719522 May 25 17:00:51.385380 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.plugins.ml2.managers [req-9e16c5b0-58c3-4ce1-aecc-1ff3e767d46b req-c3f8ff20-c736-45cb-8b95-10c55816ffa9 service neutron] Attempting to bind port 041fa5ca-9be5-4356-af06-2fe633a19ad8 on host hv-cinder-79049 for vnic_type normal with profile {{(pid=91829) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 25 17:00:51.385380 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.plugins.ml2.managers [req-9e16c5b0-58c3-4ce1-aecc-1ff3e767d46b req-c3f8ff20-c736-45cb-8b95-10c55816ffa9 service neutron] Attempting to bind port 041fa5ca-9be5-4356-af06-2fe633a19ad8 by drivers openvswitch,hyperv on host hv-cinder-79049 at level 0 using segments [{'id': 'bba065e2-1e75-4ab9-bc0e-e3037ef57277', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 654, 'network_id': 'c8b64023-a7f5-4c0f-847b-8a8aef981caa'}] {{(pid=91829) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 25 17:00:51.385380 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9e16c5b0-58c3-4ce1-aecc-1ff3e767d46b req-c3f8ff20-c736-45cb-8b95-10c55816ffa9 service neutron] Attempting to bind port 041fa5ca-9be5-4356-af06-2fe633a19ad8 on network c8b64023-a7f5-4c0f-847b-8a8aef981caa {{(pid=91829) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 25 17:00:51.390581 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9e16c5b0-58c3-4ce1-aecc-1ff3e767d46b req-c3f8ff20-c736-45cb-8b95-10c55816ffa9 service neutron] Port 041fa5ca-9be5-4356-af06-2fe633a19ad8 on network c8b64023-a7f5-4c0f-847b-8a8aef981caa not bound, no agent of type Open vSwitch agent registered on host hv-cinder-79049 {{(pid=91829) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 25 17:00:51.390908 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9e16c5b0-58c3-4ce1-aecc-1ff3e767d46b req-c3f8ff20-c736-45cb-8b95-10c55816ffa9 service neutron] Attempting to bind port 041fa5ca-9be5-4356-af06-2fe633a19ad8 on network c8b64023-a7f5-4c0f-847b-8a8aef981caa {{(pid=91829) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 25 17:00:51.416018 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9e16c5b0-58c3-4ce1-aecc-1ff3e767d46b req-c3f8ff20-c736-45cb-8b95-10c55816ffa9 service neutron] Checking agent: {'id': '3a1fdee1-bff0-49fb-b470-e13b95ee1b4d', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-79049', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 25, 16, 56, 32), 'started_at': datetime.datetime(2021, 5, 25, 16, 56, 32), 'heartbeat_timestamp': datetime.datetime(2021, 5, 25, 17, 0, 34), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=91829) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 25 17:00:51.416360 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9e16c5b0-58c3-4ce1-aecc-1ff3e767d46b req-c3f8ff20-c736-45cb-8b95-10c55816ffa9 service neutron] Checking segment: {'id': 'bba065e2-1e75-4ab9-bc0e-e3037ef57277', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 654, 'network_id': 'c8b64023-a7f5-4c0f-847b-8a8aef981caa'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91829) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 25 17:00:51.416773 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9e16c5b0-58c3-4ce1-aecc-1ff3e767d46b req-c3f8ff20-c736-45cb-8b95-10c55816ffa9 service neutron] Bound using segment: {'id': 'bba065e2-1e75-4ab9-bc0e-e3037ef57277', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 654, 'network_id': 'c8b64023-a7f5-4c0f-847b-8a8aef981caa'} {{(pid=91829) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 25 17:00:51.417160 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.plugins.ml2.managers [req-9e16c5b0-58c3-4ce1-aecc-1ff3e767d46b req-c3f8ff20-c736-45cb-8b95-10c55816ffa9 service neutron] Bound port: 041fa5ca-9be5-4356-af06-2fe633a19ad8, host: hv-cinder-79049, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'bba065e2-1e75-4ab9-bc0e-e3037ef57277', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 654, 'network_id': 'c8b64023-a7f5-4c0f-847b-8a8aef981caa'}}] {{(pid=91829) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 25 17:00:51.417503 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [req-9e16c5b0-58c3-4ce1-aecc-1ff3e767d46b req-c3f8ff20-c736-45cb-8b95-10c55816ffa9 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3832070'] for port, before_update {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:51.480698 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-15dec294-fcfb-4a72-9118-cbecdd34479f req-0432605c-f4b9-4e84-a1c5-5dde189d20b6 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/security-groups?id=fdd3b3f1-a2cb-4432-9874-c1d04f64207b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0923042 May 25 17:00:51.536368 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.plugins.ml2.db [req-9e16c5b0-58c3-4ce1-aecc-1ff3e767d46b req-c3f8ff20-c736-45cb-8b95-10c55816ffa9 service neutron] For port 041fa5ca-9be5-4356-af06-2fe633a19ad8, host hv-cinder-79049, cleared binding levels {{(pid=91829) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 25 17:00:51.539480 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.plugins.ml2.db [req-9e16c5b0-58c3-4ce1-aecc-1ff3e767d46b req-c3f8ff20-c736-45cb-8b95-10c55816ffa9 service neutron] For port 041fa5ca-9be5-4356-af06-2fe633a19ad8, host hv-cinder-79049, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79049',level=0,port_id=041fa5ca-9be5-4356-af06-2fe633a19ad8,segment=NetworkSegment(bba065e2-1e75-4ab9-bc0e-e3037ef57277),segment_id=bba065e2-1e75-4ab9-bc0e-e3037ef57277)] {{(pid=91829) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 25 17:00:51.547935 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [req-9e16c5b0-58c3-4ce1-aecc-1ff3e767d46b req-c3f8ff20-c736-45cb-8b95-10c55816ffa9 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8757892955028', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8757892520933', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8757892521750', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28230801'] for port, after_update {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:51.552979 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:00:51.611553 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9e16c5b0-58c3-4ce1-aecc-1ff3e767d46b req-c3f8ff20-c736-45cb-8b95-10c55816ffa9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:00:51.612230 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [req-9e16c5b0-58c3-4ce1-aecc-1ff3e767d46b req-c3f8ff20-c736-45cb-8b95-10c55816ffa9 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-178712', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-551373'] for port, before_response {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:51.614066 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-9e16c5b0-58c3-4ce1-aecc-1ff3e767d46b req-c3f8ff20-c736-45cb-8b95-10c55816ffa9 service neutron] 10.222.0.32 "PUT /v2.0/ports/041fa5ca-9be5-4356-af06-2fe633a19ad8 HTTP/1.1" status: 200 len: 1093 time: 1.7866027 May 25 17:00:51.617339 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '5cf3f093-ba27-473b-93f8-52a5bb9d9ec8', 'tag': '041fa5ca-9be5-4356-af06-2fe633a19ad8'}] {{(pid=91829) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 25 17:00:51.643259 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c3f8ff20-c736-45cb-8b95-10c55816ffa9 service neutron] Pushing event updated for resources: {'Port': ['ID=041fa5ca-9be5-4356-af06-2fe633a19ad8,revision_number=3']} {{(pid=91829) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:00:51.646881 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-c3f8ff20-c736-45cb-8b95-10c55816ffa9 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.094s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:00:51.682002 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '5cf3f093-ba27-473b-93f8-52a5bb9d9ec8', 'tag': '041fa5ca-9be5-4356-af06-2fe633a19ad8', 'status': 'completed', 'code': 200} May 25 17:00:52.241613 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0c8d082a-6e7d-429c-87b8-69f667b8b30e req-b2a687f0-1081-4cef-87f4-06ed5d75fdcb tempest-VolumesSnapshotTestJSON-991813121 tempest-VolumesSnapshotTestJSON-991813121-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:00:52.243091 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-0c8d082a-6e7d-429c-87b8-69f667b8b30e req-b2a687f0-1081-4cef-87f4-06ed5d75fdcb tempest-VolumesSnapshotTestJSON-991813121 tempest-VolumesSnapshotTestJSON-991813121-project] 10.222.0.62 "GET /v2.0/ports?device_id=5cf3f093-ba27-473b-93f8-52a5bb9d9ec8 HTTP/1.1" status: 200 len: 943 time: 0.1451497 May 25 17:00:52.251371 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-38bb83ad-141c-46f9-bf2b-2780077e6906 req-975f9d19-a60a-4467-922c-7661f5ea5c9f tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:00:52.252528 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-38bb83ad-141c-46f9-bf2b-2780077e6906 req-975f9d19-a60a-4467-922c-7661f5ea5c9f tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/ports?device_id=58da9205-0212-4daa-996c-1eef64a2b702 HTTP/1.1" status: 200 len: 945 time: 0.1173737 May 25 17:00:52.319165 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-0c8d082a-6e7d-429c-87b8-69f667b8b30e req-4e6099ba-251d-474a-a018-4d0a1405acf7 tempest-VolumesSnapshotTestJSON-991813121 tempest-VolumesSnapshotTestJSON-991813121-project] 10.222.0.62 "GET /v2.0/security-groups?id=b5f47757-8dd4-4226-9a13-ca15ee498213&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0656483 May 25 17:00:52.326473 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-38bb83ad-141c-46f9-bf2b-2780077e6906 req-b3e5b7e2-b933-43df-90cb-f40c17febcb1 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/security-groups?id=8ee5c4ed-9c60-4e39-9185-7e283704a7dc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0591154 May 25 17:00:52.684785 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ca7f8ef7-1ee2-46be-92b1-a5e4e7889c21 req-34f76714-ad38-4c65-9064-0bd20ac511da tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:00:52.689575 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-ca7f8ef7-1ee2-46be-92b1-a5e4e7889c21 req-34f76714-ad38-4c65-9064-0bd20ac511da tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/ports?device_id=3ead96ee-e427-4e87-9879-a1cdf303f894 HTTP/1.1" status: 200 len: 946 time: 0.0889564 May 25 17:00:52.729777 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-ca7f8ef7-1ee2-46be-92b1-a5e4e7889c21 req-57ec0826-37b8-41a6-9d60-6382d46cd0cc tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/security-groups?id=fdd3b3f1-a2cb-4432-9874-c1d04f64207b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0374846 May 25 17:00:52.749779 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.wsgi [-] (91829) accepted ('10.222.0.62', 59690) {{(pid=91829) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:00:52.867058 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-b6d5efd3-68c2-46c8-9870-223580602311 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:52.883097 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.quota.driver [None req-b6d5efd3-68c2-46c8-9870-223580602311 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91829) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 17:00:52.886703 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.quota.resource [None req-b6d5efd3-68c2-46c8-9870-223580602311 admin admin] Usage tracker for resource:security_group_rule and tenant:d159972e2b8b41c49fc157efb35a80ae is out of sync, need to count used quota {{(pid=91829) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 17:00:52.889495 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.quota.resource [None req-b6d5efd3-68c2-46c8-9870-223580602311 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91829) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 17:00:52.895251 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.quota.driver [None req-b6d5efd3-68c2-46c8-9870-223580602311 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91829) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 17:00:52.975361 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-b6d5efd3-68c2-46c8-9870-223580602311 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:52.980210 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-b6d5efd3-68c2-46c8-9870-223580602311 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-640836'] for security_group, after_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:52.987372 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-4111d749-51d5-465f-bce7-0696e6144945 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:00:53.030953 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b6d5efd3-68c2-46c8-9870-223580602311 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b00b7748-225d-482f-bd26-c38a69808afd,revision_number=1']} {{(pid=91829) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:00:53.039128 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [None req-b6d5efd3-68c2-46c8-9870-223580602311 admin admin] 10.222.0.62 "GET /v2.0/security-groups?tenant_id=d159972e2b8b41c49fc157efb35a80ae&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2852492 May 25 17:00:53.039128 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-b6d5efd3-68c2-46c8-9870-223580602311 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.050s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:00:53.039438 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.wsgi [-] (91830) accepted ('10.222.0.62', 59698) {{(pid=91830) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:00:53.097682 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-65006d0a-56e5-462f-8c67-631176b0c003 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:53.127892 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-65006d0a-56e5-462f-8c67-631176b0c003 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:53.178635 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-65006d0a-56e5-462f-8c67-631176b0c003 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-640836'] for security_group, after_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:53.182512 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-5752b679-5a62-4bf5-9da9-3da21aeeba64 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:00:53.195784 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-65006d0a-56e5-462f-8c67-631176b0c003 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b00b7748-225d-482f-bd26-c38a69808afd,revision_number=None']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:00:53.199718 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-65006d0a-56e5-462f-8c67-631176b0c003 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.017s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:00:53.203078 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-65006d0a-56e5-462f-8c67-631176b0c003 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:53.206360 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [None req-65006d0a-56e5-462f-8c67-631176b0c003 admin admin] 10.222.0.62 "DELETE /v2.0/security-groups/b00b7748-225d-482f-bd26-c38a69808afd HTTP/1.1" status: 204 len: 168 time: 0.1666019 May 25 17:00:53.496880 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.wsgi [-] (91830) accepted ('10.222.0.62', 59714) {{(pid=91830) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:00:53.514518 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-2a155ba3-d005-4c05-b44a-30613cd639e9 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:53.532612 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.quota.driver [None req-2a155ba3-d005-4c05-b44a-30613cd639e9 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91830) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 17:00:53.536544 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [None req-2a155ba3-d005-4c05-b44a-30613cd639e9 admin admin] Usage tracker for resource:security_group_rule and tenant:58faeb8b10614725bafa9091542e3976 is out of sync, need to count used quota {{(pid=91830) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 17:00:53.541367 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [None req-2a155ba3-d005-4c05-b44a-30613cd639e9 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91830) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 17:00:53.548651 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.quota.driver [None req-2a155ba3-d005-4c05-b44a-30613cd639e9 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91830) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 17:00:53.567845 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-605cc9cb-8340-4091-8a0b-cd8adec70147 req-814b6b99-381c-47d4-8eb1-755b24503783 tempest-VolumesSnapshotTestJSON-991813121 tempest-VolumesSnapshotTestJSON-991813121-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:00:53.569272 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-605cc9cb-8340-4091-8a0b-cd8adec70147 req-814b6b99-381c-47d4-8eb1-755b24503783 tempest-VolumesSnapshotTestJSON-991813121 tempest-VolumesSnapshotTestJSON-991813121-project] 10.222.0.62 "GET /v2.0/ports?device_id=5cf3f093-ba27-473b-93f8-52a5bb9d9ec8 HTTP/1.1" status: 200 len: 943 time: 0.1410909 May 25 17:00:53.584670 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-daafc2e7-f37f-47ff-bd63-ce4c6cac57c0 req-725aebe6-1c0e-4400-b42b-9190536fc40a tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:00:53.586035 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-daafc2e7-f37f-47ff-bd63-ce4c6cac57c0 req-725aebe6-1c0e-4400-b42b-9190536fc40a tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/ports?device_id=58da9205-0212-4daa-996c-1eef64a2b702 HTTP/1.1" status: 200 len: 945 time: 0.1180005 May 25 17:00:53.644020 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-2a155ba3-d005-4c05-b44a-30613cd639e9 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:53.648222 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-2a155ba3-d005-4c05-b44a-30613cd639e9 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-640836'] for security_group, after_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:53.656319 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-195ff8b8-87a2-4b35-ac0c-850677ad9ecf admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:00:53.698675 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2a155ba3-d005-4c05-b44a-30613cd639e9 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=743d7c62-6898-481d-966c-a92311710051,revision_number=1']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:00:53.701989 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-2a155ba3-d005-4c05-b44a-30613cd639e9 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.046s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:00:53.706799 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [None req-2a155ba3-d005-4c05-b44a-30613cd639e9 admin admin] 10.222.0.62 "GET /v2.0/security-groups?tenant_id=58faeb8b10614725bafa9091542e3976&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2064748 May 25 17:00:53.707421 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.wsgi [-] (91830) accepted ('10.222.0.62', 59720) {{(pid=91830) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:00:53.723229 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-605cc9cb-8340-4091-8a0b-cd8adec70147 req-5049f660-51de-481c-b218-e4499a898673 tempest-VolumesSnapshotTestJSON-991813121 tempest-VolumesSnapshotTestJSON-991813121-project] 10.222.0.62 "GET /v2.0/security-groups?id=b5f47757-8dd4-4226-9a13-ca15ee498213&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1362324 May 25 17:00:53.729936 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-daafc2e7-f37f-47ff-bd63-ce4c6cac57c0 req-db683312-ec98-4a6f-8093-369af52200c0 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/security-groups?id=8ee5c4ed-9c60-4e39-9185-7e283704a7dc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1241739 May 25 17:00:53.767618 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-899bce1d-a9ca-4b77-a01b-d63ab52e4277 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:53.793508 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-899bce1d-a9ca-4b77-a01b-d63ab52e4277 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:53.848479 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-899bce1d-a9ca-4b77-a01b-d63ab52e4277 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-640836'] for security_group, after_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:53.852162 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-067c680e-5f73-4c53-838e-82b4f9fa0974 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:00:53.866515 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-899bce1d-a9ca-4b77-a01b-d63ab52e4277 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=743d7c62-6898-481d-966c-a92311710051,revision_number=None']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:00:53.870261 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-899bce1d-a9ca-4b77-a01b-d63ab52e4277 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.018s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:00:53.873786 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-899bce1d-a9ca-4b77-a01b-d63ab52e4277 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:53.877046 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [None req-899bce1d-a9ca-4b77-a01b-d63ab52e4277 admin admin] 10.222.0.62 "DELETE /v2.0/security-groups/743d7c62-6898-481d-966c-a92311710051 HTTP/1.1" status: 204 len: 168 time: 0.1667979 May 25 17:00:53.922038 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3946d93a-9f5a-4463-9a59-14ef7e229b43 req-42c30bd5-81d1-4605-b235-43c7b90bceaf tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:00:53.923381 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-3946d93a-9f5a-4463-9a59-14ef7e229b43 req-42c30bd5-81d1-4605-b235-43c7b90bceaf tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/ports?device_id=3ead96ee-e427-4e87-9879-a1cdf303f894 HTTP/1.1" status: 200 len: 946 time: 0.0851433 May 25 17:00:53.970624 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-3946d93a-9f5a-4463-9a59-14ef7e229b43 req-eb0fcf34-e320-41dd-8d50-bd4f9153b1f7 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/security-groups?id=fdd3b3f1-a2cb-4432-9874-c1d04f64207b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0415747 May 25 17:00:54.991538 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-434411e8-b2e5-433f-a1a3-c7e8263d3e45 req-5235fe8c-b481-409a-99ef-f5a173daf267 tempest-VolumesSnapshotTestJSON-991813121 tempest-VolumesSnapshotTestJSON-991813121-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:00:54.993048 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-434411e8-b2e5-433f-a1a3-c7e8263d3e45 req-5235fe8c-b481-409a-99ef-f5a173daf267 tempest-VolumesSnapshotTestJSON-991813121 tempest-VolumesSnapshotTestJSON-991813121-project] 10.222.0.62 "GET /v2.0/ports?device_id=5cf3f093-ba27-473b-93f8-52a5bb9d9ec8 HTTP/1.1" status: 200 len: 943 time: 0.1634457 May 25 17:00:55.010245 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2b69cefc-6f9c-4744-b012-2efabc90bed5 req-6628f16f-66bb-48c0-80eb-6cd2c2ec0e9a tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:00:55.011642 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-2b69cefc-6f9c-4744-b012-2efabc90bed5 req-6628f16f-66bb-48c0-80eb-6cd2c2ec0e9a tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/ports?device_id=58da9205-0212-4daa-996c-1eef64a2b702 HTTP/1.1" status: 200 len: 945 time: 0.1425166 May 25 17:00:55.088716 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-434411e8-b2e5-433f-a1a3-c7e8263d3e45 req-d5d20f98-580a-42d0-9739-eb8da9fd052f tempest-VolumesSnapshotTestJSON-991813121 tempest-VolumesSnapshotTestJSON-991813121-project] 10.222.0.62 "GET /v2.0/security-groups?id=b5f47757-8dd4-4226-9a13-ca15ee498213&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0869212 May 25 17:00:55.099564 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-2b69cefc-6f9c-4744-b012-2efabc90bed5 req-bfd8e358-e1c2-40f9-abbe-4241084e827b tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/security-groups?id=8ee5c4ed-9c60-4e39-9185-7e283704a7dc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0709052 May 25 17:00:55.295388 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-47dec95e-9653-408e-a6dc-ee578823fa19 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:55.322932 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5287fd86-184c-4f6a-bd07-45e5fac31d29 req-d761660d-2340-4a6f-8852-89dba1052dd5 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:00:55.324399 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-5287fd86-184c-4f6a-bd07-45e5fac31d29 req-d761660d-2340-4a6f-8852-89dba1052dd5 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/ports?device_id=3ead96ee-e427-4e87-9879-a1cdf303f894 HTTP/1.1" status: 200 len: 946 time: 0.1036553 May 25 17:00:55.376643 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-5287fd86-184c-4f6a-bd07-45e5fac31d29 req-4ff191d2-1f2a-4e34-a463-c5a85659b852 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/security-groups?id=fdd3b3f1-a2cb-4432-9874-c1d04f64207b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0450120 May 25 17:00:56.013843 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-61078fe5-dd80-46b3-ba65-765513a52703 req-dfbb7078-9d92-40f1-b2f9-4ffe192db5e0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:00:56.015510 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-61078fe5-dd80-46b3-ba65-765513a52703 req-dfbb7078-9d92-40f1-b2f9-4ffe192db5e0 service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=1314f62bcf90411cadb06fa2d9392828&device_id=5cf3f093-ba27-473b-93f8-52a5bb9d9ec8 HTTP/1.1" status: 200 len: 1096 time: 0.0723813 May 25 17:00:56.353175 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ddfe571c-36a6-4279-a28a-290c17ea0499 req-2b037507-80d4-4258-b6bd-97f3de35216d tempest-VolumesSnapshotTestJSON-991813121 tempest-VolumesSnapshotTestJSON-991813121-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:00:56.354834 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-ddfe571c-36a6-4279-a28a-290c17ea0499 req-2b037507-80d4-4258-b6bd-97f3de35216d tempest-VolumesSnapshotTestJSON-991813121 tempest-VolumesSnapshotTestJSON-991813121-project] 10.222.0.62 "GET /v2.0/ports?device_id=5cf3f093-ba27-473b-93f8-52a5bb9d9ec8 HTTP/1.1" status: 200 len: 943 time: 0.1111264 May 25 17:00:56.362688 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c4d71567-fd32-47f8-b71d-0d5696fad561 req-b670dae8-3138-4232-a752-2d8f1b396de8 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:00:56.365426 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-c4d71567-fd32-47f8-b71d-0d5696fad561 req-b670dae8-3138-4232-a752-2d8f1b396de8 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/ports?device_id=58da9205-0212-4daa-996c-1eef64a2b702 HTTP/1.1" status: 200 len: 945 time: 0.1517613 May 25 17:00:56.536638 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-ddfe571c-36a6-4279-a28a-290c17ea0499 req-92a9db8b-f60b-42dd-a4e9-81abb6e1a2e0 tempest-VolumesSnapshotTestJSON-991813121 tempest-VolumesSnapshotTestJSON-991813121-project] 10.222.0.62 "GET /v2.0/security-groups?id=b5f47757-8dd4-4226-9a13-ca15ee498213&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1504035 May 25 17:00:56.541996 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-71a84803-d4fa-465e-bab0-d6d7eb8091f0 req-ebbaa4e2-1dc2-4fbe-b66a-9bfb71e63b65 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91830) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:00:56.543146 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-c4d71567-fd32-47f8-b71d-0d5696fad561 req-7a8e8f3b-f8d9-44d0-a4de-249b39b26253 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/security-groups?id=8ee5c4ed-9c60-4e39-9185-7e283704a7dc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1512103 May 25 17:00:56.543839 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-71a84803-d4fa-465e-bab0-d6d7eb8091f0 req-ebbaa4e2-1dc2-4fbe-b66a-9bfb71e63b65 service neutron] 10.222.0.32 "GET /v2.0/ports?device_id=58da9205-0212-4daa-996c-1eef64a2b702 HTTP/1.1" status: 200 len: 1098 time: 0.1387267 May 25 17:00:56.546388 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-01f9842e-49db-4fd4-92c1-05bcab84ad45 req-1ea3e956-6945-4ffd-8c94-e4d8341b4538 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91830) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:00:56.547956 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-01f9842e-49db-4fd4-92c1-05bcab84ad45 req-1ea3e956-6945-4ffd-8c94-e4d8341b4538 service neutron] 10.222.0.32 "GET /v2.0/ports?device_id=3ead96ee-e427-4e87-9879-a1cdf303f894 HTTP/1.1" status: 200 len: 1099 time: 0.1081290 May 25 17:00:56.616069 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-61078fe5-dd80-46b3-ba65-765513a52703 req-e1575b5a-5cfa-4e94-83f2-e1bcbe1045e6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:00:56.617521 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-61078fe5-dd80-46b3-ba65-765513a52703 req-e1575b5a-5cfa-4e94-83f2-e1bcbe1045e6 service neutron] 10.222.0.32 "GET /v2.0/networks?tenant_id=1314f62bcf90411cadb06fa2d9392828&shared=False HTTP/1.1" status: 200 len: 914 time: 0.2512052 May 25 17:00:56.641054 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-71a84803-d4fa-465e-bab0-d6d7eb8091f0 req-66b639dc-6759-4833-be5e-b01bbc28df7f service neutron] 10.222.0.32 "GET /v2.0/security-groups?id=8ee5c4ed-9c60-4e39-9185-7e283704a7dc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0783286 May 25 17:00:56.641054 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-01f9842e-49db-4fd4-92c1-05bcab84ad45 req-82024ded-fd69-4a4d-a223-0618d98c3e1d service neutron] 10.222.0.32 "GET /v2.0/security-groups?id=fdd3b3f1-a2cb-4432-9874-c1d04f64207b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0485804 May 25 17:00:56.816727 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-61078fe5-dd80-46b3-ba65-765513a52703 req-15f581d8-4c58-4a66-8e26-53c05dd0ef42 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:00:56.818235 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-61078fe5-dd80-46b3-ba65-765513a52703 req-15f581d8-4c58-4a66-8e26-53c05dd0ef42 service neutron] 10.222.0.32 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.1932235 May 25 17:00:56.829705 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-701bf48e-c738-4097-a1d6-3c516186714f req-c5f1ef43-04de-45ee-b86a-0d66a70e3c72 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:00:56.831312 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-701bf48e-c738-4097-a1d6-3c516186714f req-c5f1ef43-04de-45ee-b86a-0d66a70e3c72 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/ports?device_id=3ead96ee-e427-4e87-9879-a1cdf303f894 HTTP/1.1" status: 200 len: 946 time: 0.1359134 May 25 17:00:56.876759 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-701bf48e-c738-4097-a1d6-3c516186714f req-7f420dea-2294-49ee-ab95-90b6bed29da6 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/security-groups?id=fdd3b3f1-a2cb-4432-9874-c1d04f64207b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0394323 May 25 17:00:57.710931 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-45d7709c-4b98-40c1-afd8-a429a5bec610 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:57.847302 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9e16c5b0-58c3-4ce1-aecc-1ff3e767d46b req-5fdcc244-8504-48a9-b9d3-7c00ab1f31f2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:00:57.848759 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-9e16c5b0-58c3-4ce1-aecc-1ff3e767d46b req-5fdcc244-8504-48a9-b9d3-7c00ab1f31f2 service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=1314f62bcf90411cadb06fa2d9392828&device_id=5cf3f093-ba27-473b-93f8-52a5bb9d9ec8 HTTP/1.1" status: 200 len: 1096 time: 0.2641342 May 25 17:00:57.862099 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:57.916836 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f3e9a763-6e02-4b26-8427-29d94fe9f88a req-8f7767ea-3e9b-430e-88ee-9b497c3f2298 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:00:57.918534 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-f3e9a763-6e02-4b26-8427-29d94fe9f88a req-8f7767ea-3e9b-430e-88ee-9b497c3f2298 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/ports?device_id=58da9205-0212-4daa-996c-1eef64a2b702 HTTP/1.1" status: 200 len: 945 time: 0.2183597 May 25 17:00:57.951920 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-9e16c5b0-58c3-4ce1-aecc-1ff3e767d46b req-ce6a5dbc-0654-47c2-8eb6-81850c8fdb11 service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=041fa5ca-9be5-4356-af06-2fe633a19ad8 HTTP/1.1" status: 200 len: 217 time: 0.0917926 May 25 17:00:58.030664 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-057e8701-554d-4aac-b4db-c58b1a102cf8 req-f804c165-8a83-4712-a0a0-5f5165e49bb8 tempest-VolumesSnapshotTestJSON-991813121 tempest-VolumesSnapshotTestJSON-991813121-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:00:58.032130 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-057e8701-554d-4aac-b4db-c58b1a102cf8 req-f804c165-8a83-4712-a0a0-5f5165e49bb8 tempest-VolumesSnapshotTestJSON-991813121 tempest-VolumesSnapshotTestJSON-991813121-project] 10.222.0.62 "GET /v2.0/ports?device_id=5cf3f093-ba27-473b-93f8-52a5bb9d9ec8 HTTP/1.1" status: 200 len: 943 time: 0.2721219 May 25 17:00:58.050121 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-f3e9a763-6e02-4b26-8427-29d94fe9f88a req-dbdc9360-9959-40b5-a46e-3bd6149545b7 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/security-groups?id=8ee5c4ed-9c60-4e39-9185-7e283704a7dc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1223361 May 25 17:00:58.077451 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9e16c5b0-58c3-4ce1-aecc-1ff3e767d46b req-955f8f29-746f-4614-bf96-1114b42bf843 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:00:58.078851 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-9e16c5b0-58c3-4ce1-aecc-1ff3e767d46b req-955f8f29-746f-4614-bf96-1114b42bf843 service neutron] 10.222.0.32 "GET /v2.0/subnets?id=e21793ea-1820-4ec5-b3fc-a7d9b7129124 HTTP/1.1" status: 200 len: 853 time: 0.1180689 May 25 17:00:58.138472 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-057e8701-554d-4aac-b4db-c58b1a102cf8 req-5b359cbb-fa60-4705-b03a-b2ac05230e2e tempest-VolumesSnapshotTestJSON-991813121 tempest-VolumesSnapshotTestJSON-991813121-project] 10.222.0.62 "GET /v2.0/security-groups?id=b5f47757-8dd4-4226-9a13-ca15ee498213&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0959976 May 25 17:00:58.140568 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-9e16c5b0-58c3-4ce1-aecc-1ff3e767d46b req-8d626bea-e4cf-4a9d-964f-d30817df2ca4 service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=c8b64023-a7f5-4c0f-847b-8a8aef981caa&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0519531 May 25 17:00:58.395882 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-9e16c5b0-58c3-4ce1-aecc-1ff3e767d46b req-4a78f55f-0049-459d-b658-f9184cc61239 service neutron] 10.222.0.32 "GET /v2.0/networks/c8b64023-a7f5-4c0f-847b-8a8aef981caa?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2470856 May 25 17:00:58.403820 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-93a69d1f-220f-4dde-8560-0d6fedf6f268 req-0151d842-3668-42d2-905c-7365246be2cd tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:00:58.405693 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-93a69d1f-220f-4dde-8560-0d6fedf6f268 req-0151d842-3668-42d2-905c-7365246be2cd tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/ports?device_id=3ead96ee-e427-4e87-9879-a1cdf303f894 HTTP/1.1" status: 200 len: 946 time: 0.2389364 May 25 17:00:58.546840 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-93a69d1f-220f-4dde-8560-0d6fedf6f268 req-67a18780-6a58-4289-a931-1bfb1f8379be tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/security-groups?id=fdd3b3f1-a2cb-4432-9874-c1d04f64207b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1197155 May 25 17:00:58.576612 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-9e16c5b0-58c3-4ce1-aecc-1ff3e767d46b req-6b8499f7-a79a-45f4-b557-aca4739f443c service neutron] 10.222.0.32 "GET /v2.0/networks/c8b64023-a7f5-4c0f-847b-8a8aef981caa?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1631732 May 25 17:00:58.599661 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-0a55eb4a-8b57-4233-84d6-6b423b4ed6db None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:00:59.262041 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-881c416b-ac66-46ae-85e2-a6f912303b8e req-d291a27d-49b4-4717-b369-798d0e2608a5 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:00:59.263248 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-881c416b-ac66-46ae-85e2-a6f912303b8e req-d291a27d-49b4-4717-b369-798d0e2608a5 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/ports?device_id=58da9205-0212-4daa-996c-1eef64a2b702 HTTP/1.1" status: 200 len: 945 time: 0.1003904 May 25 17:00:59.354815 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-881c416b-ac66-46ae-85e2-a6f912303b8e req-f1f0759e-ca8f-4b69-bbe9-94b1edbf3f03 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/security-groups?id=8ee5c4ed-9c60-4e39-9185-7e283704a7dc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0855477 May 25 17:00:59.403807 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0d615d01-409a-4aff-9677-75c6437a247b req-ba8acb14-c777-4ae2-a0f1-5e0827f69bc8 tempest-VolumesSnapshotTestJSON-991813121 tempest-VolumesSnapshotTestJSON-991813121-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:00:59.405805 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-0d615d01-409a-4aff-9677-75c6437a247b req-ba8acb14-c777-4ae2-a0f1-5e0827f69bc8 tempest-VolumesSnapshotTestJSON-991813121 tempest-VolumesSnapshotTestJSON-991813121-project] 10.222.0.62 "GET /v2.0/ports?device_id=5cf3f093-ba27-473b-93f8-52a5bb9d9ec8 HTTP/1.1" status: 200 len: 943 time: 0.0909843 May 25 17:00:59.477126 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-0d615d01-409a-4aff-9677-75c6437a247b req-4fef24d2-a8f1-45b4-b5f3-e4b18235dc96 tempest-VolumesSnapshotTestJSON-991813121 tempest-VolumesSnapshotTestJSON-991813121-project] 10.222.0.62 "GET /v2.0/security-groups?id=b5f47757-8dd4-4226-9a13-ca15ee498213&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0658014 May 25 17:00:59.597986 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-66e5af5c-7587-4a75-851d-fc8cd997c555 req-61eb5bc6-4254-4a30-a998-de781ba2c0cb tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:00:59.599441 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-66e5af5c-7587-4a75-851d-fc8cd997c555 req-61eb5bc6-4254-4a30-a998-de781ba2c0cb tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] 10.222.0.62 "GET /v2.0/networks?id=63b1f335-e2c4-48dd-886b-6be853f8a2fc HTTP/1.1" status: 200 len: 814 time: 0.1531751 May 25 17:00:59.614691 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-66e5af5c-7587-4a75-851d-fc8cd997c555 req-b998a0fc-085d-4c96-9bf5-693a24facd48 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] 10.222.0.62 "GET /v2.0/quotas/04e8022f24e3464ab1ab7726d6a07e08 HTTP/1.1" status: 200 len: 375 time: 0.0095778 May 25 17:00:59.697789 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-66e5af5c-7587-4a75-851d-fc8cd997c555 req-dbf381b9-4760-4f74-b246-f6260e65eb94 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] 10.222.0.62 "GET /v2.0/ports?tenant_id=04e8022f24e3464ab1ab7726d6a07e08&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0777340 May 25 17:00:59.906475 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-66e5af5c-7587-4a75-851d-fc8cd997c555 req-ff1798ab-d62f-42b2-8e78-393b22e6cd4d service neutron] 10.222.0.62 "GET /v2.0/networks/63b1f335-e2c4-48dd-886b-6be853f8a2fc?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1969099 May 25 17:01:00.087818 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8f9daa87-e977-45a8-beab-dd89ed0bcdbb req-6cd3a913-f58c-4acb-a1e0-871b2ccc0c3f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:01:00.089308 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-8f9daa87-e977-45a8-beab-dd89ed0bcdbb req-6cd3a913-f58c-4acb-a1e0-871b2ccc0c3f service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=734df673f8b3484d80f35a45fbce9d5e&device_id=58da9205-0212-4daa-996c-1eef64a2b702 HTTP/1.1" status: 200 len: 1098 time: 0.2253900 May 25 17:01:00.098458 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a6d5e3cd-3303-47ee-a1eb-aba3293156da req-552b4781-2270-4297-a263-4ded695b931c tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:01:00.099792 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-a6d5e3cd-3303-47ee-a1eb-aba3293156da req-552b4781-2270-4297-a263-4ded695b931c tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/ports?device_id=3ead96ee-e427-4e87-9879-a1cdf303f894 HTTP/1.1" status: 200 len: 946 time: 0.2778585 May 25 17:01:00.101657 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-66e5af5c-7587-4a75-851d-fc8cd997c555 req-4bcfd9ca-04a4-4d47-99d5-26da61c88a72 service neutron] 10.222.0.62 "GET /v2.0/networks/63b1f335-e2c4-48dd-886b-6be853f8a2fc?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1829679 May 25 17:01:00.148259 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-a6d5e3cd-3303-47ee-a1eb-aba3293156da req-f0f6fe0f-a296-4184-9331-c01220d74060 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/security-groups?id=fdd3b3f1-a2cb-4432-9874-c1d04f64207b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0423570 May 25 17:01:00.217564 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-57f11b47-1f51-4191-b7c9-af248a48372c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:01:00.401886 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7e47432e-4fb1-4869-bb1f-1b7c08863834 req-b854566a-c18f-423d-9505-8c3d24ff517a tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:01:00.403357 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-7e47432e-4fb1-4869-bb1f-1b7c08863834 req-b854566a-c18f-423d-9505-8c3d24ff517a tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/ports?device_id=58da9205-0212-4daa-996c-1eef64a2b702 HTTP/1.1" status: 200 len: 945 time: 0.1471887 May 25 17:01:00.453312 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4b0c6d1a-dd0a-43a4-be7c-ccc7800ca7b0 req-aef343ad-edd6-4746-819a-8e29f5448b03 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:01:00.454770 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-4b0c6d1a-dd0a-43a4-be7c-ccc7800ca7b0 req-aef343ad-edd6-4746-819a-8e29f5448b03 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/ports?device_id=3ead96ee-e427-4e87-9879-a1cdf303f894 HTTP/1.1" status: 200 len: 946 time: 0.1297355 May 25 17:01:00.463917 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.wsgi [-] (91830) accepted ('10.222.0.62', 59884) {{(pid=91830) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:01:00.471222 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.v2.base [None req-e08d448a-a863-4ee3-bb5d-fda7ee90e005 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Request body: {'floatingip': {'port_id': 'b7d643d2-c7f2-4e49-8125-5c5ec0b9d463'}} {{(pid=91830) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 17:01:00.475727 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-7e47432e-4fb1-4869-bb1f-1b7c08863834 req-4953bbe0-8f8f-480d-967d-afcda62d8e3a tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/security-groups?id=8ee5c4ed-9c60-4e39-9185-7e283704a7dc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0649602 May 25 17:01:00.556966 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-c8ea7472-879a-4793-a3c1-7e7daec6b458 req-77b30acc-fe69-441b-afdc-75d679603a97 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] 10.222.0.62 "GET /v2.0/ports?device_id=6b63b4a6-5261-4e1c-b796-2f153fc24933 HTTP/1.1" status: 200 len: 210 time: 0.0611937 May 25 17:01:00.586798 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-e08d448a-a863-4ee3-bb5d-fda7ee90e005 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Notify callbacks [] for floatingip, before_update {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:01:00.686832 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-99bd7a4f-d4ec-4c5b-a016-ec5a6862d2fb req-b5269ce5-41e2-4302-83a7-ac65bd488840 tempest-VolumesSnapshotTestJSON-991813121 tempest-VolumesSnapshotTestJSON-991813121-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:01:00.688361 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-99bd7a4f-d4ec-4c5b-a016-ec5a6862d2fb req-b5269ce5-41e2-4302-83a7-ac65bd488840 tempest-VolumesSnapshotTestJSON-991813121 tempest-VolumesSnapshotTestJSON-991813121-project] 10.222.0.62 "GET /v2.0/ports?device_id=5cf3f093-ba27-473b-93f8-52a5bb9d9ec8 HTTP/1.1" status: 200 len: 943 time: 0.0907645 May 25 17:01:00.732443 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-99bd7a4f-d4ec-4c5b-a016-ec5a6862d2fb req-58fa02a4-2c6a-4cd3-acc5-82882aefa062 tempest-VolumesSnapshotTestJSON-991813121 tempest-VolumesSnapshotTestJSON-991813121-project] 10.222.0.62 "GET /v2.0/security-groups?id=b5f47757-8dd4-4226-9a13-ca15ee498213&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0382161 May 25 17:01:01.443176 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-e08d448a-a863-4ee3-bb5d-fda7ee90e005 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Notify callbacks [] for floatingip, precommit_update {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:01:01.447134 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-e08d448a-a863-4ee3-bb5d-fda7ee90e005 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-683033'] for floatingip, after_update {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:01:01.619996 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.db.l3_db [None req-e08d448a-a863-4ee3-bb5d-fda7ee90e005 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Floating IP efd05916-23a4-4ee0-a108-18fa80681716 associated. External IP: 172.27.2.190, port: b7d643d2-c7f2-4e49-8125-5c5ec0b9d463. May 25 17:01:01.885020 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-2df89c4f-87de-423b-ad5f-0fd357d218af req-69c96102-ca98-48ee-b058-d447fd60833c tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] 10.222.0.62 "GET /v2.0/ports?device_id=6b63b4a6-5261-4e1c-b796-2f153fc24933 HTTP/1.1" status: 200 len: 210 time: 0.0609138 May 25 17:01:01.921480 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5b020cad-5e2c-4bcc-b4a4-ad34117bc1fb req-d5a232db-5154-415d-aa0d-cd2932e3f84d tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:01:01.923081 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-5b020cad-5e2c-4bcc-b4a4-ad34117bc1fb req-d5a232db-5154-415d-aa0d-cd2932e3f84d tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/ports?device_id=58da9205-0212-4daa-996c-1eef64a2b702 HTTP/1.1" status: 200 len: 945 time: 0.3380430 May 25 17:01:01.925767 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8f9daa87-e977-45a8-beab-dd89ed0bcdbb req-d1c85881-c79f-49bd-b23f-293c3e2baf0b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:01:01.927191 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-8f9daa87-e977-45a8-beab-dd89ed0bcdbb req-d1c85881-c79f-49bd-b23f-293c3e2baf0b service neutron] 10.222.0.32 "GET /v2.0/networks?id=55a46372-d583-4435-a0f6-b9397668217d HTTP/1.1" status: 200 len: 919 time: 0.2023571 May 25 17:01:01.972856 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-5b020cad-5e2c-4bcc-b4a4-ad34117bc1fb req-e781f88d-d587-441f-8d8a-69476e998d9d tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/security-groups?id=8ee5c4ed-9c60-4e39-9185-7e283704a7dc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0427639 May 25 17:01:02.010459 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-e08d448a-a863-4ee3-bb5d-fda7ee90e005 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Router d2ed6ef9-f77a-4b7a-b152-3e1b9c85e1ad has already been hosted by L3 agent a2d427c1-2d07-43e8-afbe-218c9f7d0445 {{(pid=91830) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 25 17:01:02.079434 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9bf949fd-9c61-4f3b-9831-aa155cdce12f req-2e837801-b33c-4149-9519-6ec31d18b033 tempest-VolumesSnapshotTestJSON-991813121 tempest-VolumesSnapshotTestJSON-991813121-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:01:02.080981 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-9bf949fd-9c61-4f3b-9831-aa155cdce12f req-2e837801-b33c-4149-9519-6ec31d18b033 tempest-VolumesSnapshotTestJSON-991813121 tempest-VolumesSnapshotTestJSON-991813121-project] 10.222.0.62 "GET /v2.0/ports?device_id=5cf3f093-ba27-473b-93f8-52a5bb9d9ec8 HTTP/1.1" status: 200 len: 943 time: 0.0891168 May 25 17:01:02.134700 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-9bf949fd-9c61-4f3b-9831-aa155cdce12f req-4592649e-ca19-413b-a8d6-439071483fb5 tempest-VolumesSnapshotTestJSON-991813121 tempest-VolumesSnapshotTestJSON-991813121-project] 10.222.0.62 "GET /v2.0/security-groups?id=b5f47757-8dd4-4226-9a13-ca15ee498213&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0477881 May 25 17:01:02.206445 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-e08d448a-a863-4ee3-bb5d-fda7ee90e005 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Notify agent at l3_agent.dv-cinder-790492-4-iscsi the message routers_updated {{(pid=91830) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 25 17:01:02.210813 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-e08d448a-a863-4ee3-bb5d-fda7ee90e005 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-178712'] for floatingip, before_response {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:01:02.219652 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ca444281-f5bb-4263-bc73-9345d6d9960a None None] Sync routers for ids ['d2ed6ef9-f77a-4b7a-b152-3e1b9c85e1ad'] in dv-cinder-790492-4-iscsi {{(pid=91832) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 25 17:01:02.228876 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ca444281-f5bb-4263-bc73-9345d6d9960a None None] Routers {'d2ed6ef9-f77a-4b7a-b152-3e1b9c85e1ad'} bound to L3 agent in host dv-cinder-790492-4-iscsi {{(pid=91832) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 17:01:02.229490 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.db.l3_hamode_db [None req-ca444281-f5bb-4263-bc73-9345d6d9960a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-790492-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-05-25T16:50:28Z,description=,heartbeat_timestamp=2021-05-25T17:00:58Z,host='dv-cinder-790492-4-iscsi',id=a2d427c1-2d07-43e8-afbe-218c9f7d0445,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T16:50:28Z,topic='l3_agent')) {'router_ids': ['d2ed6ef9-f77a-4b7a-b152-3e1b9c85e1ad'], 'active': True} {{(pid=91832) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 17:01:02.265785 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [None req-e08d448a-a863-4ee3-bb5d-fda7ee90e005 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "PUT /v2.0/floatingips/efd05916-23a4-4ee0-a108-18fa80681716 HTTP/1.1" status: 200 len: 992 time: 1.8006198 May 25 17:01:02.266530 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '3ead96ee-e427-4e87-9879-a1cdf303f894', 'tag': 'b7d643d2-c7f2-4e49-8125-5c5ec0b9d463'}] {{(pid=91830) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 25 17:01:02.339477 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '3ead96ee-e427-4e87-9879-a1cdf303f894', 'tag': 'b7d643d2-c7f2-4e49-8125-5c5ec0b9d463', 'status': 'completed', 'code': 200} May 25 17:01:02.418532 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.db.l3_dvr_db [None req-ca444281-f5bb-4263-bc73-9345d6d9960a None None] Set router d2ed6ef9-f77a-4b7a-b152-3e1b9c85e1ad gateway port host: dv-cinder-790492-4-iscsi {{(pid=91832) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 17:01:02.776250 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.db.l3_hamode_db [None req-ca444281-f5bb-4263-bc73-9345d6d9960a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd2ed6ef9-f77a-4b7a-b152-3e1b9c85e1ad', 'name': 'tempest-AttachVolumeShelveTestJSON-437778030-router', 'tenant_id': 'bbb9e99759bc47d08005f3b1e036a6cf', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'external_fixed_ips': [{'subnet_id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'ip_address': '172.27.2.253'}], 'enable_snat': True}, 'gw_port_id': '3bc942c3-5854-4018-b3fb-5071bf6c70c6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T17:00:14Z', 'updated_at': '2021-05-25T17:00:25Z', 'revision_number': 4, 'project_id': 'bbb9e99759bc47d08005f3b1e036a6cf', 'gw_port': {'id': '3bc942c3-5854-4018-b3fb-5071bf6c70c6', 'name': '', 'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'tenant_id': '', 'mac_address': 'fa:16:3e:da:a2:c4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd2ed6ef9-f77a-4b7a-b152-3e1b9c85e1ad', 'device_owner': 'network:router_gateway', 'standard_attr_id': 294, 'fixed_ips': [{'subnet_id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'ip_address': '172.27.2.253', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790492-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:00:16Z', 'updated_at': '2021-05-25T17:00:27Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-790492-4-iscsi', '_floatingips': [{'id': 'efd05916-23a4-4ee0-a108-18fa80681716', 'tenant_id': 'bbb9e99759bc47d08005f3b1e036a6cf', 'floating_ip_address': '172.27.2.190', 'floating_network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'router_id': 'd2ed6ef9-f77a-4b7a-b152-3e1b9c85e1ad', 'port_id': 'b7d643d2-c7f2-4e49-8125-5c5ec0b9d463', 'fixed_ip_address': '172.20.0.13', 'status': 'DOWN', 'standard_attr_id': 336, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'e5be4c6a-143f-474c-a90b-37180778cefe', 'mac_address': 'fa:16:3e:a8:69:d8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3ead96ee-e427-4e87-9879-a1cdf303f894', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-25T17:00:32Z', 'updated_at': '2021-05-25T17:01:01Z', 'revision_number': 1, 'project_id': 'bbb9e99759bc47d08005f3b1e036a6cf', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '735e7c1b-31b2-48e2-b2b7-538c31dbffb6', 'name': '', 'network_id': 'e5be4c6a-143f-474c-a90b-37180778cefe', 'tenant_id': 'bbb9e99759bc47d08005f3b1e036a6cf', 'mac_address': 'fa:16:3e:9a:dc:e1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd2ed6ef9-f77a-4b7a-b152-3e1b9c85e1ad', 'device_owner': 'network:router_interface', 'standard_attr_id': 319, 'fixed_ips': [{'subnet_id': '6e6b5897-e23d-4281-96cb-a6fdf9b68134', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790492-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:00:21Z', 'updated_at': '2021-05-25T17:00:33Z', 'revision_number': 5, 'project_id': 'bbb9e99759bc47d08005f3b1e036a6cf', 'subnets': [{'id': '6e6b5897-e23d-4281-96cb-a6fdf9b68134', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-790492-4-iscsi', False) {} {{(pid=91832) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 17:01:02.779877 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ca444281-f5bb-4263-bc73-9345d6d9960a None None] Checking router: d2ed6ef9-f77a-4b7a-b152-3e1b9c85e1ad for host: dv-cinder-790492-4-iscsi {{(pid=91832) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 25 17:01:02.787943 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ca444281-f5bb-4263-bc73-9345d6d9960a None None] Routers {'d2ed6ef9-f77a-4b7a-b152-3e1b9c85e1ad'} bound to L3 agent in host dv-cinder-790492-4-iscsi {{(pid=91832) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 17:01:02.788538 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.db.l3_hamode_db [None req-ca444281-f5bb-4263-bc73-9345d6d9960a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-790492-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-05-25T16:50:28Z,description=,heartbeat_timestamp=2021-05-25T17:00:58Z,host='dv-cinder-790492-4-iscsi',id=a2d427c1-2d07-43e8-afbe-218c9f7d0445,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T16:50:28Z,topic='l3_agent')) {'router_ids': ['d2ed6ef9-f77a-4b7a-b152-3e1b9c85e1ad'], 'active': True} {{(pid=91832) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 17:01:02.969389 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.db.l3_dvr_db [None req-ca444281-f5bb-4263-bc73-9345d6d9960a None None] Set router d2ed6ef9-f77a-4b7a-b152-3e1b9c85e1ad gateway port host: dv-cinder-790492-4-iscsi {{(pid=91832) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 17:01:03.036812 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-de71df23-93a0-4d01-992a-37795fce8cb8 req-29f21a7c-57fa-4763-aef3-10a00487780f tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] 10.222.0.62 "GET /v2.0/ports?device_id=6b63b4a6-5261-4e1c-b796-2f153fc24933 HTTP/1.1" status: 200 len: 210 time: 0.0456481 May 25 17:01:03.227477 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ffc1dfa1-77a6-4924-bfbb-570da764c327 req-619c964b-4992-44b0-a884-4e82aef37285 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:01:03.228912 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-ffc1dfa1-77a6-4924-bfbb-570da764c327 req-619c964b-4992-44b0-a884-4e82aef37285 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/ports?device_id=58da9205-0212-4daa-996c-1eef64a2b702 HTTP/1.1" status: 200 len: 945 time: 0.0821848 May 25 17:01:03.274820 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-ffc1dfa1-77a6-4924-bfbb-570da764c327 req-e9951c59-6c2d-4ebc-b0af-50e7718aaeab tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/security-groups?id=8ee5c4ed-9c60-4e39-9185-7e283704a7dc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0391517 May 25 17:01:03.332892 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.db.l3_hamode_db [None req-ca444281-f5bb-4263-bc73-9345d6d9960a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd2ed6ef9-f77a-4b7a-b152-3e1b9c85e1ad', 'name': 'tempest-AttachVolumeShelveTestJSON-437778030-router', 'tenant_id': 'bbb9e99759bc47d08005f3b1e036a6cf', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'external_fixed_ips': [{'subnet_id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'ip_address': '172.27.2.253'}], 'enable_snat': True}, 'gw_port_id': '3bc942c3-5854-4018-b3fb-5071bf6c70c6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T17:00:14Z', 'updated_at': '2021-05-25T17:00:25Z', 'revision_number': 4, 'project_id': 'bbb9e99759bc47d08005f3b1e036a6cf', 'gw_port': {'id': '3bc942c3-5854-4018-b3fb-5071bf6c70c6', 'name': '', 'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'tenant_id': '', 'mac_address': 'fa:16:3e:da:a2:c4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd2ed6ef9-f77a-4b7a-b152-3e1b9c85e1ad', 'device_owner': 'network:router_gateway', 'standard_attr_id': 294, 'fixed_ips': [{'subnet_id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'ip_address': '172.27.2.253', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790492-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:00:16Z', 'updated_at': '2021-05-25T17:00:27Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-790492-4-iscsi', '_floatingips': [{'id': 'efd05916-23a4-4ee0-a108-18fa80681716', 'tenant_id': 'bbb9e99759bc47d08005f3b1e036a6cf', 'floating_ip_address': '172.27.2.190', 'floating_network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'router_id': 'd2ed6ef9-f77a-4b7a-b152-3e1b9c85e1ad', 'port_id': 'b7d643d2-c7f2-4e49-8125-5c5ec0b9d463', 'fixed_ip_address': '172.20.0.13', 'status': 'DOWN', 'standard_attr_id': 336, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'e5be4c6a-143f-474c-a90b-37180778cefe', 'mac_address': 'fa:16:3e:a8:69:d8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3ead96ee-e427-4e87-9879-a1cdf303f894', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-25T17:00:32Z', 'updated_at': '2021-05-25T17:01:01Z', 'revision_number': 1, 'project_id': 'bbb9e99759bc47d08005f3b1e036a6cf', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '735e7c1b-31b2-48e2-b2b7-538c31dbffb6', 'name': '', 'network_id': 'e5be4c6a-143f-474c-a90b-37180778cefe', 'tenant_id': 'bbb9e99759bc47d08005f3b1e036a6cf', 'mac_address': 'fa:16:3e:9a:dc:e1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd2ed6ef9-f77a-4b7a-b152-3e1b9c85e1ad', 'device_owner': 'network:router_interface', 'standard_attr_id': 319, 'fixed_ips': [{'subnet_id': '6e6b5897-e23d-4281-96cb-a6fdf9b68134', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790492-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:00:21Z', 'updated_at': '2021-05-25T17:00:33Z', 'revision_number': 5, 'project_id': 'bbb9e99759bc47d08005f3b1e036a6cf', 'subnets': [{'id': '6e6b5897-e23d-4281-96cb-a6fdf9b68134', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-790492-4-iscsi', False) {} {{(pid=91832) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 17:01:03.336752 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ca444281-f5bb-4263-bc73-9345d6d9960a None None] The sync data for ids ['d2ed6ef9-f77a-4b7a-b152-3e1b9c85e1ad'] in dv-cinder-790492-4-iscsi is: [{'id': 'd2ed6ef9-f77a-4b7a-b152-3e1b9c85e1ad', 'name': 'tempest-AttachVolumeShelveTestJSON-437778030-router', 'tenant_id': 'bbb9e99759bc47d08005f3b1e036a6cf', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'external_fixed_ips': [{'subnet_id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'ip_address': '172.27.2.253'}], 'enable_snat': True}, 'gw_port_id': '3bc942c3-5854-4018-b3fb-5071bf6c70c6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T17:00:14Z', 'updated_at': '2021-05-25T17:00:25Z', 'revision_number': 4, 'project_id': 'bbb9e99759bc47d08005f3b1e036a6cf', 'gw_port': {'id': '3bc942c3-5854-4018-b3fb-5071bf6c70c6', 'name': '', 'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'tenant_id': '', 'mac_address': 'fa:16:3e:da:a2:c4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd2ed6ef9-f77a-4b7a-b152-3e1b9c85e1ad', 'device_owner': 'network:router_gateway', 'standard_attr_id': 294, 'fixed_ips': [{'subnet_id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'ip_address': '172.27.2.253', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790492-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:00:16Z', 'updated_at': '2021-05-25T17:00:27Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-790492-4-iscsi', '_floatingips': [{'id': 'efd05916-23a4-4ee0-a108-18fa80681716', 'tenant_id': 'bbb9e99759bc47d08005f3b1e036a6cf', 'floating_ip_address': '172.27.2.190', 'floating_network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'router_id': 'd2ed6ef9-f77a-4b7a-b152-3e1b9c85e1ad', 'port_id': 'b7d643d2-c7f2-4e49-8125-5c5ec0b9d463', 'fixed_ip_address': '172.20.0.13', 'status': 'DOWN', 'standard_attr_id': 336, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'e5be4c6a-143f-474c-a90b-37180778cefe', 'mac_address': 'fa:16:3e:a8:69:d8', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3ead96ee-e427-4e87-9879-a1cdf303f894', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-25T17:00:32Z', 'updated_at': '2021-05-25T17:01:01Z', 'revision_number': 1, 'project_id': 'bbb9e99759bc47d08005f3b1e036a6cf', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '735e7c1b-31b2-48e2-b2b7-538c31dbffb6', 'name': '', 'network_id': 'e5be4c6a-143f-474c-a90b-37180778cefe', 'tenant_id': 'bbb9e99759bc47d08005f3b1e036a6cf', 'mac_address': 'fa:16:3e:9a:dc:e1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd2ed6ef9-f77a-4b7a-b152-3e1b9c85e1ad', 'device_owner': 'network:router_interface', 'standard_attr_id': 319, 'fixed_ips': [{'subnet_id': '6e6b5897-e23d-4281-96cb-a6fdf9b68134', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790492-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:00:21Z', 'updated_at': '2021-05-25T17:00:33Z', 'revision_number': 5, 'project_id': 'bbb9e99759bc47d08005f3b1e036a6cf', 'subnets': [{'id': '6e6b5897-e23d-4281-96cb-a6fdf9b68134', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=91832) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 25 17:01:03.453282 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2b5ef973-f263-43e9-9a64-5b6f76ba3163 req-6133de40-d5be-41ba-a380-5ae1c823e2ab tempest-VolumesSnapshotTestJSON-991813121 tempest-VolumesSnapshotTestJSON-991813121-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:01:03.455395 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-2b5ef973-f263-43e9-9a64-5b6f76ba3163 req-6133de40-d5be-41ba-a380-5ae1c823e2ab tempest-VolumesSnapshotTestJSON-991813121 tempest-VolumesSnapshotTestJSON-991813121-project] 10.222.0.62 "GET /v2.0/ports?device_id=5cf3f093-ba27-473b-93f8-52a5bb9d9ec8 HTTP/1.1" status: 200 len: 943 time: 0.0869253 May 25 17:01:03.515107 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-2b5ef973-f263-43e9-9a64-5b6f76ba3163 req-78e4df1f-bc97-40cd-9446-abe2574c10b0 tempest-VolumesSnapshotTestJSON-991813121 tempest-VolumesSnapshotTestJSON-991813121-project] 10.222.0.62 "GET /v2.0/security-groups?id=b5f47757-8dd4-4226-9a13-ca15ee498213&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0494854 May 25 17:01:03.560185 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-00c74256-8dd3-4d3f-9d0a-e3de2ea1d304 None None] New status for floating IP efd05916-23a4-4ee0-a108-18fa80681716: ACTIVE {{(pid=91831) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} May 25 17:01:04.183874 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-9dc33caf-59c2-453f-b6af-1f9a4d3ead7b req-ba03fe1a-afd0-47b0-8c7a-53c38767f346 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] 10.222.0.62 "GET /v2.0/ports?device_id=6b63b4a6-5261-4e1c-b796-2f153fc24933 HTTP/1.1" status: 200 len: 210 time: 0.0439308 May 25 17:01:04.348488 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:01:04.462498 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-882da4ec-14ff-4359-bd58-e89a52ceb266 req-adac953e-2f4d-4e57-a851-2914c3001581 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:01:04.463928 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-882da4ec-14ff-4359-bd58-e89a52ceb266 req-adac953e-2f4d-4e57-a851-2914c3001581 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/ports?device_id=58da9205-0212-4daa-996c-1eef64a2b702 HTTP/1.1" status: 200 len: 945 time: 0.0799730 May 25 17:01:04.513778 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-882da4ec-14ff-4359-bd58-e89a52ceb266 req-a40065f6-7a28-4701-957b-d53077ead2cb tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/security-groups?id=8ee5c4ed-9c60-4e39-9185-7e283704a7dc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0436871 May 25 17:01:04.746526 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-8f9daa87-e977-45a8-beab-dd89ed0bcdbb req-e4e3b63b-14bb-413d-b584-2523ae510dd8 service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=60078444-24b6-4560-b0a7-7802c4f8f2f8 HTTP/1.1" status: 200 len: 217 time: 0.0815842 May 25 17:01:04.769632 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e944caea-1f9d-4794-9ec0-dd8bfe89967a req-44d6a2bd-23f9-4fc4-b2dd-a49b501df6a6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91830) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:01:04.771676 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-e944caea-1f9d-4794-9ec0-dd8bfe89967a req-44d6a2bd-23f9-4fc4-b2dd-a49b501df6a6 service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=bbb9e99759bc47d08005f3b1e036a6cf&device_id=3ead96ee-e427-4e87-9879-a1cdf303f894 HTTP/1.1" status: 200 len: 1099 time: 0.0863750 May 25 17:01:04.825041 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9abfaf58-aac1-4cd9-accc-6ea5db9fa212 req-19993f40-49e0-4a28-babd-557ea0984d10 tempest-VolumesSnapshotTestJSON-991813121 tempest-VolumesSnapshotTestJSON-991813121-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:01:04.828380 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-9abfaf58-aac1-4cd9-accc-6ea5db9fa212 req-19993f40-49e0-4a28-babd-557ea0984d10 tempest-VolumesSnapshotTestJSON-991813121 tempest-VolumesSnapshotTestJSON-991813121-project] 10.222.0.62 "GET /v2.0/ports?device_id=5cf3f093-ba27-473b-93f8-52a5bb9d9ec8 HTTP/1.1" status: 200 len: 943 time: 0.2065473 May 25 17:01:04.837155 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8f9daa87-e977-45a8-beab-dd89ed0bcdbb req-45334cfc-6524-491b-bb6c-a1277595375b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:01:04.840193 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-8f9daa87-e977-45a8-beab-dd89ed0bcdbb req-45334cfc-6524-491b-bb6c-a1277595375b service neutron] 10.222.0.32 "GET /v2.0/subnets?id=927bd65a-c4de-491b-b501-302852f4c784 HTTP/1.1" status: 200 len: 858 time: 0.0866373 May 25 17:01:04.917616 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-8f9daa87-e977-45a8-beab-dd89ed0bcdbb req-7812386c-bde1-4bfd-bddc-31519f1cd6c2 service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=55a46372-d583-4435-a0f6-b9397668217d&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0579922 May 25 17:01:04.939707 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-9abfaf58-aac1-4cd9-accc-6ea5db9fa212 req-d749a9c4-df76-448a-8513-5482705cdab0 tempest-VolumesSnapshotTestJSON-991813121 tempest-VolumesSnapshotTestJSON-991813121-project] 10.222.0.62 "GET /v2.0/security-groups?id=b5f47757-8dd4-4226-9a13-ca15ee498213&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0983748 May 25 17:01:05.040638 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e944caea-1f9d-4794-9ec0-dd8bfe89967a req-90ffdbb7-fbe3-4c08-811a-d6107a67717d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91830) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:01:05.042102 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-e944caea-1f9d-4794-9ec0-dd8bfe89967a req-90ffdbb7-fbe3-4c08-811a-d6107a67717d service neutron] 10.222.0.32 "GET /v2.0/networks?id=e5be4c6a-143f-474c-a90b-37180778cefe HTTP/1.1" status: 200 len: 917 time: 0.2639053 May 25 17:01:05.108486 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-8f9daa87-e977-45a8-beab-dd89ed0bcdbb req-d86d734d-81f2-4fb9-84c4-04b7854ecc13 service neutron] 10.222.0.32 "GET /v2.0/networks/55a46372-d583-4435-a0f6-b9397668217d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1366851 May 25 17:01:05.151137 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-e944caea-1f9d-4794-9ec0-dd8bfe89967a req-670c6367-d9a5-439a-84a0-08a99cd02ba9 service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=b7d643d2-c7f2-4e49-8125-5c5ec0b9d463 HTTP/1.1" status: 200 len: 1002 time: 0.0995271 May 25 17:01:05.224810 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e944caea-1f9d-4794-9ec0-dd8bfe89967a req-cedc1811-c6bb-4b3c-b3e1-089a02378e1f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91830) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:01:05.227558 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-e944caea-1f9d-4794-9ec0-dd8bfe89967a req-cedc1811-c6bb-4b3c-b3e1-089a02378e1f service neutron] 10.222.0.32 "GET /v2.0/subnets?id=6e6b5897-e23d-4281-96cb-a6fdf9b68134 HTTP/1.1" status: 200 len: 855 time: 0.0668774 May 25 17:01:05.248594 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-8f9daa87-e977-45a8-beab-dd89ed0bcdbb req-fffa01e4-eafe-4dd6-95e4-e59a2c41ce4a service neutron] 10.222.0.32 "GET /v2.0/networks/55a46372-d583-4435-a0f6-b9397668217d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1300287 May 25 17:01:05.320139 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e944caea-1f9d-4794-9ec0-dd8bfe89967a req-3a1e216d-f071-4c24-8796-2130286efc80 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91830) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:01:05.321876 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-e944caea-1f9d-4794-9ec0-dd8bfe89967a req-3a1e216d-f071-4c24-8796-2130286efc80 service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=e5be4c6a-143f-474c-a90b-37180778cefe&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0837185 May 25 17:01:05.363157 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-be01901f-4862-408e-b9b9-298ffd1c0906 req-93784801-f541-4a21-8209-37b5f3291b1e tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] 10.222.0.62 "GET /v2.0/ports?device_id=6b63b4a6-5261-4e1c-b796-2f153fc24933 HTTP/1.1" status: 200 len: 210 time: 0.0440855 May 25 17:01:05.479706 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-e944caea-1f9d-4794-9ec0-dd8bfe89967a req-fb2027c1-111d-4384-af72-1e17e90025ed service neutron] 10.222.0.32 "GET /v2.0/networks/e5be4c6a-143f-474c-a90b-37180778cefe?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1442866 May 25 17:01:05.641266 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-e944caea-1f9d-4794-9ec0-dd8bfe89967a req-937444b7-05bc-4828-b178-8df04cd56edc service neutron] 10.222.0.32 "GET /v2.0/networks/e5be4c6a-143f-474c-a90b-37180778cefe?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1456091 May 25 17:01:05.717438 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e4805f5d-9ef3-4ebb-9e0f-fe2f9078f759 req-03bf0e5d-8311-4e2c-a114-7d92842c524b tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:01:05.718937 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-e4805f5d-9ef3-4ebb-9e0f-fe2f9078f759 req-03bf0e5d-8311-4e2c-a114-7d92842c524b tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/ports?device_id=58da9205-0212-4daa-996c-1eef64a2b702 HTTP/1.1" status: 200 len: 945 time: 0.0849297 May 25 17:01:05.826731 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-e4805f5d-9ef3-4ebb-9e0f-fe2f9078f759 req-6c080607-f660-49b1-a75f-152abd72efdb tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/security-groups?id=8ee5c4ed-9c60-4e39-9185-7e283704a7dc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0999022 May 25 17:01:05.922931 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-66e5af5c-7587-4a75-851d-fc8cd997c555 req-fb458841-f3d8-444f-b276-3ff4d6a24a1a tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=91830) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:01:05.926226 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-66e5af5c-7587-4a75-851d-fc8cd997c555 req-fb458841-f3d8-444f-b276-3ff4d6a24a1a tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] 10.222.0.32 "GET /v2.0/networks?id=63b1f335-e2c4-48dd-886b-6be853f8a2fc HTTP/1.1" status: 200 len: 814 time: 0.2151873 May 25 17:01:05.947748 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.v2.base [req-66e5af5c-7587-4a75-851d-fc8cd997c555 req-67017922-b505-4256-88eb-f408cf63dc10 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] Request body: {'port': {'device_id': '6b63b4a6-5261-4e1c-b796-2f153fc24933', 'network_id': '63b1f335-e2c4-48dd-886b-6be853f8a2fc', 'admin_state_up': True, 'tenant_id': '04e8022f24e3464ab1ab7726d6a07e08'}} {{(pid=91830) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 17:01:06.129041 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.quota.driver [req-66e5af5c-7587-4a75-851d-fc8cd997c555 req-67017922-b505-4256-88eb-f408cf63dc10 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91830) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 17:01:06.133145 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [req-66e5af5c-7587-4a75-851d-fc8cd997c555 req-67017922-b505-4256-88eb-f408cf63dc10 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] Usage tracker for resource:port and tenant:04e8022f24e3464ab1ab7726d6a07e08 is out of sync, need to count used quota {{(pid=91830) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 17:01:06.136460 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [req-66e5af5c-7587-4a75-851d-fc8cd997c555 req-67017922-b505-4256-88eb-f408cf63dc10 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] Quota usage for port was recalculated. Used quota:2. {{(pid=91830) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 17:01:06.142985 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.quota.driver [req-66e5af5c-7587-4a75-851d-fc8cd997c555 req-67017922-b505-4256-88eb-f408cf63dc10 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] Attempting to reserve 1 items for resource port. Total usage: 2; quota limit: 500; headroom:498 {{(pid=91830) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 17:01:06.154252 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-66e5af5c-7587-4a75-851d-fc8cd997c555 req-67017922-b505-4256-88eb-f408cf63dc10 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] Made reservation on behalf of 04e8022f24e3464ab1ab7726d6a07e08 for: {'port': 1} {{(pid=91830) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 25 17:01:06.158457 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [req-66e5af5c-7587-4a75-851d-fc8cd997c555 req-67017922-b505-4256-88eb-f408cf63dc10 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3832070'] for port, before_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:01:06.247579 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6c932350-3ad1-4b75-b77f-ab86c2fb0560 req-25a003c6-a549-4948-a9ce-9cff55250253 tempest-VolumesSnapshotTestJSON-991813121 tempest-VolumesSnapshotTestJSON-991813121-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:01:06.249260 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-6c932350-3ad1-4b75-b77f-ab86c2fb0560 req-25a003c6-a549-4948-a9ce-9cff55250253 tempest-VolumesSnapshotTestJSON-991813121 tempest-VolumesSnapshotTestJSON-991813121-project] 10.222.0.62 "GET /v2.0/ports?device_id=5cf3f093-ba27-473b-93f8-52a5bb9d9ec8 HTTP/1.1" status: 200 len: 943 time: 0.1062534 May 25 17:01:06.344832 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-6c932350-3ad1-4b75-b77f-ab86c2fb0560 req-aacb6a08-726a-425c-98f5-61dd0df8cd3f tempest-VolumesSnapshotTestJSON-991813121 tempest-VolumesSnapshotTestJSON-991813121-project] 10.222.0.62 "GET /v2.0/security-groups?id=b5f47757-8dd4-4226-9a13-ca15ee498213&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0887022 May 25 17:01:06.391982 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.db_base_plugin_common [req-66e5af5c-7587-4a75-851d-fc8cd997c555 req-67017922-b505-4256-88eb-f408cf63dc10 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] Allocated IP 172.20.0.9 (63b1f335-e2c4-48dd-886b-6be853f8a2fc/b0baa944-cafe-48a4-861a-dae28947b9f0/85443de0-772c-4d18-bd76-026a72cc754d) {{(pid=91830) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 25 17:01:06.522197 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-ad42ba04-7654-4ce6-92f1-01f636f38056 req-f03b0155-d690-4b37-ac76-d7f3997374b1 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] 10.222.0.62 "GET /v2.0/ports?device_id=6b63b4a6-5261-4e1c-b796-2f153fc24933 HTTP/1.1" status: 200 len: 210 time: 0.0461271 May 25 17:01:06.595232 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [req-66e5af5c-7587-4a75-851d-fc8cd997c555 req-67017922-b505-4256-88eb-f408cf63dc10 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] Notify callbacks [] for port, precommit_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:01:06.622882 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [req-66e5af5c-7587-4a75-851d-fc8cd997c555 req-67017922-b505-4256-88eb-f408cf63dc10 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8757892520915', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-27483019'] for port, after_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:01:06.628853 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:01:06.638027 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.db [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] get_ports_and_sgs() called for port_ids ['c4b9c0f2-e3d5-4fff-9b3c-a9175b027fb5', '46a1adbe-ec54-4c57-aa7a-9f257475e01c'] {{(pid=91831) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 25 17:01:06.698104 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-66e5af5c-7587-4a75-851d-fc8cd997c555 req-67017922-b505-4256-88eb-f408cf63dc10 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] Network 63b1f335-e2c4-48dd-886b-6be853f8a2fc is already hosted by enough agents. {{(pid=91830) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 25 17:01:06.701163 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.scheduler.base_scheduler [req-66e5af5c-7587-4a75-851d-fc8cd997c555 req-67017922-b505-4256-88eb-f408cf63dc10 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] Resources bound (agent type, host, resource id): {{(pid=91830) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 17:01:06.705352 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.l3_dvrscheduler_db [req-66e5af5c-7587-4a75-851d-fc8cd997c555 req-67017922-b505-4256-88eb-f408cf63dc10 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] Received port after_create {{(pid=91830) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 25 17:01:06.745293 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-67017922-b505-4256-88eb-f408cf63dc10 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] Pushing event updated for resources: {'Port': ['ID=85443de0-772c-4d18-bd76-026a72cc754d,revision_number=1']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:01:06.753775 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-67017922-b505-4256-88eb-f408cf63dc10 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.125s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:01:06.775759 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-66e5af5c-7587-4a75-851d-fc8cd997c555 req-67017922-b505-4256-88eb-f408cf63dc10 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=91830) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:01:06.776368 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [req-66e5af5c-7587-4a75-851d-fc8cd997c555 req-67017922-b505-4256-88eb-f408cf63dc10 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-178712'] for port, before_response {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:01:06.798610 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-66e5af5c-7587-4a75-851d-fc8cd997c555 req-67017922-b505-4256-88eb-f408cf63dc10 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] 10.222.0.32 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.8548844 May 25 17:01:06.812747 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.v2.base [req-66e5af5c-7587-4a75-851d-fc8cd997c555 req-a9d836cc-ec3c-4b3d-b2bd-b702e99b20ad service neutron] Request body: {'port': {'device_id': '6b63b4a6-5261-4e1c-b796-2f153fc24933', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-79049'}} {{(pid=91830) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 17:01:06.939046 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [req-66e5af5c-7587-4a75-851d-fc8cd997c555 req-a9d836cc-ec3c-4b3d-b2bd-b702e99b20ad service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3832070'] for port, before_update {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:01:07.174477 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-320fa552-3fad-47e4-bafe-76800fd64ab0 req-845b498e-de92-4819-822d-4445b6c4a87a tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:01:07.175974 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-320fa552-3fad-47e4-bafe-76800fd64ab0 req-845b498e-de92-4819-822d-4445b6c4a87a tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/ports?device_id=58da9205-0212-4daa-996c-1eef64a2b702 HTTP/1.1" status: 200 len: 945 time: 0.1778276 May 25 17:01:07.236342 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-320fa552-3fad-47e4-bafe-76800fd64ab0 req-251efac4-d372-4005-8f34-bfa98edfad4f tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/security-groups?id=8ee5c4ed-9c60-4e39-9185-7e283704a7dc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0533056 May 25 17:01:07.267223 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.wsgi [-] (91829) accepted ('10.222.0.62', 60026) {{(pid=91829) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:01:07.297043 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.rpc [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Device 041fa5ca-9be5-4356-af06-2fe633a19ad8 details requested by agent hyperv_hv-cinder-79049 with host hv-cinder-79049 {{(pid=91831) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 25 17:01:07.422309 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.notifiers.nova [req-66e5af5c-7587-4a75-851d-fc8cd997c555 req-a9d836cc-ec3c-4b3d-b2bd-b702e99b20ad service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 85443de0-772c-4d18-bd76-026a72cc754d {{(pid=91830) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} May 25 17:01:07.430592 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [req-66e5af5c-7587-4a75-851d-fc8cd997c555 req-a9d836cc-ec3c-4b3d-b2bd-b702e99b20ad service neutron] Notify callbacks [] for port, precommit_update {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:01:07.452230 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.provisioning_blocks [req-66e5af5c-7587-4a75-851d-fc8cd997c555 req-a9d836cc-ec3c-4b3d-b2bd-b702e99b20ad service neutron] Transition to ACTIVE for port object 85443de0-772c-4d18-bd76-026a72cc754d will not be triggered until provisioned by entity L2. {{(pid=91830) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 25 17:01:07.457862 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [req-66e5af5c-7587-4a75-851d-fc8cd997c555 req-a9d836cc-ec3c-4b3d-b2bd-b702e99b20ad service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8757892955028', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8757892520933', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8757892521750', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-27483010'] for port, after_update {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:01:07.463497 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.db [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] For port 041fa5ca-9be5-4356-af06-2fe633a19ad8, host hv-cinder-79049, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79049',level=0,port_id=041fa5ca-9be5-4356-af06-2fe633a19ad8,segment=NetworkSegment(bba065e2-1e75-4ab9-bc0e-e3037ef57277),segment_id=bba065e2-1e75-4ab9-bc0e-e3037ef57277)] {{(pid=91831) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 17:01:07.470398 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-67017922-b505-4256-88eb-f408cf63dc10 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:01:07.481794 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.rpc [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Returning: {'device': '041fa5ca-9be5-4356-af06-2fe633a19ad8', 'network_id': 'c8b64023-a7f5-4c0f-847b-8a8aef981caa', 'port_id': '041fa5ca-9be5-4356-af06-2fe633a19ad8', 'mac_address': 'fa:16:3e:91:85:6f', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 654, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'e21793ea-1820-4ec5-b3fc-a7d9b7129124', 'ip_address': '172.20.0.5'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=91831) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 25 17:01:07.548003 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3832070'] for port, before_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:01:07.572114 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.notifiers.nova [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 041fa5ca-9be5-4356-af06-2fe633a19ad8 {{(pid=91831) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} May 25 17:01:07.590757 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.db [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] For port 041fa5ca-9be5-4356-af06-2fe633a19ad8, host hv-cinder-79049, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79049',level=0,port_id=041fa5ca-9be5-4356-af06-2fe633a19ad8,segment=NetworkSegment(bba065e2-1e75-4ab9-bc0e-e3037ef57277),segment_id=bba065e2-1e75-4ab9-bc0e-e3037ef57277)] {{(pid=91831) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 17:01:07.596825 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8757892955028', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8757892520933', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8757892521750'] for port, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:01:07.601491 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:01:07.684335 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.wsgi [-] (91829) accepted ('10.222.0.62', 60046) {{(pid=91829) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:01:07.717045 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Pushing event updated for resources: {'Port': ['ID=041fa5ca-9be5-4356-af06-2fe633a19ad8,revision_number=4']} {{(pid=91831) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:01:07.728095 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.128s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:01:07.754865 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2ac5d517-2247-4fae-95c6-63c39804511a req-941a2f1c-e729-4b4c-aa8b-9e44041e4574 tempest-VolumesSnapshotTestJSON-991813121 tempest-VolumesSnapshotTestJSON-991813121-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:01:07.762948 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-2ac5d517-2247-4fae-95c6-63c39804511a req-941a2f1c-e729-4b4c-aa8b-9e44041e4574 tempest-VolumesSnapshotTestJSON-991813121 tempest-VolumesSnapshotTestJSON-991813121-project] 10.222.0.62 "GET /v2.0/ports?device_id=5cf3f093-ba27-473b-93f8-52a5bb9d9ec8 HTTP/1.1" status: 200 len: 944 time: 0.1722472 May 25 17:01:07.787074 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a9d836cc-ec3c-4b3d-b2bd-b702e99b20ad service neutron] Pushing event updated for resources: {'Port': ['ID=85443de0-772c-4d18-bd76-026a72cc754d,revision_number=2']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:01:07.828940 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-a9d836cc-ec3c-4b3d-b2bd-b702e99b20ad service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.358s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:01:07.837126 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-0540448c-ca73-410f-8033-9d8f32ca0998 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:01:07.854565 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-0215f3dc-e834-44f6-974b-9d21b5cc3ae0 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:01:07.872026 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-2ac5d517-2247-4fae-95c6-63c39804511a req-97e06746-e405-412a-ae34-c6c462d3c48e tempest-VolumesSnapshotTestJSON-991813121 tempest-VolumesSnapshotTestJSON-991813121-project] 10.222.0.62 "GET /v2.0/security-groups?id=b5f47757-8dd4-4226-9a13-ca15ee498213&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1075375 May 25 17:01:07.873226 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.quota.driver [None req-0540448c-ca73-410f-8033-9d8f32ca0998 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91829) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 17:01:07.876176 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.plugins.ml2.managers [req-66e5af5c-7587-4a75-851d-fc8cd997c555 req-a9d836cc-ec3c-4b3d-b2bd-b702e99b20ad service neutron] Attempting to bind port 85443de0-772c-4d18-bd76-026a72cc754d on host hv-cinder-79049 for vnic_type normal with profile {{(pid=91830) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 25 17:01:07.876514 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.plugins.ml2.managers [req-66e5af5c-7587-4a75-851d-fc8cd997c555 req-a9d836cc-ec3c-4b3d-b2bd-b702e99b20ad service neutron] Attempting to bind port 85443de0-772c-4d18-bd76-026a72cc754d by drivers openvswitch,hyperv on host hv-cinder-79049 at level 0 using segments [{'id': '7d7273c2-c6dd-43fe-83a8-cb776d48dc70', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 651, 'network_id': '63b1f335-e2c4-48dd-886b-6be853f8a2fc'}] {{(pid=91830) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 25 17:01:07.876872 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-66e5af5c-7587-4a75-851d-fc8cd997c555 req-a9d836cc-ec3c-4b3d-b2bd-b702e99b20ad service neutron] Attempting to bind port 85443de0-772c-4d18-bd76-026a72cc754d on network 63b1f335-e2c4-48dd-886b-6be853f8a2fc {{(pid=91830) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 25 17:01:07.879029 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.quota.driver [None req-0215f3dc-e834-44f6-974b-9d21b5cc3ae0 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91829) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 17:01:07.882350 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-66e5af5c-7587-4a75-851d-fc8cd997c555 req-a9d836cc-ec3c-4b3d-b2bd-b702e99b20ad service neutron] Port 85443de0-772c-4d18-bd76-026a72cc754d on network 63b1f335-e2c4-48dd-886b-6be853f8a2fc not bound, no agent of type Open vSwitch agent registered on host hv-cinder-79049 {{(pid=91830) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 25 17:01:07.882667 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-66e5af5c-7587-4a75-851d-fc8cd997c555 req-a9d836cc-ec3c-4b3d-b2bd-b702e99b20ad service neutron] Attempting to bind port 85443de0-772c-4d18-bd76-026a72cc754d on network 63b1f335-e2c4-48dd-886b-6be853f8a2fc {{(pid=91830) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 25 17:01:07.883792 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.quota.resource [None req-0215f3dc-e834-44f6-974b-9d21b5cc3ae0 admin admin] Usage tracker for resource:security_group_rule and tenant:2b6cd0a8437d45988c2d6a4d5a501b7b is out of sync, need to count used quota {{(pid=91829) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 17:01:07.886624 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.quota.resource [None req-0540448c-ca73-410f-8033-9d8f32ca0998 admin admin] Usage tracker for resource:security_group_rule and tenant:4f2a729521b64ef7905e3265dcd2c28c is out of sync, need to count used quota {{(pid=91829) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 17:01:07.889639 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-66e5af5c-7587-4a75-851d-fc8cd997c555 req-a9d836cc-ec3c-4b3d-b2bd-b702e99b20ad service neutron] Checking agent: {'id': '3a1fdee1-bff0-49fb-b470-e13b95ee1b4d', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-79049', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 25, 16, 56, 32), 'started_at': datetime.datetime(2021, 5, 25, 16, 56, 32), 'heartbeat_timestamp': datetime.datetime(2021, 5, 25, 17, 1, 4), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=91830) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 25 17:01:07.889806 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.quota.resource [None req-0215f3dc-e834-44f6-974b-9d21b5cc3ae0 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91829) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 17:01:07.890165 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-66e5af5c-7587-4a75-851d-fc8cd997c555 req-a9d836cc-ec3c-4b3d-b2bd-b702e99b20ad service neutron] Checking segment: {'id': '7d7273c2-c6dd-43fe-83a8-cb776d48dc70', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 651, 'network_id': '63b1f335-e2c4-48dd-886b-6be853f8a2fc'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91830) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 25 17:01:07.890565 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-66e5af5c-7587-4a75-851d-fc8cd997c555 req-a9d836cc-ec3c-4b3d-b2bd-b702e99b20ad service neutron] Bound using segment: {'id': '7d7273c2-c6dd-43fe-83a8-cb776d48dc70', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 651, 'network_id': '63b1f335-e2c4-48dd-886b-6be853f8a2fc'} {{(pid=91830) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 25 17:01:07.899439 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.plugins.ml2.managers [req-66e5af5c-7587-4a75-851d-fc8cd997c555 req-a9d836cc-ec3c-4b3d-b2bd-b702e99b20ad service neutron] Bound port: 85443de0-772c-4d18-bd76-026a72cc754d, host: hv-cinder-79049, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '7d7273c2-c6dd-43fe-83a8-cb776d48dc70', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 651, 'network_id': '63b1f335-e2c4-48dd-886b-6be853f8a2fc'}}] {{(pid=91830) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 25 17:01:07.899439 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [req-66e5af5c-7587-4a75-851d-fc8cd997c555 req-a9d836cc-ec3c-4b3d-b2bd-b702e99b20ad service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3832070'] for port, before_update {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:01:07.899714 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.quota.resource [None req-0540448c-ca73-410f-8033-9d8f32ca0998 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91829) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 17:01:07.943621 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.quota.driver [None req-0540448c-ca73-410f-8033-9d8f32ca0998 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91829) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 17:01:07.945747 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.quota.driver [None req-0215f3dc-e834-44f6-974b-9d21b5cc3ae0 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91829) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 17:01:07.989446 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.plugins.ml2.db [req-66e5af5c-7587-4a75-851d-fc8cd997c555 req-a9d836cc-ec3c-4b3d-b2bd-b702e99b20ad service neutron] For port 85443de0-772c-4d18-bd76-026a72cc754d, host hv-cinder-79049, cleared binding levels {{(pid=91830) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 25 17:01:07.993324 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.plugins.ml2.db [req-66e5af5c-7587-4a75-851d-fc8cd997c555 req-a9d836cc-ec3c-4b3d-b2bd-b702e99b20ad service neutron] For port 85443de0-772c-4d18-bd76-026a72cc754d, host hv-cinder-79049, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79049',level=0,port_id=85443de0-772c-4d18-bd76-026a72cc754d,segment=NetworkSegment(7d7273c2-c6dd-43fe-83a8-cb776d48dc70),segment_id=7d7273c2-c6dd-43fe-83a8-cb776d48dc70)] {{(pid=91830) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 25 17:01:07.999369 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [req-66e5af5c-7587-4a75-851d-fc8cd997c555 req-a9d836cc-ec3c-4b3d-b2bd-b702e99b20ad service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8757892955028', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8757892520933', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8757892521750', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-27483010'] for port, after_update {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:01:08.004828 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:01:08.058215 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ae942f66-8c39-483b-9c04-7a5e6950051c req-9d0d22f4-3487-488d-bade-4fbc308972c5 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:01:08.059867 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-ae942f66-8c39-483b-9c04-7a5e6950051c req-9d0d22f4-3487-488d-bade-4fbc308972c5 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] 10.222.0.62 "GET /v2.0/ports?device_id=6b63b4a6-5261-4e1c-b796-2f153fc24933 HTTP/1.1" status: 200 len: 943 time: 0.1635115 May 25 17:01:08.069133 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-66e5af5c-7587-4a75-851d-fc8cd997c555 req-a9d836cc-ec3c-4b3d-b2bd-b702e99b20ad service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91830) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:01:08.070434 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [req-66e5af5c-7587-4a75-851d-fc8cd997c555 req-a9d836cc-ec3c-4b3d-b2bd-b702e99b20ad service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-178712'] for port, before_response {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:01:08.072453 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-66e5af5c-7587-4a75-851d-fc8cd997c555 req-a9d836cc-ec3c-4b3d-b2bd-b702e99b20ad service neutron] 10.222.0.32 "PUT /v2.0/ports/85443de0-772c-4d18-bd76-026a72cc754d HTTP/1.1" status: 200 len: 1093 time: 1.2642915 May 25 17:01:08.075764 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '6b63b4a6-5261-4e1c-b796-2f153fc24933', 'tag': '85443de0-772c-4d18-bd76-026a72cc754d'}] {{(pid=91830) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 25 17:01:08.109761 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a9d836cc-ec3c-4b3d-b2bd-b702e99b20ad service neutron] Pushing event updated for resources: {'Port': ['ID=85443de0-772c-4d18-bd76-026a72cc754d,revision_number=3']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:01:08.112881 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-a9d836cc-ec3c-4b3d-b2bd-b702e99b20ad service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.108s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:01:08.163241 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '6b63b4a6-5261-4e1c-b796-2f153fc24933', 'tag': '85443de0-772c-4d18-bd76-026a72cc754d', 'status': 'completed', 'code': 200} May 25 17:01:08.193220 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-ae942f66-8c39-483b-9c04-7a5e6950051c req-a148afd9-12b6-492a-b9da-121ef26503ee tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] 10.222.0.62 "GET /v2.0/security-groups?id=f73b90a2-df48-48fb-99e0-5dd4d6a63a15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1138055 May 25 17:01:08.198389 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-66e5af5c-7587-4a75-851d-fc8cd997c555 req-29727d70-719a-407f-a809-8416152d6901 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91830) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:01:08.199593 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-0215f3dc-e834-44f6-974b-9d21b5cc3ae0 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:01:08.199896 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-66e5af5c-7587-4a75-851d-fc8cd997c555 req-29727d70-719a-407f-a809-8416152d6901 service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=04e8022f24e3464ab1ab7726d6a07e08&device_id=6b63b4a6-5261-4e1c-b796-2f153fc24933 HTTP/1.1" status: 200 len: 1096 time: 0.0805609 May 25 17:01:08.209923 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-0540448c-ca73-410f-8033-9d8f32ca0998 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:01:08.211230 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-0215f3dc-e834-44f6-974b-9d21b5cc3ae0 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-640836'] for security_group, after_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:01:08.218581 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-3a7f6ee1-08e8-4089-906d-660c3d17b3aa admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:01:08.228140 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-0540448c-ca73-410f-8033-9d8f32ca0998 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-640836'] for security_group, after_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:01:08.280330 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-66e5af5c-7587-4a75-851d-fc8cd997c555 req-84be73e7-d869-47b8-9675-7c6253930a7c service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=85443de0-772c-4d18-bd76-026a72cc754d HTTP/1.1" status: 200 len: 217 time: 0.0655389 May 25 17:01:08.284111 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [None req-0215f3dc-e834-44f6-974b-9d21b5cc3ae0 admin admin] 10.222.0.62 "GET /v2.0/security-groups?tenant_id=2b6cd0a8437d45988c2d6a4d5a501b7b&name=default HTTP/1.1" status: 200 len: 2979 time: 0.5926409 May 25 17:01:08.286488 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.wsgi [-] (91830) accepted ('10.222.0.62', 60062) {{(pid=91830) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:01:08.289112 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [None req-0540448c-ca73-410f-8033-9d8f32ca0998 admin admin] 10.222.0.62 "GET /v2.0/security-groups?tenant_id=4f2a729521b64ef7905e3265dcd2c28c&name=default HTTP/1.1" status: 200 len: 2979 time: 1.0203767 May 25 17:01:08.290437 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.wsgi [-] (91829) accepted ('10.222.0.62', 60066) {{(pid=91829) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:01:08.293210 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0215f3dc-e834-44f6-974b-9d21b5cc3ae0 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=46dcc393-0b71-425b-a192-c143a68fc691,revision_number=1']} {{(pid=91829) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:01:08.304950 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-0215f3dc-e834-44f6-974b-9d21b5cc3ae0 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.086s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:01:08.306964 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-fea52170-8718-4a27-91f2-bef73a6eb572 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.067s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:01:08.346114 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.db [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] get_ports_and_sgs() called for port_ids ['041fa5ca-9be5-4356-af06-2fe633a19ad8'] {{(pid=91831) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 25 17:01:08.362921 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-66e5af5c-7587-4a75-851d-fc8cd997c555 req-efc70a87-7781-432f-8667-f17eb29a753c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91830) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:01:08.365372 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-66e5af5c-7587-4a75-851d-fc8cd997c555 req-efc70a87-7781-432f-8667-f17eb29a753c service neutron] 10.222.0.32 "GET /v2.0/subnets?id=b0baa944-cafe-48a4-861a-dae28947b9f0 HTTP/1.1" status: 200 len: 854 time: 0.0633144 May 25 17:01:08.396880 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0540448c-ca73-410f-8033-9d8f32ca0998 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=53c11b6b-6b3d-4a65-bfe0-9d5059814bf4,revision_number=1']} {{(pid=91829) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:01:08.407680 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-0540448c-ca73-410f-8033-9d8f32ca0998 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.100s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:01:08.422813 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-66e5af5c-7587-4a75-851d-fc8cd997c555 req-e603e2ac-4a6c-427b-8515-043435873c5e service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=63b1f335-e2c4-48dd-886b-6be853f8a2fc&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0492759 May 25 17:01:08.445383 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-b0e6d757-de57-43f9-9c63-7660174ef724 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:01:08.478183 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-b0e6d757-de57-43f9-9c63-7660174ef724 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:01:08.524987 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1ac498ef-248a-4011-8cd2-30426b9fdb9c req-a3b223c7-ad91-4a78-abc2-a163d80a9315 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:01:08.525204 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-635d8fdb-df1a-43da-af11-7ddcc1ea0533 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:01:08.526476 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-1ac498ef-248a-4011-8cd2-30426b9fdb9c req-a3b223c7-ad91-4a78-abc2-a163d80a9315 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/ports?device_id=58da9205-0212-4daa-996c-1eef64a2b702 HTTP/1.1" status: 200 len: 945 time: 0.1775243 May 25 17:01:08.568497 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-b0e6d757-de57-43f9-9c63-7660174ef724 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-640836'] for security_group, after_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:01:08.569781 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-635d8fdb-df1a-43da-af11-7ddcc1ea0533 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:01:08.573590 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-7c6080bb-7653-4688-9e96-96009b8dfbd8 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:01:08.587618 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-1ac498ef-248a-4011-8cd2-30426b9fdb9c req-a69b25bd-2af8-4902-90cd-f9715bb3a436 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/security-groups?id=8ee5c4ed-9c60-4e39-9185-7e283704a7dc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0525117 May 25 17:01:08.590571 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b0e6d757-de57-43f9-9c63-7660174ef724 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=53c11b6b-6b3d-4a65-bfe0-9d5059814bf4,revision_number=None']} {{(pid=91829) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:01:08.595007 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-b0e6d757-de57-43f9-9c63-7660174ef724 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.021s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:01:08.614061 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-b0e6d757-de57-43f9-9c63-7660174ef724 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:01:08.617392 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [None req-b0e6d757-de57-43f9-9c63-7660174ef724 admin admin] 10.222.0.62 "DELETE /v2.0/security-groups/53c11b6b-6b3d-4a65-bfe0-9d5059814bf4 HTTP/1.1" status: 204 len: 168 time: 0.3237672 May 25 17:01:08.639911 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-66e5af5c-7587-4a75-851d-fc8cd997c555 req-606c5a18-af45-4012-9537-834b43cffb45 service neutron] 10.222.0.32 "GET /v2.0/networks/63b1f335-e2c4-48dd-886b-6be853f8a2fc?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2032273 May 25 17:01:08.739404 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-635d8fdb-df1a-43da-af11-7ddcc1ea0533 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-640836'] for security_group, after_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:01:08.746334 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-2a155ba3-d005-4c05-b44a-30613cd639e9 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:01:08.760097 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-635d8fdb-df1a-43da-af11-7ddcc1ea0533 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=46dcc393-0b71-425b-a192-c143a68fc691,revision_number=None']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:01:08.764657 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-635d8fdb-df1a-43da-af11-7ddcc1ea0533 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.018s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:01:08.770011 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-635d8fdb-df1a-43da-af11-7ddcc1ea0533 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:01:08.773348 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [None req-635d8fdb-df1a-43da-af11-7ddcc1ea0533 admin admin] 10.222.0.62 "DELETE /v2.0/security-groups/46dcc393-0b71-425b-a192-c143a68fc691 HTTP/1.1" status: 204 len: 168 time: 0.4835138 May 25 17:01:08.810035 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-66e5af5c-7587-4a75-851d-fc8cd997c555 req-29bd893e-4bc1-43a8-b457-2540a59b04ac service neutron] 10.222.0.32 "GET /v2.0/networks/63b1f335-e2c4-48dd-886b-6be853f8a2fc?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1612408 May 25 17:01:08.975433 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-87c0194e-711d-429d-92ea-6baec1c163eb req-d2fd672c-9eb2-49ef-a4e7-8766a28cb186 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91830) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:01:08.978123 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-87c0194e-711d-429d-92ea-6baec1c163eb req-d2fd672c-9eb2-49ef-a4e7-8766a28cb186 service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=04e8022f24e3464ab1ab7726d6a07e08&device_id=6b63b4a6-5261-4e1c-b796-2f153fc24933 HTTP/1.1" status: 200 len: 1096 time: 0.1097205 May 25 17:01:08.997605 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.wsgi [-] (91829) accepted ('10.222.0.62', 60088) {{(pid=91829) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:01:09.027545 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-6b71dc7b-6a7b-474d-88a8-1f34eddd581a admin admin] Notify callbacks [] for security_group, before_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:01:09.044030 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.quota.driver [None req-6b71dc7b-6a7b-474d-88a8-1f34eddd581a admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91829) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 17:01:09.048834 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.quota.resource [None req-6b71dc7b-6a7b-474d-88a8-1f34eddd581a admin admin] Usage tracker for resource:security_group_rule and tenant:96f6f142061044109425502e1b114be0 is out of sync, need to count used quota {{(pid=91829) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 17:01:09.051881 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.quota.resource [None req-6b71dc7b-6a7b-474d-88a8-1f34eddd581a admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91829) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 17:01:09.058023 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.quota.driver [None req-6b71dc7b-6a7b-474d-88a8-1f34eddd581a admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91829) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 17:01:09.166393 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-87c0194e-711d-429d-92ea-6baec1c163eb req-40b7eb06-fc64-46df-9770-e5b18e1067df service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91830) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:01:09.168839 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-87c0194e-711d-429d-92ea-6baec1c163eb req-40b7eb06-fc64-46df-9770-e5b18e1067df service neutron] 10.222.0.32 "GET /v2.0/networks?id=63b1f335-e2c4-48dd-886b-6be853f8a2fc HTTP/1.1" status: 200 len: 915 time: 0.1774070 May 25 17:01:09.194377 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2be3fa3c-3f62-49e8-ab3c-1fdbbcd7f087 req-927785c7-90a0-4784-8966-c04e56378cdc tempest-VolumesSnapshotTestJSON-991813121 tempest-VolumesSnapshotTestJSON-991813121-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:01:09.196095 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-2be3fa3c-3f62-49e8-ab3c-1fdbbcd7f087 req-927785c7-90a0-4784-8966-c04e56378cdc tempest-VolumesSnapshotTestJSON-991813121 tempest-VolumesSnapshotTestJSON-991813121-project] 10.222.0.62 "GET /v2.0/ports?device_id=5cf3f093-ba27-473b-93f8-52a5bb9d9ec8 HTTP/1.1" status: 200 len: 944 time: 0.1559591 May 25 17:01:09.264745 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-6b71dc7b-6a7b-474d-88a8-1f34eddd581a admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:01:09.272582 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-2be3fa3c-3f62-49e8-ab3c-1fdbbcd7f087 req-4f194079-49ca-42a0-8b23-fe6de4e7a423 tempest-VolumesSnapshotTestJSON-991813121 tempest-VolumesSnapshotTestJSON-991813121-project] 10.222.0.62 "GET /v2.0/security-groups?id=b5f47757-8dd4-4226-9a13-ca15ee498213&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0656946 May 25 17:01:09.273677 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-6b71dc7b-6a7b-474d-88a8-1f34eddd581a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-640836'] for security_group, after_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:01:09.282542 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-b12f583a-485e-41c3-869b-3986b1f921a4 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:01:09.295656 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-87c0194e-711d-429d-92ea-6baec1c163eb req-9903480a-fe05-479d-a4af-e05c21b44bd0 service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=85443de0-772c-4d18-bd76-026a72cc754d HTTP/1.1" status: 200 len: 217 time: 0.1100750 May 25 17:01:09.333737 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6b71dc7b-6a7b-474d-88a8-1f34eddd581a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=9592e6a1-71d2-4e46-ba7c-6c17e8d5bd27,revision_number=1']} {{(pid=91829) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:01:09.349155 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-6b71dc7b-6a7b-474d-88a8-1f34eddd581a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.061s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:01:09.351519 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [None req-6b71dc7b-6a7b-474d-88a8-1f34eddd581a admin admin] 10.222.0.62 "GET /v2.0/security-groups?tenant_id=96f6f142061044109425502e1b114be0&name=default HTTP/1.1" status: 200 len: 2979 time: 0.3528783 May 25 17:01:09.354076 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.wsgi [-] (91829) accepted ('10.222.0.62', 60096) {{(pid=91829) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:01:09.373564 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-87c0194e-711d-429d-92ea-6baec1c163eb req-caef9275-250e-4c53-8372-80120f05821b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91830) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:01:09.375976 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-87c0194e-711d-429d-92ea-6baec1c163eb req-caef9275-250e-4c53-8372-80120f05821b service neutron] 10.222.0.32 "GET /v2.0/subnets?id=b0baa944-cafe-48a4-861a-dae28947b9f0 HTTP/1.1" status: 200 len: 854 time: 0.0725002 May 25 17:01:09.424466 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.wsgi [-] (91829) accepted ('10.222.0.62', 60100) {{(pid=91829) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:01:09.476344 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-dde0790a-a464-4dbc-9b26-14bb74ea3e5e admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:01:09.509643 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-dde0790a-a464-4dbc-9b26-14bb74ea3e5e admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:01:09.524244 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-87c0194e-711d-429d-92ea-6baec1c163eb req-b7c17413-1a6e-4d96-93ca-de3835439787 service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=63b1f335-e2c4-48dd-886b-6be853f8a2fc&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.1400485 May 25 17:01:09.541769 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b6304eaf-da2f-4066-ab2b-c5ce6f572e24 req-3100542d-5cae-46ec-aa21-d3aece5df56c tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:01:09.543243 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-b6304eaf-da2f-4066-ab2b-c5ce6f572e24 req-3100542d-5cae-46ec-aa21-d3aece5df56c tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] 10.222.0.62 "GET /v2.0/ports?device_id=6b63b4a6-5261-4e1c-b796-2f153fc24933 HTTP/1.1" status: 200 len: 943 time: 0.1499722 May 25 17:01:09.588948 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-9ad395c2-b196-45fe-b0e6-d497011ad004 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:01:09.609154 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.quota.driver [None req-9ad395c2-b196-45fe-b0e6-d497011ad004 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91829) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 17:01:09.621233 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.quota.resource [None req-9ad395c2-b196-45fe-b0e6-d497011ad004 admin admin] Usage tracker for resource:security_group_rule and tenant:8f493b705eb74fcb8bbc319189eba98b is out of sync, need to count used quota {{(pid=91829) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 17:01:09.627871 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.quota.resource [None req-9ad395c2-b196-45fe-b0e6-d497011ad004 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91829) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 17:01:09.636738 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.quota.driver [None req-9ad395c2-b196-45fe-b0e6-d497011ad004 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91829) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 17:01:09.643691 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-b6304eaf-da2f-4066-ab2b-c5ce6f572e24 req-38307ac8-1caf-4a2e-a833-d035f505a862 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] 10.222.0.62 "GET /v2.0/security-groups?id=f73b90a2-df48-48fb-99e0-5dd4d6a63a15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0795810 May 25 17:01:09.647073 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-dde0790a-a464-4dbc-9b26-14bb74ea3e5e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-640836'] for security_group, after_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:01:09.654128 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:01:09.666923 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dde0790a-a464-4dbc-9b26-14bb74ea3e5e admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=9592e6a1-71d2-4e46-ba7c-6c17e8d5bd27,revision_number=None']} {{(pid=91829) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:01:09.677403 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-dde0790a-a464-4dbc-9b26-14bb74ea3e5e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.023s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:01:09.683850 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-dde0790a-a464-4dbc-9b26-14bb74ea3e5e admin admin] Notify callbacks [] for security_group, before_response {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:01:09.684986 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [None req-dde0790a-a464-4dbc-9b26-14bb74ea3e5e admin admin] 10.222.0.62 "DELETE /v2.0/security-groups/9592e6a1-71d2-4e46-ba7c-6c17e8d5bd27 HTTP/1.1" status: 204 len: 168 time: 0.3299906 May 25 17:01:09.712201 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-87c0194e-711d-429d-92ea-6baec1c163eb req-825d4c0e-007d-436b-bc17-ff0e34a538bf service neutron] 10.222.0.32 "GET /v2.0/networks/63b1f335-e2c4-48dd-886b-6be853f8a2fc?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1785367 May 25 17:01:09.825269 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-9ad395c2-b196-45fe-b0e6-d497011ad004 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:01:09.866898 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-9ad395c2-b196-45fe-b0e6-d497011ad004 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-640836'] for security_group, after_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:01:09.881694 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-921ab9bd-3a65-426a-99a5-52dfed281460 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:01:09.899864 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-87c0194e-711d-429d-92ea-6baec1c163eb req-cd83fc6b-9e3e-4906-86ad-cf315654163e service neutron] 10.222.0.32 "GET /v2.0/networks/63b1f335-e2c4-48dd-886b-6be853f8a2fc?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1762583 May 25 17:01:09.951893 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.wsgi [-] (91830) accepted ('10.222.0.62', 60114) {{(pid=91830) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:01:09.952109 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [None req-9ad395c2-b196-45fe-b0e6-d497011ad004 admin admin] 10.222.0.62 "GET /v2.0/security-groups?tenant_id=8f493b705eb74fcb8bbc319189eba98b&name=default HTTP/1.1" status: 200 len: 2979 time: 0.5259960 May 25 17:01:09.953832 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9ad395c2-b196-45fe-b0e6-d497011ad004 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=8a84fedf-2fb1-4a64-857d-7ace6f0de015,revision_number=1']} {{(pid=91829) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:01:09.968583 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-9ad395c2-b196-45fe-b0e6-d497011ad004 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.088s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:01:09.989415 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aa389232-5f17-4261-af15-3474c989fa55 req-fdfd35c0-10eb-459f-9ac5-448ef2d0d17f tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:01:09.990938 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-aa389232-5f17-4261-af15-3474c989fa55 req-fdfd35c0-10eb-459f-9ac5-448ef2d0d17f tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/ports?device_id=58da9205-0212-4daa-996c-1eef64a2b702 HTTP/1.1" status: 200 len: 945 time: 0.1635742 May 25 17:01:10.029350 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-579afa2f-f1f6-464b-a0fa-72fc1254622f admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:01:10.048336 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-aa389232-5f17-4261-af15-3474c989fa55 req-9dc352e8-7ccd-4429-a7b3-b814469d7b9d tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/security-groups?id=8ee5c4ed-9c60-4e39-9185-7e283704a7dc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0510833 May 25 17:01:10.059379 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-579afa2f-f1f6-464b-a0fa-72fc1254622f admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:01:10.113550 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-579afa2f-f1f6-464b-a0fa-72fc1254622f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-640836'] for security_group, after_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:01:10.117248 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-744ea5b9-4b62-4151-8bce-dacd54b8d064 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:01:10.130741 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-579afa2f-f1f6-464b-a0fa-72fc1254622f admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=8a84fedf-2fb1-4a64-857d-7ace6f0de015,revision_number=None']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:01:10.133603 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-579afa2f-f1f6-464b-a0fa-72fc1254622f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.016s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:01:10.135530 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-579afa2f-f1f6-464b-a0fa-72fc1254622f admin admin] Notify callbacks [] for security_group, before_response {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:01:10.136618 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [None req-579afa2f-f1f6-464b-a0fa-72fc1254622f admin admin] 10.222.0.62 "DELETE /v2.0/security-groups/8a84fedf-2fb1-4a64-857d-7ace6f0de015 HTTP/1.1" status: 204 len: 168 time: 0.1836522 May 25 17:01:10.493374 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0a71bd0a-baec-42ba-8015-f82f9c3fb30e req-98e71587-39f5-4ea7-b06d-8ffb697eee08 tempest-VolumesSnapshotTestJSON-991813121 tempest-VolumesSnapshotTestJSON-991813121-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:01:10.494865 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-0a71bd0a-baec-42ba-8015-f82f9c3fb30e req-98e71587-39f5-4ea7-b06d-8ffb697eee08 tempest-VolumesSnapshotTestJSON-991813121 tempest-VolumesSnapshotTestJSON-991813121-project] 10.222.0.62 "GET /v2.0/ports?device_id=5cf3f093-ba27-473b-93f8-52a5bb9d9ec8 HTTP/1.1" status: 200 len: 944 time: 0.0929625 May 25 17:01:10.550449 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-0a71bd0a-baec-42ba-8015-f82f9c3fb30e req-b9012516-c793-4bc8-a18c-fc087c2139d6 tempest-VolumesSnapshotTestJSON-991813121 tempest-VolumesSnapshotTestJSON-991813121-project] 10.222.0.62 "GET /v2.0/security-groups?id=b5f47757-8dd4-4226-9a13-ca15ee498213&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0427678 May 25 17:01:10.880655 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.wsgi [-] (91830) accepted ('10.222.0.62', 60184) {{(pid=91830) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:01:10.881214 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-04d829a2-34bb-433d-b4ee-030ade163108 req-3e021b5a-2622-4404-96b5-a5994076d045 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:01:10.888158 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-04d829a2-34bb-433d-b4ee-030ade163108 req-3e021b5a-2622-4404-96b5-a5994076d045 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] 10.222.0.62 "GET /v2.0/ports?device_id=6b63b4a6-5261-4e1c-b796-2f153fc24933 HTTP/1.1" status: 200 len: 943 time: 0.1085007 May 25 17:01:10.934863 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-04d829a2-34bb-433d-b4ee-030ade163108 req-efb6279c-e079-4b4b-a127-52ecc395288d tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] 10.222.0.62 "GET /v2.0/security-groups?id=f73b90a2-df48-48fb-99e0-5dd4d6a63a15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0449042 May 25 17:01:10.995578 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.v2.base [None req-f2816692-bd2c-42ac-8443-cfc33d95cafc admin admin] Request body: {'network': {'name': 'tempest-TestMinimumBasicScenario-1175520845-network', 'tenant_id': '36c1ffa1d458478bac5893b2ddf98eda'}} {{(pid=91830) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 17:01:11.000526 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.quota.driver [None req-f2816692-bd2c-42ac-8443-cfc33d95cafc admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91830) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 17:01:11.004306 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [None req-f2816692-bd2c-42ac-8443-cfc33d95cafc admin admin] Usage tracker for resource:network and tenant:36c1ffa1d458478bac5893b2ddf98eda is out of sync, need to count used quota {{(pid=91830) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 17:01:11.007114 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [None req-f2816692-bd2c-42ac-8443-cfc33d95cafc admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=91830) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 17:01:11.016840 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.quota.driver [None req-f2816692-bd2c-42ac-8443-cfc33d95cafc admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91830) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 17:01:11.028949 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-f2816692-bd2c-42ac-8443-cfc33d95cafc admin admin] Made reservation on behalf of 36c1ffa1d458478bac5893b2ddf98eda for: {'network': 1} {{(pid=91830) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 25 17:01:11.031417 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-f2816692-bd2c-42ac-8443-cfc33d95cafc admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-3832077'] for network, before_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:01:11.045241 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-f2816692-bd2c-42ac-8443-cfc33d95cafc admin admin] Notify callbacks [] for security_group, before_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:01:11.062130 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.quota.driver [None req-f2816692-bd2c-42ac-8443-cfc33d95cafc admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91830) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 17:01:11.066542 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [None req-f2816692-bd2c-42ac-8443-cfc33d95cafc admin admin] Usage tracker for resource:security_group_rule and tenant:36c1ffa1d458478bac5893b2ddf98eda is out of sync, need to count used quota {{(pid=91830) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 17:01:11.069352 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [None req-f2816692-bd2c-42ac-8443-cfc33d95cafc admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91830) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 17:01:11.077518 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.quota.driver [None req-f2816692-bd2c-42ac-8443-cfc33d95cafc admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91830) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 17:01:11.163166 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-f2816692-bd2c-42ac-8443-cfc33d95cafc admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:01:11.167701 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-f2816692-bd2c-42ac-8443-cfc33d95cafc admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-640836'] for security_group, after_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:01:11.171714 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-2b7b0f3a-d76e-4118-8b08-2f04c29c7334 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:01:11.200047 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-f2816692-bd2c-42ac-8443-cfc33d95cafc admin admin] vlan segment allocate from pool success with {'vlan_id': 692, 'physical_network': 'physnet1'} {{(pid=91830) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 25 17:01:11.209219 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f2816692-bd2c-42ac-8443-cfc33d95cafc admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=d7d845a2-937c-4f26-ac5a-1b178146b05e,revision_number=1']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:01:11.213586 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-f2816692-bd2c-42ac-8443-cfc33d95cafc admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.042s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:01:11.216283 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-f2816692-bd2c-42ac-8443-cfc33d95cafc admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3809789'] for segment, precommit_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:01:11.216646 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.db.segments_db [None req-f2816692-bd2c-42ac-8443-cfc33d95cafc admin admin] Added segment 5aed6094-89e8-4c7c-ba89-9b30d3e98cd0 of type vlan for network f3ddbe01-13f7-4e15-b7da-2bdffc278cb7 May 25 17:01:11.243618 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-f2816692-bd2c-42ac-8443-cfc33d95cafc admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8757892541013'] for network, precommit_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:01:11.281190 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-f2816692-bd2c-42ac-8443-cfc33d95cafc admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-640806', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-551400'] for network, after_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:01:11.282974 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f2816692-bd2c-42ac-8443-cfc33d95cafc admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91830) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:01:11.283465 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-f2816692-bd2c-42ac-8443-cfc33d95cafc admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-551373'] for network, before_response {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:01:11.288495 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-c4745f0a-80ec-4f44-a916-14795f3ab36a admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:01:11.296429 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e7ec831e-083c-456e-b6fc-6a58e0689a47 req-aac009b3-7f10-435d-8708-e318ac5aa9b0 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:01:11.297891 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-e7ec831e-083c-456e-b6fc-6a58e0689a47 req-aac009b3-7f10-435d-8708-e318ac5aa9b0 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/ports?device_id=58da9205-0212-4daa-996c-1eef64a2b702 HTTP/1.1" status: 200 len: 945 time: 0.1070087 May 25 17:01:11.307038 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.rpc [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Device 041fa5ca-9be5-4356-af06-2fe633a19ad8 up at agent hyperv_hv-cinder-79049 {{(pid=91831) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 25 17:01:11.370411 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-e7ec831e-083c-456e-b6fc-6a58e0689a47 req-cfbfbe9a-ce98-4775-a53c-face516f0894 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/security-groups?id=8ee5c4ed-9c60-4e39-9185-7e283704a7dc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0472672 May 25 17:01:11.422274 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f2816692-bd2c-42ac-8443-cfc33d95cafc admin admin] Pushing event updated for resources: {'Network': ['ID=f3ddbe01-13f7-4e15-b7da-2bdffc278cb7,revision_number=1']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:01:11.429794 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.wsgi [-] (91829) accepted ('10.222.0.62', 60220) {{(pid=91829) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:01:11.430424 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [None req-f2816692-bd2c-42ac-8443-cfc33d95cafc admin admin] 10.222.0.62 "POST /v2.0/networks HTTP/1.1" status: 201 len: 888 time: 0.5483465 May 25 17:01:11.431579 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-f2816692-bd2c-42ac-8443-cfc33d95cafc admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.143s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:01:11.436572 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.v2.base [None req-40a7173b-d156-49c9-85ef-1507c4ad454b admin admin] Request body: {'subnet': {'network_id': 'f3ddbe01-13f7-4e15-b7da-2bdffc278cb7', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestMinimumBasicScenario-1175520845-subnet', 'tenant_id': '36c1ffa1d458478bac5893b2ddf98eda', 'ip_version': 4}} {{(pid=91829) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 17:01:11.443819 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.rpc [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Network f3ddbe01-13f7-4e15-b7da-2bdffc278cb7 details requested by agent ovs-agent-dv-cinder-790492-4-iscsi with host dv-cinder-790492-4-iscsi {{(pid=91831) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 25 17:01:11.444693 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.quota.driver [None req-40a7173b-d156-49c9-85ef-1507c4ad454b admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91829) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 17:01:11.450506 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.quota.resource [None req-40a7173b-d156-49c9-85ef-1507c4ad454b admin admin] Usage tracker for resource:subnet and tenant:36c1ffa1d458478bac5893b2ddf98eda is out of sync, need to count used quota {{(pid=91829) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 17:01:11.454347 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.quota.resource [None req-40a7173b-d156-49c9-85ef-1507c4ad454b admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=91829) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 17:01:11.465017 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.quota.driver [None req-40a7173b-d156-49c9-85ef-1507c4ad454b admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91829) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 17:01:11.465243 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.provisioning_blocks [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Provisioning for port 041fa5ca-9be5-4356-af06-2fe633a19ad8 completed by entity L2. {{(pid=91831) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 25 17:01:11.487421 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-40a7173b-d156-49c9-85ef-1507c4ad454b admin admin] Made reservation on behalf of 36c1ffa1d458478bac5893b2ddf98eda for: {'subnet': 1} {{(pid=91829) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 25 17:01:11.491615 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-40a7173b-d156-49c9-85ef-1507c4ad454b admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-28266129'] for subnet, before_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:01:11.543802 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.provisioning_blocks [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Provisioning complete for port 041fa5ca-9be5-4356-af06-2fe633a19ad8 triggered by entity L2. {{(pid=91831) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 17:01:11.543802 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3854128'] for port, provisioning_complete {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:01:11.701203 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3832070'] for port, before_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:01:11.749229 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.db [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] For port 041fa5ca-9be5-4356-af06-2fe633a19ad8, host hv-cinder-79049, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79049',level=0,port_id=041fa5ca-9be5-4356-af06-2fe633a19ad8,segment=NetworkSegment(bba065e2-1e75-4ab9-bc0e-e3037ef57277),segment_id=bba065e2-1e75-4ab9-bc0e-e3037ef57277)] {{(pid=91831) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 17:01:11.750553 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '5cf3f093-ba27-473b-93f8-52a5bb9d9ec8', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '041fa5ca-9be5-4356-af06-2fe633a19ad8'}] {{(pid=91831) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 25 17:01:11.756838 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8757892955028', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8757892520933', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8757892521750'] for port, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:01:11.758672 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:01:11.838980 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Pushing event updated for resources: {'Port': ['ID=041fa5ca-9be5-4356-af06-2fe633a19ad8,revision_number=5']} {{(pid=91831) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:01:11.844854 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.086s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:01:11.865263 dv-cinder-790492-4-iscsi neutron-server[91831]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '5cf3f093-ba27-473b-93f8-52a5bb9d9ec8', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '041fa5ca-9be5-4356-af06-2fe633a19ad8', 'code': 200} May 25 17:01:11.986869 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f7cd3ba2-6e73-4814-9d78-8d0288837bae req-5d5cdc16-1aae-4f53-9239-2b916f7f96fc tempest-VolumesSnapshotTestJSON-991813121 tempest-VolumesSnapshotTestJSON-991813121-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:01:11.988610 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-f7cd3ba2-6e73-4814-9d78-8d0288837bae req-5d5cdc16-1aae-4f53-9239-2b916f7f96fc tempest-VolumesSnapshotTestJSON-991813121 tempest-VolumesSnapshotTestJSON-991813121-project] 10.222.0.62 "GET /v2.0/ports?device_id=5cf3f093-ba27-473b-93f8-52a5bb9d9ec8 HTTP/1.1" status: 200 len: 945 time: 0.1894991 May 25 17:01:12.097553 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-f7cd3ba2-6e73-4814-9d78-8d0288837bae req-7d798049-3df3-4ff1-aa64-9f64857bb81a tempest-VolumesSnapshotTestJSON-991813121 tempest-VolumesSnapshotTestJSON-991813121-project] 10.222.0.62 "GET /v2.0/security-groups?id=b5f47757-8dd4-4226-9a13-ca15ee498213&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0649180 May 25 17:01:12.147776 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.db.agents_db [None req-504cb04f-4543-46c1-8db7-349e21db7634 None None] Agent healthcheck: found 6 active agents {{(pid=91832) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} May 25 17:01:12.202434 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-853913a8-f1a8-444e-b834-6aecabc8c0c7 req-eb53db4c-097a-4dde-b9d9-1d7ca83b697d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91830) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:01:12.204026 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-853913a8-f1a8-444e-b834-6aecabc8c0c7 req-eb53db4c-097a-4dde-b9d9-1d7ca83b697d service neutron] 10.222.0.32 "GET /v2.0/ports?device_id=5cf3f093-ba27-473b-93f8-52a5bb9d9ec8 HTTP/1.1" status: 200 len: 1098 time: 0.0854011 May 25 17:01:12.204549 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-40a7173b-d156-49c9-85ef-1507c4ad454b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55886', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-27333672', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-28266119'] for subnet, after_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:01:12.209561 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-47151435-c3df-4eb0-8424-671a986b3a72 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:01:12.264187 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-853913a8-f1a8-444e-b834-6aecabc8c0c7 req-347239e2-ec30-45d9-8ba3-b323c895ef49 service neutron] 10.222.0.32 "GET /v2.0/security-groups?id=b5f47757-8dd4-4226-9a13-ca15ee498213&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0434115 May 25 17:01:12.337491 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-40a7173b-d156-49c9-85ef-1507c4ad454b admin admin] Pushing event updated for resources: {'Subnet': ['ID=69fba530-cce2-44a2-89bd-18a52f9d454c,revision_number=0']} {{(pid=91829) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:01:12.340241 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-40a7173b-d156-49c9-85ef-1507c4ad454b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.131s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:01:12.355118 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-40a7173b-d156-49c9-85ef-1507c4ad454b admin admin] Checking segment: {'id': '5aed6094-89e8-4c7c-ba89-9b30d3e98cd0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 692, 'network_id': 'f3ddbe01-13f7-4e15-b7da-2bdffc278cb7'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91829) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 25 17:01:12.355465 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-40a7173b-d156-49c9-85ef-1507c4ad454b admin admin] Network hostable DHCP agents. Network: f3ddbe01-13f7-4e15-b7da-2bdffc278cb7, hostable agents: ['8d7401c6-8951-4f2b-ace4-208761782bfc'], hosted agents: [] {{(pid=91829) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 25 17:01:12.386424 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5eced844-ca86-41c2-891d-395396d53d2a req-3babe6b7-688b-4e1a-853e-c4eb61217ba1 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:01:12.387851 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-5eced844-ca86-41c2-891d-395396d53d2a req-3babe6b7-688b-4e1a-853e-c4eb61217ba1 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] 10.222.0.62 "GET /v2.0/ports?device_id=6b63b4a6-5261-4e1c-b796-2f153fc24933 HTTP/1.1" status: 200 len: 943 time: 0.1488519 May 25 17:01:12.388587 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-40a7173b-d156-49c9-85ef-1507c4ad454b admin admin] Network f3ddbe01-13f7-4e15-b7da-2bdffc278cb7 is scheduled to be hosted by DHCP agent 8d7401c6-8951-4f2b-ace4-208761782bfc with binding_index 1 {{(pid=91829) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 25 17:01:12.411734 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.scheduler.base_scheduler [None req-40a7173b-d156-49c9-85ef-1507c4ad454b admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-790492-4-iscsi, f3ddbe01-13f7-4e15-b7da-2bdffc278cb7) {{(pid=91829) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 17:01:12.420666 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f8f97076-7347-41ba-891f-c2801bfb8512 None None] Network f3ddbe01-13f7-4e15-b7da-2bdffc278cb7 requested from dv-cinder-790492-4-iscsi {{(pid=91831) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} May 25 17:01:12.425190 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-40a7173b-d156-49c9-85ef-1507c4ad454b admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:01:12.425767 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-40a7173b-d156-49c9-85ef-1507c4ad454b admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-551373'] for subnet, before_response {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:01:12.462940 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-5eced844-ca86-41c2-891d-395396d53d2a req-fad6447f-9135-49d3-aa39-57bbdb9ef135 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] 10.222.0.62 "GET /v2.0/security-groups?id=f73b90a2-df48-48fb-99e0-5dd4d6a63a15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0676508 May 25 17:01:12.468090 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [None req-40a7173b-d156-49c9-85ef-1507c4ad454b admin admin] 10.222.0.62 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 851 time: 1.0372381 May 25 17:01:12.470810 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.wsgi [-] (91829) accepted ('10.222.0.62', 60252) {{(pid=91829) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:01:12.475604 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.v2.base [None req-8119e332-56aa-494e-9705-2ca05af0a9ff admin admin] Request body: {'router': {'name': 'tempest-TestMinimumBasicScenario-1175520845-router', 'tenant_id': '36c1ffa1d458478bac5893b2ddf98eda', 'external_gateway_info': {'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74'}}} {{(pid=91829) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 17:01:12.480200 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.quota.driver [None req-8119e332-56aa-494e-9705-2ca05af0a9ff admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91829) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 17:01:12.488000 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.quota.resource [None req-8119e332-56aa-494e-9705-2ca05af0a9ff admin admin] Usage tracker for resource:router and tenant:36c1ffa1d458478bac5893b2ddf98eda is out of sync, need to count used quota {{(pid=91829) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 17:01:12.489431 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.quota.resource [None req-8119e332-56aa-494e-9705-2ca05af0a9ff admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=91829) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 17:01:12.495791 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.quota.driver [None req-8119e332-56aa-494e-9705-2ca05af0a9ff admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91829) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 17:01:12.509918 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-8119e332-56aa-494e-9705-2ca05af0a9ff admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-684888', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-31042'] for router, before_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:01:12.510876 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-8119e332-56aa-494e-9705-2ca05af0a9ff admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-684376', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-683143', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-647018', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-31049'] for router, precommit_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:01:12.525470 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-8119e332-56aa-494e-9705-2ca05af0a9ff admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:01:12.653535 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0acb97c0-a84d-4f3f-bd7b-db003966fbc3 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp6d7ebc81-b6b5-52ec-b8f5-10a9de34bf46-f3ddbe01-13f7-4e15-b7da-2bdffc278cb7', 'network_id': 'f3ddbe01-13f7-4e15-b7da-2bdffc278cb7', 'tenant_id': '36c1ffa1d458478bac5893b2ddf98eda', 'fixed_ips': [{'subnet_id': '69fba530-cce2-44a2-89bd-18a52f9d454c'}]}} from dv-cinder-790492-4-iscsi. {{(pid=91831) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} May 25 17:01:12.654891 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-0acb97c0-a84d-4f3f-bd7b-db003966fbc3 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3832070'] for port, before_create {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:01:12.797027 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-8119e332-56aa-494e-9705-2ca05af0a9ff admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-683170', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-684906', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-31039'] for router, precommit_update {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:01:12.812341 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.db_base_plugin_common [None req-0acb97c0-a84d-4f3f-bd7b-db003966fbc3 None None] Allocated IP 172.20.0.2 (f3ddbe01-13f7-4e15-b7da-2bdffc278cb7/69fba530-cce2-44a2-89bd-18a52f9d454c/19c8c4df-6d31-4527-8bd6-b674eacf537c) {{(pid=91831) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 25 17:01:13.020734 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-0acb97c0-a84d-4f3f-bd7b-db003966fbc3 None None] Notify callbacks [] for port, precommit_create {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:01:13.035569 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.provisioning_blocks [None req-0acb97c0-a84d-4f3f-bd7b-db003966fbc3 None None] Transition to ACTIVE for port object 19c8c4df-6d31-4527-8bd6-b674eacf537c will not be triggered until provisioned by entity L2. {{(pid=91831) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 25 17:01:13.053484 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.provisioning_blocks [None req-0acb97c0-a84d-4f3f-bd7b-db003966fbc3 None None] Transition to ACTIVE for port object 19c8c4df-6d31-4527-8bd6-b674eacf537c will not be triggered until provisioned by entity DHCP. {{(pid=91831) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 25 17:01:13.059908 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-0acb97c0-a84d-4f3f-bd7b-db003966fbc3 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8757892520915'] for port, after_create {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:01:13.064364 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [None req-3fb13473-a2bf-442d-9fa8-c8caea6a2af0 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:01:13.112593 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-8119e332-56aa-494e-9705-2ca05af0a9ff admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:01:13.145421 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-8119e332-56aa-494e-9705-2ca05af0a9ff admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3832070'] for port, before_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:01:13.161624 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0acb97c0-a84d-4f3f-bd7b-db003966fbc3 None None] Network f3ddbe01-13f7-4e15-b7da-2bdffc278cb7 is already hosted by enough agents. {{(pid=91831) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 25 17:01:13.164572 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.scheduler.base_scheduler [None req-0acb97c0-a84d-4f3f-bd7b-db003966fbc3 None None] Resources bound (agent type, host, resource id): {{(pid=91831) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 17:01:13.168583 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0acb97c0-a84d-4f3f-bd7b-db003966fbc3 None None] Received port after_create {{(pid=91831) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 25 17:01:13.207827 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0acb97c0-a84d-4f3f-bd7b-db003966fbc3 None None] Pushing event updated for resources: {'Port': ['ID=19c8c4df-6d31-4527-8bd6-b674eacf537c,revision_number=1']} {{(pid=91831) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:01:13.211503 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [None req-0acb97c0-a84d-4f3f-bd7b-db003966fbc3 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.147s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:01:13.273155 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.managers [None req-0acb97c0-a84d-4f3f-bd7b-db003966fbc3 None None] Attempting to bind port 19c8c4df-6d31-4527-8bd6-b674eacf537c on host dv-cinder-790492-4-iscsi for vnic_type normal with profile {{(pid=91831) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 25 17:01:13.273417 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.managers [None req-0acb97c0-a84d-4f3f-bd7b-db003966fbc3 None None] Attempting to bind port 19c8c4df-6d31-4527-8bd6-b674eacf537c by drivers openvswitch,hyperv on host dv-cinder-790492-4-iscsi at level 0 using segments [{'id': '5aed6094-89e8-4c7c-ba89-9b30d3e98cd0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 692, 'network_id': 'f3ddbe01-13f7-4e15-b7da-2bdffc278cb7'}] {{(pid=91831) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 25 17:01:13.273789 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0acb97c0-a84d-4f3f-bd7b-db003966fbc3 None None] Attempting to bind port 19c8c4df-6d31-4527-8bd6-b674eacf537c on network f3ddbe01-13f7-4e15-b7da-2bdffc278cb7 {{(pid=91831) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 25 17:01:13.279348 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0acb97c0-a84d-4f3f-bd7b-db003966fbc3 None None] Checking agent: {'id': 'fc8251e1-071c-49f7-bc10-1337f1d37d1b', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-790492-4-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 25, 16, 50, 28), 'started_at': datetime.datetime(2021, 5, 25, 16, 50, 58), 'heartbeat_timestamp': datetime.datetime(2021, 5, 25, 17, 0, 58), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-790492-4-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=91831) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 25 17:01:13.279723 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0acb97c0-a84d-4f3f-bd7b-db003966fbc3 None None] Checking segment: {'id': '5aed6094-89e8-4c7c-ba89-9b30d3e98cd0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 692, 'network_id': 'f3ddbe01-13f7-4e15-b7da-2bdffc278cb7'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91831) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 25 17:01:13.280143 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-0acb97c0-a84d-4f3f-bd7b-db003966fbc3 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:01:13.280525 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0acb97c0-a84d-4f3f-bd7b-db003966fbc3 None None] Bound using segment: {'id': '5aed6094-89e8-4c7c-ba89-9b30d3e98cd0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 692, 'network_id': 'f3ddbe01-13f7-4e15-b7da-2bdffc278cb7'} {{(pid=91831) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 25 17:01:13.280989 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.managers [None req-0acb97c0-a84d-4f3f-bd7b-db003966fbc3 None None] Bound port: 19c8c4df-6d31-4527-8bd6-b674eacf537c, host: dv-cinder-790492-4-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '5aed6094-89e8-4c7c-ba89-9b30d3e98cd0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 692, 'network_id': 'f3ddbe01-13f7-4e15-b7da-2bdffc278cb7'}}] {{(pid=91831) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 25 17:01:13.281378 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-0acb97c0-a84d-4f3f-bd7b-db003966fbc3 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3832070'] for port, before_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:01:13.346620 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.db_base_plugin_common [None req-8119e332-56aa-494e-9705-2ca05af0a9ff admin admin] Allocated IP 172.27.2.22 (4364b6ab-4117-4a92-baeb-f5ee2f45bf74/b947e790-d731-4b63-afc4-4aa112afe0f6/abb48be3-09be-464d-887e-584de580da17) {{(pid=91829) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 25 17:01:13.371286 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b1e2a077-991e-48b4-a204-88a0533f1cb6 req-32b1c0bd-b0d2-4da7-b2af-cd8a4f0845cf tempest-VolumesSnapshotTestJSON-991813121 tempest-VolumesSnapshotTestJSON-991813121-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:01:13.373262 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-b1e2a077-991e-48b4-a204-88a0533f1cb6 req-32b1c0bd-b0d2-4da7-b2af-cd8a4f0845cf tempest-VolumesSnapshotTestJSON-991813121 tempest-VolumesSnapshotTestJSON-991813121-project] 10.222.0.62 "GET /v2.0/ports?device_id=5cf3f093-ba27-473b-93f8-52a5bb9d9ec8 HTTP/1.1" status: 200 len: 945 time: 0.1604981 May 25 17:01:13.378819 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.db [None req-0acb97c0-a84d-4f3f-bd7b-db003966fbc3 None None] For port 19c8c4df-6d31-4527-8bd6-b674eacf537c, host dv-cinder-790492-4-iscsi, cleared binding levels {{(pid=91831) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 25 17:01:13.381884 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.db [None req-0acb97c0-a84d-4f3f-bd7b-db003966fbc3 None None] For port 19c8c4df-6d31-4527-8bd6-b674eacf537c, host dv-cinder-790492-4-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-790492-4-iscsi',level=0,port_id=19c8c4df-6d31-4527-8bd6-b674eacf537c,segment=NetworkSegment(5aed6094-89e8-4c7c-ba89-9b30d3e98cd0),segment_id=5aed6094-89e8-4c7c-ba89-9b30d3e98cd0)] {{(pid=91831) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 25 17:01:13.385814 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-0acb97c0-a84d-4f3f-bd7b-db003966fbc3 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8757892955028', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8757892520933', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8757892521750'] for port, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:01:13.390127 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:01:13.474711 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0acb97c0-a84d-4f3f-bd7b-db003966fbc3 None None] Pushing event updated for resources: {'Port': ['ID=19c8c4df-6d31-4527-8bd6-b674eacf537c,revision_number=2']} {{(pid=91831) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:01:13.478699 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [None req-0acb97c0-a84d-4f3f-bd7b-db003966fbc3 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.089s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:01:13.575510 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-b1e2a077-991e-48b4-a204-88a0533f1cb6 req-a6234cee-b084-485f-89e3-96288444014a tempest-VolumesSnapshotTestJSON-991813121 tempest-VolumesSnapshotTestJSON-991813121-project] 10.222.0.62 "GET /v2.0/security-groups?id=b5f47757-8dd4-4226-9a13-ca15ee498213&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1137865 May 25 17:01:13.623725 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-8119e332-56aa-494e-9705-2ca05af0a9ff admin admin] Notify callbacks [] for port, precommit_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:01:13.686410 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-8119e332-56aa-494e-9705-2ca05af0a9ff admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8757892520915', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28230808'] for port, after_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:01:13.697261 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-c3f8ff20-c736-45cb-8b95-10c55816ffa9 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:01:13.744454 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8119e332-56aa-494e-9705-2ca05af0a9ff admin admin] Network 4364b6ab-4117-4a92-baeb-f5ee2f45bf74 is already hosted by enough agents. {{(pid=91829) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 25 17:01:13.790723 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.scheduler.base_scheduler [None req-8119e332-56aa-494e-9705-2ca05af0a9ff admin admin] Resources bound (agent type, host, resource id): {{(pid=91829) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 17:01:13.811148 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8119e332-56aa-494e-9705-2ca05af0a9ff admin admin] Received port after_create {{(pid=91829) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 25 17:01:13.881217 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8119e332-56aa-494e-9705-2ca05af0a9ff admin admin] Pushing event updated for resources: {'Port': ['ID=abb48be3-09be-464d-887e-584de580da17,revision_number=1']} {{(pid=91829) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:01:13.887894 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-8119e332-56aa-494e-9705-2ca05af0a9ff admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.191s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:01:14.075107 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f1cf84f4-e751-46f1-b062-477e8749572e req-4806e31f-d6d1-4852-afbd-fe128a5032df tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:01:14.077352 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-f1cf84f4-e751-46f1-b062-477e8749572e req-4806e31f-d6d1-4852-afbd-fe128a5032df tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] 10.222.0.62 "GET /v2.0/ports?device_id=6b63b4a6-5261-4e1c-b796-2f153fc24933 HTTP/1.1" status: 200 len: 943 time: 0.3264153 May 25 17:01:14.218232 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-f1cf84f4-e751-46f1-b062-477e8749572e req-7e5fc5c8-9705-40f4-b4e6-ba085cf8fa24 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] 10.222.0.62 "GET /v2.0/security-groups?id=f73b90a2-df48-48fb-99e0-5dd4d6a63a15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1283004 May 25 17:01:14.363188 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-8119e332-56aa-494e-9705-2ca05af0a9ff admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:01:14.468452 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-52815b0e-c3a7-4ee9-94d4-a6102eb8de16 req-f6ef8ced-be1f-4da1-b7da-92744e77dd04 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:01:14.470006 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-52815b0e-c3a7-4ee9-94d4-a6102eb8de16 req-f6ef8ced-be1f-4da1-b7da-92744e77dd04 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/ports?device_id=58da9205-0212-4daa-996c-1eef64a2b702 HTTP/1.1" status: 200 len: 945 time: 0.2550089 May 25 17:01:14.486414 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-fae26bfe-ecc3-44d1-bcaa-88d1d9b67bda None None] Network f3ddbe01-13f7-4e15-b7da-2bdffc278cb7 requested from dv-cinder-790492-4-iscsi {{(pid=91831) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} May 25 17:01:14.591215 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-52815b0e-c3a7-4ee9-94d4-a6102eb8de16 req-8eedcf22-57c0-4474-897d-dcb3e6379011 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/security-groups?id=8ee5c4ed-9c60-4e39-9185-7e283704a7dc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0661128 May 25 17:01:14.664536 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.provisioning_blocks [None req-1242b6df-f1d6-48b2-a727-cbc834a6166d None None] Provisioning for port 19c8c4df-6d31-4527-8bd6-b674eacf537c completed by entity DHCP. {{(pid=91831) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 25 17:01:14.842979 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-8119e332-56aa-494e-9705-2ca05af0a9ff admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-684881', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-683233'] for router, after_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:01:15.045088 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4975edbe-6deb-4c0f-9855-efa2f580edc7 req-91df3d32-c411-407e-919f-8d4e632fbd26 tempest-VolumesSnapshotTestJSON-991813121 tempest-VolumesSnapshotTestJSON-991813121-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:01:15.046884 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-4975edbe-6deb-4c0f-9855-efa2f580edc7 req-91df3d32-c411-407e-919f-8d4e632fbd26 tempest-VolumesSnapshotTestJSON-991813121 tempest-VolumesSnapshotTestJSON-991813121-project] 10.222.0.62 "GET /v2.0/ports?device_id=5cf3f093-ba27-473b-93f8-52a5bb9d9ec8 HTTP/1.1" status: 200 len: 945 time: 0.3118382 May 25 17:01:15.171834 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-4975edbe-6deb-4c0f-9855-efa2f580edc7 req-5e00eff4-938b-40e4-855e-58a7a3916dd2 tempest-VolumesSnapshotTestJSON-991813121 tempest-VolumesSnapshotTestJSON-991813121-project] 10.222.0.62 "GET /v2.0/security-groups?id=b5f47757-8dd4-4226-9a13-ca15ee498213&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0741382 May 25 17:01:15.208050 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-8119e332-56aa-494e-9705-2ca05af0a9ff admin admin] Router b37963ac-b2c2-4729-b4f8-6c604a1e5a2b is scheduled to L3 agent a2d427c1-2d07-43e8-afbe-218c9f7d0445 with binding_index 1 {{(pid=91829) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}} May 25 17:01:15.333521 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.rpc [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Device 85443de0-772c-4d18-bd76-026a72cc754d details requested by agent hyperv_hv-cinder-79049 with host hv-cinder-79049 {{(pid=91831) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 25 17:01:15.472734 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-8119e332-56aa-494e-9705-2ca05af0a9ff admin admin] Notify agent at l3_agent.dv-cinder-790492-4-iscsi the message routers_updated {{(pid=91829) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 25 17:01:15.483897 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4f0c2f32-bf30-479e-a431-56803d46853a None None] Sync routers for ids ['b37963ac-b2c2-4729-b4f8-6c604a1e5a2b'] in dv-cinder-790492-4-iscsi {{(pid=91832) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 25 17:01:15.496521 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4f0c2f32-bf30-479e-a431-56803d46853a None None] Routers {'b37963ac-b2c2-4729-b4f8-6c604a1e5a2b'} bound to L3 agent in host dv-cinder-790492-4-iscsi {{(pid=91832) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 17:01:15.497157 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.db.l3_hamode_db [None req-4f0c2f32-bf30-479e-a431-56803d46853a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-790492-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-05-25T16:50:28Z,description=,heartbeat_timestamp=2021-05-25T17:00:58Z,host='dv-cinder-790492-4-iscsi',id=a2d427c1-2d07-43e8-afbe-218c9f7d0445,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T16:50:28Z,topic='l3_agent')) {'router_ids': ['b37963ac-b2c2-4729-b4f8-6c604a1e5a2b'], 'active': True} {{(pid=91832) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 17:01:15.521946 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.db [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] For port 85443de0-772c-4d18-bd76-026a72cc754d, host hv-cinder-79049, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79049',level=0,port_id=85443de0-772c-4d18-bd76-026a72cc754d,segment=NetworkSegment(7d7273c2-c6dd-43fe-83a8-cb776d48dc70),segment_id=7d7273c2-c6dd-43fe-83a8-cb776d48dc70)] {{(pid=91831) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 17:01:15.536088 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-8119e332-56aa-494e-9705-2ca05af0a9ff admin admin] Notify callbacks [] for router, before_response {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:01:15.536088 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [None req-8119e332-56aa-494e-9705-2ca05af0a9ff admin admin] 10.222.0.62 "POST /v2.0/routers HTTP/1.1" status: 201 len: 926 time: 3.0616307 May 25 17:01:15.536394 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.wsgi [-] (91829) accepted ('10.222.0.62', 60334) {{(pid=91829) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:01:15.538866 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.rpc [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Returning: {'device': '85443de0-772c-4d18-bd76-026a72cc754d', 'network_id': '63b1f335-e2c4-48dd-886b-6be853f8a2fc', 'port_id': '85443de0-772c-4d18-bd76-026a72cc754d', 'mac_address': 'fa:16:3e:4d:c0:d3', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 651, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'b0baa944-cafe-48a4-861a-dae28947b9f0', 'ip_address': '172.20.0.9'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=91831) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 25 17:01:15.604839 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3832070'] for port, before_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:01:15.645880 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.notifiers.nova [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 85443de0-772c-4d18-bd76-026a72cc754d {{(pid=91831) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} May 25 17:01:15.686826 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.db [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] For port 85443de0-772c-4d18-bd76-026a72cc754d, host hv-cinder-79049, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79049',level=0,port_id=85443de0-772c-4d18-bd76-026a72cc754d,segment=NetworkSegment(7d7273c2-c6dd-43fe-83a8-cb776d48dc70),segment_id=7d7273c2-c6dd-43fe-83a8-cb776d48dc70)] {{(pid=91831) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 17:01:15.697134 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8757892955028', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8757892520933', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8757892521750'] for port, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:01:15.699938 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:01:15.739397 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3bc08318-a841-48e3-a27e-27888e6a0eb3 req-4b58c23b-96f7-4033-bfe9-428ad96acd54 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:01:15.740860 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-3bc08318-a841-48e3-a27e-27888e6a0eb3 req-4b58c23b-96f7-4033-bfe9-428ad96acd54 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] 10.222.0.62 "GET /v2.0/ports?device_id=6b63b4a6-5261-4e1c-b796-2f153fc24933 HTTP/1.1" status: 200 len: 943 time: 0.3682816 May 25 17:01:15.811065 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.rpc [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Device 19c8c4df-6d31-4527-8bd6-b674eacf537c up at agent ovs-agent-dv-cinder-790492-4-iscsi {{(pid=91831) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 25 17:01:15.845435 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.db.l3_dvr_db [None req-4f0c2f32-bf30-479e-a431-56803d46853a None None] Set router b37963ac-b2c2-4729-b4f8-6c604a1e5a2b gateway port host: dv-cinder-790492-4-iscsi {{(pid=91832) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 17:01:15.906814 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Pushing event updated for resources: {'Port': ['ID=85443de0-772c-4d18-bd76-026a72cc754d,revision_number=4']} {{(pid=91831) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:01:15.912473 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.212s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:01:15.940919 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.provisioning_blocks [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Provisioning for port 19c8c4df-6d31-4527-8bd6-b674eacf537c completed by entity L2. {{(pid=91831) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 25 17:01:15.947828 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.provisioning_blocks [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Provisioning complete for port 19c8c4df-6d31-4527-8bd6-b674eacf537c triggered by entity L2. {{(pid=91831) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 17:01:15.948216 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3854128'] for port, provisioning_complete {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:01:15.979074 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-3bc08318-a841-48e3-a27e-27888e6a0eb3 req-1c20e483-3548-4f28-94ff-311a1c2a83f6 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] 10.222.0.62 "GET /v2.0/security-groups?id=f73b90a2-df48-48fb-99e0-5dd4d6a63a15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2247236 May 25 17:01:16.161746 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3832070'] for port, before_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:01:16.197038 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.db [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] For port 19c8c4df-6d31-4527-8bd6-b674eacf537c, host dv-cinder-790492-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-790492-4-iscsi',level=0,port_id=19c8c4df-6d31-4527-8bd6-b674eacf537c,segment=NetworkSegment(5aed6094-89e8-4c7c-ba89-9b30d3e98cd0),segment_id=5aed6094-89e8-4c7c-ba89-9b30d3e98cd0)] {{(pid=91831) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 17:01:16.204800 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8757892955028', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8757892520933', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8757892521750'] for port, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:01:16.206945 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [None req-4ab4d9ba-2f68-4214-a4f4-a30840f53de0 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:01:16.226193 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.db.l3_hamode_db [None req-4f0c2f32-bf30-479e-a431-56803d46853a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'b37963ac-b2c2-4729-b4f8-6c604a1e5a2b', 'name': 'tempest-TestMinimumBasicScenario-1175520845-router', 'tenant_id': '36c1ffa1d458478bac5893b2ddf98eda', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'external_fixed_ips': [{'subnet_id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'ip_address': '172.27.2.22'}], 'enable_snat': True}, 'gw_port_id': 'abb48be3-09be-464d-887e-584de580da17', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T17:01:12Z', 'updated_at': '2021-05-25T17:01:14Z', 'revision_number': 3, 'project_id': '36c1ffa1d458478bac5893b2ddf98eda', 'gw_port': {'id': 'abb48be3-09be-464d-887e-584de580da17', 'name': '', 'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'tenant_id': '', 'mac_address': 'fa:16:3e:3f:15:26', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'b37963ac-b2c2-4729-b4f8-6c604a1e5a2b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 432, 'fixed_ips': [{'subnet_id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'ip_address': '172.27.2.22', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:01:13Z', 'updated_at': '2021-05-25T17:01:13Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-790492-4-iscsi'}], 'dv-cinder-790492-4-iscsi', False) {} {{(pid=91832) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 17:01:16.229891 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4f0c2f32-bf30-479e-a431-56803d46853a None None] Checking router: b37963ac-b2c2-4729-b4f8-6c604a1e5a2b for host: dv-cinder-790492-4-iscsi {{(pid=91832) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 25 17:01:16.230271 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4f0c2f32-bf30-479e-a431-56803d46853a None None] Updating router b37963ac-b2c2-4729-b4f8-6c604a1e5a2b port abb48be3-09be-464d-887e-584de580da17 binding host dv-cinder-790492-4-iscsi {{(pid=91832) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} May 25 17:01:16.292971 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Pushing event updated for resources: {'Port': ['ID=19c8c4df-6d31-4527-8bd6-b674eacf537c,revision_number=3']} {{(pid=91831) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:01:16.297422 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.090s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:01:16.324170 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron_lib.callbacks.manager [None req-4f0c2f32-bf30-479e-a431-56803d46853a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3832070'] for port, before_update {{(pid=91832) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:01:16.335342 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.db [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] get_ports_and_sgs() called for port_ids ['85443de0-772c-4d18-bd76-026a72cc754d'] {{(pid=91831) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 25 17:01:16.606567 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-2dfcd7ce-2023-49aa-9728-a381803c759e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3832070'] for port, before_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:01:16.713012 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron_lib.callbacks.manager [None req-4f0c2f32-bf30-479e-a431-56803d46853a None None] Notify callbacks [] for port, precommit_update {{(pid=91832) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:01:16.725340 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.db.provisioning_blocks [None req-4f0c2f32-bf30-479e-a431-56803d46853a None None] Transition to ACTIVE for port object abb48be3-09be-464d-887e-584de580da17 will not be triggered until provisioned by entity L2. {{(pid=91832) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 25 17:01:16.732718 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron_lib.callbacks.manager [None req-4f0c2f32-bf30-479e-a431-56803d46853a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8757892955028', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8757892520933', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8757892521750'] for port, after_update {{(pid=91832) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:01:16.737321 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG oslo_concurrency.lockutils [None req-5d577993-7c36-4f17-9599-70c105d0c2a3 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:01:16.817670 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-23e47b70-fe77-4a93-aa70-325da1d0166b None None] Pushing event updated for resources: {'Port': ['ID=abb48be3-09be-464d-887e-584de580da17,revision_number=2']} {{(pid=91832) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:01:16.820048 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.plugins.ml2.managers [None req-4f0c2f32-bf30-479e-a431-56803d46853a None None] Attempting to bind port abb48be3-09be-464d-887e-584de580da17 on host dv-cinder-790492-4-iscsi for vnic_type normal with profile {{(pid=91832) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 25 17:01:16.820410 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.plugins.ml2.managers [None req-4f0c2f32-bf30-479e-a431-56803d46853a None None] Attempting to bind port abb48be3-09be-464d-887e-584de580da17 by drivers openvswitch,hyperv on host dv-cinder-790492-4-iscsi at level 0 using segments [{'id': '414a8468-1d66-4792-9e81-d8ac5ccf1512', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74'}] {{(pid=91832) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 25 17:01:16.820767 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4f0c2f32-bf30-479e-a431-56803d46853a None None] Attempting to bind port abb48be3-09be-464d-887e-584de580da17 on network 4364b6ab-4117-4a92-baeb-f5ee2f45bf74 {{(pid=91832) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 25 17:01:16.829938 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4f0c2f32-bf30-479e-a431-56803d46853a None None] Checking agent: {'id': 'fc8251e1-071c-49f7-bc10-1337f1d37d1b', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-790492-4-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 25, 16, 50, 28), 'started_at': datetime.datetime(2021, 5, 25, 16, 50, 58), 'heartbeat_timestamp': datetime.datetime(2021, 5, 25, 17, 0, 58), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-790492-4-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=91832) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 25 17:01:16.830320 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4f0c2f32-bf30-479e-a431-56803d46853a None None] Checking segment: {'id': '414a8468-1d66-4792-9e81-d8ac5ccf1512', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91832) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 25 17:01:16.830718 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron_lib.callbacks.manager [None req-4f0c2f32-bf30-479e-a431-56803d46853a None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=91832) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:01:16.831121 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4f0c2f32-bf30-479e-a431-56803d46853a None None] Bound using segment: {'id': '414a8468-1d66-4792-9e81-d8ac5ccf1512', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74'} {{(pid=91832) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 25 17:01:16.831875 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.plugins.ml2.managers [None req-4f0c2f32-bf30-479e-a431-56803d46853a None None] Bound port: abb48be3-09be-464d-887e-584de580da17, host: dv-cinder-790492-4-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '414a8468-1d66-4792-9e81-d8ac5ccf1512', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74'}}] {{(pid=91832) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 25 17:01:16.832296 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron_lib.callbacks.manager [None req-4f0c2f32-bf30-479e-a431-56803d46853a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3832070'] for port, before_update {{(pid=91832) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:01:16.860659 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-23e47b70-fe77-4a93-aa70-325da1d0166b None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91832) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:01:16.861016 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-23e47b70-fe77-4a93-aa70-325da1d0166b None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91832) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:01:16.861346 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-23e47b70-fe77-4a93-aa70-325da1d0166b None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91832) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:01:16.861669 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-23e47b70-fe77-4a93-aa70-325da1d0166b None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91832) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:01:16.862131 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-23e47b70-fe77-4a93-aa70-325da1d0166b None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91832) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:01:16.862342 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-23e47b70-fe77-4a93-aa70-325da1d0166b None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91832) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:01:16.862656 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-23e47b70-fe77-4a93-aa70-325da1d0166b None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91832) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:01:16.862972 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-23e47b70-fe77-4a93-aa70-325da1d0166b None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91832) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:01:16.863284 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-23e47b70-fe77-4a93-aa70-325da1d0166b None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91832) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:01:16.863603 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-23e47b70-fe77-4a93-aa70-325da1d0166b None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91832) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:01:16.863912 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-23e47b70-fe77-4a93-aa70-325da1d0166b None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91832) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:01:16.864245 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-23e47b70-fe77-4a93-aa70-325da1d0166b None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91832) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:01:16.872138 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG oslo_concurrency.lockutils [None req-23e47b70-fe77-4a93-aa70-325da1d0166b None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.135s {{(pid=91832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:01:16.902952 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.db_base_plugin_common [None req-2dfcd7ce-2023-49aa-9728-a381803c759e admin admin] Allocated IP 172.20.0.1 (f3ddbe01-13f7-4e15-b7da-2bdffc278cb7/69fba530-cce2-44a2-89bd-18a52f9d454c/bcd1bd96-7471-48e7-844a-de3c2de0ab2b) {{(pid=91829) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 25 17:01:16.918112 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.plugins.ml2.db [None req-4f0c2f32-bf30-479e-a431-56803d46853a None None] For port abb48be3-09be-464d-887e-584de580da17, host dv-cinder-790492-4-iscsi, cleared binding levels {{(pid=91832) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 25 17:01:16.921314 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.plugins.ml2.db [None req-4f0c2f32-bf30-479e-a431-56803d46853a None None] For port abb48be3-09be-464d-887e-584de580da17, host dv-cinder-790492-4-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-790492-4-iscsi',level=0,port_id=abb48be3-09be-464d-887e-584de580da17,segment=NetworkSegment(414a8468-1d66-4792-9e81-d8ac5ccf1512),segment_id=414a8468-1d66-4792-9e81-d8ac5ccf1512)] {{(pid=91832) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 25 17:01:16.925223 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron_lib.callbacks.manager [None req-4f0c2f32-bf30-479e-a431-56803d46853a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8757892955028', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8757892520933', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8757892521750'] for port, after_update {{(pid=91832) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:01:16.929105 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:01:17.003389 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4f0c2f32-bf30-479e-a431-56803d46853a None None] Routers {'b37963ac-b2c2-4729-b4f8-6c604a1e5a2b'} bound to L3 agent in host dv-cinder-790492-4-iscsi {{(pid=91832) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 17:01:17.004069 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.db.l3_hamode_db [None req-4f0c2f32-bf30-479e-a431-56803d46853a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-790492-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-05-25T16:50:28Z,description=,heartbeat_timestamp=2021-05-25T17:00:58Z,host='dv-cinder-790492-4-iscsi',id=a2d427c1-2d07-43e8-afbe-218c9f7d0445,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T16:50:28Z,topic='l3_agent')) {'router_ids': ['b37963ac-b2c2-4729-b4f8-6c604a1e5a2b'], 'active': True} {{(pid=91832) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 17:01:17.060057 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-2dfcd7ce-2023-49aa-9728-a381803c759e admin admin] Notify callbacks [] for port, precommit_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:01:17.084779 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.provisioning_blocks [None req-2dfcd7ce-2023-49aa-9728-a381803c759e admin admin] Transition to ACTIVE for port object bcd1bd96-7471-48e7-844a-de3c2de0ab2b will not be triggered until provisioned by entity DHCP. {{(pid=91829) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 25 17:01:17.094002 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-23e47b70-fe77-4a93-aa70-325da1d0166b None None] Pushing event updated for resources: {'Port': ['ID=abb48be3-09be-464d-887e-584de580da17,revision_number=3']} {{(pid=91832) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:01:17.099863 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG oslo_concurrency.lockutils [None req-23e47b70-fe77-4a93-aa70-325da1d0166b None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.171s {{(pid=91832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:01:17.127740 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-2dfcd7ce-2023-49aa-9728-a381803c759e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8757892520915', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28230808'] for port, after_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:01:17.152618 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:01:17.229061 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.db.l3_dvr_db [None req-4f0c2f32-bf30-479e-a431-56803d46853a None None] Set router b37963ac-b2c2-4729-b4f8-6c604a1e5a2b gateway port host: dv-cinder-790492-4-iscsi {{(pid=91832) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 17:01:17.285300 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2dfcd7ce-2023-49aa-9728-a381803c759e admin admin] Network f3ddbe01-13f7-4e15-b7da-2bdffc278cb7 is already hosted by enough agents. {{(pid=91829) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 25 17:01:17.297327 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.scheduler.base_scheduler [None req-2dfcd7ce-2023-49aa-9728-a381803c759e admin admin] Resources bound (agent type, host, resource id): {{(pid=91829) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 17:01:17.302599 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2dfcd7ce-2023-49aa-9728-a381803c759e admin admin] Received port after_create {{(pid=91829) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 25 17:01:17.366980 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2dfcd7ce-2023-49aa-9728-a381803c759e admin admin] Pushing event updated for resources: {'Port': ['ID=bcd1bd96-7471-48e7-844a-de3c2de0ab2b,revision_number=1']} {{(pid=91829) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:01:17.373704 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-2dfcd7ce-2023-49aa-9728-a381803c759e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.221s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:01:17.377496 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-2dfcd7ce-2023-49aa-9728-a381803c759e admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-680080'] for router_interface, before_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:01:17.406914 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4e51cbf5-1a73-43f7-bc95-0d7fb6b8f60a req-45865ff8-a67c-4ba1-b8fa-3cfd86502cc7 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:01:17.408426 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-4e51cbf5-1a73-43f7-bc95-0d7fb6b8f60a req-45865ff8-a67c-4ba1-b8fa-3cfd86502cc7 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] 10.222.0.62 "GET /v2.0/ports?device_id=6b63b4a6-5261-4e1c-b796-2f153fc24933 HTTP/1.1" status: 200 len: 944 time: 0.1873627 May 25 17:01:17.477192 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-4e51cbf5-1a73-43f7-bc95-0d7fb6b8f60a req-530d1a78-dc59-498a-acf8-66911707aa6e tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] 10.222.0.62 "GET /v2.0/security-groups?id=f73b90a2-df48-48fb-99e0-5dd4d6a63a15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0556264 May 25 17:01:17.547751 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.provisioning_blocks [None req-783870fd-e65e-41c9-9292-984e4ab425ae None None] Provisioning for port bcd1bd96-7471-48e7-844a-de3c2de0ab2b completed by entity DHCP. {{(pid=91831) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 25 17:01:17.553607 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.provisioning_blocks [None req-783870fd-e65e-41c9-9292-984e4ab425ae None None] Provisioning complete for port bcd1bd96-7471-48e7-844a-de3c2de0ab2b triggered by entity DHCP. {{(pid=91831) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 17:01:17.554689 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-783870fd-e65e-41c9-9292-984e4ab425ae None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3854128'] for port, provisioning_complete {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:01:17.557533 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.db.l3_hamode_db [None req-4f0c2f32-bf30-479e-a431-56803d46853a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'b37963ac-b2c2-4729-b4f8-6c604a1e5a2b', 'name': 'tempest-TestMinimumBasicScenario-1175520845-router', 'tenant_id': '36c1ffa1d458478bac5893b2ddf98eda', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'external_fixed_ips': [{'subnet_id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'ip_address': '172.27.2.22'}], 'enable_snat': True}, 'gw_port_id': 'abb48be3-09be-464d-887e-584de580da17', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T17:01:12Z', 'updated_at': '2021-05-25T17:01:14Z', 'revision_number': 3, 'project_id': '36c1ffa1d458478bac5893b2ddf98eda', 'gw_port': {'id': 'abb48be3-09be-464d-887e-584de580da17', 'name': '', 'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'tenant_id': '', 'mac_address': 'fa:16:3e:3f:15:26', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'b37963ac-b2c2-4729-b4f8-6c604a1e5a2b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 432, 'fixed_ips': [{'subnet_id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'ip_address': '172.27.2.22', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790492-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:01:13Z', 'updated_at': '2021-05-25T17:01:16Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-790492-4-iscsi'}], 'dv-cinder-790492-4-iscsi', False) {} {{(pid=91832) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 17:01:17.562975 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-2dfcd7ce-2023-49aa-9728-a381803c759e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3832070'] for port, before_update {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:01:17.564578 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4f0c2f32-bf30-479e-a431-56803d46853a None None] The sync data for ids ['b37963ac-b2c2-4729-b4f8-6c604a1e5a2b'] in dv-cinder-790492-4-iscsi is: [{'id': 'b37963ac-b2c2-4729-b4f8-6c604a1e5a2b', 'name': 'tempest-TestMinimumBasicScenario-1175520845-router', 'tenant_id': '36c1ffa1d458478bac5893b2ddf98eda', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'external_fixed_ips': [{'subnet_id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'ip_address': '172.27.2.22'}], 'enable_snat': True}, 'gw_port_id': 'abb48be3-09be-464d-887e-584de580da17', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T17:01:12Z', 'updated_at': '2021-05-25T17:01:14Z', 'revision_number': 3, 'project_id': '36c1ffa1d458478bac5893b2ddf98eda', 'gw_port': {'id': 'abb48be3-09be-464d-887e-584de580da17', 'name': '', 'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'tenant_id': '', 'mac_address': 'fa:16:3e:3f:15:26', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'b37963ac-b2c2-4729-b4f8-6c604a1e5a2b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 432, 'fixed_ips': [{'subnet_id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'ip_address': '172.27.2.22', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790492-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:01:13Z', 'updated_at': '2021-05-25T17:01:16Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-790492-4-iscsi'}] {{(pid=91832) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 25 17:01:17.623357 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.plugin [None req-783870fd-e65e-41c9-9292-984e4ab425ae None None] Port bcd1bd96-7471-48e7-844a-de3c2de0ab2b cannot update to ACTIVE because it is not bound. {{(pid=91831) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 25 17:01:17.706453 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.rpc [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Device 19c8c4df-6d31-4527-8bd6-b674eacf537c up at agent ovs-agent-dv-cinder-790492-4-iscsi {{(pid=91831) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 25 17:01:17.791837 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.provisioning_blocks [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Provisioning complete for port 19c8c4df-6d31-4527-8bd6-b674eacf537c triggered by entity L2. {{(pid=91831) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 17:01:17.792202 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3854128'] for port, provisioning_complete {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:01:17.824127 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-2dfcd7ce-2023-49aa-9728-a381803c759e admin admin] Notify callbacks [] for port, precommit_update {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:01:17.830148 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-2dfcd7ce-2023-49aa-9728-a381803c759e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8757892955028', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8757892520933', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8757892521750', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28230801'] for port, after_update {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:01:17.883383 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-84b3f358-d6ad-4264-bf76-810b33627178 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:01:17.998131 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-2dfcd7ce-2023-49aa-9728-a381803c759e admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-549138', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-679997'] for router_interface, after_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:01:18.007662 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2dfcd7ce-2023-49aa-9728-a381803c759e admin admin] Pushing event updated for resources: {'Port': ['ID=bcd1bd96-7471-48e7-844a-de3c2de0ab2b,revision_number=2']} {{(pid=91829) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:01:18.010756 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-2dfcd7ce-2023-49aa-9728-a381803c759e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.132s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:01:18.155900 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-bc355d70-4b57-45d7-9445-85e58637ca3c req-a5232421-bbee-4920-b5b2-c16edcac87ef tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] 10.222.0.62 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-1915957469&fields=id&tenant_id=a736cc60cc2143c4b6dea99321051da5 HTTP/1.1" status: 200 len: 267 time: 0.0750358 May 25 17:01:18.261666 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2dfcd7ce-2023-49aa-9728-a381803c759e admin admin] Network f3ddbe01-13f7-4e15-b7da-2bdffc278cb7 is already hosted by enough agents. {{(pid=91829) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 25 17:01:18.272017 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.scheduler.base_scheduler [None req-2dfcd7ce-2023-49aa-9728-a381803c759e admin admin] Resources bound (agent type, host, resource id): {{(pid=91829) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 17:01:18.501872 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bc355d70-4b57-45d7-9445-85e58637ca3c req-c057920a-12c5-4628-931c-5796665c7c79 tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:01:18.502459 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-bc355d70-4b57-45d7-9445-85e58637ca3c req-c057920a-12c5-4628-931c-5796665c7c79 tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] 10.222.0.62 "GET /v2.0/networks?id=613457eb-6f6d-4604-8f6c-f2d318ff9bc5 HTTP/1.1" status: 200 len: 809 time: 0.3329933 May 25 17:01:18.541733 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-bc355d70-4b57-45d7-9445-85e58637ca3c req-b602d6d1-c113-4011-929d-b42b8fbc7751 tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] 10.222.0.62 "GET /v2.0/quotas/a736cc60cc2143c4b6dea99321051da5 HTTP/1.1" status: 200 len: 375 time: 0.0191865 May 25 17:01:18.548002 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.provisioning_blocks [None req-4fa644fb-2b4d-408e-9613-0066faa334f3 None None] Provisioning complete for port bcd1bd96-7471-48e7-844a-de3c2de0ab2b triggered by entity DHCP. {{(pid=91831) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 17:01:18.549084 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-4fa644fb-2b4d-408e-9613-0066faa334f3 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3854128'] for port, provisioning_complete {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:01:18.605601 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.plugin [None req-4fa644fb-2b4d-408e-9613-0066faa334f3 None None] Port bcd1bd96-7471-48e7-844a-de3c2de0ab2b cannot update to ACTIVE because it is not bound. {{(pid=91831) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 25 17:01:18.621073 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-2dfcd7ce-2023-49aa-9728-a381803c759e admin admin] Router b37963ac-b2c2-4729-b4f8-6c604a1e5a2b has already been hosted by L3 agent a2d427c1-2d07-43e8-afbe-218c9f7d0445 {{(pid=91829) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 25 17:01:18.925449 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.quota.resource [req-bc355d70-4b57-45d7-9445-85e58637ca3c req-2ac5c47f-fcec-4e43-8944-688e28f9cbe2 tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] Synchronizing usage tracker for tenant:a736cc60cc2143c4b6dea99321051da5 on resource:port {{(pid=91829) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 25 17:01:18.979024 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9c4b0c72-fc63-4928-8805-d998517c57f7 req-5dbfd869-8a68-4626-80af-bfe4834abe8a tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:01:18.980445 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-9c4b0c72-fc63-4928-8805-d998517c57f7 req-5dbfd869-8a68-4626-80af-bfe4834abe8a tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] 10.222.0.62 "GET /v2.0/ports?device_id=6b63b4a6-5261-4e1c-b796-2f153fc24933 HTTP/1.1" status: 200 len: 944 time: 0.3668122 May 25 17:01:19.003060 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.quota.resource [req-bc355d70-4b57-45d7-9445-85e58637ca3c req-2ac5c47f-fcec-4e43-8944-688e28f9cbe2 tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] Unset dirty status for tenant:a736cc60cc2143c4b6dea99321051da5 on resource:port {{(pid=91829) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 25 17:01:19.004315 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-bc355d70-4b57-45d7-9445-85e58637ca3c req-2ac5c47f-fcec-4e43-8944-688e28f9cbe2 tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] 10.222.0.62 "GET /v2.0/ports?tenant_id=a736cc60cc2143c4b6dea99321051da5&fields=id HTTP/1.1" status: 200 len: 302 time: 0.4472966 May 25 17:01:19.005281 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-2dfcd7ce-2023-49aa-9728-a381803c759e admin admin] Notify agent at l3_agent.dv-cinder-790492-4-iscsi the message routers_updated {{(pid=91829) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 25 17:01:19.052312 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [None req-2dfcd7ce-2023-49aa-9728-a381803c759e admin admin] 10.222.0.62 "PUT /v2.0/routers/b37963ac-b2c2-4729-b4f8-6c604a1e5a2b/add_router_interface HTTP/1.1" status: 200 len: 503 time: 3.5149963 May 25 17:01:19.121401 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-9c4b0c72-fc63-4928-8805-d998517c57f7 req-805d4b30-ad46-48ca-af8e-61b66971f2c0 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] 10.222.0.62 "GET /v2.0/security-groups?id=f73b90a2-df48-48fb-99e0-5dd4d6a63a15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1334181 May 25 17:01:19.170744 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-bc355d70-4b57-45d7-9445-85e58637ca3c req-0096ec67-131c-40a9-8d39-113562f689b9 service neutron] 10.222.0.62 "GET /v2.0/networks/613457eb-6f6d-4604-8f6c-f2d318ff9bc5?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1526082 May 25 17:01:19.284225 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c6244703-c631-46fc-aa23-cf39686c6d51 None None] Sync routers for ids ['b37963ac-b2c2-4729-b4f8-6c604a1e5a2b'] in dv-cinder-790492-4-iscsi {{(pid=91831) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 25 17:01:19.296199 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c6244703-c631-46fc-aa23-cf39686c6d51 None None] Routers {'b37963ac-b2c2-4729-b4f8-6c604a1e5a2b'} bound to L3 agent in host dv-cinder-790492-4-iscsi {{(pid=91831) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 17:01:19.296908 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.l3_hamode_db [None req-c6244703-c631-46fc-aa23-cf39686c6d51 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-790492-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-05-25T16:50:28Z,description=,heartbeat_timestamp=2021-05-25T17:00:58Z,host='dv-cinder-790492-4-iscsi',id=a2d427c1-2d07-43e8-afbe-218c9f7d0445,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T16:50:28Z,topic='l3_agent')) {'router_ids': ['b37963ac-b2c2-4729-b4f8-6c604a1e5a2b'], 'active': True} {{(pid=91831) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 17:01:19.317875 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-bc355d70-4b57-45d7-9445-85e58637ca3c req-3274e847-0828-448a-be97-89de1d0bea96 service neutron] 10.222.0.62 "GET /v2.0/networks/613457eb-6f6d-4604-8f6c-f2d318ff9bc5?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1403263 May 25 17:01:19.361185 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.rpc [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Device 85443de0-772c-4d18-bd76-026a72cc754d up at agent hyperv_hv-cinder-79049 {{(pid=91831) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 25 17:01:19.574373 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.provisioning_blocks [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Provisioning for port 85443de0-772c-4d18-bd76-026a72cc754d completed by entity L2. {{(pid=91831) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 25 17:01:19.584073 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.provisioning_blocks [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Provisioning complete for port 85443de0-772c-4d18-bd76-026a72cc754d triggered by entity L2. {{(pid=91831) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 17:01:19.584500 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3854128'] for port, provisioning_complete {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:01:19.638714 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.l3_dvr_db [None req-c6244703-c631-46fc-aa23-cf39686c6d51 None None] Set router b37963ac-b2c2-4729-b4f8-6c604a1e5a2b gateway port host: dv-cinder-790492-4-iscsi {{(pid=91831) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 17:01:19.792022 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.rpc [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Device abb48be3-09be-464d-887e-584de580da17 up at agent ovs-agent-dv-cinder-790492-4-iscsi {{(pid=91831) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 25 17:01:19.801597 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.wsgi [-] (91829) accepted ('10.222.0.62', 60420) {{(pid=91829) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:01:19.812634 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.v2.base [None req-8a0888b5-a9ab-4b87-bfc4-0d6f61161c64 admin admin] Request body: {'network': {'name': 'tempest-TestMinimumBasicScenario-1151073527-network', 'tenant_id': 'a60ff90c536747ff984cf0591f1a098b'}} {{(pid=91829) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 17:01:19.835461 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.quota.driver [None req-8a0888b5-a9ab-4b87-bfc4-0d6f61161c64 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91829) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 17:01:19.842774 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.quota.resource [None req-8a0888b5-a9ab-4b87-bfc4-0d6f61161c64 admin admin] Usage tracker for resource:network and tenant:a60ff90c536747ff984cf0591f1a098b is out of sync, need to count used quota {{(pid=91829) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 17:01:19.845901 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.quota.resource [None req-8a0888b5-a9ab-4b87-bfc4-0d6f61161c64 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=91829) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 17:01:19.911423 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.quota.driver [None req-8a0888b5-a9ab-4b87-bfc4-0d6f61161c64 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91829) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 17:01:19.934500 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-9dd5b10a-ccd9-4b12-9d9a-e10fe5ef45f0 req-70c71da6-7c43-462a-8bfa-816a223aa6e2 tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] 10.222.0.62 "GET /v2.0/ports?device_id=482f4d0c-0df9-4de7-9c75-b28c728be580 HTTP/1.1" status: 200 len: 210 time: 0.0800455 May 25 17:01:19.946139 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-8a0888b5-a9ab-4b87-bfc4-0d6f61161c64 admin admin] Made reservation on behalf of a60ff90c536747ff984cf0591f1a098b for: {'network': 1} {{(pid=91829) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 25 17:01:19.948977 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-8a0888b5-a9ab-4b87-bfc4-0d6f61161c64 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-3832077'] for network, before_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:01:19.964867 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-8a0888b5-a9ab-4b87-bfc4-0d6f61161c64 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:01:19.986053 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.quota.driver [None req-8a0888b5-a9ab-4b87-bfc4-0d6f61161c64 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91829) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 17:01:19.991047 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.quota.resource [None req-8a0888b5-a9ab-4b87-bfc4-0d6f61161c64 admin admin] Usage tracker for resource:security_group_rule and tenant:a60ff90c536747ff984cf0591f1a098b is out of sync, need to count used quota {{(pid=91829) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 17:01:19.993987 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.quota.resource [None req-8a0888b5-a9ab-4b87-bfc4-0d6f61161c64 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91829) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 17:01:20.003444 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.quota.driver [None req-8a0888b5-a9ab-4b87-bfc4-0d6f61161c64 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91829) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 17:01:20.019501 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3832070'] for port, before_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:01:20.092423 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '6b63b4a6-5261-4e1c-b796-2f153fc24933', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '85443de0-772c-4d18-bd76-026a72cc754d'}] {{(pid=91831) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 25 17:01:20.112198 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-8a0888b5-a9ab-4b87-bfc4-0d6f61161c64 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:01:20.120869 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-8a0888b5-a9ab-4b87-bfc4-0d6f61161c64 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-640836'] for security_group, after_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:01:20.126021 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-cdad4274-1186-4dda-9254-bd3782906678 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:01:20.133931 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.provisioning_blocks [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Provisioning for port abb48be3-09be-464d-887e-584de580da17 completed by entity L2. {{(pid=91831) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 25 17:01:20.138692 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.db [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] For port 85443de0-772c-4d18-bd76-026a72cc754d, host hv-cinder-79049, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79049',level=0,port_id=85443de0-772c-4d18-bd76-026a72cc754d,segment=NetworkSegment(7d7273c2-c6dd-43fe-83a8-cb776d48dc70),segment_id=7d7273c2-c6dd-43fe-83a8-cb776d48dc70)] {{(pid=91831) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 17:01:20.147384 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.provisioning_blocks [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Provisioning complete for port abb48be3-09be-464d-887e-584de580da17 triggered by entity L2. {{(pid=91831) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 17:01:20.147986 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3854128'] for port, provisioning_complete {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:01:20.172373 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a0888b5-a9ab-4b87-bfc4-0d6f61161c64 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=5f670629-5849-44ab-878d-8949864207a2,revision_number=1']} {{(pid=91829) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:01:20.175118 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-8a0888b5-a9ab-4b87-bfc4-0d6f61161c64 admin admin] vlan segment allocate from pool success with {'vlan_id': 682, 'physical_network': 'physnet1'} {{(pid=91829) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 25 17:01:20.177474 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-8a0888b5-a9ab-4b87-bfc4-0d6f61161c64 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.051s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:01:20.198583 dv-cinder-790492-4-iscsi neutron-server[91831]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '6b63b4a6-5261-4e1c-b796-2f153fc24933', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '85443de0-772c-4d18-bd76-026a72cc754d', 'code': 200} May 25 17:01:20.206046 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-8a0888b5-a9ab-4b87-bfc4-0d6f61161c64 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3809789'] for segment, precommit_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:01:20.207806 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.db.segments_db [None req-8a0888b5-a9ab-4b87-bfc4-0d6f61161c64 admin admin] Added segment ed45d58b-5f76-41a7-95d9-322227308621 of type vlan for network faa2de89-15e9-41fa-ad3d-fb87f039acb9 May 25 17:01:20.238908 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8757892955028', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8757892520933', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8757892521750'] for port, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:01:20.241872 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-8a0888b5-a9ab-4b87-bfc4-0d6f61161c64 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8757892541013'] for network, precommit_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:01:20.256225 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [None req-4ab4d9ba-2f68-4214-a4f4-a30840f53de0 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:01:20.284459 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-8a0888b5-a9ab-4b87-bfc4-0d6f61161c64 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-640806', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-551400'] for network, after_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:01:20.288644 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8a0888b5-a9ab-4b87-bfc4-0d6f61161c64 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:01:20.289306 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-8a0888b5-a9ab-4b87-bfc4-0d6f61161c64 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-551373'] for network, before_response {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:01:20.297427 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:01:20.377100 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Pushing event updated for resources: {'Port': ['ID=85443de0-772c-4d18-bd76-026a72cc754d,revision_number=5']} {{(pid=91831) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:01:20.380706 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.124s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:01:20.436475 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.l3_hamode_db [None req-c6244703-c631-46fc-aa23-cf39686c6d51 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'b37963ac-b2c2-4729-b4f8-6c604a1e5a2b', 'name': 'tempest-TestMinimumBasicScenario-1175520845-router', 'tenant_id': '36c1ffa1d458478bac5893b2ddf98eda', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'external_fixed_ips': [{'subnet_id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'ip_address': '172.27.2.22'}], 'enable_snat': True}, 'gw_port_id': 'abb48be3-09be-464d-887e-584de580da17', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T17:01:12Z', 'updated_at': '2021-05-25T17:01:17Z', 'revision_number': 4, 'project_id': '36c1ffa1d458478bac5893b2ddf98eda', 'gw_port': {'id': 'abb48be3-09be-464d-887e-584de580da17', 'name': '', 'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'tenant_id': '', 'mac_address': 'fa:16:3e:3f:15:26', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'b37963ac-b2c2-4729-b4f8-6c604a1e5a2b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 432, 'fixed_ips': [{'subnet_id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'ip_address': '172.27.2.22', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790492-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:01:13Z', 'updated_at': '2021-05-25T17:01:16Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-790492-4-iscsi', '_interfaces': [{'id': 'bcd1bd96-7471-48e7-844a-de3c2de0ab2b', 'name': '', 'network_id': 'f3ddbe01-13f7-4e15-b7da-2bdffc278cb7', 'tenant_id': '36c1ffa1d458478bac5893b2ddf98eda', 'mac_address': 'fa:16:3e:a1:cb:e4', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'b37963ac-b2c2-4729-b4f8-6c604a1e5a2b', 'device_owner': 'network:router_interface', 'standard_attr_id': 433, 'fixed_ips': [{'subnet_id': '69fba530-cce2-44a2-89bd-18a52f9d454c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:01:16Z', 'updated_at': '2021-05-25T17:01:17Z', 'revision_number': 2, 'project_id': '36c1ffa1d458478bac5893b2ddf98eda', 'subnets': [{'id': '69fba530-cce2-44a2-89bd-18a52f9d454c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-790492-4-iscsi', False) {} {{(pid=91831) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 17:01:20.445385 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c6244703-c631-46fc-aa23-cf39686c6d51 None None] Checking router: b37963ac-b2c2-4729-b4f8-6c604a1e5a2b for host: dv-cinder-790492-4-iscsi {{(pid=91831) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 25 17:01:20.445740 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c6244703-c631-46fc-aa23-cf39686c6d51 None None] Updating router b37963ac-b2c2-4729-b4f8-6c604a1e5a2b port bcd1bd96-7471-48e7-844a-de3c2de0ab2b binding host dv-cinder-790492-4-iscsi {{(pid=91831) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} May 25 17:01:20.490162 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [None req-8a0888b5-a9ab-4b87-bfc4-0d6f61161c64 admin admin] 10.222.0.62 "POST /v2.0/networks HTTP/1.1" status: 201 len: 888 time: 0.6871986 May 25 17:01:20.491565 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.wsgi [-] (91829) accepted ('10.222.0.62', 60438) {{(pid=91829) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:01:20.491682 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3832070'] for port, before_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:01:20.505436 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.v2.base [None req-30c959cc-25a1-42fa-b7ef-9af2ffbf61b4 admin admin] Request body: {'subnet': {'network_id': 'faa2de89-15e9-41fa-ad3d-fb87f039acb9', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestMinimumBasicScenario-1151073527-subnet', 'tenant_id': 'a60ff90c536747ff984cf0591f1a098b', 'ip_version': 4}} {{(pid=91829) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 17:01:20.511860 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.quota.driver [None req-30c959cc-25a1-42fa-b7ef-9af2ffbf61b4 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91829) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 17:01:20.518700 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.db [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] For port abb48be3-09be-464d-887e-584de580da17, host dv-cinder-790492-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-790492-4-iscsi',level=0,port_id=abb48be3-09be-464d-887e-584de580da17,segment=NetworkSegment(414a8468-1d66-4792-9e81-d8ac5ccf1512),segment_id=414a8468-1d66-4792-9e81-d8ac5ccf1512)] {{(pid=91831) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 17:01:20.520033 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.quota.resource [None req-30c959cc-25a1-42fa-b7ef-9af2ffbf61b4 admin admin] Usage tracker for resource:subnet and tenant:a60ff90c536747ff984cf0591f1a098b is out of sync, need to count used quota {{(pid=91829) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 17:01:20.521729 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-c6244703-c631-46fc-aa23-cf39686c6d51 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3832070'] for port, before_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:01:20.524033 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.quota.resource [None req-30c959cc-25a1-42fa-b7ef-9af2ffbf61b4 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=91829) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 17:01:20.532135 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.quota.driver [None req-30c959cc-25a1-42fa-b7ef-9af2ffbf61b4 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91829) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 17:01:20.532343 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8757892955028', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8757892520933', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8757892521750'] for port, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:01:20.537971 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:01:20.547358 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-30c959cc-25a1-42fa-b7ef-9af2ffbf61b4 admin admin] Made reservation on behalf of a60ff90c536747ff984cf0591f1a098b for: {'subnet': 1} {{(pid=91829) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 25 17:01:20.549683 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-30c959cc-25a1-42fa-b7ef-9af2ffbf61b4 admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-28266129'] for subnet, before_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:01:20.593412 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eee9ff33-fa8c-47ea-91d3-97ef2e848368 req-41fb7862-c233-4f9b-a5d7-ebc98278539c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91830) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:01:20.598030 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-eee9ff33-fa8c-47ea-91d3-97ef2e848368 req-41fb7862-c233-4f9b-a5d7-ebc98278539c service neutron] 10.222.0.32 "GET /v2.0/ports?device_id=6b63b4a6-5261-4e1c-b796-2f153fc24933 HTTP/1.1" status: 200 len: 1098 time: 0.1824982 May 25 17:01:20.661694 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-eee9ff33-fa8c-47ea-91d3-97ef2e848368 req-3aa90b5c-122d-4121-b548-738ede1dcc01 service neutron] 10.222.0.32 "GET /v2.0/security-groups?id=f73b90a2-df48-48fb-99e0-5dd4d6a63a15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0396047 May 25 17:01:20.708336 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Pushing event updated for resources: {'Port': ['ID=abb48be3-09be-464d-887e-584de580da17,revision_number=4']} {{(pid=91831) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:01:20.710856 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a0888b5-a9ab-4b87-bfc4-0d6f61161c64 admin admin] Pushing event updated for resources: {'Network': ['ID=faa2de89-15e9-41fa-ad3d-fb87f039acb9,revision_number=1']} {{(pid=91829) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:01:20.712324 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.174s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:01:20.716666 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-8a0888b5-a9ab-4b87-bfc4-0d6f61161c64 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.419s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:01:20.783025 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.rpc [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Network faa2de89-15e9-41fa-ad3d-fb87f039acb9 details requested by agent ovs-agent-dv-cinder-790492-4-iscsi with host dv-cinder-790492-4-iscsi {{(pid=91831) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 25 17:01:20.802556 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6c6b91c5-681b-465b-b861-caff284dd4c8 req-6ec6a559-74ac-4cf4-bc72-5bf98cefea8d tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:01:20.804759 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-6c6b91c5-681b-465b-b861-caff284dd4c8 req-6ec6a559-74ac-4cf4-bc72-5bf98cefea8d tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] 10.222.0.62 "GET /v2.0/ports?device_id=6b63b4a6-5261-4e1c-b796-2f153fc24933 HTTP/1.1" status: 200 len: 945 time: 0.5084507 May 25 17:01:20.888816 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-6c6b91c5-681b-465b-b861-caff284dd4c8 req-b8d25eda-57f3-4b96-b673-3dce15918377 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] 10.222.0.62 "GET /v2.0/security-groups?id=f73b90a2-df48-48fb-99e0-5dd4d6a63a15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0765910 May 25 17:01:21.097023 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-c6244703-c631-46fc-aa23-cf39686c6d51 None None] Notify callbacks [] for port, precommit_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:01:21.109139 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.provisioning_blocks [None req-c6244703-c631-46fc-aa23-cf39686c6d51 None None] Transition to ACTIVE for port object bcd1bd96-7471-48e7-844a-de3c2de0ab2b will not be triggered until provisioned by entity L2. {{(pid=91831) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 25 17:01:21.115566 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-c6244703-c631-46fc-aa23-cf39686c6d51 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8757892955028', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8757892520933', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8757892521750'] for port, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:01:21.119291 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:01:21.141221 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-74d36b25-832d-4e54-87b7-b42656c0b393 req-69dfea17-8191-4cdb-8f0a-760a0f62c703 tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] 10.222.0.62 "GET /v2.0/ports?device_id=482f4d0c-0df9-4de7-9c75-b28c728be580 HTTP/1.1" status: 200 len: 210 time: 0.0594165 May 25 17:01:21.153271 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-30c959cc-25a1-42fa-b7ef-9af2ffbf61b4 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55886', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-27333672', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-28266119'] for subnet, after_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:01:21.158730 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-e34ce3ce-8eb2-4d71-81b0-2cf1839b21ac admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:01:21.232598 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-30c959cc-25a1-42fa-b7ef-9af2ffbf61b4 admin admin] Pushing event updated for resources: {'Subnet': ['ID=ccf0e45f-5342-4190-89c1-d04cd1f8e468,revision_number=0']} {{(pid=91829) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:01:21.244395 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-30c959cc-25a1-42fa-b7ef-9af2ffbf61b4 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91829) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:01:21.244757 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-30c959cc-25a1-42fa-b7ef-9af2ffbf61b4 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91829) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:01:21.245115 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-30c959cc-25a1-42fa-b7ef-9af2ffbf61b4 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91829) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:01:21.245461 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-30c959cc-25a1-42fa-b7ef-9af2ffbf61b4 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91829) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:01:21.245802 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-30c959cc-25a1-42fa-b7ef-9af2ffbf61b4 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91829) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:01:21.246170 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-30c959cc-25a1-42fa-b7ef-9af2ffbf61b4 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91829) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:01:21.246512 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-30c959cc-25a1-42fa-b7ef-9af2ffbf61b4 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91829) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:01:21.246854 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-30c959cc-25a1-42fa-b7ef-9af2ffbf61b4 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91829) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:01:21.247188 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-30c959cc-25a1-42fa-b7ef-9af2ffbf61b4 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91829) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:01:21.247556 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-30c959cc-25a1-42fa-b7ef-9af2ffbf61b4 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91829) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:01:21.247918 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-30c959cc-25a1-42fa-b7ef-9af2ffbf61b4 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91829) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:01:21.248250 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-30c959cc-25a1-42fa-b7ef-9af2ffbf61b4 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91829) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:01:21.254889 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-30c959cc-25a1-42fa-b7ef-9af2ffbf61b4 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.096s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:01:21.255533 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-30c959cc-25a1-42fa-b7ef-9af2ffbf61b4 admin admin] Checking segment: {'id': 'ed45d58b-5f76-41a7-95d9-322227308621', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 682, 'network_id': 'faa2de89-15e9-41fa-ad3d-fb87f039acb9'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91829) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 25 17:01:21.255844 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-30c959cc-25a1-42fa-b7ef-9af2ffbf61b4 admin admin] Network hostable DHCP agents. Network: faa2de89-15e9-41fa-ad3d-fb87f039acb9, hostable agents: ['8d7401c6-8951-4f2b-ace4-208761782bfc'], hosted agents: [] {{(pid=91829) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 25 17:01:21.279409 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-30c959cc-25a1-42fa-b7ef-9af2ffbf61b4 admin admin] Network faa2de89-15e9-41fa-ad3d-fb87f039acb9 is scheduled to be hosted by DHCP agent 8d7401c6-8951-4f2b-ace4-208761782bfc with binding_index 1 {{(pid=91829) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 25 17:01:21.284886 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dbccdb86-a843-4579-865e-b4299e6f33cf None None] Pushing event updated for resources: {'Port': ['ID=bcd1bd96-7471-48e7-844a-de3c2de0ab2b,revision_number=3']} {{(pid=91831) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:01:21.291137 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.scheduler.base_scheduler [None req-30c959cc-25a1-42fa-b7ef-9af2ffbf61b4 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-790492-4-iscsi, faa2de89-15e9-41fa-ad3d-fb87f039acb9) {{(pid=91829) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 17:01:21.305374 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-30c959cc-25a1-42fa-b7ef-9af2ffbf61b4 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:01:21.306083 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-30c959cc-25a1-42fa-b7ef-9af2ffbf61b4 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-551373'] for subnet, before_response {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:01:21.315079 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [None req-dbccdb86-a843-4579-865e-b4299e6f33cf None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.196s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:01:21.315881 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-dd2a5852-a945-4860-b063-23b516f32306 None None] Network faa2de89-15e9-41fa-ad3d-fb87f039acb9 requested from dv-cinder-790492-4-iscsi {{(pid=91831) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} May 25 17:01:21.337367 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.wsgi [-] (91830) accepted ('10.222.0.62', 60450) {{(pid=91830) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:01:21.337582 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [None req-30c959cc-25a1-42fa-b7ef-9af2ffbf61b4 admin admin] 10.222.0.62 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 851 time: 0.8424976 May 25 17:01:21.345012 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.v2.base [None req-a3eecb13-2f0e-4d6f-a2c7-30e627ff22c9 admin admin] Request body: {'router': {'name': 'tempest-TestMinimumBasicScenario-1151073527-router', 'tenant_id': 'a60ff90c536747ff984cf0591f1a098b', 'external_gateway_info': {'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74'}}} {{(pid=91830) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 17:01:21.350257 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.quota.driver [None req-a3eecb13-2f0e-4d6f-a2c7-30e627ff22c9 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91830) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 17:01:21.354769 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [None req-a3eecb13-2f0e-4d6f-a2c7-30e627ff22c9 admin admin] Usage tracker for resource:router and tenant:a60ff90c536747ff984cf0591f1a098b is out of sync, need to count used quota {{(pid=91830) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 17:01:21.358030 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [None req-a3eecb13-2f0e-4d6f-a2c7-30e627ff22c9 admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=91830) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 17:01:21.363948 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.quota.driver [None req-a3eecb13-2f0e-4d6f-a2c7-30e627ff22c9 admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91830) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 17:01:21.378832 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-a3eecb13-2f0e-4d6f-a2c7-30e627ff22c9 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-684888', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-31042'] for router, before_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:01:21.380059 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-a3eecb13-2f0e-4d6f-a2c7-30e627ff22c9 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-684376', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-683143', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-647018', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-31049'] for router, precommit_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:01:21.399330 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-a3eecb13-2f0e-4d6f-a2c7-30e627ff22c9 admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:01:21.458156 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.managers [None req-c6244703-c631-46fc-aa23-cf39686c6d51 None None] Attempting to bind port bcd1bd96-7471-48e7-844a-de3c2de0ab2b on host dv-cinder-790492-4-iscsi for vnic_type normal with profile {{(pid=91831) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 25 17:01:21.458534 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.managers [None req-c6244703-c631-46fc-aa23-cf39686c6d51 None None] Attempting to bind port bcd1bd96-7471-48e7-844a-de3c2de0ab2b by drivers openvswitch,hyperv on host dv-cinder-790492-4-iscsi at level 0 using segments [{'id': '5aed6094-89e8-4c7c-ba89-9b30d3e98cd0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 692, 'network_id': 'f3ddbe01-13f7-4e15-b7da-2bdffc278cb7'}] {{(pid=91831) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 25 17:01:21.458896 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c6244703-c631-46fc-aa23-cf39686c6d51 None None] Attempting to bind port bcd1bd96-7471-48e7-844a-de3c2de0ab2b on network f3ddbe01-13f7-4e15-b7da-2bdffc278cb7 {{(pid=91831) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 25 17:01:21.477183 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c6244703-c631-46fc-aa23-cf39686c6d51 None None] Checking agent: {'id': 'fc8251e1-071c-49f7-bc10-1337f1d37d1b', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-790492-4-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 25, 16, 50, 28), 'started_at': datetime.datetime(2021, 5, 25, 16, 50, 58), 'heartbeat_timestamp': datetime.datetime(2021, 5, 25, 17, 0, 58), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-790492-4-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=91831) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 25 17:01:21.477659 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c6244703-c631-46fc-aa23-cf39686c6d51 None None] Checking segment: {'id': '5aed6094-89e8-4c7c-ba89-9b30d3e98cd0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 692, 'network_id': 'f3ddbe01-13f7-4e15-b7da-2bdffc278cb7'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91831) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 25 17:01:21.478044 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-c6244703-c631-46fc-aa23-cf39686c6d51 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:01:21.478376 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c6244703-c631-46fc-aa23-cf39686c6d51 None None] Bound using segment: {'id': '5aed6094-89e8-4c7c-ba89-9b30d3e98cd0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 692, 'network_id': 'f3ddbe01-13f7-4e15-b7da-2bdffc278cb7'} {{(pid=91831) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 25 17:01:21.478848 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.managers [None req-c6244703-c631-46fc-aa23-cf39686c6d51 None None] Bound port: bcd1bd96-7471-48e7-844a-de3c2de0ab2b, host: dv-cinder-790492-4-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '5aed6094-89e8-4c7c-ba89-9b30d3e98cd0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 692, 'network_id': 'f3ddbe01-13f7-4e15-b7da-2bdffc278cb7'}}] {{(pid=91831) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 25 17:01:21.479224 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-c6244703-c631-46fc-aa23-cf39686c6d51 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3832070'] for port, before_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:01:21.683407 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.db [None req-c6244703-c631-46fc-aa23-cf39686c6d51 None None] For port bcd1bd96-7471-48e7-844a-de3c2de0ab2b, host dv-cinder-790492-4-iscsi, cleared binding levels {{(pid=91831) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 25 17:01:21.693728 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.db [None req-c6244703-c631-46fc-aa23-cf39686c6d51 None None] For port bcd1bd96-7471-48e7-844a-de3c2de0ab2b, host dv-cinder-790492-4-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-790492-4-iscsi',level=0,port_id=bcd1bd96-7471-48e7-844a-de3c2de0ab2b,segment=NetworkSegment(5aed6094-89e8-4c7c-ba89-9b30d3e98cd0),segment_id=5aed6094-89e8-4c7c-ba89-9b30d3e98cd0)] {{(pid=91831) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 25 17:01:21.696880 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-12a18a89-5b44-4402-8d0e-0f0a132bc88f None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp6d7ebc81-b6b5-52ec-b8f5-10a9de34bf46-faa2de89-15e9-41fa-ad3d-fb87f039acb9', 'network_id': 'faa2de89-15e9-41fa-ad3d-fb87f039acb9', 'tenant_id': 'a60ff90c536747ff984cf0591f1a098b', 'fixed_ips': [{'subnet_id': 'ccf0e45f-5342-4190-89c1-d04cd1f8e468'}]}} from dv-cinder-790492-4-iscsi. {{(pid=91831) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} May 25 17:01:21.697900 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-12a18a89-5b44-4402-8d0e-0f0a132bc88f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3832070'] for port, before_create {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:01:21.710795 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-c6244703-c631-46fc-aa23-cf39686c6d51 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8757892955028', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8757892520933', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8757892521750'] for port, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:01:21.722327 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:01:21.766004 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.rpc [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Device abb48be3-09be-464d-887e-584de580da17 up at agent ovs-agent-dv-cinder-790492-4-iscsi {{(pid=91831) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 25 17:01:21.860221 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-a3eecb13-2f0e-4d6f-a2c7-30e627ff22c9 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-683170', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-684906', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-31039'] for router, precommit_update {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:01:21.924028 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bc355d70-4b57-45d7-9445-85e58637ca3c req-b1832b29-084f-4f58-9292-ef55f161c3e0 tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=91830) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:01:21.926216 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [req-bc355d70-4b57-45d7-9445-85e58637ca3c req-b1832b29-084f-4f58-9292-ef55f161c3e0 tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] Synchronizing usage tracker for tenant:a736cc60cc2143c4b6dea99321051da5 on resource:network {{(pid=91830) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 25 17:01:21.926731 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c6244703-c631-46fc-aa23-cf39686c6d51 None None] Routers {'b37963ac-b2c2-4729-b4f8-6c604a1e5a2b'} bound to L3 agent in host dv-cinder-790492-4-iscsi {{(pid=91831) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 17:01:21.927545 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.l3_hamode_db [None req-c6244703-c631-46fc-aa23-cf39686c6d51 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-790492-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-05-25T16:50:28Z,description=,heartbeat_timestamp=2021-05-25T17:00:58Z,host='dv-cinder-790492-4-iscsi',id=a2d427c1-2d07-43e8-afbe-218c9f7d0445,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T16:50:28Z,topic='l3_agent')) {'router_ids': ['b37963ac-b2c2-4729-b4f8-6c604a1e5a2b'], 'active': True} {{(pid=91831) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 17:01:22.000834 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dbccdb86-a843-4579-865e-b4299e6f33cf None None] Pushing event updated for resources: {'Port': ['ID=bcd1bd96-7471-48e7-844a-de3c2de0ab2b,revision_number=4']} {{(pid=91831) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:01:22.028217 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dbccdb86-a843-4579-865e-b4299e6f33cf None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91831) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:01:22.029211 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dbccdb86-a843-4579-865e-b4299e6f33cf None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91831) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:01:22.029561 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dbccdb86-a843-4579-865e-b4299e6f33cf None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91831) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:01:22.029986 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dbccdb86-a843-4579-865e-b4299e6f33cf None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91831) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:01:22.030324 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dbccdb86-a843-4579-865e-b4299e6f33cf None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91831) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:01:22.030651 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dbccdb86-a843-4579-865e-b4299e6f33cf None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91831) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:01:22.031043 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dbccdb86-a843-4579-865e-b4299e6f33cf None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91831) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:01:22.031436 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dbccdb86-a843-4579-865e-b4299e6f33cf None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91831) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:01:22.031817 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dbccdb86-a843-4579-865e-b4299e6f33cf None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91831) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:01:22.032403 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dbccdb86-a843-4579-865e-b4299e6f33cf None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91831) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:01:22.032931 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dbccdb86-a843-4579-865e-b4299e6f33cf None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91831) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:01:22.033415 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-dbccdb86-a843-4579-865e-b4299e6f33cf None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91831) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:01:22.040323 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [None req-dbccdb86-a843-4579-865e-b4299e6f33cf None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.318s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:01:22.053572 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [req-bc355d70-4b57-45d7-9445-85e58637ca3c req-b1832b29-084f-4f58-9292-ef55f161c3e0 tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] Unset dirty status for tenant:a736cc60cc2143c4b6dea99321051da5 on resource:network {{(pid=91830) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 25 17:01:22.054998 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-bc355d70-4b57-45d7-9445-85e58637ca3c req-b1832b29-084f-4f58-9292-ef55f161c3e0 tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] 10.222.0.32 "GET /v2.0/networks?id=613457eb-6f6d-4604-8f6c-f2d318ff9bc5 HTTP/1.1" status: 200 len: 809 time: 0.5716579 May 25 17:01:22.069954 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.provisioning_blocks [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Provisioning complete for port abb48be3-09be-464d-887e-584de580da17 triggered by entity L2. {{(pid=91831) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 17:01:22.070168 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3854128'] for port, provisioning_complete {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:01:22.157244 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [req-bc355d70-4b57-45d7-9445-85e58637ca3c req-5481fb24-e7d3-4506-997a-ee34c72dadf7 tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] Synchronizing usage tracker for tenant:a736cc60cc2143c4b6dea99321051da5 on resource:security_group {{(pid=91830) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 25 17:01:22.194477 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2cae5c1d-f2e6-4ff8-97f8-61c2b1ac1d00 req-4cf33ee7-29af-475e-8c83-33c2f5424554 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:01:22.196181 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-2cae5c1d-f2e6-4ff8-97f8-61c2b1ac1d00 req-4cf33ee7-29af-475e-8c83-33c2f5424554 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] 10.222.0.62 "GET /v2.0/ports?device_id=6b63b4a6-5261-4e1c-b796-2f153fc24933 HTTP/1.1" status: 200 len: 945 time: 0.1291115 May 25 17:01:22.333350 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.l3_dvr_db [None req-c6244703-c631-46fc-aa23-cf39686c6d51 None None] Set router b37963ac-b2c2-4729-b4f8-6c604a1e5a2b gateway port host: dv-cinder-790492-4-iscsi {{(pid=91831) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 17:01:22.338214 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-d898924b-c13f-4028-925f-7de6be82dbf7 req-0e162da9-4df7-4260-a072-e82f3332e94b tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] 10.222.0.62 "GET /v2.0/ports?device_id=482f4d0c-0df9-4de7-9c75-b28c728be580 HTTP/1.1" status: 200 len: 210 time: 0.0542176 May 25 17:01:22.347211 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-2cae5c1d-f2e6-4ff8-97f8-61c2b1ac1d00 req-6480d0b6-b367-44b7-99df-ee438dce5372 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] 10.222.0.62 "GET /v2.0/security-groups?id=f73b90a2-df48-48fb-99e0-5dd4d6a63a15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1444709 May 25 17:01:22.453124 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [req-bc355d70-4b57-45d7-9445-85e58637ca3c req-5481fb24-e7d3-4506-997a-ee34c72dadf7 tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] Unset dirty status for tenant:a736cc60cc2143c4b6dea99321051da5 on resource:security_group {{(pid=91830) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 25 17:01:22.454291 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-bc355d70-4b57-45d7-9445-85e58637ca3c req-5481fb24-e7d3-4506-997a-ee34c72dadf7 tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] 10.222.0.32 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=a736cc60cc2143c4b6dea99321051da5 HTTP/1.1" status: 200 len: 380 time: 0.3807456 May 25 17:01:22.475799 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.v2.base [req-bc355d70-4b57-45d7-9445-85e58637ca3c req-a5cb100a-fc0f-4f4b-9097-c93df1368518 tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] Request body: {'port': {'device_id': '482f4d0c-0df9-4de7-9c75-b28c728be580', 'network_id': '613457eb-6f6d-4604-8f6c-f2d318ff9bc5', 'admin_state_up': True, 'tenant_id': 'a736cc60cc2143c4b6dea99321051da5', 'security_groups': ['1468f899-860c-4905-aee3-f13adc83d0a4']}} {{(pid=91830) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 17:01:22.486934 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.db_base_plugin_common [None req-12a18a89-5b44-4402-8d0e-0f0a132bc88f None None] Allocated IP 172.20.0.2 (faa2de89-15e9-41fa-ad3d-fb87f039acb9/ccf0e45f-5342-4190-89c1-d04cd1f8e468/e6815fb7-1b18-4cc6-b357-42279bfb7877) {{(pid=91831) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 25 17:01:22.545505 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-a3eecb13-2f0e-4d6f-a2c7-30e627ff22c9 admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:01:22.588358 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-a3eecb13-2f0e-4d6f-a2c7-30e627ff22c9 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3832070'] for port, before_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:01:22.768855 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.quota.driver [req-bc355d70-4b57-45d7-9445-85e58637ca3c req-a5cb100a-fc0f-4f4b-9097-c93df1368518 tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91830) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 17:01:22.791401 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.quota.driver [req-bc355d70-4b57-45d7-9445-85e58637ca3c req-a5cb100a-fc0f-4f4b-9097-c93df1368518 tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] Attempting to reserve 1 items for resource port. Total usage: 2; quota limit: 500; headroom:498 {{(pid=91830) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 17:01:22.817951 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-bc355d70-4b57-45d7-9445-85e58637ca3c req-a5cb100a-fc0f-4f4b-9097-c93df1368518 tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] Made reservation on behalf of a736cc60cc2143c4b6dea99321051da5 for: {'port': 1} {{(pid=91830) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 25 17:01:22.821959 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [req-bc355d70-4b57-45d7-9445-85e58637ca3c req-a5cb100a-fc0f-4f4b-9097-c93df1368518 tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3832070'] for port, before_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:01:22.833153 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.db_base_plugin_common [None req-a3eecb13-2f0e-4d6f-a2c7-30e627ff22c9 admin admin] Allocated IP 172.27.2.228 (4364b6ab-4117-4a92-baeb-f5ee2f45bf74/b947e790-d731-4b63-afc4-4aa112afe0f6/1cd0b8ab-beec-4909-80a4-6c7ac80ecd5c) {{(pid=91830) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 25 17:01:22.958928 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-12a18a89-5b44-4402-8d0e-0f0a132bc88f None None] Notify callbacks [] for port, precommit_create {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:01:22.972322 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.provisioning_blocks [None req-12a18a89-5b44-4402-8d0e-0f0a132bc88f None None] Transition to ACTIVE for port object e6815fb7-1b18-4cc6-b357-42279bfb7877 will not be triggered until provisioned by entity L2. {{(pid=91831) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 25 17:01:22.988613 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.l3_hamode_db [None req-c6244703-c631-46fc-aa23-cf39686c6d51 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'b37963ac-b2c2-4729-b4f8-6c604a1e5a2b', 'name': 'tempest-TestMinimumBasicScenario-1175520845-router', 'tenant_id': '36c1ffa1d458478bac5893b2ddf98eda', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'external_fixed_ips': [{'subnet_id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'ip_address': '172.27.2.22'}], 'enable_snat': True}, 'gw_port_id': 'abb48be3-09be-464d-887e-584de580da17', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T17:01:12Z', 'updated_at': '2021-05-25T17:01:17Z', 'revision_number': 4, 'project_id': '36c1ffa1d458478bac5893b2ddf98eda', 'gw_port': {'id': 'abb48be3-09be-464d-887e-584de580da17', 'name': '', 'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'tenant_id': '', 'mac_address': 'fa:16:3e:3f:15:26', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b37963ac-b2c2-4729-b4f8-6c604a1e5a2b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 432, 'fixed_ips': [{'subnet_id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'ip_address': '172.27.2.22', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790492-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:01:13Z', 'updated_at': '2021-05-25T17:01:20Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-790492-4-iscsi', '_interfaces': [{'id': 'bcd1bd96-7471-48e7-844a-de3c2de0ab2b', 'name': '', 'network_id': 'f3ddbe01-13f7-4e15-b7da-2bdffc278cb7', 'tenant_id': '36c1ffa1d458478bac5893b2ddf98eda', 'mac_address': 'fa:16:3e:a1:cb:e4', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'b37963ac-b2c2-4729-b4f8-6c604a1e5a2b', 'device_owner': 'network:router_interface', 'standard_attr_id': 433, 'fixed_ips': [{'subnet_id': '69fba530-cce2-44a2-89bd-18a52f9d454c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790492-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:01:16Z', 'updated_at': '2021-05-25T17:01:21Z', 'revision_number': 4, 'project_id': '36c1ffa1d458478bac5893b2ddf98eda', 'subnets': [{'id': '69fba530-cce2-44a2-89bd-18a52f9d454c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-790492-4-iscsi', False) {} {{(pid=91831) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 17:01:23.000608 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c6244703-c631-46fc-aa23-cf39686c6d51 None None] The sync data for ids ['b37963ac-b2c2-4729-b4f8-6c604a1e5a2b'] in dv-cinder-790492-4-iscsi is: [{'id': 'b37963ac-b2c2-4729-b4f8-6c604a1e5a2b', 'name': 'tempest-TestMinimumBasicScenario-1175520845-router', 'tenant_id': '36c1ffa1d458478bac5893b2ddf98eda', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'external_fixed_ips': [{'subnet_id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'ip_address': '172.27.2.22'}], 'enable_snat': True}, 'gw_port_id': 'abb48be3-09be-464d-887e-584de580da17', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T17:01:12Z', 'updated_at': '2021-05-25T17:01:17Z', 'revision_number': 4, 'project_id': '36c1ffa1d458478bac5893b2ddf98eda', 'gw_port': {'id': 'abb48be3-09be-464d-887e-584de580da17', 'name': '', 'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'tenant_id': '', 'mac_address': 'fa:16:3e:3f:15:26', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b37963ac-b2c2-4729-b4f8-6c604a1e5a2b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 432, 'fixed_ips': [{'subnet_id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'ip_address': '172.27.2.22', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790492-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:01:13Z', 'updated_at': '2021-05-25T17:01:20Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-790492-4-iscsi', '_interfaces': [{'id': 'bcd1bd96-7471-48e7-844a-de3c2de0ab2b', 'name': '', 'network_id': 'f3ddbe01-13f7-4e15-b7da-2bdffc278cb7', 'tenant_id': '36c1ffa1d458478bac5893b2ddf98eda', 'mac_address': 'fa:16:3e:a1:cb:e4', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'b37963ac-b2c2-4729-b4f8-6c604a1e5a2b', 'device_owner': 'network:router_interface', 'standard_attr_id': 433, 'fixed_ips': [{'subnet_id': '69fba530-cce2-44a2-89bd-18a52f9d454c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790492-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:01:16Z', 'updated_at': '2021-05-25T17:01:21Z', 'revision_number': 4, 'project_id': '36c1ffa1d458478bac5893b2ddf98eda', 'subnets': [{'id': '69fba530-cce2-44a2-89bd-18a52f9d454c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=91831) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 25 17:01:23.002249 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.provisioning_blocks [None req-12a18a89-5b44-4402-8d0e-0f0a132bc88f None None] Transition to ACTIVE for port object e6815fb7-1b18-4cc6-b357-42279bfb7877 will not be triggered until provisioned by entity DHCP. {{(pid=91831) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 25 17:01:23.009310 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-12a18a89-5b44-4402-8d0e-0f0a132bc88f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8757892520915'] for port, after_create {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:01:23.014696 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:01:23.119433 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-12a18a89-5b44-4402-8d0e-0f0a132bc88f None None] Network faa2de89-15e9-41fa-ad3d-fb87f039acb9 is already hosted by enough agents. {{(pid=91831) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 25 17:01:23.124217 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.scheduler.base_scheduler [None req-12a18a89-5b44-4402-8d0e-0f0a132bc88f None None] Resources bound (agent type, host, resource id): {{(pid=91831) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 17:01:23.132197 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.l3_dvrscheduler_db [None req-12a18a89-5b44-4402-8d0e-0f0a132bc88f None None] Received port after_create {{(pid=91831) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 25 17:01:23.155552 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-12a18a89-5b44-4402-8d0e-0f0a132bc88f None None] Pushing event updated for resources: {'Port': ['ID=e6815fb7-1b18-4cc6-b357-42279bfb7877,revision_number=1']} {{(pid=91831) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:01:23.174848 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [None req-12a18a89-5b44-4402-8d0e-0f0a132bc88f None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.160s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:01:23.187107 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-a3eecb13-2f0e-4d6f-a2c7-30e627ff22c9 admin admin] Notify callbacks [] for port, precommit_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:01:23.197553 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.db_base_plugin_common [req-bc355d70-4b57-45d7-9445-85e58637ca3c req-a5cb100a-fc0f-4f4b-9097-c93df1368518 tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] Allocated IP 172.20.0.11 (613457eb-6f6d-4604-8f6c-f2d318ff9bc5/3fc60650-484d-4574-bb67-0e4931bc9854/646693a2-80a9-425d-bb26-ffda8fa453a7) {{(pid=91830) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 25 17:01:23.315910 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.managers [None req-12a18a89-5b44-4402-8d0e-0f0a132bc88f None None] Attempting to bind port e6815fb7-1b18-4cc6-b357-42279bfb7877 on host dv-cinder-790492-4-iscsi for vnic_type normal with profile {{(pid=91831) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 25 17:01:23.316288 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.managers [None req-12a18a89-5b44-4402-8d0e-0f0a132bc88f None None] Attempting to bind port e6815fb7-1b18-4cc6-b357-42279bfb7877 by drivers openvswitch,hyperv on host dv-cinder-790492-4-iscsi at level 0 using segments [{'id': 'ed45d58b-5f76-41a7-95d9-322227308621', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 682, 'network_id': 'faa2de89-15e9-41fa-ad3d-fb87f039acb9'}] {{(pid=91831) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 25 17:01:23.316689 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-12a18a89-5b44-4402-8d0e-0f0a132bc88f None None] Attempting to bind port e6815fb7-1b18-4cc6-b357-42279bfb7877 on network faa2de89-15e9-41fa-ad3d-fb87f039acb9 {{(pid=91831) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 25 17:01:23.323462 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-12a18a89-5b44-4402-8d0e-0f0a132bc88f None None] Checking agent: {'id': 'fc8251e1-071c-49f7-bc10-1337f1d37d1b', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-790492-4-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 25, 16, 50, 28), 'started_at': datetime.datetime(2021, 5, 25, 16, 50, 58), 'heartbeat_timestamp': datetime.datetime(2021, 5, 25, 17, 0, 58), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-790492-4-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=91831) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 25 17:01:23.323886 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-12a18a89-5b44-4402-8d0e-0f0a132bc88f None None] Checking segment: {'id': 'ed45d58b-5f76-41a7-95d9-322227308621', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 682, 'network_id': 'faa2de89-15e9-41fa-ad3d-fb87f039acb9'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91831) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 25 17:01:23.324230 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-12a18a89-5b44-4402-8d0e-0f0a132bc88f None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:01:23.324625 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-12a18a89-5b44-4402-8d0e-0f0a132bc88f None None] Bound using segment: {'id': 'ed45d58b-5f76-41a7-95d9-322227308621', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 682, 'network_id': 'faa2de89-15e9-41fa-ad3d-fb87f039acb9'} {{(pid=91831) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 25 17:01:23.326388 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.managers [None req-12a18a89-5b44-4402-8d0e-0f0a132bc88f None None] Bound port: e6815fb7-1b18-4cc6-b357-42279bfb7877, host: dv-cinder-790492-4-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'ed45d58b-5f76-41a7-95d9-322227308621', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 682, 'network_id': 'faa2de89-15e9-41fa-ad3d-fb87f039acb9'}}] {{(pid=91831) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 25 17:01:23.326388 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-12a18a89-5b44-4402-8d0e-0f0a132bc88f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3832070'] for port, before_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:01:23.396344 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-a3eecb13-2f0e-4d6f-a2c7-30e627ff22c9 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8757892520915', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-27483019'] for port, after_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:01:23.410053 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-a9d836cc-ec3c-4b3d-b2bd-b702e99b20ad service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:01:23.518812 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.db [None req-12a18a89-5b44-4402-8d0e-0f0a132bc88f None None] For port e6815fb7-1b18-4cc6-b357-42279bfb7877, host dv-cinder-790492-4-iscsi, cleared binding levels {{(pid=91831) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 25 17:01:23.522816 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.db [None req-12a18a89-5b44-4402-8d0e-0f0a132bc88f None None] For port e6815fb7-1b18-4cc6-b357-42279bfb7877, host dv-cinder-790492-4-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-790492-4-iscsi',level=0,port_id=e6815fb7-1b18-4cc6-b357-42279bfb7877,segment=NetworkSegment(ed45d58b-5f76-41a7-95d9-322227308621),segment_id=ed45d58b-5f76-41a7-95d9-322227308621)] {{(pid=91831) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 25 17:01:23.531643 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-12a18a89-5b44-4402-8d0e-0f0a132bc88f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8757892955028', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8757892520933', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8757892521750'] for port, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:01:23.540772 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:01:23.548229 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a3eecb13-2f0e-4d6f-a2c7-30e627ff22c9 admin admin] Network 4364b6ab-4117-4a92-baeb-f5ee2f45bf74 is already hosted by enough agents. {{(pid=91830) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 25 17:01:23.557558 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.scheduler.base_scheduler [None req-a3eecb13-2f0e-4d6f-a2c7-30e627ff22c9 admin admin] Resources bound (agent type, host, resource id): {{(pid=91830) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 17:01:23.565092 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a3eecb13-2f0e-4d6f-a2c7-30e627ff22c9 admin admin] Pushing event updated for resources: {'Port': ['ID=1cd0b8ab-beec-4909-80a4-6c7ac80ecd5c,revision_number=1']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:01:23.591434 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a3eecb13-2f0e-4d6f-a2c7-30e627ff22c9 admin admin] Received port after_create {{(pid=91830) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 25 17:01:23.657878 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-12a18a89-5b44-4402-8d0e-0f0a132bc88f None None] Pushing event updated for resources: {'Port': ['ID=e6815fb7-1b18-4cc6-b357-42279bfb7877,revision_number=2']} {{(pid=91831) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:01:23.661210 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [None req-12a18a89-5b44-4402-8d0e-0f0a132bc88f None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.120s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:01:23.695227 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a3eecb13-2f0e-4d6f-a2c7-30e627ff22c9 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91830) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:01:23.695948 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a3eecb13-2f0e-4d6f-a2c7-30e627ff22c9 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91830) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:01:23.696456 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a3eecb13-2f0e-4d6f-a2c7-30e627ff22c9 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91830) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:01:23.697043 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a3eecb13-2f0e-4d6f-a2c7-30e627ff22c9 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91830) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:01:23.697606 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a3eecb13-2f0e-4d6f-a2c7-30e627ff22c9 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91830) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:01:23.698177 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a3eecb13-2f0e-4d6f-a2c7-30e627ff22c9 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91830) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:01:23.698805 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a3eecb13-2f0e-4d6f-a2c7-30e627ff22c9 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91830) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:01:23.699334 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a3eecb13-2f0e-4d6f-a2c7-30e627ff22c9 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91830) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:01:23.699896 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a3eecb13-2f0e-4d6f-a2c7-30e627ff22c9 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91830) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:01:23.700739 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a3eecb13-2f0e-4d6f-a2c7-30e627ff22c9 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91830) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:01:23.701404 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a3eecb13-2f0e-4d6f-a2c7-30e627ff22c9 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91830) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:01:23.701888 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a3eecb13-2f0e-4d6f-a2c7-30e627ff22c9 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91830) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:01:23.755428 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [req-bc355d70-4b57-45d7-9445-85e58637ca3c req-a5cb100a-fc0f-4f4b-9097-c93df1368518 tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] Notify callbacks [] for port, precommit_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:01:23.777323 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-a3eecb13-2f0e-4d6f-a2c7-30e627ff22c9 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.367s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:01:23.795846 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.provisioning_blocks [req-bc355d70-4b57-45d7-9445-85e58637ca3c req-a5cb100a-fc0f-4f4b-9097-c93df1368518 tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] Transition to ACTIVE for port object 646693a2-80a9-425d-bb26-ffda8fa453a7 will not be triggered until provisioned by entity DHCP. {{(pid=91830) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 25 17:01:23.800162 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-455f8e2c-a8c2-43cc-a391-725f3ace45e5 req-f33caec9-eb05-493d-9179-9ec91a3a582a tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] 10.222.0.62 "GET /v2.0/ports?device_id=482f4d0c-0df9-4de7-9c75-b28c728be580 HTTP/1.1" status: 200 len: 210 time: 0.2331002 May 25 17:01:23.834399 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.rpc [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Device bcd1bd96-7471-48e7-844a-de3c2de0ab2b up at agent ovs-agent-dv-cinder-790492-4-iscsi {{(pid=91831) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 25 17:01:23.915301 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0ec2f7a6-f3ba-4ce4-814b-8bb5617557fb req-93f0642d-0731-49b0-991c-bff9ebdcbbc3 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:01:23.925841 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-0ec2f7a6-f3ba-4ce4-814b-8bb5617557fb req-93f0642d-0731-49b0-991c-bff9ebdcbbc3 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] 10.222.0.62 "GET /v2.0/ports?device_id=6b63b4a6-5261-4e1c-b796-2f153fc24933 HTTP/1.1" status: 200 len: 945 time: 0.1228819 May 25 17:01:23.959141 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.provisioning_blocks [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Provisioning for port bcd1bd96-7471-48e7-844a-de3c2de0ab2b completed by entity L2. {{(pid=91831) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 25 17:01:23.968108 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.provisioning_blocks [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Provisioning complete for port bcd1bd96-7471-48e7-844a-de3c2de0ab2b triggered by entity L2. {{(pid=91831) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 17:01:23.970991 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3854128'] for port, provisioning_complete {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:01:24.010466 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-0ec2f7a6-f3ba-4ce4-814b-8bb5617557fb req-9dce9ea5-b0a6-4dd9-bc2b-632501da7583 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] 10.222.0.62 "GET /v2.0/security-groups?id=f73b90a2-df48-48fb-99e0-5dd4d6a63a15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0814395 May 25 17:01:24.111205 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [req-bc355d70-4b57-45d7-9445-85e58637ca3c req-a5cb100a-fc0f-4f4b-9097-c93df1368518 tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8757892520915', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-27483019'] for port, after_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:01:24.127332 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-858f32af-939b-4134-b6d9-232fefb45db7 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:01:24.220167 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3832070'] for port, before_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:01:24.256296 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-bc355d70-4b57-45d7-9445-85e58637ca3c req-a5cb100a-fc0f-4f4b-9097-c93df1368518 tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] Network 613457eb-6f6d-4604-8f6c-f2d318ff9bc5 is already hosted by enough agents. {{(pid=91830) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 25 17:01:24.261455 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.scheduler.base_scheduler [req-bc355d70-4b57-45d7-9445-85e58637ca3c req-a5cb100a-fc0f-4f4b-9097-c93df1368518 tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] Resources bound (agent type, host, resource id): {{(pid=91830) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 17:01:24.264327 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.db [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] For port bcd1bd96-7471-48e7-844a-de3c2de0ab2b, host dv-cinder-790492-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-790492-4-iscsi',level=0,port_id=bcd1bd96-7471-48e7-844a-de3c2de0ab2b,segment=NetworkSegment(5aed6094-89e8-4c7c-ba89-9b30d3e98cd0),segment_id=5aed6094-89e8-4c7c-ba89-9b30d3e98cd0)] {{(pid=91831) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 17:01:24.269883 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8757892955028', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8757892520933', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8757892521750'] for port, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:01:24.273101 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [None req-075457c9-1261-4590-9479-dd745cf5afe1 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:01:24.284343 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.l3_dvrscheduler_db [req-bc355d70-4b57-45d7-9445-85e58637ca3c req-a5cb100a-fc0f-4f4b-9097-c93df1368518 tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] Received port after_create {{(pid=91830) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 25 17:01:24.427000 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Pushing event updated for resources: {'Port': ['ID=bcd1bd96-7471-48e7-844a-de3c2de0ab2b,revision_number=5']} {{(pid=91831) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:01:24.430907 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.159s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:01:24.648372 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a5cb100a-fc0f-4f4b-9097-c93df1368518 tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] Pushing event updated for resources: {'Port': ['ID=646693a2-80a9-425d-bb26-ffda8fa453a7,revision_number=1']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:01:24.683815 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.provisioning_blocks [None req-aac3f9fb-f223-4f4a-8425-d1d9c12df2ad None None] Provisioning for port 646693a2-80a9-425d-bb26-ffda8fa453a7 completed by entity DHCP. {{(pid=91831) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 25 17:01:24.694143 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.provisioning_blocks [None req-aac3f9fb-f223-4f4a-8425-d1d9c12df2ad None None] Provisioning complete for port 646693a2-80a9-425d-bb26-ffda8fa453a7 triggered by entity DHCP. {{(pid=91831) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 17:01:24.694883 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-aac3f9fb-f223-4f4a-8425-d1d9c12df2ad None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3854128'] for port, provisioning_complete {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:01:24.697665 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-a5cb100a-fc0f-4f4b-9097-c93df1368518 tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.571s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:01:24.771413 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bc355d70-4b57-45d7-9445-85e58637ca3c req-a5cb100a-fc0f-4f4b-9097-c93df1368518 tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=91830) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:01:24.780552 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [req-bc355d70-4b57-45d7-9445-85e58637ca3c req-a5cb100a-fc0f-4f4b-9097-c93df1368518 tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-178712'] for port, before_response {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:01:24.876701 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-bc355d70-4b57-45d7-9445-85e58637ca3c req-a5cb100a-fc0f-4f4b-9097-c93df1368518 tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] 10.222.0.32 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 2.4060917 May 25 17:01:24.946483 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.plugin [None req-aac3f9fb-f223-4f4a-8425-d1d9c12df2ad None None] Port 646693a2-80a9-425d-bb26-ffda8fa453a7 cannot update to ACTIVE because it is not bound. {{(pid=91831) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 25 17:01:25.033456 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.v2.base [req-bc355d70-4b57-45d7-9445-85e58637ca3c req-e393b150-46a8-4165-b26b-60df4e8cbdbf service neutron] Request body: {'port': {'device_id': '482f4d0c-0df9-4de7-9c75-b28c728be580', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-79049'}} {{(pid=91830) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 17:01:25.142914 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-07912109-e3bb-4bab-a26e-379bb080716a req-4d763060-2cc8-4917-b7fa-df97b2a6febf tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:01:25.144574 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-07912109-e3bb-4bab-a26e-379bb080716a req-4d763060-2cc8-4917-b7fa-df97b2a6febf tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] 10.222.0.62 "GET /v2.0/ports?device_id=482f4d0c-0df9-4de7-9c75-b28c728be580 HTTP/1.1" status: 200 len: 932 time: 0.1400592 May 25 17:01:25.217859 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-07912109-e3bb-4bab-a26e-379bb080716a req-631fdd25-7633-41bf-9e06-41bc7b26537f tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] 10.222.0.62 "GET /v2.0/security-groups?id=1468f899-860c-4905-aee3-f13adc83d0a4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0657098 May 25 17:01:25.221694 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [req-bc355d70-4b57-45d7-9445-85e58637ca3c req-e393b150-46a8-4165-b26b-60df4e8cbdbf service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3832070'] for port, before_update {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:01:25.241618 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-a3eecb13-2f0e-4d6f-a2c7-30e627ff22c9 admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:01:25.260060 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-77efbdff-c5ed-4b68-9e16-a1ec668300c7 None None] Network faa2de89-15e9-41fa-ad3d-fb87f039acb9 requested from dv-cinder-790492-4-iscsi {{(pid=91831) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} May 25 17:01:25.376895 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-8c493e86-a0cb-41ca-a200-748df93339d3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:01:25.382473 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.provisioning_blocks [None req-2f7b1d8d-d5b6-4f94-bca4-361d7d09400e None None] Provisioning for port e6815fb7-1b18-4cc6-b357-42279bfb7877 completed by entity DHCP. {{(pid=91831) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 25 17:01:25.517275 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4ac4b065-e0ac-4e2e-8c4d-8beb1dee745a req-a5af273b-b6f7-434b-9fd7-db6516740c68 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:01:25.518670 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-4ac4b065-e0ac-4e2e-8c4d-8beb1dee745a req-a5af273b-b6f7-434b-9fd7-db6516740c68 service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=734df673f8b3484d80f35a45fbce9d5e&device_id=58da9205-0212-4daa-996c-1eef64a2b702 HTTP/1.1" status: 200 len: 1098 time: 0.1583948 May 25 17:01:25.535888 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-839663f0-0707-4781-8a7d-520932bc1e8c req-d98dbc4e-b3d0-4be3-9740-ec021d286000 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:01:25.544113 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-839663f0-0707-4781-8a7d-520932bc1e8c req-d98dbc4e-b3d0-4be3-9740-ec021d286000 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/ports?device_id=58da9205-0212-4daa-996c-1eef64a2b702 HTTP/1.1" status: 200 len: 945 time: 0.1249766 May 25 17:01:25.726672 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-839663f0-0707-4781-8a7d-520932bc1e8c req-f35c5aff-d96b-4545-a7a7-bbd21a56026d tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/security-groups?id=8ee5c4ed-9c60-4e39-9185-7e283704a7dc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1809349 May 25 17:01:25.789940 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4ac4b065-e0ac-4e2e-8c4d-8beb1dee745a req-62d98947-6c9b-42f2-a4fe-22d485e2bcda service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:01:25.791496 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-4ac4b065-e0ac-4e2e-8c4d-8beb1dee745a req-62d98947-6c9b-42f2-a4fe-22d485e2bcda service neutron] 10.222.0.32 "GET /v2.0/networks?id=55a46372-d583-4435-a0f6-b9397668217d HTTP/1.1" status: 200 len: 919 time: 0.2312863 May 25 17:01:25.863274 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.rpc [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Device bcd1bd96-7471-48e7-844a-de3c2de0ab2b up at agent ovs-agent-dv-cinder-790492-4-iscsi {{(pid=91831) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 25 17:01:25.871994 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-4ac4b065-e0ac-4e2e-8c4d-8beb1dee745a req-150e9777-a947-4da5-9a98-aee9d77823e2 service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=60078444-24b6-4560-b0a7-7802c4f8f2f8 HTTP/1.1" status: 200 len: 217 time: 0.0694115 May 25 17:01:25.906557 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-a3eecb13-2f0e-4d6f-a2c7-30e627ff22c9 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-684881', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-683233'] for router, after_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:01:25.944773 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.provisioning_blocks [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Provisioning complete for port bcd1bd96-7471-48e7-844a-de3c2de0ab2b triggered by entity L2. {{(pid=91831) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 17:01:25.945229 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3854128'] for port, provisioning_complete {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:01:25.955512 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4ac4b065-e0ac-4e2e-8c4d-8beb1dee745a req-3f1eefda-0379-464e-952e-de5197f9a98e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:01:25.957160 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-4ac4b065-e0ac-4e2e-8c4d-8beb1dee745a req-3f1eefda-0379-464e-952e-de5197f9a98e service neutron] 10.222.0.32 "GET /v2.0/subnets?id=927bd65a-c4de-491b-b501-302852f4c784 HTTP/1.1" status: 200 len: 858 time: 0.0705175 May 25 17:01:26.039926 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-4ac4b065-e0ac-4e2e-8c4d-8beb1dee745a req-d4826fac-5b9b-43d6-9f77-f3ce23196662 service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=55a46372-d583-4435-a0f6-b9397668217d&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0731382 May 25 17:01:26.078386 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.rpc [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Device e6815fb7-1b18-4cc6-b357-42279bfb7877 up at agent ovs-agent-dv-cinder-790492-4-iscsi {{(pid=91831) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 25 17:01:26.158284 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.provisioning_blocks [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Provisioning for port e6815fb7-1b18-4cc6-b357-42279bfb7877 completed by entity L2. {{(pid=91831) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 25 17:01:26.163701 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.provisioning_blocks [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Provisioning complete for port e6815fb7-1b18-4cc6-b357-42279bfb7877 triggered by entity L2. {{(pid=91831) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 17:01:26.164157 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3854128'] for port, provisioning_complete {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:01:26.170349 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.notifiers.nova [req-bc355d70-4b57-45d7-9445-85e58637ca3c req-e393b150-46a8-4165-b26b-60df4e8cbdbf service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 646693a2-80a9-425d-bb26-ffda8fa453a7 {{(pid=91830) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} May 25 17:01:26.181750 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [req-bc355d70-4b57-45d7-9445-85e58637ca3c req-e393b150-46a8-4165-b26b-60df4e8cbdbf service neutron] Notify callbacks [] for port, precommit_update {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:01:26.197806 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-4ac4b065-e0ac-4e2e-8c4d-8beb1dee745a req-cff4c2a1-8eb3-4382-95b2-da0b5f4f3c74 service neutron] 10.222.0.32 "GET /v2.0/networks/55a46372-d583-4435-a0f6-b9397668217d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1381135 May 25 17:01:26.205175 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.provisioning_blocks [req-bc355d70-4b57-45d7-9445-85e58637ca3c req-e393b150-46a8-4165-b26b-60df4e8cbdbf service neutron] Transition to ACTIVE for port object 646693a2-80a9-425d-bb26-ffda8fa453a7 will not be triggered until provisioned by entity L2. {{(pid=91830) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 25 17:01:26.211523 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [req-bc355d70-4b57-45d7-9445-85e58637ca3c req-e393b150-46a8-4165-b26b-60df4e8cbdbf service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8757892955028', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8757892520933', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8757892521750', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-27483010'] for port, after_update {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:01:26.218419 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-858f32af-939b-4134-b6d9-232fefb45db7 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:01:26.295842 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3832070'] for port, before_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:01:26.318910 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e393b150-46a8-4165-b26b-60df4e8cbdbf service neutron] Pushing event updated for resources: {'Port': ['ID=646693a2-80a9-425d-bb26-ffda8fa453a7,revision_number=2']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:01:26.333016 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.db [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] For port e6815fb7-1b18-4cc6-b357-42279bfb7877, host dv-cinder-790492-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-790492-4-iscsi',level=0,port_id=e6815fb7-1b18-4cc6-b357-42279bfb7877,segment=NetworkSegment(ed45d58b-5f76-41a7-95d9-322227308621),segment_id=ed45d58b-5f76-41a7-95d9-322227308621)] {{(pid=91831) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 17:01:26.335661 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-e393b150-46a8-4165-b26b-60df4e8cbdbf service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.117s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:01:26.340322 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8757892955028', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8757892520933', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8757892521750'] for port, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:01:26.342594 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [None req-0acb97c0-a84d-4f3f-bd7b-db003966fbc3 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:01:26.469870 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Pushing event updated for resources: {'Port': ['ID=e6815fb7-1b18-4cc6-b357-42279bfb7877,revision_number=3']} {{(pid=91831) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:01:26.473871 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.131s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:01:26.475028 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-4ac4b065-e0ac-4e2e-8c4d-8beb1dee745a req-4b687aea-fa96-410c-b32e-9194d02c6203 service neutron] 10.222.0.32 "GET /v2.0/networks/55a46372-d583-4435-a0f6-b9397668217d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2660644 May 25 17:01:26.515552 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ff836876-2e51-48a1-9080-bdac01998784 req-55f8cbf0-bd2d-4bac-b6d0-e41953e8e9c5 tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:01:26.517040 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-ff836876-2e51-48a1-9080-bdac01998784 req-55f8cbf0-bd2d-4bac-b6d0-e41953e8e9c5 tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] 10.222.0.62 "GET /v2.0/ports?device_id=482f4d0c-0df9-4de7-9c75-b28c728be580 HTTP/1.1" status: 200 len: 944 time: 0.1276889 May 25 17:01:26.566830 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-ff836876-2e51-48a1-9080-bdac01998784 req-784af855-175f-4c35-a8d0-5a000b12eee2 tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] 10.222.0.62 "GET /v2.0/security-groups?id=1468f899-860c-4905-aee3-f13adc83d0a4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0438437 May 25 17:01:26.632000 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-a3eecb13-2f0e-4d6f-a2c7-30e627ff22c9 admin admin] Router a00240d8-05fd-40cc-9536-9762357ba6d6 is scheduled to L3 agent a2d427c1-2d07-43e8-afbe-218c9f7d0445 with binding_index 1 {{(pid=91830) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}} May 25 17:01:26.812058 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.plugins.ml2.managers [req-bc355d70-4b57-45d7-9445-85e58637ca3c req-e393b150-46a8-4165-b26b-60df4e8cbdbf service neutron] Attempting to bind port 646693a2-80a9-425d-bb26-ffda8fa453a7 on host hv-cinder-79049 for vnic_type normal with profile {{(pid=91830) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 25 17:01:26.812414 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.plugins.ml2.managers [req-bc355d70-4b57-45d7-9445-85e58637ca3c req-e393b150-46a8-4165-b26b-60df4e8cbdbf service neutron] Attempting to bind port 646693a2-80a9-425d-bb26-ffda8fa453a7 by drivers openvswitch,hyperv on host hv-cinder-79049 at level 0 using segments [{'id': '55bc70ae-213c-42ca-b035-b4a902044007', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 659, 'network_id': '613457eb-6f6d-4604-8f6c-f2d318ff9bc5'}] {{(pid=91830) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 25 17:01:26.812726 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-bc355d70-4b57-45d7-9445-85e58637ca3c req-e393b150-46a8-4165-b26b-60df4e8cbdbf service neutron] Attempting to bind port 646693a2-80a9-425d-bb26-ffda8fa453a7 on network 613457eb-6f6d-4604-8f6c-f2d318ff9bc5 {{(pid=91830) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 25 17:01:26.843001 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-bc355d70-4b57-45d7-9445-85e58637ca3c req-e393b150-46a8-4165-b26b-60df4e8cbdbf service neutron] Port 646693a2-80a9-425d-bb26-ffda8fa453a7 on network 613457eb-6f6d-4604-8f6c-f2d318ff9bc5 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-79049 {{(pid=91830) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 25 17:01:26.843281 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-bc355d70-4b57-45d7-9445-85e58637ca3c req-e393b150-46a8-4165-b26b-60df4e8cbdbf service neutron] Attempting to bind port 646693a2-80a9-425d-bb26-ffda8fa453a7 on network 613457eb-6f6d-4604-8f6c-f2d318ff9bc5 {{(pid=91830) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 25 17:01:26.854269 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-bc355d70-4b57-45d7-9445-85e58637ca3c req-e393b150-46a8-4165-b26b-60df4e8cbdbf service neutron] Checking agent: {'id': '3a1fdee1-bff0-49fb-b470-e13b95ee1b4d', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-79049', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 25, 16, 56, 32), 'started_at': datetime.datetime(2021, 5, 25, 16, 56, 32), 'heartbeat_timestamp': datetime.datetime(2021, 5, 25, 17, 1, 4), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=91830) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 25 17:01:26.854603 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-bc355d70-4b57-45d7-9445-85e58637ca3c req-e393b150-46a8-4165-b26b-60df4e8cbdbf service neutron] Checking segment: {'id': '55bc70ae-213c-42ca-b035-b4a902044007', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 659, 'network_id': '613457eb-6f6d-4604-8f6c-f2d318ff9bc5'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91830) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 25 17:01:26.854981 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-bc355d70-4b57-45d7-9445-85e58637ca3c req-e393b150-46a8-4165-b26b-60df4e8cbdbf service neutron] Bound using segment: {'id': '55bc70ae-213c-42ca-b035-b4a902044007', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 659, 'network_id': '613457eb-6f6d-4604-8f6c-f2d318ff9bc5'} {{(pid=91830) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 25 17:01:26.855647 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.plugins.ml2.managers [req-bc355d70-4b57-45d7-9445-85e58637ca3c req-e393b150-46a8-4165-b26b-60df4e8cbdbf service neutron] Bound port: 646693a2-80a9-425d-bb26-ffda8fa453a7, host: hv-cinder-79049, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '55bc70ae-213c-42ca-b035-b4a902044007', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 659, 'network_id': '613457eb-6f6d-4604-8f6c-f2d318ff9bc5'}}] {{(pid=91830) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 25 17:01:26.855996 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [req-bc355d70-4b57-45d7-9445-85e58637ca3c req-e393b150-46a8-4165-b26b-60df4e8cbdbf service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3832070'] for port, before_update {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:01:26.911523 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-a3eecb13-2f0e-4d6f-a2c7-30e627ff22c9 admin admin] Notify agent at l3_agent.dv-cinder-790492-4-iscsi the message routers_updated {{(pid=91830) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 25 17:01:26.920690 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-64e86313-a5a2-45ca-8509-ef45443b1199 None None] Sync routers for ids ['a00240d8-05fd-40cc-9536-9762357ba6d6'] in dv-cinder-790492-4-iscsi {{(pid=91832) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 25 17:01:26.930031 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-56c1bdc8-81a5-430c-8a37-9e8b5caf58f4 req-c306af96-ef3c-4394-9453-c9d8c097bb10 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:01:26.930213 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.db.l3_dvrscheduler_db [None req-64e86313-a5a2-45ca-8509-ef45443b1199 None None] Routers {'a00240d8-05fd-40cc-9536-9762357ba6d6'} bound to L3 agent in host dv-cinder-790492-4-iscsi {{(pid=91832) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 17:01:26.930736 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.db.l3_hamode_db [None req-64e86313-a5a2-45ca-8509-ef45443b1199 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-790492-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-05-25T16:50:28Z,description=,heartbeat_timestamp=2021-05-25T17:00:58Z,host='dv-cinder-790492-4-iscsi',id=a2d427c1-2d07-43e8-afbe-218c9f7d0445,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T16:50:28Z,topic='l3_agent')) {'router_ids': ['a00240d8-05fd-40cc-9536-9762357ba6d6'], 'active': True} {{(pid=91832) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 17:01:26.931776 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-56c1bdc8-81a5-430c-8a37-9e8b5caf58f4 req-c306af96-ef3c-4394-9453-c9d8c097bb10 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/ports?device_id=58da9205-0212-4daa-996c-1eef64a2b702 HTTP/1.1" status: 200 len: 945 time: 0.0890286 May 25 17:01:26.961380 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-a3eecb13-2f0e-4d6f-a2c7-30e627ff22c9 admin admin] Notify callbacks [] for router, before_response {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:01:26.964614 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [None req-a3eecb13-2f0e-4d6f-a2c7-30e627ff22c9 admin admin] 10.222.0.62 "POST /v2.0/routers HTTP/1.1" status: 201 len: 927 time: 5.6232972 May 25 17:01:26.967385 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.wsgi [-] (91829) accepted ('10.222.0.62', 60522) {{(pid=91829) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:01:26.975721 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.plugins.ml2.db [req-bc355d70-4b57-45d7-9445-85e58637ca3c req-e393b150-46a8-4165-b26b-60df4e8cbdbf service neutron] For port 646693a2-80a9-425d-bb26-ffda8fa453a7, host hv-cinder-79049, cleared binding levels {{(pid=91830) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 25 17:01:26.984867 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.plugins.ml2.db [req-bc355d70-4b57-45d7-9445-85e58637ca3c req-e393b150-46a8-4165-b26b-60df4e8cbdbf service neutron] For port 646693a2-80a9-425d-bb26-ffda8fa453a7, host hv-cinder-79049, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79049',level=0,port_id=646693a2-80a9-425d-bb26-ffda8fa453a7,segment=NetworkSegment(55bc70ae-213c-42ca-b035-b4a902044007),segment_id=55bc70ae-213c-42ca-b035-b4a902044007)] {{(pid=91830) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 25 17:01:26.990127 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [req-bc355d70-4b57-45d7-9445-85e58637ca3c req-e393b150-46a8-4165-b26b-60df4e8cbdbf service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8757892955028', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8757892520933', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8757892521750', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-27483010'] for port, after_update {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:01:26.994595 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-a3eecb13-2f0e-4d6f-a2c7-30e627ff22c9 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:01:27.064083 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bc355d70-4b57-45d7-9445-85e58637ca3c req-e393b150-46a8-4165-b26b-60df4e8cbdbf service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91830) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:01:27.064689 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [req-bc355d70-4b57-45d7-9445-85e58637ca3c req-e393b150-46a8-4165-b26b-60df4e8cbdbf service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-178712'] for port, before_response {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:01:27.066072 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-bc355d70-4b57-45d7-9445-85e58637ca3c req-e393b150-46a8-4165-b26b-60df4e8cbdbf service neutron] 10.222.0.32 "PUT /v2.0/ports/646693a2-80a9-425d-bb26-ffda8fa453a7 HTTP/1.1" status: 200 len: 1094 time: 2.1711273 May 25 17:01:27.066558 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '482f4d0c-0df9-4de7-9c75-b28c728be580', 'tag': '646693a2-80a9-425d-bb26-ffda8fa453a7'}] {{(pid=91830) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 25 17:01:27.088190 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e393b150-46a8-4165-b26b-60df4e8cbdbf service neutron] Pushing event updated for resources: {'Port': ['ID=646693a2-80a9-425d-bb26-ffda8fa453a7,revision_number=3']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:01:27.092520 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-e393b150-46a8-4165-b26b-60df4e8cbdbf service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.098s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:01:27.107417 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-56c1bdc8-81a5-430c-8a37-9e8b5caf58f4 req-0e64eb3e-c69c-4997-bf24-a9b4f598a0b3 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/security-groups?id=8ee5c4ed-9c60-4e39-9185-7e283704a7dc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1678228 May 25 17:01:27.163039 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.db.l3_dvr_db [None req-64e86313-a5a2-45ca-8509-ef45443b1199 None None] Set router a00240d8-05fd-40cc-9536-9762357ba6d6 gateway port host: dv-cinder-790492-4-iscsi {{(pid=91832) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 17:01:27.197177 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '482f4d0c-0df9-4de7-9c75-b28c728be580', 'tag': '646693a2-80a9-425d-bb26-ffda8fa453a7', 'status': 'completed', 'code': 200} May 25 17:01:27.274526 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bc355d70-4b57-45d7-9445-85e58637ca3c req-fd3cd21f-211d-4b8b-9297-e14648ccbc7c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91830) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:01:27.276102 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-bc355d70-4b57-45d7-9445-85e58637ca3c req-fd3cd21f-211d-4b8b-9297-e14648ccbc7c service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=a736cc60cc2143c4b6dea99321051da5&device_id=482f4d0c-0df9-4de7-9c75-b28c728be580 HTTP/1.1" status: 200 len: 1097 time: 0.1444650 May 25 17:01:27.394132 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-bc355d70-4b57-45d7-9445-85e58637ca3c req-5fd5deda-a864-4195-b21c-fa8665470d36 service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=646693a2-80a9-425d-bb26-ffda8fa453a7 HTTP/1.1" status: 200 len: 217 time: 0.1075103 May 25 17:01:27.486730 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bc355d70-4b57-45d7-9445-85e58637ca3c req-0bce55f0-334d-4d76-919a-5ad502e50920 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91830) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:01:27.488363 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-bc355d70-4b57-45d7-9445-85e58637ca3c req-0bce55f0-334d-4d76-919a-5ad502e50920 service neutron] 10.222.0.32 "GET /v2.0/subnets?id=3fc60650-484d-4574-bb67-0e4931bc9854 HTTP/1.1" status: 200 len: 848 time: 0.0871532 May 25 17:01:27.578257 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.db.l3_hamode_db [None req-64e86313-a5a2-45ca-8509-ef45443b1199 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'a00240d8-05fd-40cc-9536-9762357ba6d6', 'name': 'tempest-TestMinimumBasicScenario-1151073527-router', 'tenant_id': 'a60ff90c536747ff984cf0591f1a098b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'external_fixed_ips': [{'subnet_id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'ip_address': '172.27.2.228'}], 'enable_snat': True}, 'gw_port_id': '1cd0b8ab-beec-4909-80a4-6c7ac80ecd5c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T17:01:21Z', 'updated_at': '2021-05-25T17:01:24Z', 'revision_number': 3, 'project_id': 'a60ff90c536747ff984cf0591f1a098b', 'gw_port': {'id': '1cd0b8ab-beec-4909-80a4-6c7ac80ecd5c', 'name': '', 'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'tenant_id': '', 'mac_address': 'fa:16:3e:f6:e5:02', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'a00240d8-05fd-40cc-9536-9762357ba6d6', 'device_owner': 'network:router_gateway', 'standard_attr_id': 444, 'fixed_ips': [{'subnet_id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'ip_address': '172.27.2.228', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:01:22Z', 'updated_at': '2021-05-25T17:01:22Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-790492-4-iscsi'}], 'dv-cinder-790492-4-iscsi', False) {} {{(pid=91832) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 17:01:27.584127 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-64e86313-a5a2-45ca-8509-ef45443b1199 None None] Checking router: a00240d8-05fd-40cc-9536-9762357ba6d6 for host: dv-cinder-790492-4-iscsi {{(pid=91832) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 25 17:01:27.586963 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-64e86313-a5a2-45ca-8509-ef45443b1199 None None] Updating router a00240d8-05fd-40cc-9536-9762357ba6d6 port 1cd0b8ab-beec-4909-80a4-6c7ac80ecd5c binding host dv-cinder-790492-4-iscsi {{(pid=91832) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} May 25 17:01:27.630368 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bc355d70-4b57-45d7-9445-85e58637ca3c req-7a17e44f-0a10-4fce-ab4a-403e19408c02 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91830) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:01:27.634399 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-bc355d70-4b57-45d7-9445-85e58637ca3c req-7a17e44f-0a10-4fce-ab4a-403e19408c02 service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=613457eb-6f6d-4604-8f6c-f2d318ff9bc5&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.1333365 May 25 17:01:27.651781 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron_lib.callbacks.manager [None req-64e86313-a5a2-45ca-8509-ef45443b1199 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3832070'] for port, before_update {{(pid=91832) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:01:27.700854 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-77c28e3f-fcc2-459d-8043-a94d682f5b5a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:01:27.745095 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.rpc [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Device e6815fb7-1b18-4cc6-b357-42279bfb7877 up at agent ovs-agent-dv-cinder-790492-4-iscsi {{(pid=91831) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 25 17:01:27.931500 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:01:27.954402 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-bc355d70-4b57-45d7-9445-85e58637ca3c req-98415e0e-ab11-4a5d-aaee-f591c14b3f9d service neutron] 10.222.0.32 "GET /v2.0/networks/613457eb-6f6d-4604-8f6c-f2d318ff9bc5?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3107376 May 25 17:01:27.987035 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.provisioning_blocks [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Provisioning complete for port e6815fb7-1b18-4cc6-b357-42279bfb7877 triggered by entity L2. {{(pid=91831) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 17:01:27.987413 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3854128'] for port, provisioning_complete {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:01:28.223597 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-bc355d70-4b57-45d7-9445-85e58637ca3c req-d8e86b93-4416-42dc-be6b-377f982fcb21 service neutron] 10.222.0.32 "GET /v2.0/networks/613457eb-6f6d-4604-8f6c-f2d318ff9bc5?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2471755 May 25 17:01:28.230628 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron_lib.callbacks.manager [None req-64e86313-a5a2-45ca-8509-ef45443b1199 None None] Notify callbacks [] for port, precommit_update {{(pid=91832) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:01:28.247071 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.db.provisioning_blocks [None req-64e86313-a5a2-45ca-8509-ef45443b1199 None None] Transition to ACTIVE for port object 1cd0b8ab-beec-4909-80a4-6c7ac80ecd5c will not be triggered until provisioned by entity L2. {{(pid=91832) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 25 17:01:28.256900 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron_lib.callbacks.manager [None req-64e86313-a5a2-45ca-8509-ef45443b1199 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8757892955028', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8757892520933', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8757892521750'] for port, after_update {{(pid=91832) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:01:28.257948 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-80831278-b0f7-46e1-b157-1fa33306f953 req-8d63ef2e-f283-4ccd-9989-d529492ded1f service neutron] 10.222.0.32 "GET /v2.0/ports?device_id=d87a1395-92e0-4727-a5ed-a8dcdee587c3&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.3280344 May 25 17:01:28.269292 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:01:28.275379 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bb4d9099-12c7-4911-b949-88bf9463700e req-2137c1f5-c89a-4840-90f2-9f33cf2402ff tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:01:28.289147 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-bb4d9099-12c7-4911-b949-88bf9463700e req-2137c1f5-c89a-4840-90f2-9f33cf2402ff tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] 10.222.0.62 "GET /v2.0/ports?device_id=482f4d0c-0df9-4de7-9c75-b28c728be580 HTTP/1.1" status: 200 len: 944 time: 0.4950376 May 25 17:01:28.343822 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.plugins.ml2.managers [None req-64e86313-a5a2-45ca-8509-ef45443b1199 None None] Attempting to bind port 1cd0b8ab-beec-4909-80a4-6c7ac80ecd5c on host dv-cinder-790492-4-iscsi for vnic_type normal with profile {{(pid=91832) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 25 17:01:28.344280 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.plugins.ml2.managers [None req-64e86313-a5a2-45ca-8509-ef45443b1199 None None] Attempting to bind port 1cd0b8ab-beec-4909-80a4-6c7ac80ecd5c by drivers openvswitch,hyperv on host dv-cinder-790492-4-iscsi at level 0 using segments [{'id': '414a8468-1d66-4792-9e81-d8ac5ccf1512', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74'}] {{(pid=91832) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 25 17:01:28.344723 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-64e86313-a5a2-45ca-8509-ef45443b1199 None None] Attempting to bind port 1cd0b8ab-beec-4909-80a4-6c7ac80ecd5c on network 4364b6ab-4117-4a92-baeb-f5ee2f45bf74 {{(pid=91832) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 25 17:01:28.353965 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-64e86313-a5a2-45ca-8509-ef45443b1199 None None] Checking agent: {'id': 'fc8251e1-071c-49f7-bc10-1337f1d37d1b', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-790492-4-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 25, 16, 50, 28), 'started_at': datetime.datetime(2021, 5, 25, 16, 50, 58), 'heartbeat_timestamp': datetime.datetime(2021, 5, 25, 17, 1, 28), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-790492-4-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=91832) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 25 17:01:28.354435 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-64e86313-a5a2-45ca-8509-ef45443b1199 None None] Checking segment: {'id': '414a8468-1d66-4792-9e81-d8ac5ccf1512', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91832) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 25 17:01:28.354908 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron_lib.callbacks.manager [None req-64e86313-a5a2-45ca-8509-ef45443b1199 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=91832) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:01:28.355367 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-64e86313-a5a2-45ca-8509-ef45443b1199 None None] Bound using segment: {'id': '414a8468-1d66-4792-9e81-d8ac5ccf1512', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74'} {{(pid=91832) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 25 17:01:28.355897 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.plugins.ml2.managers [None req-64e86313-a5a2-45ca-8509-ef45443b1199 None None] Bound port: 1cd0b8ab-beec-4909-80a4-6c7ac80ecd5c, host: dv-cinder-790492-4-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '414a8468-1d66-4792-9e81-d8ac5ccf1512', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74'}}] {{(pid=91832) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 25 17:01:28.356338 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron_lib.callbacks.manager [None req-64e86313-a5a2-45ca-8509-ef45443b1199 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3832070'] for port, before_update {{(pid=91832) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:01:28.385202 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a2d1a440-9fe8-4ac6-a9e3-a28c520b1480 None None] Pushing event updated for resources: {'Port': ['ID=1cd0b8ab-beec-4909-80a4-6c7ac80ecd5c,revision_number=2']} {{(pid=91832) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:01:28.401086 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG oslo_concurrency.lockutils [None req-a2d1a440-9fe8-4ac6-a9e3-a28c520b1480 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.132s {{(pid=91832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:01:28.405562 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-80831278-b0f7-46e1-b157-1fa33306f953 req-fb17cc0b-d470-4dad-a907-256bceedee2c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91830) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:01:28.407399 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-80831278-b0f7-46e1-b157-1fa33306f953 req-fb17cc0b-d470-4dad-a907-256bceedee2c service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=734df673f8b3484d80f35a45fbce9d5e&device_id=d87a1395-92e0-4727-a5ed-a8dcdee587c3 HTTP/1.1" status: 200 len: 1098 time: 0.0824292 May 25 17:01:28.439224 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.plugins.ml2.db [None req-64e86313-a5a2-45ca-8509-ef45443b1199 None None] For port 1cd0b8ab-beec-4909-80a4-6c7ac80ecd5c, host dv-cinder-790492-4-iscsi, cleared binding levels {{(pid=91832) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 25 17:01:28.442458 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.plugins.ml2.db [None req-64e86313-a5a2-45ca-8509-ef45443b1199 None None] For port 1cd0b8ab-beec-4909-80a4-6c7ac80ecd5c, host dv-cinder-790492-4-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-790492-4-iscsi',level=0,port_id=1cd0b8ab-beec-4909-80a4-6c7ac80ecd5c,segment=NetworkSegment(414a8468-1d66-4792-9e81-d8ac5ccf1512),segment_id=414a8468-1d66-4792-9e81-d8ac5ccf1512)] {{(pid=91832) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 25 17:01:28.448165 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron_lib.callbacks.manager [None req-64e86313-a5a2-45ca-8509-ef45443b1199 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8757892955028', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8757892520933', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8757892521750'] for port, after_update {{(pid=91832) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:01:28.454472 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:01:28.531555 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-bb4d9099-12c7-4911-b949-88bf9463700e req-94684814-4db0-4213-aba4-4cc3e566c1c5 tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] 10.222.0.62 "GET /v2.0/security-groups?id=1468f899-860c-4905-aee3-f13adc83d0a4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2018890 May 25 17:01:28.546535 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.db.l3_dvrscheduler_db [None req-64e86313-a5a2-45ca-8509-ef45443b1199 None None] Routers {'a00240d8-05fd-40cc-9536-9762357ba6d6'} bound to L3 agent in host dv-cinder-790492-4-iscsi {{(pid=91832) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 17:01:28.547889 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.db.l3_hamode_db [None req-64e86313-a5a2-45ca-8509-ef45443b1199 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-790492-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-05-25T16:50:28Z,description=,heartbeat_timestamp=2021-05-25T17:01:28Z,host='dv-cinder-790492-4-iscsi',id=a2d427c1-2d07-43e8-afbe-218c9f7d0445,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T16:50:28Z,topic='l3_agent')) {'router_ids': ['a00240d8-05fd-40cc-9536-9762357ba6d6'], 'active': True} {{(pid=91832) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 17:01:28.585766 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-80831278-b0f7-46e1-b157-1fa33306f953 req-0d1c09ec-b314-4a43-9d67-7c0979541b64 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91830) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:01:28.587490 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-80831278-b0f7-46e1-b157-1fa33306f953 req-0d1c09ec-b314-4a43-9d67-7c0979541b64 service neutron] 10.222.0.32 "GET /v2.0/networks?id=55a46372-d583-4435-a0f6-b9397668217d HTTP/1.1" status: 200 len: 919 time: 0.1526093 May 25 17:01:28.609090 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-0a55eb4a-8b57-4233-84d6-6b423b4ed6db None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:01:28.627735 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1136b46d-72f9-4025-be59-355915202c48 req-1cf7f295-9a47-4428-b48d-873bbd2fa785 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:01:28.627735 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-1136b46d-72f9-4025-be59-355915202c48 req-1cf7f295-9a47-4428-b48d-873bbd2fa785 service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=a736cc60cc2143c4b6dea99321051da5&device_id=482f4d0c-0df9-4de7-9c75-b28c728be580 HTTP/1.1" status: 200 len: 1097 time: 0.2939560 May 25 17:01:28.634774 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ff24142e-46b2-4396-9ea9-6cf1d4427d0e req-be9ec17b-99da-4dce-8a2a-fa799a56bfb6 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:01:28.635905 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-ff24142e-46b2-4396-9ea9-6cf1d4427d0e req-be9ec17b-99da-4dce-8a2a-fa799a56bfb6 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/ports?device_id=58da9205-0212-4daa-996c-1eef64a2b702 HTTP/1.1" status: 200 len: 945 time: 0.3074024 May 25 17:01:28.687995 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-80831278-b0f7-46e1-b157-1fa33306f953 req-37de2572-46d6-4eb4-a773-1a182cfa4dc4 service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=250e0a7c-f7d1-4092-af1f-d50d5b92f68a HTTP/1.1" status: 200 len: 217 time: 0.0848718 May 25 17:01:28.712664 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a2d1a440-9fe8-4ac6-a9e3-a28c520b1480 None None] Pushing event updated for resources: {'Port': ['ID=1cd0b8ab-beec-4909-80a4-6c7ac80ecd5c,revision_number=3']} {{(pid=91832) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:01:28.728479 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG oslo_concurrency.lockutils [None req-a2d1a440-9fe8-4ac6-a9e3-a28c520b1480 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.274s {{(pid=91832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:01:28.738913 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-0dd53d8e-5dd0-41b0-a28c-023cb6a5c924 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3832070'] for port, before_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:01:28.758839 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.db.l3_dvr_db [None req-64e86313-a5a2-45ca-8509-ef45443b1199 None None] Set router a00240d8-05fd-40cc-9536-9762357ba6d6 gateway port host: dv-cinder-790492-4-iscsi {{(pid=91832) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 17:01:28.761605 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-80831278-b0f7-46e1-b157-1fa33306f953 req-1c597764-f42b-447e-9784-3b192c87134e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91830) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:01:28.763185 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-80831278-b0f7-46e1-b157-1fa33306f953 req-1c597764-f42b-447e-9784-3b192c87134e service neutron] 10.222.0.32 "GET /v2.0/subnets?id=927bd65a-c4de-491b-b501-302852f4c784 HTTP/1.1" status: 200 len: 858 time: 0.0670688 May 25 17:01:28.815174 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-80831278-b0f7-46e1-b157-1fa33306f953 req-96aba5a9-80da-459f-94ae-2050d2ee987f service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=55a46372-d583-4435-a0f6-b9397668217d&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0430446 May 25 17:01:28.831263 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-ff24142e-46b2-4396-9ea9-6cf1d4427d0e req-dcc13757-768d-495c-8fbe-1d4da62009aa tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/security-groups?id=8ee5c4ed-9c60-4e39-9185-7e283704a7dc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1704116 May 25 17:01:28.900616 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1136b46d-72f9-4025-be59-355915202c48 req-39524f2d-91f8-4a67-9f55-dc2acd707180 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:01:28.902826 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-1136b46d-72f9-4025-be59-355915202c48 req-39524f2d-91f8-4a67-9f55-dc2acd707180 service neutron] 10.222.0.32 "GET /v2.0/networks?id=613457eb-6f6d-4604-8f6c-f2d318ff9bc5 HTTP/1.1" status: 200 len: 910 time: 0.2637258 May 25 17:01:28.976871 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-80831278-b0f7-46e1-b157-1fa33306f953 req-5f16235a-7341-425b-86fb-6f0d9ee9dbc4 service neutron] 10.222.0.32 "GET /v2.0/networks/55a46372-d583-4435-a0f6-b9397668217d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1533959 May 25 17:01:29.017721 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-1136b46d-72f9-4025-be59-355915202c48 req-8529394a-6fce-4ae4-b64b-cec119bdab89 service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=646693a2-80a9-425d-bb26-ffda8fa453a7 HTTP/1.1" status: 200 len: 217 time: 0.0794077 May 25 17:01:29.118211 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.db.l3_hamode_db [None req-64e86313-a5a2-45ca-8509-ef45443b1199 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'a00240d8-05fd-40cc-9536-9762357ba6d6', 'name': 'tempest-TestMinimumBasicScenario-1151073527-router', 'tenant_id': 'a60ff90c536747ff984cf0591f1a098b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'external_fixed_ips': [{'subnet_id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'ip_address': '172.27.2.228'}], 'enable_snat': True}, 'gw_port_id': '1cd0b8ab-beec-4909-80a4-6c7ac80ecd5c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T17:01:21Z', 'updated_at': '2021-05-25T17:01:24Z', 'revision_number': 3, 'project_id': 'a60ff90c536747ff984cf0591f1a098b', 'gw_port': {'id': '1cd0b8ab-beec-4909-80a4-6c7ac80ecd5c', 'name': '', 'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'tenant_id': '', 'mac_address': 'fa:16:3e:f6:e5:02', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'a00240d8-05fd-40cc-9536-9762357ba6d6', 'device_owner': 'network:router_gateway', 'standard_attr_id': 444, 'fixed_ips': [{'subnet_id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'ip_address': '172.27.2.228', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790492-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:01:22Z', 'updated_at': '2021-05-25T17:01:28Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-790492-4-iscsi'}], 'dv-cinder-790492-4-iscsi', False) {} {{(pid=91832) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 17:01:29.126308 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-64e86313-a5a2-45ca-8509-ef45443b1199 None None] The sync data for ids ['a00240d8-05fd-40cc-9536-9762357ba6d6'] in dv-cinder-790492-4-iscsi is: [{'id': 'a00240d8-05fd-40cc-9536-9762357ba6d6', 'name': 'tempest-TestMinimumBasicScenario-1151073527-router', 'tenant_id': 'a60ff90c536747ff984cf0591f1a098b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'external_fixed_ips': [{'subnet_id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'ip_address': '172.27.2.228'}], 'enable_snat': True}, 'gw_port_id': '1cd0b8ab-beec-4909-80a4-6c7ac80ecd5c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T17:01:21Z', 'updated_at': '2021-05-25T17:01:24Z', 'revision_number': 3, 'project_id': 'a60ff90c536747ff984cf0591f1a098b', 'gw_port': {'id': '1cd0b8ab-beec-4909-80a4-6c7ac80ecd5c', 'name': '', 'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'tenant_id': '', 'mac_address': 'fa:16:3e:f6:e5:02', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'a00240d8-05fd-40cc-9536-9762357ba6d6', 'device_owner': 'network:router_gateway', 'standard_attr_id': 444, 'fixed_ips': [{'subnet_id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'ip_address': '172.27.2.228', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790492-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:01:22Z', 'updated_at': '2021-05-25T17:01:28Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-790492-4-iscsi'}] {{(pid=91832) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 25 17:01:29.174454 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1136b46d-72f9-4025-be59-355915202c48 req-e8420c85-61ec-4ed7-9a43-ae9ea44ddfa1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:01:29.176021 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-1136b46d-72f9-4025-be59-355915202c48 req-e8420c85-61ec-4ed7-9a43-ae9ea44ddfa1 service neutron] 10.222.0.32 "GET /v2.0/subnets?id=3fc60650-484d-4574-bb67-0e4931bc9854 HTTP/1.1" status: 200 len: 848 time: 0.0861938 May 25 17:01:29.221581 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.db_base_plugin_common [None req-0dd53d8e-5dd0-41b0-a28c-023cb6a5c924 admin admin] Allocated IP 172.20.0.1 (faa2de89-15e9-41fa-ad3d-fb87f039acb9/ccf0e45f-5342-4190-89c1-d04cd1f8e468/57de629d-5918-4034-ad5a-0176cb475228) {{(pid=91829) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 25 17:01:29.269109 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-80831278-b0f7-46e1-b157-1fa33306f953 req-14246bd8-a803-4c4c-b0ba-47e9e6359e79 service neutron] 10.222.0.32 "GET /v2.0/networks/55a46372-d583-4435-a0f6-b9397668217d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2718434 May 25 17:01:29.391118 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1136b46d-72f9-4025-be59-355915202c48 req-53c323b4-df9c-4da8-878f-816bc4e6bd3e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:01:29.392575 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-1136b46d-72f9-4025-be59-355915202c48 req-53c323b4-df9c-4da8-878f-816bc4e6bd3e service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=613457eb-6f6d-4604-8f6c-f2d318ff9bc5&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.2093616 May 25 17:01:29.456297 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-0dd53d8e-5dd0-41b0-a28c-023cb6a5c924 admin admin] Notify callbacks [] for port, precommit_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:01:29.623930 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.provisioning_blocks [None req-0dd53d8e-5dd0-41b0-a28c-023cb6a5c924 admin admin] Transition to ACTIVE for port object 57de629d-5918-4034-ad5a-0176cb475228 will not be triggered until provisioned by entity DHCP. {{(pid=91829) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 25 17:01:29.755897 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-1136b46d-72f9-4025-be59-355915202c48 req-2e40fb16-a949-4824-aec1-197d5c01c1c1 service neutron] 10.222.0.32 "GET /v2.0/networks/613457eb-6f6d-4604-8f6c-f2d318ff9bc5?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3530064 May 25 17:01:29.781506 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.rpc [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Device 1cd0b8ab-beec-4909-80a4-6c7ac80ecd5c up at agent ovs-agent-dv-cinder-790492-4-iscsi {{(pid=91831) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 25 17:01:29.850089 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-0dd53d8e-5dd0-41b0-a28c-023cb6a5c924 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8757892520915', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28230808'] for port, after_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:01:29.857389 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-be7579e0-8835-4775-a346-c87d7efa41ac admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:01:29.869301 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.provisioning_blocks [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Provisioning for port 1cd0b8ab-beec-4909-80a4-6c7ac80ecd5c completed by entity L2. {{(pid=91831) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 25 17:01:29.876205 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.provisioning_blocks [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Provisioning complete for port 1cd0b8ab-beec-4909-80a4-6c7ac80ecd5c triggered by entity L2. {{(pid=91831) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 17:01:29.876708 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3854128'] for port, provisioning_complete {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:01:29.939929 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0dd53d8e-5dd0-41b0-a28c-023cb6a5c924 admin admin] Network faa2de89-15e9-41fa-ad3d-fb87f039acb9 is already hosted by enough agents. {{(pid=91829) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 25 17:01:29.946536 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.scheduler.base_scheduler [None req-0dd53d8e-5dd0-41b0-a28c-023cb6a5c924 admin admin] Resources bound (agent type, host, resource id): {{(pid=91829) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 17:01:29.954900 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0dd53d8e-5dd0-41b0-a28c-023cb6a5c924 admin admin] Received port after_create {{(pid=91829) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 25 17:01:30.010169 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e3fa2a4a-6991-4e86-9513-96a424e821f6 req-6edf293b-e4bc-4ec6-8fce-944c2f90b4fd tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:01:30.019796 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-e3fa2a4a-6991-4e86-9513-96a424e821f6 req-6edf293b-e4bc-4ec6-8fce-944c2f90b4fd tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] 10.222.0.62 "GET /v2.0/ports?device_id=482f4d0c-0df9-4de7-9c75-b28c728be580 HTTP/1.1" status: 200 len: 944 time: 0.3423443 May 25 17:01:30.067001 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3832070'] for port, before_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:01:30.086884 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0dd53d8e-5dd0-41b0-a28c-023cb6a5c924 admin admin] Pushing event updated for resources: {'Port': ['ID=57de629d-5918-4034-ad5a-0176cb475228,revision_number=1']} {{(pid=91829) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:01:30.103088 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.db [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] For port 1cd0b8ab-beec-4909-80a4-6c7ac80ecd5c, host dv-cinder-790492-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-790492-4-iscsi',level=0,port_id=1cd0b8ab-beec-4909-80a4-6c7ac80ecd5c,segment=NetworkSegment(414a8468-1d66-4792-9e81-d8ac5ccf1512),segment_id=414a8468-1d66-4792-9e81-d8ac5ccf1512)] {{(pid=91831) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 17:01:30.111566 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8757892955028', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8757892520933', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8757892521750'] for port, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:01:30.118708 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [None req-dbccdb86-a843-4579-865e-b4299e6f33cf None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:01:30.119361 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-0dd53d8e-5dd0-41b0-a28c-023cb6a5c924 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.262s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:01:30.199088 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-1136b46d-72f9-4025-be59-355915202c48 req-0b42b48e-1609-44d5-bfa3-5b7e19ea7ccc service neutron] 10.222.0.32 "GET /v2.0/networks/613457eb-6f6d-4604-8f6c-f2d318ff9bc5?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.4304194 May 25 17:01:30.238061 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-e3fa2a4a-6991-4e86-9513-96a424e821f6 req-874b6811-8a3b-48d8-aa01-411e5bc22286 tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] 10.222.0.62 "GET /v2.0/security-groups?id=1468f899-860c-4905-aee3-f13adc83d0a4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2126374 May 25 17:01:30.244605 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-0dd53d8e-5dd0-41b0-a28c-023cb6a5c924 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-680080'] for router_interface, before_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:01:30.301371 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-57f11b47-1f51-4191-b7c9-af248a48372c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:01:30.322915 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-614f7680-565e-4387-b6ef-5299c61e76b1 req-3959c27e-8b35-4360-8973-9df5a636a6ec tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:01:30.326924 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-614f7680-565e-4387-b6ef-5299c61e76b1 req-3959c27e-8b35-4360-8973-9df5a636a6ec tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/ports?device_id=58da9205-0212-4daa-996c-1eef64a2b702 HTTP/1.1" status: 200 len: 945 time: 0.2852235 May 25 17:01:30.330589 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Pushing event updated for resources: {'Port': ['ID=1cd0b8ab-beec-4909-80a4-6c7ac80ecd5c,revision_number=4']} {{(pid=91831) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:01:30.336071 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.218s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:01:30.347073 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.provisioning_blocks [None req-369b7fec-2fef-4bb3-bb9f-e3ea8d2cfc57 None None] Provisioning for port 57de629d-5918-4034-ad5a-0176cb475228 completed by entity DHCP. {{(pid=91831) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 25 17:01:30.352083 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.provisioning_blocks [None req-369b7fec-2fef-4bb3-bb9f-e3ea8d2cfc57 None None] Provisioning complete for port 57de629d-5918-4034-ad5a-0176cb475228 triggered by entity DHCP. {{(pid=91831) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 17:01:30.352453 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-369b7fec-2fef-4bb3-bb9f-e3ea8d2cfc57 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3854128'] for port, provisioning_complete {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:01:30.395227 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-614f7680-565e-4387-b6ef-5299c61e76b1 req-a8475d43-0223-49b0-b61b-bdef296fb45a tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/security-groups?id=8ee5c4ed-9c60-4e39-9185-7e283704a7dc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0640457 May 25 17:01:30.428996 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.plugin [None req-369b7fec-2fef-4bb3-bb9f-e3ea8d2cfc57 None None] Port 57de629d-5918-4034-ad5a-0176cb475228 cannot update to ACTIVE because it is not bound. {{(pid=91831) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 25 17:01:30.492843 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-0dd53d8e-5dd0-41b0-a28c-023cb6a5c924 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3832070'] for port, before_update {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:01:30.732712 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-0dd53d8e-5dd0-41b0-a28c-023cb6a5c924 admin admin] Notify callbacks [] for port, precommit_update {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:01:30.737559 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-0dd53d8e-5dd0-41b0-a28c-023cb6a5c924 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8757892955028', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8757892520933', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8757892521750', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28230801'] for port, after_update {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:01:30.762452 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-42905d27-cfb2-4b93-8c1c-2dd7aa37f822 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:01:30.851134 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0dd53d8e-5dd0-41b0-a28c-023cb6a5c924 admin admin] Pushing event updated for resources: {'Port': ['ID=57de629d-5918-4034-ad5a-0176cb475228,revision_number=2']} {{(pid=91829) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:01:30.854134 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-0dd53d8e-5dd0-41b0-a28c-023cb6a5c924 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.092s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:01:30.854757 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-0dd53d8e-5dd0-41b0-a28c-023cb6a5c924 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-549138', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-679997'] for router_interface, after_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:01:30.993247 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0dd53d8e-5dd0-41b0-a28c-023cb6a5c924 admin admin] Network faa2de89-15e9-41fa-ad3d-fb87f039acb9 is already hosted by enough agents. {{(pid=91829) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 25 17:01:30.994592 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.scheduler.base_scheduler [None req-0dd53d8e-5dd0-41b0-a28c-023cb6a5c924 admin admin] Resources bound (agent type, host, resource id): {{(pid=91829) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 17:01:31.187391 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-0dd53d8e-5dd0-41b0-a28c-023cb6a5c924 admin admin] Router a00240d8-05fd-40cc-9536-9762357ba6d6 has already been hosted by L3 agent a2d427c1-2d07-43e8-afbe-218c9f7d0445 {{(pid=91829) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 25 17:01:31.254987 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.provisioning_blocks [None req-f9809a9a-fc4b-4e23-83f4-265bf644bcbe None None] Provisioning complete for port 57de629d-5918-4034-ad5a-0176cb475228 triggered by entity DHCP. {{(pid=91831) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 17:01:31.255584 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-f9809a9a-fc4b-4e23-83f4-265bf644bcbe None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3854128'] for port, provisioning_complete {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:01:31.362851 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.plugin [None req-f9809a9a-fc4b-4e23-83f4-265bf644bcbe None None] Port 57de629d-5918-4034-ad5a-0176cb475228 cannot update to ACTIVE because it is not bound. {{(pid=91831) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 25 17:01:31.566673 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-0dd53d8e-5dd0-41b0-a28c-023cb6a5c924 admin admin] Notify agent at l3_agent.dv-cinder-790492-4-iscsi the message routers_updated {{(pid=91829) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 25 17:01:31.574839 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ed5e03c0-03ee-4716-98d5-dae93b020a4d None None] Sync routers for ids ['a00240d8-05fd-40cc-9536-9762357ba6d6'] in dv-cinder-790492-4-iscsi {{(pid=91831) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 25 17:01:31.583830 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ed5e03c0-03ee-4716-98d5-dae93b020a4d None None] Routers {'a00240d8-05fd-40cc-9536-9762357ba6d6'} bound to L3 agent in host dv-cinder-790492-4-iscsi {{(pid=91831) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 17:01:31.584453 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.l3_hamode_db [None req-ed5e03c0-03ee-4716-98d5-dae93b020a4d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-790492-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-05-25T16:50:28Z,description=,heartbeat_timestamp=2021-05-25T17:01:28Z,host='dv-cinder-790492-4-iscsi',id=a2d427c1-2d07-43e8-afbe-218c9f7d0445,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T16:50:28Z,topic='l3_agent')) {'router_ids': ['a00240d8-05fd-40cc-9536-9762357ba6d6'], 'active': True} {{(pid=91831) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 17:01:31.592808 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [None req-0dd53d8e-5dd0-41b0-a28c-023cb6a5c924 admin admin] 10.222.0.62 "PUT /v2.0/routers/a00240d8-05fd-40cc-9536-9762357ba6d6/add_router_interface HTTP/1.1" status: 200 len: 503 time: 4.6241181 May 25 17:01:31.629482 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-404973c5-b66e-4be8-95bb-ab5580459d75 req-32c0ddf5-de6b-4f96-9ea3-7b0a8db29054 tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:01:31.631022 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-404973c5-b66e-4be8-95bb-ab5580459d75 req-32c0ddf5-de6b-4f96-9ea3-7b0a8db29054 tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] 10.222.0.62 "GET /v2.0/ports?device_id=482f4d0c-0df9-4de7-9c75-b28c728be580 HTTP/1.1" status: 200 len: 944 time: 0.1693068 May 25 17:01:31.649232 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-86307fb4-d847-44f2-8bc2-f44c87074e35 req-eb0982a8-2d49-43ae-8982-b4f1f01f0c72 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:01:31.658536 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-86307fb4-d847-44f2-8bc2-f44c87074e35 req-eb0982a8-2d49-43ae-8982-b4f1f01f0c72 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/ports?device_id=58da9205-0212-4daa-996c-1eef64a2b702 HTTP/1.1" status: 200 len: 945 time: 0.1391003 May 25 17:01:31.739741 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-404973c5-b66e-4be8-95bb-ab5580459d75 req-90b2eed2-fcf2-47cc-a8cd-6c4f1c35a401 tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] 10.222.0.62 "GET /v2.0/security-groups?id=1468f899-860c-4905-aee3-f13adc83d0a4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0791838 May 25 17:01:31.742795 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-86307fb4-d847-44f2-8bc2-f44c87074e35 req-95c263fa-01e2-4fdb-b468-447916ca27c7 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/security-groups?id=8ee5c4ed-9c60-4e39-9185-7e283704a7dc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0812848 May 25 17:01:31.758154 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.rpc [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Device 1cd0b8ab-beec-4909-80a4-6c7ac80ecd5c up at agent ovs-agent-dv-cinder-790492-4-iscsi {{(pid=91831) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 25 17:01:31.850128 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.l3_dvr_db [None req-ed5e03c0-03ee-4716-98d5-dae93b020a4d None None] Set router a00240d8-05fd-40cc-9536-9762357ba6d6 gateway port host: dv-cinder-790492-4-iscsi {{(pid=91831) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 17:01:31.921550 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.provisioning_blocks [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Provisioning complete for port 1cd0b8ab-beec-4909-80a4-6c7ac80ecd5c triggered by entity L2. {{(pid=91831) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 17:01:31.921947 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3854128'] for port, provisioning_complete {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:01:32.264873 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.l3_hamode_db [None req-ed5e03c0-03ee-4716-98d5-dae93b020a4d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'a00240d8-05fd-40cc-9536-9762357ba6d6', 'name': 'tempest-TestMinimumBasicScenario-1151073527-router', 'tenant_id': 'a60ff90c536747ff984cf0591f1a098b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'external_fixed_ips': [{'subnet_id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'ip_address': '172.27.2.228'}], 'enable_snat': True}, 'gw_port_id': '1cd0b8ab-beec-4909-80a4-6c7ac80ecd5c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T17:01:21Z', 'updated_at': '2021-05-25T17:01:30Z', 'revision_number': 4, 'project_id': 'a60ff90c536747ff984cf0591f1a098b', 'gw_port': {'id': '1cd0b8ab-beec-4909-80a4-6c7ac80ecd5c', 'name': '', 'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'tenant_id': '', 'mac_address': 'fa:16:3e:f6:e5:02', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a00240d8-05fd-40cc-9536-9762357ba6d6', 'device_owner': 'network:router_gateway', 'standard_attr_id': 444, 'fixed_ips': [{'subnet_id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'ip_address': '172.27.2.228', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790492-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:01:22Z', 'updated_at': '2021-05-25T17:01:30Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-790492-4-iscsi', '_interfaces': [{'id': '57de629d-5918-4034-ad5a-0176cb475228', 'name': '', 'network_id': 'faa2de89-15e9-41fa-ad3d-fb87f039acb9', 'tenant_id': 'a60ff90c536747ff984cf0591f1a098b', 'mac_address': 'fa:16:3e:be:0d:e2', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'a00240d8-05fd-40cc-9536-9762357ba6d6', 'device_owner': 'network:router_interface', 'standard_attr_id': 446, 'fixed_ips': [{'subnet_id': 'ccf0e45f-5342-4190-89c1-d04cd1f8e468', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:01:28Z', 'updated_at': '2021-05-25T17:01:30Z', 'revision_number': 2, 'project_id': 'a60ff90c536747ff984cf0591f1a098b', 'subnets': [{'id': 'ccf0e45f-5342-4190-89c1-d04cd1f8e468', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-790492-4-iscsi', False) {} {{(pid=91831) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 17:01:32.268819 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ed5e03c0-03ee-4716-98d5-dae93b020a4d None None] Checking router: a00240d8-05fd-40cc-9536-9762357ba6d6 for host: dv-cinder-790492-4-iscsi {{(pid=91831) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 25 17:01:32.269180 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ed5e03c0-03ee-4716-98d5-dae93b020a4d None None] Updating router a00240d8-05fd-40cc-9536-9762357ba6d6 port 57de629d-5918-4034-ad5a-0176cb475228 binding host dv-cinder-790492-4-iscsi {{(pid=91831) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} May 25 17:01:32.326483 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-ed5e03c0-03ee-4716-98d5-dae93b020a4d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3832070'] for port, before_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:01:32.706751 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-ed5e03c0-03ee-4716-98d5-dae93b020a4d None None] Notify callbacks [] for port, precommit_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:01:32.717392 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.provisioning_blocks [None req-ed5e03c0-03ee-4716-98d5-dae93b020a4d None None] Transition to ACTIVE for port object 57de629d-5918-4034-ad5a-0176cb475228 will not be triggered until provisioned by entity L2. {{(pid=91831) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 25 17:01:32.724050 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-ed5e03c0-03ee-4716-98d5-dae93b020a4d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8757892955028', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8757892520933', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8757892521750'] for port, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:01:32.727502 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [None req-7eee7a75-fb73-4d08-a0db-eb89e624b25f None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:01:32.927574 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b0d85d62-a45e-4615-b952-f2b33680a7ad None None] Pushing event updated for resources: {'Port': ['ID=57de629d-5918-4034-ad5a-0176cb475228,revision_number=3']} {{(pid=91831) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:01:32.936125 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [None req-b0d85d62-a45e-4615-b952-f2b33680a7ad None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.207s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:01:32.958102 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.managers [None req-ed5e03c0-03ee-4716-98d5-dae93b020a4d None None] Attempting to bind port 57de629d-5918-4034-ad5a-0176cb475228 on host dv-cinder-790492-4-iscsi for vnic_type normal with profile {{(pid=91831) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 25 17:01:32.958385 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.managers [None req-ed5e03c0-03ee-4716-98d5-dae93b020a4d None None] Attempting to bind port 57de629d-5918-4034-ad5a-0176cb475228 by drivers openvswitch,hyperv on host dv-cinder-790492-4-iscsi at level 0 using segments [{'id': 'ed45d58b-5f76-41a7-95d9-322227308621', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 682, 'network_id': 'faa2de89-15e9-41fa-ad3d-fb87f039acb9'}] {{(pid=91831) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 25 17:01:32.958750 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ed5e03c0-03ee-4716-98d5-dae93b020a4d None None] Attempting to bind port 57de629d-5918-4034-ad5a-0176cb475228 on network faa2de89-15e9-41fa-ad3d-fb87f039acb9 {{(pid=91831) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 25 17:01:32.964696 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ed5e03c0-03ee-4716-98d5-dae93b020a4d None None] Checking agent: {'id': 'fc8251e1-071c-49f7-bc10-1337f1d37d1b', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-790492-4-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 25, 16, 50, 28), 'started_at': datetime.datetime(2021, 5, 25, 16, 50, 58), 'heartbeat_timestamp': datetime.datetime(2021, 5, 25, 17, 1, 28), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-790492-4-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=91831) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 25 17:01:32.965112 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ed5e03c0-03ee-4716-98d5-dae93b020a4d None None] Checking segment: {'id': 'ed45d58b-5f76-41a7-95d9-322227308621', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 682, 'network_id': 'faa2de89-15e9-41fa-ad3d-fb87f039acb9'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91831) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 25 17:01:32.965519 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-ed5e03c0-03ee-4716-98d5-dae93b020a4d None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:01:32.966463 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ed5e03c0-03ee-4716-98d5-dae93b020a4d None None] Bound using segment: {'id': 'ed45d58b-5f76-41a7-95d9-322227308621', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 682, 'network_id': 'faa2de89-15e9-41fa-ad3d-fb87f039acb9'} {{(pid=91831) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 25 17:01:32.967064 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.managers [None req-ed5e03c0-03ee-4716-98d5-dae93b020a4d None None] Bound port: 57de629d-5918-4034-ad5a-0176cb475228, host: dv-cinder-790492-4-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'ed45d58b-5f76-41a7-95d9-322227308621', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 682, 'network_id': 'faa2de89-15e9-41fa-ad3d-fb87f039acb9'}}] {{(pid=91831) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 25 17:01:32.967600 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-ed5e03c0-03ee-4716-98d5-dae93b020a4d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3832070'] for port, before_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:01:33.054712 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-beaff9e5-76dc-4687-9864-85e8f3e29a62 req-f24954cd-a7f5-48f0-a80c-b280d396a410 tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:01:33.056184 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-beaff9e5-76dc-4687-9864-85e8f3e29a62 req-f24954cd-a7f5-48f0-a80c-b280d396a410 tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] 10.222.0.62 "GET /v2.0/ports?device_id=482f4d0c-0df9-4de7-9c75-b28c728be580 HTTP/1.1" status: 200 len: 944 time: 0.1625686 May 25 17:01:33.064995 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ca9fc742-3da4-4a93-9a77-babae4cd3d4b req-73b436f3-5878-431d-a144-10c7ec66b58d tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:01:33.066410 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-ca9fc742-3da4-4a93-9a77-babae4cd3d4b req-73b436f3-5878-431d-a144-10c7ec66b58d tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/ports?device_id=58da9205-0212-4daa-996c-1eef64a2b702 HTTP/1.1" status: 200 len: 945 time: 0.1362553 May 25 17:01:33.078850 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.db [None req-ed5e03c0-03ee-4716-98d5-dae93b020a4d None None] For port 57de629d-5918-4034-ad5a-0176cb475228, host dv-cinder-790492-4-iscsi, cleared binding levels {{(pid=91831) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 25 17:01:33.082501 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.db [None req-ed5e03c0-03ee-4716-98d5-dae93b020a4d None None] For port 57de629d-5918-4034-ad5a-0176cb475228, host dv-cinder-790492-4-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-790492-4-iscsi',level=0,port_id=57de629d-5918-4034-ad5a-0176cb475228,segment=NetworkSegment(ed45d58b-5f76-41a7-95d9-322227308621),segment_id=ed45d58b-5f76-41a7-95d9-322227308621)] {{(pid=91831) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 25 17:01:33.087391 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-ed5e03c0-03ee-4716-98d5-dae93b020a4d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8757892955028', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8757892520933', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8757892521750'] for port, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:01:33.092522 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:01:33.140447 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-beaff9e5-76dc-4687-9864-85e8f3e29a62 req-1b5de518-bcc1-4361-a5e9-05979a81e4e1 tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] 10.222.0.62 "GET /v2.0/security-groups?id=1468f899-860c-4905-aee3-f13adc83d0a4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0730872 May 25 17:01:33.146427 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-ca9fc742-3da4-4a93-9a77-babae4cd3d4b req-861dd3c9-d85d-4544-b740-6a46afdaf008 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/security-groups?id=8ee5c4ed-9c60-4e39-9185-7e283704a7dc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0658646 May 25 17:01:33.176543 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b0d85d62-a45e-4615-b952-f2b33680a7ad None None] Pushing event updated for resources: {'Port': ['ID=57de629d-5918-4034-ad5a-0176cb475228,revision_number=4']} {{(pid=91831) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:01:33.182745 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [None req-b0d85d62-a45e-4615-b952-f2b33680a7ad None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.090s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:01:33.206035 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ed5e03c0-03ee-4716-98d5-dae93b020a4d None None] Routers {'a00240d8-05fd-40cc-9536-9762357ba6d6'} bound to L3 agent in host dv-cinder-790492-4-iscsi {{(pid=91831) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 17:01:33.206828 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.l3_hamode_db [None req-ed5e03c0-03ee-4716-98d5-dae93b020a4d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-790492-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-05-25T16:50:28Z,description=,heartbeat_timestamp=2021-05-25T17:01:28Z,host='dv-cinder-790492-4-iscsi',id=a2d427c1-2d07-43e8-afbe-218c9f7d0445,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T16:50:28Z,topic='l3_agent')) {'router_ids': ['a00240d8-05fd-40cc-9536-9762357ba6d6'], 'active': True} {{(pid=91831) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 17:01:33.390992 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.l3_dvr_db [None req-ed5e03c0-03ee-4716-98d5-dae93b020a4d None None] Set router a00240d8-05fd-40cc-9536-9762357ba6d6 gateway port host: dv-cinder-790492-4-iscsi {{(pid=91831) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 17:01:33.715066 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.l3_hamode_db [None req-ed5e03c0-03ee-4716-98d5-dae93b020a4d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'a00240d8-05fd-40cc-9536-9762357ba6d6', 'name': 'tempest-TestMinimumBasicScenario-1151073527-router', 'tenant_id': 'a60ff90c536747ff984cf0591f1a098b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'external_fixed_ips': [{'subnet_id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'ip_address': '172.27.2.228'}], 'enable_snat': True}, 'gw_port_id': '1cd0b8ab-beec-4909-80a4-6c7ac80ecd5c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T17:01:21Z', 'updated_at': '2021-05-25T17:01:30Z', 'revision_number': 4, 'project_id': 'a60ff90c536747ff984cf0591f1a098b', 'gw_port': {'id': '1cd0b8ab-beec-4909-80a4-6c7ac80ecd5c', 'name': '', 'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'tenant_id': '', 'mac_address': 'fa:16:3e:f6:e5:02', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a00240d8-05fd-40cc-9536-9762357ba6d6', 'device_owner': 'network:router_gateway', 'standard_attr_id': 444, 'fixed_ips': [{'subnet_id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'ip_address': '172.27.2.228', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790492-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:01:22Z', 'updated_at': '2021-05-25T17:01:30Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-790492-4-iscsi', '_interfaces': [{'id': '57de629d-5918-4034-ad5a-0176cb475228', 'name': '', 'network_id': 'faa2de89-15e9-41fa-ad3d-fb87f039acb9', 'tenant_id': 'a60ff90c536747ff984cf0591f1a098b', 'mac_address': 'fa:16:3e:be:0d:e2', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'a00240d8-05fd-40cc-9536-9762357ba6d6', 'device_owner': 'network:router_interface', 'standard_attr_id': 446, 'fixed_ips': [{'subnet_id': 'ccf0e45f-5342-4190-89c1-d04cd1f8e468', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790492-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:01:28Z', 'updated_at': '2021-05-25T17:01:33Z', 'revision_number': 4, 'project_id': 'a60ff90c536747ff984cf0591f1a098b', 'subnets': [{'id': 'ccf0e45f-5342-4190-89c1-d04cd1f8e468', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-790492-4-iscsi', False) {} {{(pid=91831) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 17:01:33.718988 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ed5e03c0-03ee-4716-98d5-dae93b020a4d None None] The sync data for ids ['a00240d8-05fd-40cc-9536-9762357ba6d6'] in dv-cinder-790492-4-iscsi is: [{'id': 'a00240d8-05fd-40cc-9536-9762357ba6d6', 'name': 'tempest-TestMinimumBasicScenario-1151073527-router', 'tenant_id': 'a60ff90c536747ff984cf0591f1a098b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'external_fixed_ips': [{'subnet_id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'ip_address': '172.27.2.228'}], 'enable_snat': True}, 'gw_port_id': '1cd0b8ab-beec-4909-80a4-6c7ac80ecd5c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T17:01:21Z', 'updated_at': '2021-05-25T17:01:30Z', 'revision_number': 4, 'project_id': 'a60ff90c536747ff984cf0591f1a098b', 'gw_port': {'id': '1cd0b8ab-beec-4909-80a4-6c7ac80ecd5c', 'name': '', 'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'tenant_id': '', 'mac_address': 'fa:16:3e:f6:e5:02', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a00240d8-05fd-40cc-9536-9762357ba6d6', 'device_owner': 'network:router_gateway', 'standard_attr_id': 444, 'fixed_ips': [{'subnet_id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'ip_address': '172.27.2.228', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790492-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:01:22Z', 'updated_at': '2021-05-25T17:01:30Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-790492-4-iscsi', '_interfaces': [{'id': '57de629d-5918-4034-ad5a-0176cb475228', 'name': '', 'network_id': 'faa2de89-15e9-41fa-ad3d-fb87f039acb9', 'tenant_id': 'a60ff90c536747ff984cf0591f1a098b', 'mac_address': 'fa:16:3e:be:0d:e2', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'a00240d8-05fd-40cc-9536-9762357ba6d6', 'device_owner': 'network:router_interface', 'standard_attr_id': 446, 'fixed_ips': [{'subnet_id': 'ccf0e45f-5342-4190-89c1-d04cd1f8e468', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790492-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:01:28Z', 'updated_at': '2021-05-25T17:01:33Z', 'revision_number': 4, 'project_id': 'a60ff90c536747ff984cf0591f1a098b', 'subnets': [{'id': 'ccf0e45f-5342-4190-89c1-d04cd1f8e468', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=91831) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 25 17:01:34.378623 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:01:34.412265 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-770ac4dc-cd4f-47ea-b236-232d6a0a73b3 req-0e3d58cd-e2a6-4731-ac4c-0e41e2bdcb83 tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:01:34.413747 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-770ac4dc-cd4f-47ea-b236-232d6a0a73b3 req-0e3d58cd-e2a6-4731-ac4c-0e41e2bdcb83 tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] 10.222.0.62 "GET /v2.0/ports?device_id=482f4d0c-0df9-4de7-9c75-b28c728be580 HTTP/1.1" status: 200 len: 944 time: 0.1542513 May 25 17:01:34.422380 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-59678ebd-3597-4a2c-a4a9-6fa741b918b8 req-23239d8c-d3e0-41e3-ac2c-103f80bb47ac tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:01:34.423802 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-59678ebd-3597-4a2c-a4a9-6fa741b918b8 req-23239d8c-d3e0-41e3-ac2c-103f80bb47ac tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/ports?device_id=58da9205-0212-4daa-996c-1eef64a2b702 HTTP/1.1" status: 200 len: 945 time: 0.1625412 May 25 17:01:34.495482 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-770ac4dc-cd4f-47ea-b236-232d6a0a73b3 req-a6583951-72f7-4012-b1e2-b22c6675fd7f tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] 10.222.0.62 "GET /v2.0/security-groups?id=1468f899-860c-4905-aee3-f13adc83d0a4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0707073 May 25 17:01:34.502940 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-59678ebd-3597-4a2c-a4a9-6fa741b918b8 req-7c20d6f6-ac6f-4498-a9a3-8a13b98fc62c tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/security-groups?id=8ee5c4ed-9c60-4e39-9185-7e283704a7dc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0644855 May 25 17:01:35.762410 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.rpc [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Device 57de629d-5918-4034-ad5a-0176cb475228 up at agent ovs-agent-dv-cinder-790492-4-iscsi {{(pid=91831) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 25 17:01:35.788148 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d4096fca-06fb-47ea-acfb-1265e123a492 req-c7ced30b-f532-4e9e-a2e4-dcf9486e56e3 tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:01:35.790089 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-d4096fca-06fb-47ea-acfb-1265e123a492 req-c7ced30b-f532-4e9e-a2e4-dcf9486e56e3 tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] 10.222.0.62 "GET /v2.0/ports?device_id=482f4d0c-0df9-4de7-9c75-b28c728be580 HTTP/1.1" status: 200 len: 944 time: 0.1754315 May 25 17:01:35.806473 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4a6aeb67-247f-47d6-9eb2-10e652baf2ec req-15f1db89-a200-4f4d-8c0b-0be8856a9450 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:01:35.815357 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-4a6aeb67-247f-47d6-9eb2-10e652baf2ec req-15f1db89-a200-4f4d-8c0b-0be8856a9450 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/ports?device_id=58da9205-0212-4daa-996c-1eef64a2b702 HTTP/1.1" status: 200 len: 945 time: 0.2019019 May 25 17:01:35.847941 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.provisioning_blocks [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Provisioning for port 57de629d-5918-4034-ad5a-0176cb475228 completed by entity L2. {{(pid=91831) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 25 17:01:35.854651 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.provisioning_blocks [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Provisioning complete for port 57de629d-5918-4034-ad5a-0176cb475228 triggered by entity L2. {{(pid=91831) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 17:01:35.855770 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3854128'] for port, provisioning_complete {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:01:35.901947 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-4a6aeb67-247f-47d6-9eb2-10e652baf2ec req-b3acda27-faea-4967-9a67-5e8452ad2a41 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/security-groups?id=8ee5c4ed-9c60-4e39-9185-7e283704a7dc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0855386 May 25 17:01:35.931205 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-d4096fca-06fb-47ea-acfb-1265e123a492 req-d3d190bc-8329-4e02-99d9-b560778e0f6c tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] 10.222.0.62 "GET /v2.0/security-groups?id=1468f899-860c-4905-aee3-f13adc83d0a4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1061113 May 25 17:01:36.001626 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3832070'] for port, before_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:01:36.035294 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.db [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] For port 57de629d-5918-4034-ad5a-0176cb475228, host dv-cinder-790492-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-790492-4-iscsi',level=0,port_id=57de629d-5918-4034-ad5a-0176cb475228,segment=NetworkSegment(ed45d58b-5f76-41a7-95d9-322227308621),segment_id=ed45d58b-5f76-41a7-95d9-322227308621)] {{(pid=91831) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 17:01:36.039168 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8757892955028', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8757892520933', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8757892521750'] for port, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:01:36.041003 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:01:36.109091 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Pushing event updated for resources: {'Port': ['ID=57de629d-5918-4034-ad5a-0176cb475228,revision_number=5']} {{(pid=91831) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:01:36.112542 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.071s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:01:37.188204 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8919c252-8a6f-4390-81fe-0b4b87d12100 req-a7f3a8a9-267a-4e5f-9ea1-babe61ef69af tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:01:37.189710 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-8919c252-8a6f-4390-81fe-0b4b87d12100 req-a7f3a8a9-267a-4e5f-9ea1-babe61ef69af tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] 10.222.0.62 "GET /v2.0/ports?device_id=482f4d0c-0df9-4de7-9c75-b28c728be580 HTTP/1.1" status: 200 len: 944 time: 0.1180079 May 25 17:01:37.197723 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2dd0b84a-4a86-4800-97b6-3c19ccb32604 req-47af46d3-e5a4-48f3-a178-7fc21c8c6e19 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:01:37.199107 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-2dd0b84a-4a86-4800-97b6-3c19ccb32604 req-47af46d3-e5a4-48f3-a178-7fc21c8c6e19 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/ports?device_id=58da9205-0212-4daa-996c-1eef64a2b702 HTTP/1.1" status: 200 len: 945 time: 0.1677878 May 25 17:01:37.271696 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-2dd0b84a-4a86-4800-97b6-3c19ccb32604 req-0cbc5f9f-b40e-4805-b64e-84b5e79d7373 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/security-groups?id=8ee5c4ed-9c60-4e39-9185-7e283704a7dc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0581470 May 25 17:01:37.284680 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-8919c252-8a6f-4390-81fe-0b4b87d12100 req-24891c3c-a8e8-4838-a578-12bb6a2b0914 tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] 10.222.0.62 "GET /v2.0/security-groups?id=1468f899-860c-4905-aee3-f13adc83d0a4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0846031 May 25 17:01:37.455413 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.rpc [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Device 646693a2-80a9-425d-bb26-ffda8fa453a7 details requested by agent hyperv_hv-cinder-79049 with host hv-cinder-79049 {{(pid=91831) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 25 17:01:37.662636 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.db [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] For port 646693a2-80a9-425d-bb26-ffda8fa453a7, host hv-cinder-79049, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79049',level=0,port_id=646693a2-80a9-425d-bb26-ffda8fa453a7,segment=NetworkSegment(55bc70ae-213c-42ca-b035-b4a902044007),segment_id=55bc70ae-213c-42ca-b035-b4a902044007)] {{(pid=91831) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 17:01:37.685974 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.rpc [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Returning: {'device': '646693a2-80a9-425d-bb26-ffda8fa453a7', 'network_id': '613457eb-6f6d-4604-8f6c-f2d318ff9bc5', 'port_id': '646693a2-80a9-425d-bb26-ffda8fa453a7', 'mac_address': 'fa:16:3e:2c:b8:5f', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 659, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '3fc60650-484d-4574-bb67-0e4931bc9854', 'ip_address': '172.20.0.11'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=91831) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 25 17:01:37.767745 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3832070'] for port, before_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:01:37.789622 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.notifiers.nova [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 646693a2-80a9-425d-bb26-ffda8fa453a7 {{(pid=91831) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} May 25 17:01:37.814407 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.db [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] For port 646693a2-80a9-425d-bb26-ffda8fa453a7, host hv-cinder-79049, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79049',level=0,port_id=646693a2-80a9-425d-bb26-ffda8fa453a7,segment=NetworkSegment(55bc70ae-213c-42ca-b035-b4a902044007),segment_id=55bc70ae-213c-42ca-b035-b4a902044007)] {{(pid=91831) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 17:01:37.827228 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8757892955028', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8757892520933', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8757892521750'] for port, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:01:37.835107 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [None req-7eee7a75-fb73-4d08-a0db-eb89e624b25f None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:01:37.874670 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.rpc [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Device 57de629d-5918-4034-ad5a-0176cb475228 up at agent ovs-agent-dv-cinder-790492-4-iscsi {{(pid=91831) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 25 17:01:37.975817 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Pushing event updated for resources: {'Port': ['ID=646693a2-80a9-425d-bb26-ffda8fa453a7,revision_number=4']} {{(pid=91831) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:01:37.994125 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.157s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:01:38.001371 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.provisioning_blocks [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Provisioning complete for port 57de629d-5918-4034-ad5a-0176cb475228 triggered by entity L2. {{(pid=91831) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 17:01:38.001932 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3854128'] for port, provisioning_complete {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:01:38.407857 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.db [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] get_ports_and_sgs() called for port_ids ['646693a2-80a9-425d-bb26-ffda8fa453a7'] {{(pid=91831) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 25 17:01:38.579337 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4ed2090a-7a30-4396-a84d-8bec9764c789 req-c360a99b-9c57-4ef1-9dfa-f1ab6e01ae12 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:01:38.591284 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-4ed2090a-7a30-4396-a84d-8bec9764c789 req-c360a99b-9c57-4ef1-9dfa-f1ab6e01ae12 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/ports?device_id=58da9205-0212-4daa-996c-1eef64a2b702 HTTP/1.1" status: 200 len: 945 time: 0.1855085 May 25 17:01:38.638221 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-07c33c30-bca4-4830-8fd2-a01782833ced req-e7b1a1cc-8b53-4e6c-b2b6-6e9b3a5b4747 tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:01:38.646114 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-07c33c30-bca4-4830-8fd2-a01782833ced req-e7b1a1cc-8b53-4e6c-b2b6-6e9b3a5b4747 tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] 10.222.0.62 "GET /v2.0/ports?device_id=482f4d0c-0df9-4de7-9c75-b28c728be580 HTTP/1.1" status: 200 len: 945 time: 0.1887884 May 25 17:01:38.675282 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-4ed2090a-7a30-4396-a84d-8bec9764c789 req-fed83c8f-1bb2-4ebb-9c98-7a1670c92812 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/security-groups?id=8ee5c4ed-9c60-4e39-9185-7e283704a7dc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0817606 May 25 17:01:38.766309 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-07c33c30-bca4-4830-8fd2-a01782833ced req-84e542f1-0c00-41ff-8c2c-f5bf2ee85d13 tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] 10.222.0.62 "GET /v2.0/security-groups?id=1468f899-860c-4905-aee3-f13adc83d0a4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1188915 May 25 17:01:39.904739 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4e0c4f73-3b49-4d53-ad58-56e236c10954 req-c6882cba-4c1e-499d-831a-0708294443db tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:01:39.906766 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-4e0c4f73-3b49-4d53-ad58-56e236c10954 req-c6882cba-4c1e-499d-831a-0708294443db tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/ports?device_id=58da9205-0212-4daa-996c-1eef64a2b702 HTTP/1.1" status: 200 len: 945 time: 0.0960307 May 25 17:01:39.971761 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-4e0c4f73-3b49-4d53-ad58-56e236c10954 req-d7f73dde-4d12-4113-bba5-f07629000e57 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/security-groups?id=8ee5c4ed-9c60-4e39-9185-7e283704a7dc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0586147 May 25 17:01:40.187295 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2bcd1581-ccf5-43a8-b529-6c215ffc5619 req-625a4e65-6d42-49d1-94c4-ddbfd7fd72b2 tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:01:40.195445 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-2bcd1581-ccf5-43a8-b529-6c215ffc5619 req-625a4e65-6d42-49d1-94c4-ddbfd7fd72b2 tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] 10.222.0.62 "GET /v2.0/ports?device_id=482f4d0c-0df9-4de7-9c75-b28c728be580 HTTP/1.1" status: 200 len: 945 time: 0.1075399 May 25 17:01:40.247886 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-2bcd1581-ccf5-43a8-b529-6c215ffc5619 req-5ed07503-e98e-473e-bcd8-6e674c0dd33f tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] 10.222.0.62 "GET /v2.0/security-groups?id=1468f899-860c-4905-aee3-f13adc83d0a4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0511935 May 25 17:01:41.183480 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-df2f958d-e510-4878-8ddd-56f3e6d48238 req-e77639a4-939e-4a3b-b4c6-1ccd03034171 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:01:41.185006 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-df2f958d-e510-4878-8ddd-56f3e6d48238 req-e77639a4-939e-4a3b-b4c6-1ccd03034171 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/ports?device_id=58da9205-0212-4daa-996c-1eef64a2b702 HTTP/1.1" status: 200 len: 945 time: 0.0841892 May 25 17:01:41.254637 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-df2f958d-e510-4878-8ddd-56f3e6d48238 req-7415a31f-4047-4293-b665-9adc8f2c8d0b tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/security-groups?id=8ee5c4ed-9c60-4e39-9185-7e283704a7dc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0572283 May 25 17:01:41.470651 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.rpc [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Device 646693a2-80a9-425d-bb26-ffda8fa453a7 up at agent hyperv_hv-cinder-79049 {{(pid=91831) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 25 17:01:41.579137 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.provisioning_blocks [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Provisioning for port 646693a2-80a9-425d-bb26-ffda8fa453a7 completed by entity L2. {{(pid=91831) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 25 17:01:41.586154 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.provisioning_blocks [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Provisioning complete for port 646693a2-80a9-425d-bb26-ffda8fa453a7 triggered by entity L2. {{(pid=91831) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 17:01:41.587172 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3854128'] for port, provisioning_complete {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:01:41.710165 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f52cdedc-1b46-46cb-97b1-5b4ec1b063b1 req-2d794591-70bd-46d3-8343-742098ee5f28 tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:01:41.715403 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-f52cdedc-1b46-46cb-97b1-5b4ec1b063b1 req-2d794591-70bd-46d3-8343-742098ee5f28 tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] 10.222.0.62 "GET /v2.0/ports?device_id=482f4d0c-0df9-4de7-9c75-b28c728be580 HTTP/1.1" status: 200 len: 945 time: 0.2944965 May 25 17:01:41.738938 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3832070'] for port, before_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:01:41.778629 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '482f4d0c-0df9-4de7-9c75-b28c728be580', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '646693a2-80a9-425d-bb26-ffda8fa453a7'}] {{(pid=91831) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 25 17:01:41.783423 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-f52cdedc-1b46-46cb-97b1-5b4ec1b063b1 req-49b88ec2-0952-4d20-abbc-3f2fc04017c2 tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] 10.222.0.62 "GET /v2.0/security-groups?id=1468f899-860c-4905-aee3-f13adc83d0a4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0666246 May 25 17:01:41.798572 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.db [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] For port 646693a2-80a9-425d-bb26-ffda8fa453a7, host hv-cinder-79049, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79049',level=0,port_id=646693a2-80a9-425d-bb26-ffda8fa453a7,segment=NetworkSegment(55bc70ae-213c-42ca-b035-b4a902044007),segment_id=55bc70ae-213c-42ca-b035-b4a902044007)] {{(pid=91831) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 17:01:41.805002 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8757892955028', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8757892520933', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8757892521750'] for port, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:01:41.808315 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [None req-cbfe79ae-38f6-477b-9537-244bfa603ab4 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:01:41.813089 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d868d770-3d2c-49db-b034-ae1f87eafa18 req-8ed45e5c-dbdc-4988-835a-840922dfbfce tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:01:41.815008 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-d868d770-3d2c-49db-b034-ae1f87eafa18 req-8ed45e5c-dbdc-4988-835a-840922dfbfce tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] 10.222.0.62 "GET /v2.0/networks?id=63b1f335-e2c4-48dd-886b-6be853f8a2fc HTTP/1.1" status: 200 len: 814 time: 0.4180653 May 25 17:01:41.838559 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-d868d770-3d2c-49db-b034-ae1f87eafa18 req-61472fb1-ac56-4ae9-8d2a-67fca4a7d05d tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] 10.222.0.62 "GET /v2.0/quotas/04e8022f24e3464ab1ab7726d6a07e08 HTTP/1.1" status: 200 len: 375 time: 0.0173738 May 25 17:01:41.927431 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Pushing event updated for resources: {'Port': ['ID=646693a2-80a9-425d-bb26-ffda8fa453a7,revision_number=5']} {{(pid=91831) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:01:41.938043 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.130s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:01:41.972289 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-d868d770-3d2c-49db-b034-ae1f87eafa18 req-c4563c2e-2f11-4c15-8f76-f08920172059 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] 10.222.0.62 "GET /v2.0/ports?tenant_id=04e8022f24e3464ab1ab7726d6a07e08&fields=id HTTP/1.1" status: 200 len: 348 time: 0.1269066 May 25 17:01:42.055073 dv-cinder-790492-4-iscsi neutron-server[91831]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '482f4d0c-0df9-4de7-9c75-b28c728be580', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '646693a2-80a9-425d-bb26-ffda8fa453a7', 'code': 200} May 25 17:01:42.114190 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-d868d770-3d2c-49db-b034-ae1f87eafa18 req-0a83a5bd-9cef-40b3-8461-3945bb869c23 service neutron] 10.222.0.62 "GET /v2.0/networks/63b1f335-e2c4-48dd-886b-6be853f8a2fc?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1407628 May 25 17:01:42.314299 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-d868d770-3d2c-49db-b034-ae1f87eafa18 req-6572cc28-33ef-4886-89cb-27c52e5551c0 service neutron] 10.222.0.62 "GET /v2.0/networks/63b1f335-e2c4-48dd-886b-6be853f8a2fc?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1914771 May 25 17:01:42.627671 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-ec0dc6a7-7d95-4c96-ac94-5c887725483a req-790d9ed9-0b99-4ad2-8578-6581baefc419 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] 10.222.0.62 "GET /v2.0/ports?device_id=0c32425a-15a9-4c9d-8e31-17183d4909c9 HTTP/1.1" status: 200 len: 210 time: 0.0593512 May 25 17:01:42.656914 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f78c1379-ea7f-4ed2-8cda-0605d086e39d req-0f79e99f-2ce2-4691-aabb-e29ae274f0cf service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:01:42.658412 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-f78c1379-ea7f-4ed2-8cda-0605d086e39d req-0f79e99f-2ce2-4691-aabb-e29ae274f0cf service neutron] 10.222.0.32 "GET /v2.0/ports?device_id=482f4d0c-0df9-4de7-9c75-b28c728be580 HTTP/1.1" status: 200 len: 1099 time: 0.2844353 May 25 17:01:42.666856 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-488a0d4e-cfe5-47f2-8adc-2b174fc61f91 req-e19217fd-da7e-4bfb-bc79-2416b7f4f8c0 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:01:42.678882 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-488a0d4e-cfe5-47f2-8adc-2b174fc61f91 req-e19217fd-da7e-4bfb-bc79-2416b7f4f8c0 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/ports?device_id=58da9205-0212-4daa-996c-1eef64a2b702 HTTP/1.1" status: 200 len: 945 time: 0.2105546 May 25 17:01:42.749157 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-f78c1379-ea7f-4ed2-8cda-0605d086e39d req-d266d85b-c778-4fd2-8aa4-5930ee19a09f service neutron] 10.222.0.32 "GET /v2.0/security-groups?id=1468f899-860c-4905-aee3-f13adc83d0a4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0691330 May 25 17:01:42.765214 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-488a0d4e-cfe5-47f2-8adc-2b174fc61f91 req-bc6fab70-5a5d-4c4a-ad02-1c540fd0ab38 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/security-groups?id=8ee5c4ed-9c60-4e39-9185-7e283704a7dc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0670357 May 25 17:01:43.070108 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-410322c1-d57c-469d-be22-e4156278cfcb req-c8ac4bb5-fb50-46de-b49e-c4cd50de5230 tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:01:43.072995 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-410322c1-d57c-469d-be22-e4156278cfcb req-c8ac4bb5-fb50-46de-b49e-c4cd50de5230 tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] 10.222.0.62 "GET /v2.0/ports?device_id=482f4d0c-0df9-4de7-9c75-b28c728be580 HTTP/1.1" status: 200 len: 946 time: 0.1474645 May 25 17:01:43.169091 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-410322c1-d57c-469d-be22-e4156278cfcb req-06b89c0d-d826-44ad-a674-11b57eda2e06 tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] 10.222.0.62 "GET /v2.0/security-groups?id=1468f899-860c-4905-aee3-f13adc83d0a4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0950940 May 25 17:01:43.788959 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-b503c2b8-6cb7-4690-a04a-85abc88b8692 req-cd6ac604-ea35-4b97-af32-760a236825bc tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] 10.222.0.62 "GET /v2.0/ports?device_id=0c32425a-15a9-4c9d-8e31-17183d4909c9 HTTP/1.1" status: 200 len: 210 time: 0.0441756 May 25 17:01:44.302777 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d868d770-3d2c-49db-b034-ae1f87eafa18 req-835915e5-310b-44c4-9715-bfcd87c9db61 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:01:44.304533 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-d868d770-3d2c-49db-b034-ae1f87eafa18 req-835915e5-310b-44c4-9715-bfcd87c9db61 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] 10.222.0.32 "GET /v2.0/networks?id=63b1f335-e2c4-48dd-886b-6be853f8a2fc HTTP/1.1" status: 200 len: 814 time: 0.2811637 May 25 17:01:44.350862 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.v2.base [req-d868d770-3d2c-49db-b034-ae1f87eafa18 req-4f1857dc-3e6c-4225-a247-ce9bfcee644b tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] Request body: {'port': {'device_id': '0c32425a-15a9-4c9d-8e31-17183d4909c9', 'network_id': '63b1f335-e2c4-48dd-886b-6be853f8a2fc', 'admin_state_up': True, 'tenant_id': '04e8022f24e3464ab1ab7726d6a07e08'}} {{(pid=91829) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 17:01:44.509868 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9d489a58-cc18-44ca-a984-35bf8b4efde6 req-400796e6-6019-47d8-8f69-d8a0f432c13c tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:01:44.511421 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-9d489a58-cc18-44ca-a984-35bf8b4efde6 req-400796e6-6019-47d8-8f69-d8a0f432c13c tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/ports?device_id=58da9205-0212-4daa-996c-1eef64a2b702 HTTP/1.1" status: 200 len: 945 time: 0.4460881 May 25 17:01:44.585654 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8974348a-d689-42a7-8411-2af58e923998 req-17610c41-a79b-4f14-b1a6-1e9b05073aa8 tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:01:44.587163 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-8974348a-d689-42a7-8411-2af58e923998 req-17610c41-a79b-4f14-b1a6-1e9b05073aa8 tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] 10.222.0.62 "GET /v2.0/ports?device_id=482f4d0c-0df9-4de7-9c75-b28c728be580 HTTP/1.1" status: 200 len: 946 time: 0.2817509 May 25 17:01:44.619073 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.quota.driver [req-d868d770-3d2c-49db-b034-ae1f87eafa18 req-4f1857dc-3e6c-4225-a247-ce9bfcee644b tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91829) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 17:01:44.626948 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-9d489a58-cc18-44ca-a984-35bf8b4efde6 req-60783aee-4c11-4506-8510-152142994568 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/security-groups?id=8ee5c4ed-9c60-4e39-9185-7e283704a7dc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1063514 May 25 17:01:44.630975 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.quota.resource [req-d868d770-3d2c-49db-b034-ae1f87eafa18 req-4f1857dc-3e6c-4225-a247-ce9bfcee644b tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] Usage tracker for resource:port and tenant:04e8022f24e3464ab1ab7726d6a07e08 is out of sync, need to count used quota {{(pid=91829) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 17:01:44.634993 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.quota.resource [req-d868d770-3d2c-49db-b034-ae1f87eafa18 req-4f1857dc-3e6c-4225-a247-ce9bfcee644b tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] Quota usage for port was recalculated. Used quota:3. {{(pid=91829) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 17:01:44.654480 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.quota.driver [req-d868d770-3d2c-49db-b034-ae1f87eafa18 req-4f1857dc-3e6c-4225-a247-ce9bfcee644b tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] Attempting to reserve 1 items for resource port. Total usage: 3; quota limit: 500; headroom:497 {{(pid=91829) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 17:01:44.677902 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-8974348a-d689-42a7-8411-2af58e923998 req-d6b5e1d5-d4d9-4ebf-8438-320f9c8f2acf tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] 10.222.0.62 "GET /v2.0/security-groups?id=1468f899-860c-4905-aee3-f13adc83d0a4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0769782 May 25 17:01:44.703844 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-d868d770-3d2c-49db-b034-ae1f87eafa18 req-4f1857dc-3e6c-4225-a247-ce9bfcee644b tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] Made reservation on behalf of 04e8022f24e3464ab1ab7726d6a07e08 for: {'port': 1} {{(pid=91829) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 25 17:01:44.708040 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [req-d868d770-3d2c-49db-b034-ae1f87eafa18 req-4f1857dc-3e6c-4225-a247-ce9bfcee644b tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3832070'] for port, before_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:01:44.982197 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-b3735536-6a7a-4629-b4af-620971cbb79e req-a8f8d86f-4f9e-4dda-908a-d259d8ae3139 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] 10.222.0.62 "GET /v2.0/ports?device_id=0c32425a-15a9-4c9d-8e31-17183d4909c9 HTTP/1.1" status: 200 len: 210 time: 0.0533869 May 25 17:01:44.998947 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.db_base_plugin_common [req-d868d770-3d2c-49db-b034-ae1f87eafa18 req-4f1857dc-3e6c-4225-a247-ce9bfcee644b tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] Allocated IP 172.20.0.10 (63b1f335-e2c4-48dd-886b-6be853f8a2fc/b0baa944-cafe-48a4-861a-dae28947b9f0/993b7d31-308c-4414-910f-1a10bea6ed57) {{(pid=91829) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 25 17:01:45.234333 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-90784534-9453-499b-ae1e-2f0449c13546 req-86514f57-f9eb-4a36-82ce-9a176a4b0335 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91830) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:01:45.236067 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-90784534-9453-499b-ae1e-2f0449c13546 req-86514f57-f9eb-4a36-82ce-9a176a4b0335 service neutron] 10.222.0.32 "GET /v2.0/ports?device_id=58da9205-0212-4daa-996c-1eef64a2b702 HTTP/1.1" status: 200 len: 1098 time: 0.0796323 May 25 17:01:45.300974 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-90784534-9453-499b-ae1e-2f0449c13546 req-4febd753-ccc0-4bd0-8820-987d790d5889 service neutron] 10.222.0.32 "GET /v2.0/security-groups?id=8ee5c4ed-9c60-4e39-9185-7e283704a7dc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0498512 May 25 17:01:45.346232 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [req-d868d770-3d2c-49db-b034-ae1f87eafa18 req-4f1857dc-3e6c-4225-a247-ce9bfcee644b tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] Notify callbacks [] for port, precommit_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:01:45.377562 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [req-d868d770-3d2c-49db-b034-ae1f87eafa18 req-4f1857dc-3e6c-4225-a247-ce9bfcee644b tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8757892520915', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28230808'] for port, after_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:01:45.383969 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-0dd53d8e-5dd0-41b0-a28c-023cb6a5c924 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:01:45.399426 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.db [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] get_ports_and_sgs() called for port_ids ['c4b9c0f2-e3d5-4fff-9b3c-a9175b027fb5', '46a1adbe-ec54-4c57-aa7a-9f257475e01c', '85443de0-772c-4d18-bd76-026a72cc754d'] {{(pid=91831) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 25 17:01:45.455534 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-d868d770-3d2c-49db-b034-ae1f87eafa18 req-4f1857dc-3e6c-4225-a247-ce9bfcee644b tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] Network 63b1f335-e2c4-48dd-886b-6be853f8a2fc is already hosted by enough agents. {{(pid=91829) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 25 17:01:45.458307 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.scheduler.base_scheduler [req-d868d770-3d2c-49db-b034-ae1f87eafa18 req-4f1857dc-3e6c-4225-a247-ce9bfcee644b tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] Resources bound (agent type, host, resource id): {{(pid=91829) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 17:01:45.460735 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.l3_dvrscheduler_db [req-d868d770-3d2c-49db-b034-ae1f87eafa18 req-4f1857dc-3e6c-4225-a247-ce9bfcee644b tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] Received port after_create {{(pid=91829) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 25 17:01:45.498518 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4f1857dc-3e6c-4225-a247-ce9bfcee644b tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] Pushing event updated for resources: {'Port': ['ID=993b7d31-308c-4414-910f-1a10bea6ed57,revision_number=1']} {{(pid=91829) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:01:45.501684 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-4f1857dc-3e6c-4225-a247-ce9bfcee644b tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.118s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:01:45.538061 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d868d770-3d2c-49db-b034-ae1f87eafa18 req-4f1857dc-3e6c-4225-a247-ce9bfcee644b tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:01:45.538678 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [req-d868d770-3d2c-49db-b034-ae1f87eafa18 req-4f1857dc-3e6c-4225-a247-ce9bfcee644b tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-178712', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-551373'] for port, before_response {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:01:45.566934 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-d868d770-3d2c-49db-b034-ae1f87eafa18 req-4f1857dc-3e6c-4225-a247-ce9bfcee644b tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] 10.222.0.32 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 1.2252865 May 25 17:01:45.710275 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.v2.base [req-d868d770-3d2c-49db-b034-ae1f87eafa18 req-11322510-0860-4b24-bea0-e87b70011e99 service neutron] Request body: {'port': {'device_id': '0c32425a-15a9-4c9d-8e31-17183d4909c9', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-79049'}} {{(pid=91829) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 17:01:46.034099 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [req-d868d770-3d2c-49db-b034-ae1f87eafa18 req-11322510-0860-4b24-bea0-e87b70011e99 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3832070'] for port, before_update {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:01:46.064601 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d34591fe-0036-453e-928d-34e507379619 req-81158ef0-d23b-4662-99d3-451d34f7c7ce tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:01:46.066056 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-d34591fe-0036-453e-928d-34e507379619 req-81158ef0-d23b-4662-99d3-451d34f7c7ce tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/ports?device_id=58da9205-0212-4daa-996c-1eef64a2b702 HTTP/1.1" status: 200 len: 945 time: 0.2239249 May 25 17:01:46.135396 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4bcb4ce5-458f-4c9c-934d-d9d906ccb249 req-bd82d515-fbfe-492c-b8c6-9cd852915a71 tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:01:46.137479 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-4bcb4ce5-458f-4c9c-934d-d9d906ccb249 req-bd82d515-fbfe-492c-b8c6-9cd852915a71 tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] 10.222.0.62 "GET /v2.0/ports?device_id=482f4d0c-0df9-4de7-9c75-b28c728be580 HTTP/1.1" status: 200 len: 946 time: 0.2559841 May 25 17:01:46.227440 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-d34591fe-0036-453e-928d-34e507379619 req-475a663a-c302-400f-b5b5-e61ca314a045 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/security-groups?id=8ee5c4ed-9c60-4e39-9185-7e283704a7dc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1303802 May 25 17:01:46.380463 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-4bcb4ce5-458f-4c9c-934d-d9d906ccb249 req-cb48ef6d-d81b-4d36-ac8e-b27d7b142b30 tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] 10.222.0.62 "GET /v2.0/security-groups?id=1468f899-860c-4905-aee3-f13adc83d0a4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2346375 May 25 17:01:46.681291 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-26480ae0-4d36-476b-80d3-5fb34fa56f4c req-cf9f522f-b9b4-4f8a-a1ac-5f2be2415de9 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:01:46.682310 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.quota.resource [req-26480ae0-4d36-476b-80d3-5fb34fa56f4c req-cf9f522f-b9b4-4f8a-a1ac-5f2be2415de9 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] Synchronizing usage tracker for tenant:04e8022f24e3464ab1ab7726d6a07e08 on resource:port {{(pid=91829) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 25 17:01:46.697721 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.notifiers.nova [req-d868d770-3d2c-49db-b034-ae1f87eafa18 req-11322510-0860-4b24-bea0-e87b70011e99 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 993b7d31-308c-4414-910f-1a10bea6ed57 {{(pid=91829) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} May 25 17:01:46.748583 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [req-d868d770-3d2c-49db-b034-ae1f87eafa18 req-11322510-0860-4b24-bea0-e87b70011e99 service neutron] Notify callbacks [] for port, precommit_update {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:01:46.762682 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.quota.resource [req-26480ae0-4d36-476b-80d3-5fb34fa56f4c req-cf9f522f-b9b4-4f8a-a1ac-5f2be2415de9 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] Unset dirty status for tenant:04e8022f24e3464ab1ab7726d6a07e08 on resource:port {{(pid=91829) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 25 17:01:46.763808 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-26480ae0-4d36-476b-80d3-5fb34fa56f4c req-cf9f522f-b9b4-4f8a-a1ac-5f2be2415de9 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] 10.222.0.62 "GET /v2.0/ports?device_id=0c32425a-15a9-4c9d-8e31-17183d4909c9 HTTP/1.1" status: 200 len: 932 time: 0.2569067 May 25 17:01:46.796470 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.provisioning_blocks [req-d868d770-3d2c-49db-b034-ae1f87eafa18 req-11322510-0860-4b24-bea0-e87b70011e99 service neutron] Transition to ACTIVE for port object 993b7d31-308c-4414-910f-1a10bea6ed57 will not be triggered until provisioned by entity L2. {{(pid=91829) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 25 17:01:46.815427 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [req-d868d770-3d2c-49db-b034-ae1f87eafa18 req-11322510-0860-4b24-bea0-e87b70011e99 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8757892955028', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8757892520933', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8757892521750', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28230801'] for port, after_update {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:01:46.821529 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:01:46.868375 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-26480ae0-4d36-476b-80d3-5fb34fa56f4c req-883ec72d-60e4-45e8-9b2d-cf6b22172f6f tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] 10.222.0.62 "GET /v2.0/security-groups?id=f73b90a2-df48-48fb-99e0-5dd4d6a63a15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0957284 May 25 17:01:46.998016 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-11322510-0860-4b24-bea0-e87b70011e99 service neutron] Pushing event updated for resources: {'Port': ['ID=993b7d31-308c-4414-910f-1a10bea6ed57,revision_number=2']} {{(pid=91829) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:01:47.007346 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-817644aa-df13-4f70-8982-5fc462877bdf req-87c3f175-06ac-4ae5-b29a-4a2b8159ba00 tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:01:47.008685 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-817644aa-df13-4f70-8982-5fc462877bdf req-87c3f175-06ac-4ae5-b29a-4a2b8159ba00 tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] 10.222.0.62 "GET /v2.0/ports?device_id=482f4d0c-0df9-4de7-9c75-b28c728be580 HTTP/1.1" status: 200 len: 946 time: 0.3039684 May 25 17:01:47.009547 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-11322510-0860-4b24-bea0-e87b70011e99 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.188s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:01:47.107686 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-817644aa-df13-4f70-8982-5fc462877bdf req-61a5f47e-b7a1-4f01-b66f-38f779c9da2d tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] 10.222.0.62 "GET /v2.0/security-groups?id=1468f899-860c-4905-aee3-f13adc83d0a4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0920045 May 25 17:01:47.129897 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.wsgi [-] (91829) accepted ('10.222.0.62', 60844) {{(pid=91829) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:01:47.139098 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.plugins.ml2.managers [req-d868d770-3d2c-49db-b034-ae1f87eafa18 req-11322510-0860-4b24-bea0-e87b70011e99 service neutron] Attempting to bind port 993b7d31-308c-4414-910f-1a10bea6ed57 on host hv-cinder-79049 for vnic_type normal with profile {{(pid=91829) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 25 17:01:47.139560 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.plugins.ml2.managers [req-d868d770-3d2c-49db-b034-ae1f87eafa18 req-11322510-0860-4b24-bea0-e87b70011e99 service neutron] Attempting to bind port 993b7d31-308c-4414-910f-1a10bea6ed57 by drivers openvswitch,hyperv on host hv-cinder-79049 at level 0 using segments [{'id': '7d7273c2-c6dd-43fe-83a8-cb776d48dc70', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 651, 'network_id': '63b1f335-e2c4-48dd-886b-6be853f8a2fc'}] {{(pid=91829) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 25 17:01:47.140407 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d868d770-3d2c-49db-b034-ae1f87eafa18 req-11322510-0860-4b24-bea0-e87b70011e99 service neutron] Attempting to bind port 993b7d31-308c-4414-910f-1a10bea6ed57 on network 63b1f335-e2c4-48dd-886b-6be853f8a2fc {{(pid=91829) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 25 17:01:47.144900 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d868d770-3d2c-49db-b034-ae1f87eafa18 req-11322510-0860-4b24-bea0-e87b70011e99 service neutron] Port 993b7d31-308c-4414-910f-1a10bea6ed57 on network 63b1f335-e2c4-48dd-886b-6be853f8a2fc not bound, no agent of type Open vSwitch agent registered on host hv-cinder-79049 {{(pid=91829) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 25 17:01:47.145314 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d868d770-3d2c-49db-b034-ae1f87eafa18 req-11322510-0860-4b24-bea0-e87b70011e99 service neutron] Attempting to bind port 993b7d31-308c-4414-910f-1a10bea6ed57 on network 63b1f335-e2c4-48dd-886b-6be853f8a2fc {{(pid=91829) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 25 17:01:47.150461 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d868d770-3d2c-49db-b034-ae1f87eafa18 req-11322510-0860-4b24-bea0-e87b70011e99 service neutron] Checking agent: {'id': '3a1fdee1-bff0-49fb-b470-e13b95ee1b4d', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-79049', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 25, 16, 56, 32), 'started_at': datetime.datetime(2021, 5, 25, 16, 56, 32), 'heartbeat_timestamp': datetime.datetime(2021, 5, 25, 17, 1, 34), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=91829) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 25 17:01:47.150904 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d868d770-3d2c-49db-b034-ae1f87eafa18 req-11322510-0860-4b24-bea0-e87b70011e99 service neutron] Checking segment: {'id': '7d7273c2-c6dd-43fe-83a8-cb776d48dc70', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 651, 'network_id': '63b1f335-e2c4-48dd-886b-6be853f8a2fc'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91829) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 25 17:01:47.151382 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d868d770-3d2c-49db-b034-ae1f87eafa18 req-11322510-0860-4b24-bea0-e87b70011e99 service neutron] Bound using segment: {'id': '7d7273c2-c6dd-43fe-83a8-cb776d48dc70', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 651, 'network_id': '63b1f335-e2c4-48dd-886b-6be853f8a2fc'} {{(pid=91829) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 25 17:01:47.151873 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.plugins.ml2.managers [req-d868d770-3d2c-49db-b034-ae1f87eafa18 req-11322510-0860-4b24-bea0-e87b70011e99 service neutron] Bound port: 993b7d31-308c-4414-910f-1a10bea6ed57, host: hv-cinder-79049, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '7d7273c2-c6dd-43fe-83a8-cb776d48dc70', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 651, 'network_id': '63b1f335-e2c4-48dd-886b-6be853f8a2fc'}}] {{(pid=91829) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 25 17:01:47.152278 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [req-d868d770-3d2c-49db-b034-ae1f87eafa18 req-11322510-0860-4b24-bea0-e87b70011e99 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3832070'] for port, before_update {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:01:47.241105 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.plugins.ml2.db [req-d868d770-3d2c-49db-b034-ae1f87eafa18 req-11322510-0860-4b24-bea0-e87b70011e99 service neutron] For port 993b7d31-308c-4414-910f-1a10bea6ed57, host hv-cinder-79049, cleared binding levels {{(pid=91829) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 25 17:01:47.244626 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.plugins.ml2.db [req-d868d770-3d2c-49db-b034-ae1f87eafa18 req-11322510-0860-4b24-bea0-e87b70011e99 service neutron] For port 993b7d31-308c-4414-910f-1a10bea6ed57, host hv-cinder-79049, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79049',level=0,port_id=993b7d31-308c-4414-910f-1a10bea6ed57,segment=NetworkSegment(7d7273c2-c6dd-43fe-83a8-cb776d48dc70),segment_id=7d7273c2-c6dd-43fe-83a8-cb776d48dc70)] {{(pid=91829) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 25 17:01:47.249194 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [req-d868d770-3d2c-49db-b034-ae1f87eafa18 req-11322510-0860-4b24-bea0-e87b70011e99 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8757892955028', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8757892520933', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8757892521750', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28230801'] for port, after_update {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:01:47.253755 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:01:47.346547 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d868d770-3d2c-49db-b034-ae1f87eafa18 req-11322510-0860-4b24-bea0-e87b70011e99 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:01:47.347159 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [req-d868d770-3d2c-49db-b034-ae1f87eafa18 req-11322510-0860-4b24-bea0-e87b70011e99 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-178712', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-551373'] for port, before_response {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:01:47.348524 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-d868d770-3d2c-49db-b034-ae1f87eafa18 req-11322510-0860-4b24-bea0-e87b70011e99 service neutron] 10.222.0.32 "PUT /v2.0/ports/993b7d31-308c-4414-910f-1a10bea6ed57 HTTP/1.1" status: 200 len: 1094 time: 1.6491163 May 25 17:01:47.351200 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '0c32425a-15a9-4c9d-8e31-17183d4909c9', 'tag': '993b7d31-308c-4414-910f-1a10bea6ed57'}] {{(pid=91829) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 25 17:01:47.410760 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-11322510-0860-4b24-bea0-e87b70011e99 service neutron] Pushing event updated for resources: {'Port': ['ID=993b7d31-308c-4414-910f-1a10bea6ed57,revision_number=3']} {{(pid=91829) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:01:47.419392 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-11322510-0860-4b24-bea0-e87b70011e99 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.166s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:01:47.685051 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e7044021-4a00-4e49-99f7-cc8f99d016df tempest-TestShelveInstance-1868975443 tempest-TestShelveInstance-1868975443-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:01:47.685750 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.quota.resource [None req-e7044021-4a00-4e49-99f7-cc8f99d016df tempest-TestShelveInstance-1868975443 tempest-TestShelveInstance-1868975443-project-admin] Synchronizing usage tracker for tenant:6a788f87b23b492da7fbfb18883b9d2d on resource:port {{(pid=91829) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 25 17:01:47.734232 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7853799a-5179-492a-9dfe-59e85402d5f8 req-c6402b3e-da4c-4a32-8c5d-aafe85b1899b tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:01:47.735652 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-7853799a-5179-492a-9dfe-59e85402d5f8 req-c6402b3e-da4c-4a32-8c5d-aafe85b1899b tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] 10.222.0.62 "GET /v2.0/networks?id=f3ddbe01-13f7-4e15-b7da-2bdffc278cb7 HTTP/1.1" status: 200 len: 815 time: 0.3537424 May 25 17:01:47.746148 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.quota.resource [None req-e7044021-4a00-4e49-99f7-cc8f99d016df tempest-TestShelveInstance-1868975443 tempest-TestShelveInstance-1868975443-project-admin] Unset dirty status for tenant:6a788f87b23b492da7fbfb18883b9d2d on resource:port {{(pid=91829) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 25 17:01:47.747735 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [None req-e7044021-4a00-4e49-99f7-cc8f99d016df tempest-TestShelveInstance-1868975443 tempest-TestShelveInstance-1868975443-project-admin] 10.222.0.62 "GET /v2.0/ports?device_id=482f4d0c-0df9-4de7-9c75-b28c728be580 HTTP/1.1" status: 200 len: 1094 time: 0.6167741 May 25 17:01:47.750979 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.wsgi [-] (91830) accepted ('10.222.0.62', 60870) {{(pid=91830) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:01:47.756166 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.v2.base [None req-f7dca670-83e9-478a-aa86-bc414af0b2c1 tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] Request body: {'floatingip': {'floating_network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'port_id': '646693a2-80a9-425d-bb26-ffda8fa453a7', 'tenant_id': 'a736cc60cc2143c4b6dea99321051da5', 'fixed_ip_address': '172.20.0.11'}} {{(pid=91830) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 17:01:47.758786 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d868d770-3d2c-49db-b034-ae1f87eafa18 req-4d5f5cd3-c6de-4371-940d-e5dd6c0e3c7c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:01:47.759766 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-d868d770-3d2c-49db-b034-ae1f87eafa18 req-4d5f5cd3-c6de-4371-940d-e5dd6c0e3c7c service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=04e8022f24e3464ab1ab7726d6a07e08&device_id=0c32425a-15a9-4c9d-8e31-17183d4909c9 HTTP/1.1" status: 200 len: 1097 time: 0.3452499 May 25 17:01:47.763233 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.quota.driver [None req-f7dca670-83e9-478a-aa86-bc414af0b2c1 tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91830) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 17:01:47.770315 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-08190652-26eb-496e-b331-9a20f6d163b2 req-f439cd13-a37f-4872-9a07-839443d26bfe tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:01:47.771801 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-08190652-26eb-496e-b331-9a20f6d163b2 req-f439cd13-a37f-4872-9a07-839443d26bfe tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/ports?device_id=58da9205-0212-4daa-996c-1eef64a2b702 HTTP/1.1" status: 200 len: 945 time: 0.2121015 May 25 17:01:47.773013 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-7853799a-5179-492a-9dfe-59e85402d5f8 req-67764a81-42df-4f26-a07f-d54d1d79b1e2 tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] 10.222.0.62 "GET /v2.0/quotas/36c1ffa1d458478bac5893b2ddf98eda HTTP/1.1" status: 200 len: 375 time: 0.0297055 May 25 17:01:47.774033 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [None req-f7dca670-83e9-478a-aa86-bc414af0b2c1 tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] Usage tracker for resource:floatingip and tenant:a736cc60cc2143c4b6dea99321051da5 is out of sync, need to count used quota {{(pid=91830) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 17:01:47.777326 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [None req-f7dca670-83e9-478a-aa86-bc414af0b2c1 tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] Quota usage for floatingip was recalculated. Used quota:0. {{(pid=91830) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 17:01:47.788870 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.quota.driver [None req-f7dca670-83e9-478a-aa86-bc414af0b2c1 tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] Attempting to reserve 1 items for resource floatingip. Total usage: 0; quota limit: 50; headroom:50 {{(pid=91830) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 17:01:47.799127 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-f7dca670-83e9-478a-aa86-bc414af0b2c1 tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] Notify callbacks [] for floatingip, before_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:01:47.898323 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-d868d770-3d2c-49db-b034-ae1f87eafa18 req-e3607991-8f28-4e93-8272-55919aa67901 service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=993b7d31-308c-4414-910f-1a10bea6ed57 HTTP/1.1" status: 200 len: 217 time: 0.1052890 May 25 17:01:47.939382 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-f7dca670-83e9-478a-aa86-bc414af0b2c1 tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3832070'] for port, before_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:01:47.963860 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-08190652-26eb-496e-b331-9a20f6d163b2 req-fe4941ba-cadc-4617-90ef-7590113c2a1b tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/security-groups?id=8ee5c4ed-9c60-4e39-9185-7e283704a7dc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1854250 May 25 17:01:47.998125 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d868d770-3d2c-49db-b034-ae1f87eafa18 req-f2b5e77f-b8aa-469b-b568-945c3d73b04a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:01:47.999546 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-d868d770-3d2c-49db-b034-ae1f87eafa18 req-f2b5e77f-b8aa-469b-b568-945c3d73b04a service neutron] 10.222.0.32 "GET /v2.0/subnets?id=b0baa944-cafe-48a4-861a-dae28947b9f0 HTTP/1.1" status: 200 len: 854 time: 0.0853250 May 25 17:01:48.009789 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.quota.resource [req-7853799a-5179-492a-9dfe-59e85402d5f8 req-201ca15c-9d03-4d3e-9986-c6dca74bd7e5 tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Synchronizing usage tracker for tenant:36c1ffa1d458478bac5893b2ddf98eda on resource:port {{(pid=91829) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 25 17:01:48.059585 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '0c32425a-15a9-4c9d-8e31-17183d4909c9', 'tag': '993b7d31-308c-4414-910f-1a10bea6ed57', 'status': 'completed', 'code': 200} May 25 17:01:48.063591 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-d868d770-3d2c-49db-b034-ae1f87eafa18 req-74864ea8-5a81-4d31-a242-8c407c6824f5 service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=63b1f335-e2c4-48dd-886b-6be853f8a2fc&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0499322 May 25 17:01:48.097364 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.quota.resource [req-7853799a-5179-492a-9dfe-59e85402d5f8 req-201ca15c-9d03-4d3e-9986-c6dca74bd7e5 tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Unset dirty status for tenant:36c1ffa1d458478bac5893b2ddf98eda on resource:port {{(pid=91829) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 25 17:01:48.098633 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-7853799a-5179-492a-9dfe-59e85402d5f8 req-201ca15c-9d03-4d3e-9986-c6dca74bd7e5 tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] 10.222.0.62 "GET /v2.0/ports?tenant_id=36c1ffa1d458478bac5893b2ddf98eda&fields=id HTTP/1.1" status: 200 len: 302 time: 0.3192234 May 25 17:01:48.109029 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.db_base_plugin_common [None req-f7dca670-83e9-478a-aa86-bc414af0b2c1 tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] Allocated IP 172.27.2.213 (4364b6ab-4117-4a92-baeb-f5ee2f45bf74/b947e790-d731-4b63-afc4-4aa112afe0f6/a8be13ac-177f-401c-919c-2457ab2749cb) {{(pid=91830) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 25 17:01:48.260733 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-f7dca670-83e9-478a-aa86-bc414af0b2c1 tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] Notify callbacks [] for port, precommit_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:01:48.292506 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-f7dca670-83e9-478a-aa86-bc414af0b2c1 tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8757892520915', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-27483019'] for port, after_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:01:48.298467 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:01:48.313236 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-d868d770-3d2c-49db-b034-ae1f87eafa18 req-08c43757-ca99-4961-a03c-f6b50c939b12 service neutron] 10.222.0.32 "GET /v2.0/networks/63b1f335-e2c4-48dd-886b-6be853f8a2fc?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2331271 May 25 17:01:48.366882 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f7dca670-83e9-478a-aa86-bc414af0b2c1 tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] Network 4364b6ab-4117-4a92-baeb-f5ee2f45bf74 is already hosted by enough agents. {{(pid=91830) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 25 17:01:48.369532 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.scheduler.base_scheduler [None req-f7dca670-83e9-478a-aa86-bc414af0b2c1 tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] Resources bound (agent type, host, resource id): {{(pid=91830) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 17:01:48.372350 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f7dca670-83e9-478a-aa86-bc414af0b2c1 tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] Received port after_create {{(pid=91830) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 25 17:01:48.373076 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-7853799a-5179-492a-9dfe-59e85402d5f8 req-80bbcde0-cb30-4ca8-ae31-406b91a772a5 service neutron] 10.222.0.62 "GET /v2.0/networks/f3ddbe01-13f7-4e15-b7da-2bdffc278cb7?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2217743 May 25 17:01:48.418468 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f7dca670-83e9-478a-aa86-bc414af0b2c1 tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] Pushing event updated for resources: {'Port': ['ID=a8be13ac-177f-401c-919c-2457ab2749cb,revision_number=1']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:01:48.421937 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-f7dca670-83e9-478a-aa86-bc414af0b2c1 tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.123s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:01:48.617979 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-d868d770-3d2c-49db-b034-ae1f87eafa18 req-c90ff5d3-4058-4635-b7e7-95d553d8961a service neutron] 10.222.0.32 "GET /v2.0/networks/63b1f335-e2c4-48dd-886b-6be853f8a2fc?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2680714 May 25 17:01:48.628668 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-44dafd83-3bb2-4471-9709-c2cd6f2241a5 req-caf1c359-f0d3-48ab-8039-5b1571159e12 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:01:48.629865 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-44dafd83-3bb2-4471-9709-c2cd6f2241a5 req-caf1c359-f0d3-48ab-8039-5b1571159e12 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] 10.222.0.62 "GET /v2.0/ports?device_id=0c32425a-15a9-4c9d-8e31-17183d4909c9 HTTP/1.1" status: 200 len: 944 time: 0.3135448 May 25 17:01:48.634717 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-7853799a-5179-492a-9dfe-59e85402d5f8 req-7dec9ef7-d3cd-419f-b496-fc12ac40413c service neutron] 10.222.0.62 "GET /v2.0/networks/f3ddbe01-13f7-4e15-b7da-2bdffc278cb7?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2537549 May 25 17:01:48.745312 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-44dafd83-3bb2-4471-9709-c2cd6f2241a5 req-2936ab76-8e4e-4f88-a9bf-8e99bf4b95c0 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] 10.222.0.62 "GET /v2.0/security-groups?id=f73b90a2-df48-48fb-99e0-5dd4d6a63a15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1027005 May 25 17:01:48.789457 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-951b399b-7467-438f-80f5-5b8ac629dfa8 req-da3be729-914c-45da-be1e-3da4d930cc6d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:01:48.790972 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-951b399b-7467-438f-80f5-5b8ac629dfa8 req-da3be729-914c-45da-be1e-3da4d930cc6d service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=04e8022f24e3464ab1ab7726d6a07e08&device_id=0c32425a-15a9-4c9d-8e31-17183d4909c9 HTTP/1.1" status: 200 len: 1097 time: 0.1019015 May 25 17:01:48.838046 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-f7dca670-83e9-478a-aa86-bc414af0b2c1 tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] Notify callbacks [] for floatingip, precommit_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:01:48.916023 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-f7dca670-83e9-478a-aa86-bc414af0b2c1 tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3832070'] for port, before_update {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:01:48.921866 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-603c372e-03e8-4956-9abd-1397484f03db req-37c5f4eb-833f-4e7b-bb14-d80a4b6b22ac tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] 10.222.0.62 "GET /v2.0/ports?device_id=4413fd77-4f3e-40c8-b7ee-77d416cd7667 HTTP/1.1" status: 200 len: 210 time: 0.0976465 May 25 17:01:48.979817 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-951b399b-7467-438f-80f5-5b8ac629dfa8 req-c701c84e-9ea9-43ed-baef-8862896458a3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:01:48.982251 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-951b399b-7467-438f-80f5-5b8ac629dfa8 req-c701c84e-9ea9-43ed-baef-8862896458a3 service neutron] 10.222.0.32 "GET /v2.0/networks?id=63b1f335-e2c4-48dd-886b-6be853f8a2fc HTTP/1.1" status: 200 len: 915 time: 0.1793938 May 25 17:01:49.152426 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.db.agents_db [None req-504cb04f-4543-46c1-8db7-349e21db7634 None None] Agent healthcheck: found 6 active agents {{(pid=91832) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} May 25 17:01:49.168390 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-f7dca670-83e9-478a-aa86-bc414af0b2c1 tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] Notify callbacks [] for port, precommit_update {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:01:49.174317 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-f7dca670-83e9-478a-aa86-bc414af0b2c1 tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8757892955028', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8757892520933', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8757892521750', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-27483010'] for port, after_update {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:01:49.179213 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-a9d836cc-ec3c-4b3d-b2bd-b702e99b20ad service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:01:49.248561 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-951b399b-7467-438f-80f5-5b8ac629dfa8 req-c737707c-836c-4037-bc3e-6bcbc5d8d176 service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=993b7d31-308c-4414-910f-1a10bea6ed57 HTTP/1.1" status: 200 len: 217 time: 0.2449951 May 25 17:01:49.293520 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-f7dca670-83e9-478a-aa86-bc414af0b2c1 tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-683033'] for floatingip, after_update {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:01:49.339854 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-951b399b-7467-438f-80f5-5b8ac629dfa8 req-3a1c552c-6d65-4d50-b933-d10ecdfc6d67 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:01:49.341244 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-951b399b-7467-438f-80f5-5b8ac629dfa8 req-3a1c552c-6d65-4d50-b933-d10ecdfc6d67 service neutron] 10.222.0.32 "GET /v2.0/subnets?id=b0baa944-cafe-48a4-861a-dae28947b9f0 HTTP/1.1" status: 200 len: 854 time: 0.0808740 May 25 17:01:49.354202 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f9d338db-0dbc-4d66-927d-2deef90d1f61 req-8ab566c3-7aa0-4b3c-bed7-b49fec401ae0 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:01:49.355956 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-f9d338db-0dbc-4d66-927d-2deef90d1f61 req-8ab566c3-7aa0-4b3c-bed7-b49fec401ae0 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/ports?device_id=58da9205-0212-4daa-996c-1eef64a2b702 HTTP/1.1" status: 200 len: 945 time: 0.1567965 May 25 17:01:49.416587 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-951b399b-7467-438f-80f5-5b8ac629dfa8 req-e0b19519-a42e-432b-831f-46568128a869 service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=63b1f335-e2c4-48dd-886b-6be853f8a2fc&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0595233 May 25 17:01:49.463316 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f7dca670-83e9-478a-aa86-bc414af0b2c1 tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] Pushing event updated for resources: {'Port': ['ID=a8be13ac-177f-401c-919c-2457ab2749cb,revision_number=2']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:01:49.468487 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-f7dca670-83e9-478a-aa86-bc414af0b2c1 tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.289s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:01:49.474478 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-f9d338db-0dbc-4d66-927d-2deef90d1f61 req-d3f9a354-b0f1-4b37-bbc5-b21bbf1641e2 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/security-groups?id=8ee5c4ed-9c60-4e39-9185-7e283704a7dc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0826235 May 25 17:01:49.573192 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.db.l3_db [None req-f7dca670-83e9-478a-aa86-bc414af0b2c1 tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] Floating IP 2eb8e904-a20e-4e25-838a-b9ec0488e5ae associated. External IP: 172.27.2.213, port: 646693a2-80a9-425d-bb26-ffda8fa453a7. May 25 17:01:49.595454 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-951b399b-7467-438f-80f5-5b8ac629dfa8 req-22766f06-c86b-4b2d-95ad-aad584e0a4b0 service neutron] 10.222.0.32 "GET /v2.0/networks/63b1f335-e2c4-48dd-886b-6be853f8a2fc?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1556649 May 25 17:01:49.735910 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-951b399b-7467-438f-80f5-5b8ac629dfa8 req-463a082d-2ddc-47ec-aeab-13f81ed300fe service neutron] 10.222.0.32 "GET /v2.0/networks/63b1f335-e2c4-48dd-886b-6be853f8a2fc?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1328430 May 25 17:01:49.951235 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9412e846-f112-4c4b-beb3-dc50a30dfc57 req-d994008d-60b0-46bc-b6b9-1a1c9ba65f64 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:01:49.952767 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-9412e846-f112-4c4b-beb3-dc50a30dfc57 req-d994008d-60b0-46bc-b6b9-1a1c9ba65f64 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] 10.222.0.62 "GET /v2.0/ports?device_id=0c32425a-15a9-4c9d-8e31-17183d4909c9 HTTP/1.1" status: 200 len: 944 time: 0.0875411 May 25 17:01:49.975268 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-f7dca670-83e9-478a-aa86-bc414af0b2c1 tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] Router c063ed68-292f-4e35-ba01-24f34d8a5e42 has already been hosted by L3 agent a2d427c1-2d07-43e8-afbe-218c9f7d0445 {{(pid=91830) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 25 17:01:50.103558 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-9412e846-f112-4c4b-beb3-dc50a30dfc57 req-cb060b16-93a0-4dfc-8d1f-e3a244b85dec tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] 10.222.0.62 "GET /v2.0/security-groups?id=f73b90a2-df48-48fb-99e0-5dd4d6a63a15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1203384 May 25 17:01:50.133809 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3a6c5553-444a-42ef-84b9-a48876af38fc req-af09a26e-d64e-473b-a365-8251250cf0e0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:01:50.135362 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-3a6c5553-444a-42ef-84b9-a48876af38fc req-af09a26e-d64e-473b-a365-8251250cf0e0 service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=734df673f8b3484d80f35a45fbce9d5e&device_id=58da9205-0212-4daa-996c-1eef64a2b702 HTTP/1.1" status: 200 len: 1098 time: 0.1926401 May 25 17:01:50.144845 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2cf813aa-434e-4520-a5bd-bfa9af1b9e8f req-71ddb7aa-47f0-4cf8-9584-0a4a8c5966ca tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:01:50.146363 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-2cf813aa-434e-4520-a5bd-bfa9af1b9e8f req-71ddb7aa-47f0-4cf8-9584-0a4a8c5966ca tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/ports?device_id=58da9205-0212-4daa-996c-1eef64a2b702 HTTP/1.1" status: 200 len: 945 time: 0.1618795 May 25 17:01:50.196831 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-f7dca670-83e9-478a-aa86-bc414af0b2c1 tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] Notify agent at l3_agent.dv-cinder-790492-4-iscsi the message routers_updated {{(pid=91830) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 25 17:01:50.231543 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bca2b339-404f-40ca-99de-5f964cec9d32 None None] Sync routers for ids ['c063ed68-292f-4e35-ba01-24f34d8a5e42'] in dv-cinder-790492-4-iscsi {{(pid=91832) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 25 17:01:50.247074 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bca2b339-404f-40ca-99de-5f964cec9d32 None None] Routers {'c063ed68-292f-4e35-ba01-24f34d8a5e42'} bound to L3 agent in host dv-cinder-790492-4-iscsi {{(pid=91832) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 17:01:50.248086 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.db.l3_hamode_db [None req-bca2b339-404f-40ca-99de-5f964cec9d32 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-790492-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-05-25T16:50:28Z,description=,heartbeat_timestamp=2021-05-25T17:01:28Z,host='dv-cinder-790492-4-iscsi',id=a2d427c1-2d07-43e8-afbe-218c9f7d0445,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T16:50:28Z,topic='l3_agent')) {'router_ids': ['c063ed68-292f-4e35-ba01-24f34d8a5e42'], 'active': True} {{(pid=91832) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 17:01:50.375265 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-538e4ddc-bb2d-4a70-bd50-012bf1f2a579 req-92b9aa3c-a84b-47bb-9b59-6955b390527d tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] 10.222.0.62 "GET /v2.0/ports?device_id=4413fd77-4f3e-40c8-b7ee-77d416cd7667 HTTP/1.1" status: 200 len: 210 time: 0.1122177 May 25 17:01:50.386200 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-2cf813aa-434e-4520-a5bd-bfa9af1b9e8f req-eccabb13-f519-4e06-8dcc-4ab1bd246836 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/security-groups?id=8ee5c4ed-9c60-4e39-9185-7e283704a7dc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2312675 May 25 17:01:50.472703 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3a6c5553-444a-42ef-84b9-a48876af38fc req-15ad038b-90d4-494f-9aa4-a37f7032a44c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:01:50.474430 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-3a6c5553-444a-42ef-84b9-a48876af38fc req-15ad038b-90d4-494f-9aa4-a37f7032a44c service neutron] 10.222.0.32 "GET /v2.0/networks?id=55a46372-d583-4435-a0f6-b9397668217d HTTP/1.1" status: 200 len: 919 time: 0.3045106 May 25 17:01:50.503440 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-f7dca670-83e9-478a-aa86-bc414af0b2c1 tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-178712'] for floatingip, before_response {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:01:50.571215 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7853799a-5179-492a-9dfe-59e85402d5f8 req-37baddaa-9395-42b5-b3c9-8fd6d643b4df tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=91830) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:01:50.571926 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [req-7853799a-5179-492a-9dfe-59e85402d5f8 req-37baddaa-9395-42b5-b3c9-8fd6d643b4df tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Synchronizing usage tracker for tenant:36c1ffa1d458478bac5893b2ddf98eda on resource:network {{(pid=91830) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 25 17:01:50.577224 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-3a6c5553-444a-42ef-84b9-a48876af38fc req-271385a6-ed34-4fd1-b415-72ebd1d77242 service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=60078444-24b6-4560-b0a7-7802c4f8f2f8 HTTP/1.1" status: 200 len: 217 time: 0.0893779 May 25 17:01:50.597562 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [None req-f7dca670-83e9-478a-aa86-bc414af0b2c1 tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] 10.222.0.62 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 997 time: 2.8454010 May 25 17:01:50.599069 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '482f4d0c-0df9-4de7-9c75-b28c728be580', 'tag': '646693a2-80a9-425d-bb26-ffda8fa453a7'}] {{(pid=91830) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 25 17:01:50.604911 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.db.l3_dvr_db [None req-bca2b339-404f-40ca-99de-5f964cec9d32 None None] Set router c063ed68-292f-4e35-ba01-24f34d8a5e42 gateway port host: dv-cinder-790492-4-iscsi {{(pid=91832) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 17:01:50.615742 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [req-7853799a-5179-492a-9dfe-59e85402d5f8 req-37baddaa-9395-42b5-b3c9-8fd6d643b4df tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Unset dirty status for tenant:36c1ffa1d458478bac5893b2ddf98eda on resource:network {{(pid=91830) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 25 17:01:50.617567 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-7853799a-5179-492a-9dfe-59e85402d5f8 req-37baddaa-9395-42b5-b3c9-8fd6d643b4df tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] 10.222.0.32 "GET /v2.0/networks?id=f3ddbe01-13f7-4e15-b7da-2bdffc278cb7 HTTP/1.1" status: 200 len: 815 time: 0.4112434 May 25 17:01:50.644590 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '482f4d0c-0df9-4de7-9c75-b28c728be580', 'tag': '646693a2-80a9-425d-bb26-ffda8fa453a7', 'status': 'completed', 'code': 200} May 25 17:01:50.760839 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.v2.base [req-7853799a-5179-492a-9dfe-59e85402d5f8 req-f6713847-03cd-4004-8410-4ad749a02e63 tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Request body: {'port': {'device_id': '4413fd77-4f3e-40c8-b7ee-77d416cd7667', 'network_id': 'f3ddbe01-13f7-4e15-b7da-2bdffc278cb7', 'admin_state_up': True, 'tenant_id': '36c1ffa1d458478bac5893b2ddf98eda'}} {{(pid=91830) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 17:01:50.821057 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3a6c5553-444a-42ef-84b9-a48876af38fc req-1de5d6cb-e118-440b-b53e-550c190d2a7d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:01:50.822530 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-3a6c5553-444a-42ef-84b9-a48876af38fc req-1de5d6cb-e118-440b-b53e-550c190d2a7d service neutron] 10.222.0.32 "GET /v2.0/subnets?id=927bd65a-c4de-491b-b501-302852f4c784 HTTP/1.1" status: 200 len: 858 time: 0.0670331 May 25 17:01:50.879759 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-3a6c5553-444a-42ef-84b9-a48876af38fc req-0d31daa7-c0f4-4c25-b70f-57650156959e service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=55a46372-d583-4435-a0f6-b9397668217d&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0488431 May 25 17:01:50.957695 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.quota.driver [req-7853799a-5179-492a-9dfe-59e85402d5f8 req-f6713847-03cd-4004-8410-4ad749a02e63 tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91830) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 17:01:50.961278 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4153f2b3-72ce-4a05-9f85-3f98fb7a0891 req-00258819-0b7f-43a7-8c06-3faa0be8eed7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91830) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:01:50.962872 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-4153f2b3-72ce-4a05-9f85-3f98fb7a0891 req-00258819-0b7f-43a7-8c06-3faa0be8eed7 service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=a736cc60cc2143c4b6dea99321051da5&device_id=482f4d0c-0df9-4de7-9c75-b28c728be580 HTTP/1.1" status: 200 len: 1099 time: 0.1844635 May 25 17:01:50.993972 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.quota.driver [req-7853799a-5179-492a-9dfe-59e85402d5f8 req-f6713847-03cd-4004-8410-4ad749a02e63 tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Attempting to reserve 1 items for resource port. Total usage: 2; quota limit: 500; headroom:498 {{(pid=91830) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 17:01:50.998450 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.db.l3_hamode_db [None req-bca2b339-404f-40ca-99de-5f964cec9d32 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'c063ed68-292f-4e35-ba01-24f34d8a5e42', 'name': 'tempest-TestShelveInstance-1452464711-router', 'tenant_id': 'a736cc60cc2143c4b6dea99321051da5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'external_fixed_ips': [{'subnet_id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'ip_address': '172.27.2.75'}], 'enable_snat': True}, 'gw_port_id': '703dfe81-5ded-48db-9e96-d09ac4afce0f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T17:00:08Z', 'updated_at': '2021-05-25T17:00:15Z', 'revision_number': 4, 'project_id': 'a736cc60cc2143c4b6dea99321051da5', 'gw_port': {'id': '703dfe81-5ded-48db-9e96-d09ac4afce0f', 'name': '', 'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'tenant_id': '', 'mac_address': 'fa:16:3e:32:8f:aa', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c063ed68-292f-4e35-ba01-24f34d8a5e42', 'device_owner': 'network:router_gateway', 'standard_attr_id': 268, 'fixed_ips': [{'subnet_id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'ip_address': '172.27.2.75', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790492-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:00:09Z', 'updated_at': '2021-05-25T17:00:17Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-790492-4-iscsi', '_floatingips': [{'id': '2eb8e904-a20e-4e25-838a-b9ec0488e5ae', 'tenant_id': 'a736cc60cc2143c4b6dea99321051da5', 'floating_ip_address': '172.27.2.213', 'floating_network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'router_id': 'c063ed68-292f-4e35-ba01-24f34d8a5e42', 'port_id': '646693a2-80a9-425d-bb26-ffda8fa453a7', 'fixed_ip_address': '172.20.0.11', 'status': 'DOWN', 'standard_attr_id': 449, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '613457eb-6f6d-4604-8f6c-f2d318ff9bc5', 'mac_address': 'fa:16:3e:2c:b8:5f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '482f4d0c-0df9-4de7-9c75-b28c728be580', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-25T17:01:48Z', 'updated_at': '2021-05-25T17:01:48Z', 'revision_number': 0, 'project_id': 'a736cc60cc2143c4b6dea99321051da5', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'a3cc4b79-05f1-4b3f-95e5-18e49199b00a', 'name': '', 'network_id': '613457eb-6f6d-4604-8f6c-f2d318ff9bc5', 'tenant_id': 'a736cc60cc2143c4b6dea99321051da5', 'mac_address': 'fa:16:3e:c6:46:19', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c063ed68-292f-4e35-ba01-24f34d8a5e42', 'device_owner': 'network:router_interface', 'standard_attr_id': 282, 'fixed_ips': [{'subnet_id': '3fc60650-484d-4574-bb67-0e4931bc9854', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790492-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:00:13Z', 'updated_at': '2021-05-25T17:00:27Z', 'revision_number': 5, 'project_id': 'a736cc60cc2143c4b6dea99321051da5', 'subnets': [{'id': '3fc60650-484d-4574-bb67-0e4931bc9854', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-790492-4-iscsi', False) {} {{(pid=91832) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 17:01:51.003183 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bca2b339-404f-40ca-99de-5f964cec9d32 None None] Checking router: c063ed68-292f-4e35-ba01-24f34d8a5e42 for host: dv-cinder-790492-4-iscsi {{(pid=91832) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 25 17:01:51.013959 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bca2b339-404f-40ca-99de-5f964cec9d32 None None] Routers {'c063ed68-292f-4e35-ba01-24f34d8a5e42'} bound to L3 agent in host dv-cinder-790492-4-iscsi {{(pid=91832) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 17:01:51.014949 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.db.l3_hamode_db [None req-bca2b339-404f-40ca-99de-5f964cec9d32 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-790492-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-05-25T16:50:28Z,description=,heartbeat_timestamp=2021-05-25T17:01:28Z,host='dv-cinder-790492-4-iscsi',id=a2d427c1-2d07-43e8-afbe-218c9f7d0445,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T16:50:28Z,topic='l3_agent')) {'router_ids': ['c063ed68-292f-4e35-ba01-24f34d8a5e42'], 'active': True} {{(pid=91832) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 17:01:51.040712 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-3a6c5553-444a-42ef-84b9-a48876af38fc req-fdb0b505-75f0-4131-9689-9908d8f5a45c service neutron] 10.222.0.32 "GET /v2.0/networks/55a46372-d583-4435-a0f6-b9397668217d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1536996 May 25 17:01:51.065942 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-7853799a-5179-492a-9dfe-59e85402d5f8 req-f6713847-03cd-4004-8410-4ad749a02e63 tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Made reservation on behalf of 36c1ffa1d458478bac5893b2ddf98eda for: {'port': 1} {{(pid=91830) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 25 17:01:51.069831 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [req-7853799a-5179-492a-9dfe-59e85402d5f8 req-f6713847-03cd-4004-8410-4ad749a02e63 tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3832070'] for port, before_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:01:51.193127 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4153f2b3-72ce-4a05-9f85-3f98fb7a0891 req-6f59b48c-44d1-4c82-a056-bf2ab76f2c0f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91830) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:01:51.194765 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-4153f2b3-72ce-4a05-9f85-3f98fb7a0891 req-6f59b48c-44d1-4c82-a056-bf2ab76f2c0f service neutron] 10.222.0.32 "GET /v2.0/networks?id=613457eb-6f6d-4604-8f6c-f2d318ff9bc5 HTTP/1.1" status: 200 len: 910 time: 0.2231886 May 25 17:01:51.213878 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-3a6c5553-444a-42ef-84b9-a48876af38fc req-67073477-9efd-40fd-8ce8-4bf6641d7024 service neutron] 10.222.0.32 "GET /v2.0/networks/55a46372-d583-4435-a0f6-b9397668217d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1642399 May 25 17:01:51.236403 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.db.l3_dvr_db [None req-bca2b339-404f-40ca-99de-5f964cec9d32 None None] Set router c063ed68-292f-4e35-ba01-24f34d8a5e42 gateway port host: dv-cinder-790492-4-iscsi {{(pid=91832) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 17:01:51.504037 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bec00306-9ef6-4b07-ba0b-d78fcef6f87f req-0764d42e-a3d9-4c80-b325-80aad5111ebf tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:01:51.505755 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-bec00306-9ef6-4b07-ba0b-d78fcef6f87f req-0764d42e-a3d9-4c80-b325-80aad5111ebf tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] 10.222.0.62 "GET /v2.0/ports?device_id=0c32425a-15a9-4c9d-8e31-17183d4909c9 HTTP/1.1" status: 200 len: 944 time: 0.2501905 May 25 17:01:51.595285 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-bec00306-9ef6-4b07-ba0b-d78fcef6f87f req-6eaab79b-4ad5-4e20-a80c-cdc7ee9875d1 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] 10.222.0.62 "GET /v2.0/security-groups?id=f73b90a2-df48-48fb-99e0-5dd4d6a63a15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0788341 May 25 17:01:51.648703 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-4153f2b3-72ce-4a05-9f85-3f98fb7a0891 req-189c0fe6-cfcb-4b91-a482-14beee07adf9 service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=646693a2-80a9-425d-bb26-ffda8fa453a7 HTTP/1.1" status: 200 len: 1000 time: 0.4345551 May 25 17:01:51.667510 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.db_base_plugin_common [req-7853799a-5179-492a-9dfe-59e85402d5f8 req-f6713847-03cd-4004-8410-4ad749a02e63 tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Allocated IP 172.20.0.12 (f3ddbe01-13f7-4e15-b7da-2bdffc278cb7/69fba530-cce2-44a2-89bd-18a52f9d454c/d64889c5-b5bd-42be-aa18-7a6149a0a583) {{(pid=91830) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 25 17:01:51.784291 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.db.l3_hamode_db [None req-bca2b339-404f-40ca-99de-5f964cec9d32 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'c063ed68-292f-4e35-ba01-24f34d8a5e42', 'name': 'tempest-TestShelveInstance-1452464711-router', 'tenant_id': 'a736cc60cc2143c4b6dea99321051da5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'external_fixed_ips': [{'subnet_id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'ip_address': '172.27.2.75'}], 'enable_snat': True}, 'gw_port_id': '703dfe81-5ded-48db-9e96-d09ac4afce0f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T17:00:08Z', 'updated_at': '2021-05-25T17:00:15Z', 'revision_number': 4, 'project_id': 'a736cc60cc2143c4b6dea99321051da5', 'gw_port': {'id': '703dfe81-5ded-48db-9e96-d09ac4afce0f', 'name': '', 'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'tenant_id': '', 'mac_address': 'fa:16:3e:32:8f:aa', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c063ed68-292f-4e35-ba01-24f34d8a5e42', 'device_owner': 'network:router_gateway', 'standard_attr_id': 268, 'fixed_ips': [{'subnet_id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'ip_address': '172.27.2.75', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790492-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:00:09Z', 'updated_at': '2021-05-25T17:00:17Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-790492-4-iscsi', '_floatingips': [{'id': '2eb8e904-a20e-4e25-838a-b9ec0488e5ae', 'tenant_id': 'a736cc60cc2143c4b6dea99321051da5', 'floating_ip_address': '172.27.2.213', 'floating_network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'router_id': 'c063ed68-292f-4e35-ba01-24f34d8a5e42', 'port_id': '646693a2-80a9-425d-bb26-ffda8fa453a7', 'fixed_ip_address': '172.20.0.11', 'status': 'DOWN', 'standard_attr_id': 449, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '613457eb-6f6d-4604-8f6c-f2d318ff9bc5', 'mac_address': 'fa:16:3e:2c:b8:5f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '482f4d0c-0df9-4de7-9c75-b28c728be580', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-25T17:01:48Z', 'updated_at': '2021-05-25T17:01:48Z', 'revision_number': 0, 'project_id': 'a736cc60cc2143c4b6dea99321051da5', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'a3cc4b79-05f1-4b3f-95e5-18e49199b00a', 'name': '', 'network_id': '613457eb-6f6d-4604-8f6c-f2d318ff9bc5', 'tenant_id': 'a736cc60cc2143c4b6dea99321051da5', 'mac_address': 'fa:16:3e:c6:46:19', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c063ed68-292f-4e35-ba01-24f34d8a5e42', 'device_owner': 'network:router_interface', 'standard_attr_id': 282, 'fixed_ips': [{'subnet_id': '3fc60650-484d-4574-bb67-0e4931bc9854', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790492-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:00:13Z', 'updated_at': '2021-05-25T17:00:27Z', 'revision_number': 5, 'project_id': 'a736cc60cc2143c4b6dea99321051da5', 'subnets': [{'id': '3fc60650-484d-4574-bb67-0e4931bc9854', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-790492-4-iscsi', False) {} {{(pid=91832) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 17:01:51.787423 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a47041d7-b1d8-41c8-b21e-c8aa4f8fac14 req-6fc901a9-0fc6-4b94-b6ed-46992f517c80 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:01:51.788946 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bca2b339-404f-40ca-99de-5f964cec9d32 None None] The sync data for ids ['c063ed68-292f-4e35-ba01-24f34d8a5e42'] in dv-cinder-790492-4-iscsi is: [{'id': 'c063ed68-292f-4e35-ba01-24f34d8a5e42', 'name': 'tempest-TestShelveInstance-1452464711-router', 'tenant_id': 'a736cc60cc2143c4b6dea99321051da5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'external_fixed_ips': [{'subnet_id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'ip_address': '172.27.2.75'}], 'enable_snat': True}, 'gw_port_id': '703dfe81-5ded-48db-9e96-d09ac4afce0f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T17:00:08Z', 'updated_at': '2021-05-25T17:00:15Z', 'revision_number': 4, 'project_id': 'a736cc60cc2143c4b6dea99321051da5', 'gw_port': {'id': '703dfe81-5ded-48db-9e96-d09ac4afce0f', 'name': '', 'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'tenant_id': '', 'mac_address': 'fa:16:3e:32:8f:aa', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c063ed68-292f-4e35-ba01-24f34d8a5e42', 'device_owner': 'network:router_gateway', 'standard_attr_id': 268, 'fixed_ips': [{'subnet_id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'ip_address': '172.27.2.75', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790492-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:00:09Z', 'updated_at': '2021-05-25T17:00:17Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-790492-4-iscsi', '_floatingips': [{'id': '2eb8e904-a20e-4e25-838a-b9ec0488e5ae', 'tenant_id': 'a736cc60cc2143c4b6dea99321051da5', 'floating_ip_address': '172.27.2.213', 'floating_network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'router_id': 'c063ed68-292f-4e35-ba01-24f34d8a5e42', 'port_id': '646693a2-80a9-425d-bb26-ffda8fa453a7', 'fixed_ip_address': '172.20.0.11', 'status': 'DOWN', 'standard_attr_id': 449, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '613457eb-6f6d-4604-8f6c-f2d318ff9bc5', 'mac_address': 'fa:16:3e:2c:b8:5f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '482f4d0c-0df9-4de7-9c75-b28c728be580', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-25T17:01:48Z', 'updated_at': '2021-05-25T17:01:48Z', 'revision_number': 0, 'project_id': 'a736cc60cc2143c4b6dea99321051da5', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'a3cc4b79-05f1-4b3f-95e5-18e49199b00a', 'name': '', 'network_id': '613457eb-6f6d-4604-8f6c-f2d318ff9bc5', 'tenant_id': 'a736cc60cc2143c4b6dea99321051da5', 'mac_address': 'fa:16:3e:c6:46:19', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c063ed68-292f-4e35-ba01-24f34d8a5e42', 'device_owner': 'network:router_interface', 'standard_attr_id': 282, 'fixed_ips': [{'subnet_id': '3fc60650-484d-4574-bb67-0e4931bc9854', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790492-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:00:13Z', 'updated_at': '2021-05-25T17:00:27Z', 'revision_number': 5, 'project_id': 'a736cc60cc2143c4b6dea99321051da5', 'subnets': [{'id': '3fc60650-484d-4574-bb67-0e4931bc9854', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=91832) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 25 17:01:51.797607 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-a47041d7-b1d8-41c8-b21e-c8aa4f8fac14 req-6fc901a9-0fc6-4b94-b6ed-46992f517c80 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/ports?device_id=58da9205-0212-4daa-996c-1eef64a2b702 HTTP/1.1" status: 200 len: 945 time: 0.1504111 May 25 17:01:51.890620 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-8edec1bf-e25c-4a0e-95fa-848ebaae5497 req-2cbdfab1-54c0-4d3b-80fa-8fc658df5f41 tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] 10.222.0.62 "GET /v2.0/ports?device_id=4413fd77-4f3e-40c8-b7ee-77d416cd7667 HTTP/1.1" status: 200 len: 210 time: 0.0666165 May 25 17:01:51.926860 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-a47041d7-b1d8-41c8-b21e-c8aa4f8fac14 req-4bf507a8-c489-4693-b5ee-87946cc25467 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/security-groups?id=8ee5c4ed-9c60-4e39-9185-7e283704a7dc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1259189 May 25 17:01:52.062206 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [req-7853799a-5179-492a-9dfe-59e85402d5f8 req-f6713847-03cd-4004-8410-4ad749a02e63 tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Notify callbacks [] for port, precommit_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:01:52.092993 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.provisioning_blocks [req-7853799a-5179-492a-9dfe-59e85402d5f8 req-f6713847-03cd-4004-8410-4ad749a02e63 tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Transition to ACTIVE for port object d64889c5-b5bd-42be-aa18-7a6149a0a583 will not be triggered until provisioned by entity DHCP. {{(pid=91830) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 25 17:01:52.123549 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-36f3f5f3-a1f1-422e-86a7-5bdb2febea4a None None] New status for floating IP 2eb8e904-a20e-4e25-838a-b9ec0488e5ae: ACTIVE {{(pid=91831) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} May 25 17:01:52.126114 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [req-7853799a-5179-492a-9dfe-59e85402d5f8 req-f6713847-03cd-4004-8410-4ad749a02e63 tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8757892520915', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-27483019'] for port, after_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:01:52.131967 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-894dffd1-cbc4-443b-96b6-0c876bc4a0b5 tempest-DeleteServersTestJSON-1172980508 tempest-DeleteServersTestJSON-1172980508-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:01:52.198475 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-7853799a-5179-492a-9dfe-59e85402d5f8 req-f6713847-03cd-4004-8410-4ad749a02e63 tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Network f3ddbe01-13f7-4e15-b7da-2bdffc278cb7 is already hosted by enough agents. {{(pid=91830) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 25 17:01:52.201872 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.scheduler.base_scheduler [req-7853799a-5179-492a-9dfe-59e85402d5f8 req-f6713847-03cd-4004-8410-4ad749a02e63 tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Resources bound (agent type, host, resource id): {{(pid=91830) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 17:01:52.205806 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.l3_dvrscheduler_db [req-7853799a-5179-492a-9dfe-59e85402d5f8 req-f6713847-03cd-4004-8410-4ad749a02e63 tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Received port after_create {{(pid=91830) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 25 17:01:52.265440 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f6713847-03cd-4004-8410-4ad749a02e63 tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Pushing event updated for resources: {'Port': ['ID=d64889c5-b5bd-42be-aa18-7a6149a0a583,revision_number=1']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:01:52.270072 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-f6713847-03cd-4004-8410-4ad749a02e63 tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.138s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:01:52.278480 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7853799a-5179-492a-9dfe-59e85402d5f8 req-f6713847-03cd-4004-8410-4ad749a02e63 tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=91830) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:01:52.279094 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [req-7853799a-5179-492a-9dfe-59e85402d5f8 req-f6713847-03cd-4004-8410-4ad749a02e63 tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-178712'] for port, before_response {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:01:52.315816 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-7853799a-5179-492a-9dfe-59e85402d5f8 req-f6713847-03cd-4004-8410-4ad749a02e63 tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] 10.222.0.32 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 1.5589139 May 25 17:01:52.443411 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.provisioning_blocks [None req-fc8111d1-9505-440f-9a3b-a3dfda1a7528 None None] Provisioning for port d64889c5-b5bd-42be-aa18-7a6149a0a583 completed by entity DHCP. {{(pid=91831) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 25 17:01:52.448524 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.provisioning_blocks [None req-fc8111d1-9505-440f-9a3b-a3dfda1a7528 None None] Provisioning complete for port d64889c5-b5bd-42be-aa18-7a6149a0a583 triggered by entity DHCP. {{(pid=91831) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 17:01:52.448988 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-fc8111d1-9505-440f-9a3b-a3dfda1a7528 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3854128'] for port, provisioning_complete {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:01:52.503942 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.plugin [None req-fc8111d1-9505-440f-9a3b-a3dfda1a7528 None None] Port d64889c5-b5bd-42be-aa18-7a6149a0a583 cannot update to ACTIVE because it is not bound. {{(pid=91831) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 25 17:01:52.796942 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-29ba1062-122b-4ab5-bacf-d83e06b329e9 req-fdbe2a0b-0fe3-491b-a0a2-222aab08e830 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:01:52.798432 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-29ba1062-122b-4ab5-bacf-d83e06b329e9 req-fdbe2a0b-0fe3-491b-a0a2-222aab08e830 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] 10.222.0.62 "GET /v2.0/ports?device_id=0c32425a-15a9-4c9d-8e31-17183d4909c9 HTTP/1.1" status: 200 len: 944 time: 0.0796633 May 25 17:01:52.848048 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-29ba1062-122b-4ab5-bacf-d83e06b329e9 req-19a1d3c4-fc7b-4f99-a35d-f7440b0ec010 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] 10.222.0.62 "GET /v2.0/security-groups?id=f73b90a2-df48-48fb-99e0-5dd4d6a63a15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0434201 May 25 17:01:53.076756 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-caa08d76-2176-46aa-b186-9f418a311752 req-2567588d-7009-43a8-851b-7091d51ca1da tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:01:53.078229 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-caa08d76-2176-46aa-b186-9f418a311752 req-2567588d-7009-43a8-851b-7091d51ca1da tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] 10.222.0.62 "GET /v2.0/ports?device_id=4413fd77-4f3e-40c8-b7ee-77d416cd7667 HTTP/1.1" status: 200 len: 932 time: 0.0782633 May 25 17:01:53.125829 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-caa08d76-2176-46aa-b186-9f418a311752 req-b007f077-555d-41f6-9a66-0380ab1d4bea tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] 10.222.0.62 "GET /v2.0/security-groups?id=d7d845a2-937c-4f26-ac5a-1b178146b05e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0410612 May 25 17:01:53.309297 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-935c4b19-539d-4742-aaec-a495e4274314 req-8b706ab3-e211-4352-8a19-9c0a74c3d1dd tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:01:53.310977 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-935c4b19-539d-4742-aaec-a495e4274314 req-8b706ab3-e211-4352-8a19-9c0a74c3d1dd tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/ports?device_id=58da9205-0212-4daa-996c-1eef64a2b702 HTTP/1.1" status: 200 len: 945 time: 0.0863795 May 25 17:01:53.356663 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-935c4b19-539d-4742-aaec-a495e4274314 req-434a8b14-bbc5-42a9-aed5-e3ce1799e9ac tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/security-groups?id=8ee5c4ed-9c60-4e39-9185-7e283704a7dc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0398591 May 25 17:01:54.034557 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eb1a6a55-f4fb-4f44-8b8a-235fc20823de req-ca3b739a-d1b1-46b6-8709-8920fb3be3ae tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:01:54.036001 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-eb1a6a55-f4fb-4f44-8b8a-235fc20823de req-ca3b739a-d1b1-46b6-8709-8920fb3be3ae tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] 10.222.0.62 "GET /v2.0/ports?device_id=0c32425a-15a9-4c9d-8e31-17183d4909c9 HTTP/1.1" status: 200 len: 944 time: 0.0812070 May 25 17:01:54.082724 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-eb1a6a55-f4fb-4f44-8b8a-235fc20823de req-4888ce83-4cdb-402d-809e-babea12764ac tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] 10.222.0.62 "GET /v2.0/security-groups?id=f73b90a2-df48-48fb-99e0-5dd4d6a63a15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0408554 May 25 17:01:54.317832 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bb912e90-40ce-49b0-b297-14ded7e016d9 req-7699149b-b27f-47a5-bd89-d5cf588a3088 tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:01:54.319412 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-bb912e90-40ce-49b0-b297-14ded7e016d9 req-7699149b-b27f-47a5-bd89-d5cf588a3088 tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] 10.222.0.62 "GET /v2.0/ports?device_id=4413fd77-4f3e-40c8-b7ee-77d416cd7667 HTTP/1.1" status: 200 len: 932 time: 0.0841961 May 25 17:01:54.367031 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-bb912e90-40ce-49b0-b297-14ded7e016d9 req-ea8952de-88d6-47fd-bc4b-ffcea3bbfe96 tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] 10.222.0.62 "GET /v2.0/security-groups?id=d7d845a2-937c-4f26-ac5a-1b178146b05e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0398490 May 25 17:01:54.549126 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aa0a1add-332e-4d99-8336-70ab084d8d83 req-96ce7e13-16ec-4a3b-958f-e6f03657f435 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:01:54.550703 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-aa0a1add-332e-4d99-8336-70ab084d8d83 req-96ce7e13-16ec-4a3b-958f-e6f03657f435 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/ports?device_id=58da9205-0212-4daa-996c-1eef64a2b702 HTTP/1.1" status: 200 len: 945 time: 0.0817349 May 25 17:01:54.595527 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-aa0a1add-332e-4d99-8336-70ab084d8d83 req-d9b77d9a-9a96-43dd-960e-459eb7b94869 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/security-groups?id=8ee5c4ed-9c60-4e39-9185-7e283704a7dc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0388186 May 25 17:01:55.284221 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-59f46c30-4e4f-427a-8e90-bc0c1c1e793e req-579efe51-b77b-47f5-a2ec-a2a6502edec9 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:01:55.286848 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-59f46c30-4e4f-427a-8e90-bc0c1c1e793e req-579efe51-b77b-47f5-a2ec-a2a6502edec9 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] 10.222.0.62 "GET /v2.0/ports?device_id=0c32425a-15a9-4c9d-8e31-17183d4909c9 HTTP/1.1" status: 200 len: 944 time: 0.0959268 May 25 17:01:55.291767 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-e6e4e791-b193-42e4-a121-92715736b01c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:01:55.341213 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-59f46c30-4e4f-427a-8e90-bc0c1c1e793e req-abb272d4-17ce-4b3c-b8de-bf8c2ba21a9b tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] 10.222.0.62 "GET /v2.0/security-groups?id=f73b90a2-df48-48fb-99e0-5dd4d6a63a15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0458345 May 25 17:01:55.549831 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-02acdb68-8d66-47b3-a242-e2420e46d1dc req-b8a62dee-6c05-432c-b2f5-0681a78a0c14 tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:01:55.551371 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-02acdb68-8d66-47b3-a242-e2420e46d1dc req-b8a62dee-6c05-432c-b2f5-0681a78a0c14 tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] 10.222.0.62 "GET /v2.0/ports?device_id=4413fd77-4f3e-40c8-b7ee-77d416cd7667 HTTP/1.1" status: 200 len: 932 time: 0.0791028 May 25 17:01:55.598247 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-02acdb68-8d66-47b3-a242-e2420e46d1dc req-c696528a-c38f-42ee-88af-ff14f72c9f0a tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] 10.222.0.62 "GET /v2.0/security-groups?id=d7d845a2-937c-4f26-ac5a-1b178146b05e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0409355 May 25 17:01:55.785218 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-41884626-5a99-4902-8f9c-97ba704d1e15 req-638de42a-959c-4952-8bf6-11d69284d856 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:01:55.786666 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-41884626-5a99-4902-8f9c-97ba704d1e15 req-638de42a-959c-4952-8bf6-11d69284d856 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/ports?device_id=58da9205-0212-4daa-996c-1eef64a2b702 HTTP/1.1" status: 200 len: 945 time: 0.0803769 May 25 17:01:55.832056 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-41884626-5a99-4902-8f9c-97ba704d1e15 req-8a96a883-ccdc-4b27-a973-e900d0c6892f tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/security-groups?id=8ee5c4ed-9c60-4e39-9185-7e283704a7dc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0396035 May 25 17:01:56.533275 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e983ccbc-d140-49f5-842c-341fcf1c14ab req-cfbfaa65-4001-487f-8d6f-00c30eacfebf tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:01:56.534732 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-e983ccbc-d140-49f5-842c-341fcf1c14ab req-cfbfaa65-4001-487f-8d6f-00c30eacfebf tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] 10.222.0.62 "GET /v2.0/ports?device_id=0c32425a-15a9-4c9d-8e31-17183d4909c9 HTTP/1.1" status: 200 len: 944 time: 0.0855505 May 25 17:01:56.579518 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-e983ccbc-d140-49f5-842c-341fcf1c14ab req-bb8c8f5f-845f-4e4b-860a-dcefc7dcb961 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] 10.222.0.62 "GET /v2.0/security-groups?id=f73b90a2-df48-48fb-99e0-5dd4d6a63a15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0391443 May 25 17:01:56.786275 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-755d815f-5b4a-4d6b-814e-174ff60acea3 req-a524eda6-3ddf-4550-a6ed-6274c5d4ae70 tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:01:56.787737 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-755d815f-5b4a-4d6b-814e-174ff60acea3 req-a524eda6-3ddf-4550-a6ed-6274c5d4ae70 tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] 10.222.0.62 "GET /v2.0/ports?device_id=4413fd77-4f3e-40c8-b7ee-77d416cd7667 HTTP/1.1" status: 200 len: 932 time: 0.0860250 May 25 17:01:56.834195 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-755d815f-5b4a-4d6b-814e-174ff60acea3 req-63dbfb3e-62e0-43f4-a00e-dbee9a3fd8d7 tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] 10.222.0.62 "GET /v2.0/security-groups?id=d7d845a2-937c-4f26-ac5a-1b178146b05e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0396705 May 25 17:01:57.033898 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-04dd9cf3-239f-4656-aec2-0b02fae8f2e6 req-0afdf04c-337b-41ff-841d-e9845863844d tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:01:57.035653 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-04dd9cf3-239f-4656-aec2-0b02fae8f2e6 req-0afdf04c-337b-41ff-841d-e9845863844d tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/ports?device_id=58da9205-0212-4daa-996c-1eef64a2b702 HTTP/1.1" status: 200 len: 945 time: 0.0925956 May 25 17:01:57.082712 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-04dd9cf3-239f-4656-aec2-0b02fae8f2e6 req-db6e179c-8a85-4c15-876f-3fe75b0c80fd tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/security-groups?id=8ee5c4ed-9c60-4e39-9185-7e283704a7dc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0412107 May 25 17:01:57.683241 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-4d4e9a62-b456-4120-9c7d-0ef5bc6c0b3f None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:01:57.767178 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5259999b-1ace-43f4-9b5e-160a7947ef85 req-c4e33547-c82b-4c6f-8a1d-c1b4c89861c3 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:01:57.768494 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-5259999b-1ace-43f4-9b5e-160a7947ef85 req-c4e33547-c82b-4c6f-8a1d-c1b4c89861c3 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] 10.222.0.62 "GET /v2.0/ports?device_id=0c32425a-15a9-4c9d-8e31-17183d4909c9 HTTP/1.1" status: 200 len: 944 time: 0.0827608 May 25 17:01:57.819640 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-5259999b-1ace-43f4-9b5e-160a7947ef85 req-b934fcab-c7c3-4356-834c-c5dff1adc155 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] 10.222.0.62 "GET /v2.0/security-groups?id=f73b90a2-df48-48fb-99e0-5dd4d6a63a15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0452430 May 25 17:01:57.867260 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:01:58.019553 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1d12e5eb-b5f7-4c34-88cf-699b3f9b005c req-780276c0-8699-46ef-9687-19dc91ced8c8 tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:01:58.020907 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-1d12e5eb-b5f7-4c34-88cf-699b3f9b005c req-780276c0-8699-46ef-9687-19dc91ced8c8 tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] 10.222.0.62 "GET /v2.0/ports?device_id=4413fd77-4f3e-40c8-b7ee-77d416cd7667 HTTP/1.1" status: 200 len: 932 time: 0.0794747 May 25 17:01:58.067012 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-1d12e5eb-b5f7-4c34-88cf-699b3f9b005c req-8dfec966-df13-440a-81d5-c277c827c69f tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] 10.222.0.62 "GET /v2.0/security-groups?id=d7d845a2-937c-4f26-ac5a-1b178146b05e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0404692 May 25 17:01:58.275290 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c639e09c-f7a6-42c4-b5ba-89403deadae8 req-cf640ed1-c3ca-4158-a657-d16b56faa774 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:01:58.276726 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-c639e09c-f7a6-42c4-b5ba-89403deadae8 req-cf640ed1-c3ca-4158-a657-d16b56faa774 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/ports?device_id=58da9205-0212-4daa-996c-1eef64a2b702 HTTP/1.1" status: 200 len: 945 time: 0.0826159 May 25 17:01:58.325720 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-c639e09c-f7a6-42c4-b5ba-89403deadae8 req-905e6d6a-d3e0-4a28-acae-aa242de5b69b tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/security-groups?id=8ee5c4ed-9c60-4e39-9185-7e283704a7dc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0426614 May 25 17:01:58.604995 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-0a55eb4a-8b57-4233-84d6-6b423b4ed6db None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:01:59.006813 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5d393d29-cc82-4b80-b95d-800bab7eb25e req-836bfd42-3d3a-497a-a7a7-b4aab0f7c91f tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:01:59.008250 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-5d393d29-cc82-4b80-b95d-800bab7eb25e req-836bfd42-3d3a-497a-a7a7-b4aab0f7c91f tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] 10.222.0.62 "GET /v2.0/ports?device_id=0c32425a-15a9-4c9d-8e31-17183d4909c9 HTTP/1.1" status: 200 len: 944 time: 0.0818179 May 25 17:01:59.051639 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-5d393d29-cc82-4b80-b95d-800bab7eb25e req-6bb1d3b9-8b7b-4006-bf6c-34e9742ecd7d tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] 10.222.0.62 "GET /v2.0/security-groups?id=f73b90a2-df48-48fb-99e0-5dd4d6a63a15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0369320 May 25 17:01:59.319155 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6e24fc45-c4a1-4f13-8629-13701aa8a717 req-40bf9dbd-d02c-42f6-90ec-0b3169de1dbf tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:01:59.320599 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-6e24fc45-c4a1-4f13-8629-13701aa8a717 req-40bf9dbd-d02c-42f6-90ec-0b3169de1dbf tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] 10.222.0.62 "GET /v2.0/ports?device_id=4413fd77-4f3e-40c8-b7ee-77d416cd7667 HTTP/1.1" status: 200 len: 932 time: 0.1470969 May 25 17:01:59.366952 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-6e24fc45-c4a1-4f13-8629-13701aa8a717 req-bf453552-d1fe-4897-b82b-45a88010f62a tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] 10.222.0.62 "GET /v2.0/security-groups?id=d7d845a2-937c-4f26-ac5a-1b178146b05e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0400791 May 25 17:01:59.540399 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-927a23d8-056e-4a9f-ad35-eb0a3b00d22d req-c55fb288-fd79-437a-8ea8-d0ffefc11c67 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:01:59.541836 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-927a23d8-056e-4a9f-ad35-eb0a3b00d22d req-c55fb288-fd79-437a-8ea8-d0ffefc11c67 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/ports?device_id=58da9205-0212-4daa-996c-1eef64a2b702 HTTP/1.1" status: 200 len: 945 time: 0.0797160 May 25 17:01:59.589256 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-927a23d8-056e-4a9f-ad35-eb0a3b00d22d req-31872c7e-d6b7-47d7-ba50-c9cc3733ffbe tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/security-groups?id=8ee5c4ed-9c60-4e39-9185-7e283704a7dc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0416005 May 25 17:02:00.210771 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-57f11b47-1f51-4191-b7c9-af248a48372c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:02:00.239597 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-49447481-5e01-4062-a9c9-9875bbe365a5 req-d5a1e728-ec8f-4485-9b27-183fcc76503d tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:02:00.241042 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-49447481-5e01-4062-a9c9-9875bbe365a5 req-d5a1e728-ec8f-4485-9b27-183fcc76503d tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] 10.222.0.62 "GET /v2.0/ports?device_id=0c32425a-15a9-4c9d-8e31-17183d4909c9 HTTP/1.1" status: 200 len: 944 time: 0.0823913 May 25 17:02:00.289384 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-49447481-5e01-4062-a9c9-9875bbe365a5 req-a028d202-ee76-4c4d-be6b-85c876f3f427 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] 10.222.0.62 "GET /v2.0/security-groups?id=f73b90a2-df48-48fb-99e0-5dd4d6a63a15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0425138 May 25 17:02:00.555299 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-487a1946-9fc4-4fd2-9c79-21562330d49a req-3aa3d8e8-448c-4e15-9ba8-de084afa6f0e tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:02:00.557607 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-487a1946-9fc4-4fd2-9c79-21562330d49a req-3aa3d8e8-448c-4e15-9ba8-de084afa6f0e tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] 10.222.0.62 "GET /v2.0/ports?device_id=4413fd77-4f3e-40c8-b7ee-77d416cd7667 HTTP/1.1" status: 200 len: 932 time: 0.0856631 May 25 17:02:00.603671 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-487a1946-9fc4-4fd2-9c79-21562330d49a req-2f6a23a3-88af-4019-bae7-32958a96a626 tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] 10.222.0.62 "GET /v2.0/security-groups?id=d7d845a2-937c-4f26-ac5a-1b178146b05e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0397849 May 25 17:02:00.782829 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-20a18883-aa73-49ab-942f-ee7d70465a11 req-7bd3afc0-538d-4470-aae4-ca6c23014461 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:02:00.786497 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-20a18883-aa73-49ab-942f-ee7d70465a11 req-7bd3afc0-538d-4470-aae4-ca6c23014461 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/ports?device_id=58da9205-0212-4daa-996c-1eef64a2b702 HTTP/1.1" status: 200 len: 945 time: 0.0856955 May 25 17:02:00.829008 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-20a18883-aa73-49ab-942f-ee7d70465a11 req-5c0043e9-d5f9-488c-a97e-181f7e3e36af tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/security-groups?id=8ee5c4ed-9c60-4e39-9185-7e283704a7dc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0390449 May 25 17:02:01.627347 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-61b160a1-fe96-41fc-9693-86ae0161d4fa req-a90f4339-6723-4412-a50a-ff4820ce2810 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:02:01.628685 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-61b160a1-fe96-41fc-9693-86ae0161d4fa req-a90f4339-6723-4412-a50a-ff4820ce2810 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] 10.222.0.62 "GET /v2.0/ports?device_id=0c32425a-15a9-4c9d-8e31-17183d4909c9 HTTP/1.1" status: 200 len: 944 time: 0.0856357 May 25 17:02:01.673773 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-61b160a1-fe96-41fc-9693-86ae0161d4fa req-cbfc513a-4d98-4f2d-8583-6b73ece83466 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] 10.222.0.62 "GET /v2.0/security-groups?id=f73b90a2-df48-48fb-99e0-5dd4d6a63a15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0394926 May 25 17:02:01.844073 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-241b6069-d560-44f8-aa5c-3de3e8968d0d req-852d0499-0d00-4b21-9a7c-54fb80541939 tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:02:01.845418 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-241b6069-d560-44f8-aa5c-3de3e8968d0d req-852d0499-0d00-4b21-9a7c-54fb80541939 tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] 10.222.0.62 "GET /v2.0/ports?device_id=4413fd77-4f3e-40c8-b7ee-77d416cd7667 HTTP/1.1" status: 200 len: 932 time: 0.0801694 May 25 17:02:01.891458 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-241b6069-d560-44f8-aa5c-3de3e8968d0d req-dfdb8673-b18c-4d4f-96e7-c8e1dfdc1356 tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] 10.222.0.62 "GET /v2.0/security-groups?id=d7d845a2-937c-4f26-ac5a-1b178146b05e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0402973 May 25 17:02:02.090218 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d32ae061-e580-4baf-bb57-62744110344c req-6122b517-3f7f-40e3-b84e-d8a79828c2e7 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:02:02.091672 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-d32ae061-e580-4baf-bb57-62744110344c req-6122b517-3f7f-40e3-b84e-d8a79828c2e7 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/ports?device_id=58da9205-0212-4daa-996c-1eef64a2b702 HTTP/1.1" status: 200 len: 945 time: 0.0985875 May 25 17:02:02.146106 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-d32ae061-e580-4baf-bb57-62744110344c req-6cb96796-c503-4fcf-b591-9fbe0bbc030a tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/security-groups?id=8ee5c4ed-9c60-4e39-9185-7e283704a7dc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0485814 May 25 17:02:02.861506 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5b0f3a68-888d-431d-ab84-58a03a02c4eb req-58af302e-b1cb-443a-91b2-6a70d250d3f4 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:02:02.863186 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-5b0f3a68-888d-431d-ab84-58a03a02c4eb req-58af302e-b1cb-443a-91b2-6a70d250d3f4 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] 10.222.0.62 "GET /v2.0/ports?device_id=0c32425a-15a9-4c9d-8e31-17183d4909c9 HTTP/1.1" status: 200 len: 944 time: 0.0808618 May 25 17:02:02.911814 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-5b0f3a68-888d-431d-ab84-58a03a02c4eb req-e117e85e-b9ee-4e52-9ef1-ffb73aa218e7 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] 10.222.0.62 "GET /v2.0/security-groups?id=f73b90a2-df48-48fb-99e0-5dd4d6a63a15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0430305 May 25 17:02:03.090205 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-86c41085-86b6-4c12-9b89-cb8579dcd6d6 req-1f0e2d04-2204-4718-b6d3-70c16a566c4e tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:02:03.091669 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-86c41085-86b6-4c12-9b89-cb8579dcd6d6 req-1f0e2d04-2204-4718-b6d3-70c16a566c4e tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] 10.222.0.62 "GET /v2.0/ports?device_id=4413fd77-4f3e-40c8-b7ee-77d416cd7667 HTTP/1.1" status: 200 len: 932 time: 0.0830598 May 25 17:02:03.136999 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-86c41085-86b6-4c12-9b89-cb8579dcd6d6 req-862dadd8-d7f5-41f8-8b24-97a5f013b83b tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] 10.222.0.62 "GET /v2.0/security-groups?id=d7d845a2-937c-4f26-ac5a-1b178146b05e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0394859 May 25 17:02:03.340242 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-52cac07e-91cc-4291-b282-e20265a002cb req-46d42248-5688-4b6c-8ea5-5a9f7cd77147 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:02:03.341738 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-52cac07e-91cc-4291-b282-e20265a002cb req-46d42248-5688-4b6c-8ea5-5a9f7cd77147 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/ports?device_id=58da9205-0212-4daa-996c-1eef64a2b702 HTTP/1.1" status: 200 len: 945 time: 0.0862625 May 25 17:02:03.387345 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-52cac07e-91cc-4291-b282-e20265a002cb req-a71cf1e2-e8ad-4e01-acd3-1a9f7a75b892 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/security-groups?id=8ee5c4ed-9c60-4e39-9185-7e283704a7dc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0392466 May 25 17:02:04.106598 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1ffe241e-a67a-45a2-88e1-5a84d049c1b7 req-9a3f0e18-b8f9-48ad-9a45-331d0381568e tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:02:04.107984 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-1ffe241e-a67a-45a2-88e1-5a84d049c1b7 req-9a3f0e18-b8f9-48ad-9a45-331d0381568e tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] 10.222.0.62 "GET /v2.0/ports?device_id=0c32425a-15a9-4c9d-8e31-17183d4909c9 HTTP/1.1" status: 200 len: 944 time: 0.0840485 May 25 17:02:04.152989 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-1ffe241e-a67a-45a2-88e1-5a84d049c1b7 req-1694f990-3a43-4405-bf52-5b0ea5b59014 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] 10.222.0.62 "GET /v2.0/security-groups?id=f73b90a2-df48-48fb-99e0-5dd4d6a63a15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0387652 May 25 17:02:04.326222 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e5a65aaa-7802-4a69-9b8b-1a69aecfb153 req-8adb1411-cbd5-4a7d-9825-b74a32363bc9 tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:02:04.327662 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-e5a65aaa-7802-4a69-9b8b-1a69aecfb153 req-8adb1411-cbd5-4a7d-9825-b74a32363bc9 tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] 10.222.0.62 "GET /v2.0/ports?device_id=4413fd77-4f3e-40c8-b7ee-77d416cd7667 HTTP/1.1" status: 200 len: 932 time: 0.0837305 May 25 17:02:04.371581 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-e5a65aaa-7802-4a69-9b8b-1a69aecfb153 req-6f2d4f05-fc10-4936-826e-723923d922c8 tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] 10.222.0.62 "GET /v2.0/security-groups?id=d7d845a2-937c-4f26-ac5a-1b178146b05e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0376668 May 25 17:02:04.392331 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:02:04.577425 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ca3cb373-51ee-4a2c-9569-9d83e7deadce req-52e8e5cd-7b33-4ef0-a2a7-d1be853405b4 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:02:04.578883 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-ca3cb373-51ee-4a2c-9569-9d83e7deadce req-52e8e5cd-7b33-4ef0-a2a7-d1be853405b4 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/ports?device_id=58da9205-0212-4daa-996c-1eef64a2b702 HTTP/1.1" status: 200 len: 945 time: 0.0810177 May 25 17:02:04.626712 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-ca3cb373-51ee-4a2c-9569-9d83e7deadce req-985874b7-593a-48f1-bf54-206b29d1e6d2 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/security-groups?id=8ee5c4ed-9c60-4e39-9185-7e283704a7dc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0421450 May 25 17:02:05.358845 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-695b8fe5-5265-4a26-8ad6-8663033ede73 req-4a73241a-276e-4c10-8530-397a7f004d80 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:02:05.360311 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-695b8fe5-5265-4a26-8ad6-8663033ede73 req-4a73241a-276e-4c10-8530-397a7f004d80 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] 10.222.0.62 "GET /v2.0/ports?device_id=0c32425a-15a9-4c9d-8e31-17183d4909c9 HTTP/1.1" status: 200 len: 944 time: 0.0999238 May 25 17:02:05.407559 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-695b8fe5-5265-4a26-8ad6-8663033ede73 req-b6ac4c74-1fb1-4fa9-a4fd-bc07bcf847ef tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] 10.222.0.62 "GET /v2.0/security-groups?id=f73b90a2-df48-48fb-99e0-5dd4d6a63a15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0413189 May 25 17:02:05.581156 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c85581d3-20d3-439f-aae5-59d725204efb req-683407d5-e561-4376-ad45-7743c1ac30de tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:02:05.582606 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-c85581d3-20d3-439f-aae5-59d725204efb req-683407d5-e561-4376-ad45-7743c1ac30de tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] 10.222.0.62 "GET /v2.0/ports?device_id=4413fd77-4f3e-40c8-b7ee-77d416cd7667 HTTP/1.1" status: 200 len: 932 time: 0.0827599 May 25 17:02:05.627199 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-c85581d3-20d3-439f-aae5-59d725204efb req-1fbe9a21-49df-4d63-9ba4-bcb6029b1b01 tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] 10.222.0.62 "GET /v2.0/security-groups?id=d7d845a2-937c-4f26-ac5a-1b178146b05e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0389886 May 25 17:02:05.812356 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a348929b-5bfd-46ed-b422-bd11cbcf9763 req-7f120cfc-cf0f-4f74-b371-e0b7c8b1d5c4 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:02:05.813877 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-a348929b-5bfd-46ed-b422-bd11cbcf9763 req-7f120cfc-cf0f-4f74-b371-e0b7c8b1d5c4 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/ports?device_id=58da9205-0212-4daa-996c-1eef64a2b702 HTTP/1.1" status: 200 len: 945 time: 0.0807197 May 25 17:02:05.861436 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-a348929b-5bfd-46ed-b422-bd11cbcf9763 req-4dc804a7-fe3f-4ba9-9327-30343aa201bb tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/security-groups?id=8ee5c4ed-9c60-4e39-9185-7e283704a7dc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0413032 May 25 17:02:13.949056 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.v2.base [req-7853799a-5179-492a-9dfe-59e85402d5f8 req-91b43151-d64d-47f8-8e6e-86c6c40ce00c service neutron] Request body: {'port': {'device_id': '4413fd77-4f3e-40c8-b7ee-77d416cd7667', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-79049'}} {{(pid=91830) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 17:02:14.067636 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4153f2b3-72ce-4a05-9f85-3f98fb7a0891 req-64e9b087-d8ea-4c95-ab2f-06eec0c7a87f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91830) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:02:14.069071 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-4153f2b3-72ce-4a05-9f85-3f98fb7a0891 req-64e9b087-d8ea-4c95-ab2f-06eec0c7a87f service neutron] 10.222.0.32 "GET /v2.0/subnets?id=3fc60650-484d-4574-bb67-0e4931bc9854 HTTP/1.1" status: 200 len: 848 time: 0.0868957 May 25 17:02:14.184896 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [req-7853799a-5179-492a-9dfe-59e85402d5f8 req-91b43151-d64d-47f8-8e6e-86c6c40ce00c service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3832070'] for port, before_update {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:02:14.268287 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ab024885-4898-44bb-ae7e-fab1f5e14da4 req-32a7cf60-6f8b-4863-910d-7daf91c7c40c tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:02:14.281511 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-ab024885-4898-44bb-ae7e-fab1f5e14da4 req-32a7cf60-6f8b-4863-910d-7daf91c7c40c tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] 10.222.0.62 "GET /v2.0/ports?device_id=0c32425a-15a9-4c9d-8e31-17183d4909c9 HTTP/1.1" status: 200 len: 944 time: 0.1467929 May 25 17:02:14.347676 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4153f2b3-72ce-4a05-9f85-3f98fb7a0891 req-bc12553b-44e1-4884-a980-33110985a80d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91830) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:02:14.349316 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-4153f2b3-72ce-4a05-9f85-3f98fb7a0891 req-bc12553b-44e1-4884-a980-33110985a80d service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=613457eb-6f6d-4604-8f6c-f2d318ff9bc5&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.2481508 May 25 17:02:14.382636 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-ab024885-4898-44bb-ae7e-fab1f5e14da4 req-bfc17322-6a80-401a-be99-cdc6ad5e8de2 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] 10.222.0.62 "GET /v2.0/security-groups?id=f73b90a2-df48-48fb-99e0-5dd4d6a63a15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0990040 May 25 17:02:14.408408 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9246644b-86fe-4cd3-893f-6e4f4eee9603 req-0503f39a-fca0-432a-84aa-136a0336a7fc tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:02:14.409881 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-9246644b-86fe-4cd3-893f-6e4f4eee9603 req-0503f39a-fca0-432a-84aa-136a0336a7fc tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] 10.222.0.62 "GET /v2.0/ports?device_id=4413fd77-4f3e-40c8-b7ee-77d416cd7667 HTTP/1.1" status: 200 len: 932 time: 0.1098151 May 25 17:02:14.464952 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-9246644b-86fe-4cd3-893f-6e4f4eee9603 req-deb3fcf8-d92b-4bd7-ae6b-9e9d0db9e8e4 tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] 10.222.0.62 "GET /v2.0/security-groups?id=d7d845a2-937c-4f26-ac5a-1b178146b05e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0484712 May 25 17:02:14.607234 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-4153f2b3-72ce-4a05-9f85-3f98fb7a0891 req-f3ccc59f-aaf0-455f-b8b8-135f42927c2d service neutron] 10.222.0.32 "GET /v2.0/networks/613457eb-6f6d-4604-8f6c-f2d318ff9bc5?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2374609 May 25 17:02:14.634960 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1ab255dd-c8bf-46e7-8422-e02f19c4dd84 req-0fbf456d-61cb-407f-8d9f-a805df46f978 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:02:14.636318 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-1ab255dd-c8bf-46e7-8422-e02f19c4dd84 req-0fbf456d-61cb-407f-8d9f-a805df46f978 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/ports?device_id=58da9205-0212-4daa-996c-1eef64a2b702 HTTP/1.1" status: 200 len: 945 time: 0.1438272 May 25 17:02:14.685433 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-1ab255dd-c8bf-46e7-8422-e02f19c4dd84 req-4e943d02-d663-4aa7-9128-6dc2ae2aac20 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/security-groups?id=8ee5c4ed-9c60-4e39-9185-7e283704a7dc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0418818 May 25 17:02:14.787393 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.notifiers.nova [req-7853799a-5179-492a-9dfe-59e85402d5f8 req-91b43151-d64d-47f8-8e6e-86c6c40ce00c service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id d64889c5-b5bd-42be-aa18-7a6149a0a583 {{(pid=91830) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} May 25 17:02:14.798845 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [req-7853799a-5179-492a-9dfe-59e85402d5f8 req-91b43151-d64d-47f8-8e6e-86c6c40ce00c service neutron] Notify callbacks [] for port, precommit_update {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:02:14.829262 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-4153f2b3-72ce-4a05-9f85-3f98fb7a0891 req-c3b4d2ee-c26f-4b3d-8cc1-2ee7604a5144 service neutron] 10.222.0.32 "GET /v2.0/networks/613457eb-6f6d-4604-8f6c-f2d318ff9bc5?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2098908 May 25 17:02:14.830283 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.provisioning_blocks [req-7853799a-5179-492a-9dfe-59e85402d5f8 req-91b43151-d64d-47f8-8e6e-86c6c40ce00c service neutron] Transition to ACTIVE for port object d64889c5-b5bd-42be-aa18-7a6149a0a583 will not be triggered until provisioned by entity L2. {{(pid=91830) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 25 17:02:14.833553 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [req-7853799a-5179-492a-9dfe-59e85402d5f8 req-91b43151-d64d-47f8-8e6e-86c6c40ce00c service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8757892955028', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8757892520933', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8757892521750', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-27483010'] for port, after_update {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:02:14.838310 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:02:14.997956 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-91b43151-d64d-47f8-8e6e-86c6c40ce00c service neutron] Pushing event updated for resources: {'Port': ['ID=d64889c5-b5bd-42be-aa18-7a6149a0a583,revision_number=2']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:02:15.005823 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-91b43151-d64d-47f8-8e6e-86c6c40ce00c service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.167s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:02:15.166073 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.plugins.ml2.managers [req-7853799a-5179-492a-9dfe-59e85402d5f8 req-91b43151-d64d-47f8-8e6e-86c6c40ce00c service neutron] Attempting to bind port d64889c5-b5bd-42be-aa18-7a6149a0a583 on host hv-cinder-79049 for vnic_type normal with profile {{(pid=91830) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 25 17:02:15.166328 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.plugins.ml2.managers [req-7853799a-5179-492a-9dfe-59e85402d5f8 req-91b43151-d64d-47f8-8e6e-86c6c40ce00c service neutron] Attempting to bind port d64889c5-b5bd-42be-aa18-7a6149a0a583 by drivers openvswitch,hyperv on host hv-cinder-79049 at level 0 using segments [{'id': '5aed6094-89e8-4c7c-ba89-9b30d3e98cd0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 692, 'network_id': 'f3ddbe01-13f7-4e15-b7da-2bdffc278cb7'}] {{(pid=91830) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 25 17:02:15.166650 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7853799a-5179-492a-9dfe-59e85402d5f8 req-91b43151-d64d-47f8-8e6e-86c6c40ce00c service neutron] Attempting to bind port d64889c5-b5bd-42be-aa18-7a6149a0a583 on network f3ddbe01-13f7-4e15-b7da-2bdffc278cb7 {{(pid=91830) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 25 17:02:15.171429 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7853799a-5179-492a-9dfe-59e85402d5f8 req-91b43151-d64d-47f8-8e6e-86c6c40ce00c service neutron] Port d64889c5-b5bd-42be-aa18-7a6149a0a583 on network f3ddbe01-13f7-4e15-b7da-2bdffc278cb7 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-79049 {{(pid=91830) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 25 17:02:15.171739 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7853799a-5179-492a-9dfe-59e85402d5f8 req-91b43151-d64d-47f8-8e6e-86c6c40ce00c service neutron] Attempting to bind port d64889c5-b5bd-42be-aa18-7a6149a0a583 on network f3ddbe01-13f7-4e15-b7da-2bdffc278cb7 {{(pid=91830) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 25 17:02:15.177100 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7853799a-5179-492a-9dfe-59e85402d5f8 req-91b43151-d64d-47f8-8e6e-86c6c40ce00c service neutron] Checking agent: {'id': '3a1fdee1-bff0-49fb-b470-e13b95ee1b4d', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-79049', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 25, 16, 56, 32), 'started_at': datetime.datetime(2021, 5, 25, 16, 56, 32), 'heartbeat_timestamp': datetime.datetime(2021, 5, 25, 17, 2, 4), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=91830) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 25 17:02:15.177437 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7853799a-5179-492a-9dfe-59e85402d5f8 req-91b43151-d64d-47f8-8e6e-86c6c40ce00c service neutron] Checking segment: {'id': '5aed6094-89e8-4c7c-ba89-9b30d3e98cd0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 692, 'network_id': 'f3ddbe01-13f7-4e15-b7da-2bdffc278cb7'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91830) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 25 17:02:15.177844 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7853799a-5179-492a-9dfe-59e85402d5f8 req-91b43151-d64d-47f8-8e6e-86c6c40ce00c service neutron] Bound using segment: {'id': '5aed6094-89e8-4c7c-ba89-9b30d3e98cd0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 692, 'network_id': 'f3ddbe01-13f7-4e15-b7da-2bdffc278cb7'} {{(pid=91830) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 25 17:02:15.178569 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.plugins.ml2.managers [req-7853799a-5179-492a-9dfe-59e85402d5f8 req-91b43151-d64d-47f8-8e6e-86c6c40ce00c service neutron] Bound port: d64889c5-b5bd-42be-aa18-7a6149a0a583, host: hv-cinder-79049, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '5aed6094-89e8-4c7c-ba89-9b30d3e98cd0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 692, 'network_id': 'f3ddbe01-13f7-4e15-b7da-2bdffc278cb7'}}] {{(pid=91830) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 25 17:02:15.178907 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [req-7853799a-5179-492a-9dfe-59e85402d5f8 req-91b43151-d64d-47f8-8e6e-86c6c40ce00c service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3832070'] for port, before_update {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:02:15.268147 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.plugins.ml2.db [req-7853799a-5179-492a-9dfe-59e85402d5f8 req-91b43151-d64d-47f8-8e6e-86c6c40ce00c service neutron] For port d64889c5-b5bd-42be-aa18-7a6149a0a583, host hv-cinder-79049, cleared binding levels {{(pid=91830) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 25 17:02:15.271245 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.plugins.ml2.db [req-7853799a-5179-492a-9dfe-59e85402d5f8 req-91b43151-d64d-47f8-8e6e-86c6c40ce00c service neutron] For port d64889c5-b5bd-42be-aa18-7a6149a0a583, host hv-cinder-79049, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79049',level=0,port_id=d64889c5-b5bd-42be-aa18-7a6149a0a583,segment=NetworkSegment(5aed6094-89e8-4c7c-ba89-9b30d3e98cd0),segment_id=5aed6094-89e8-4c7c-ba89-9b30d3e98cd0)] {{(pid=91830) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 25 17:02:15.275196 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [req-7853799a-5179-492a-9dfe-59e85402d5f8 req-91b43151-d64d-47f8-8e6e-86c6c40ce00c service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8757892955028', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8757892520933', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8757892521750', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-27483010'] for port, after_update {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:02:15.280089 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:02:15.340472 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7853799a-5179-492a-9dfe-59e85402d5f8 req-91b43151-d64d-47f8-8e6e-86c6c40ce00c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91830) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:02:15.341106 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [req-7853799a-5179-492a-9dfe-59e85402d5f8 req-91b43151-d64d-47f8-8e6e-86c6c40ce00c service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-178712'] for port, before_response {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:02:15.342525 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-7853799a-5179-492a-9dfe-59e85402d5f8 req-91b43151-d64d-47f8-8e6e-86c6c40ce00c service neutron] 10.222.0.32 "PUT /v2.0/ports/d64889c5-b5bd-42be-aa18-7a6149a0a583 HTTP/1.1" status: 200 len: 1094 time: 1.3977246 May 25 17:02:15.343013 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '4413fd77-4f3e-40c8-b7ee-77d416cd7667', 'tag': 'd64889c5-b5bd-42be-aa18-7a6149a0a583'}] {{(pid=91830) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 25 17:02:15.366305 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-91b43151-d64d-47f8-8e6e-86c6c40ce00c service neutron] Pushing event updated for resources: {'Port': ['ID=d64889c5-b5bd-42be-aa18-7a6149a0a583,revision_number=3']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:02:15.370309 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-91b43151-d64d-47f8-8e6e-86c6c40ce00c service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.090s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:02:15.397677 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '4413fd77-4f3e-40c8-b7ee-77d416cd7667', 'tag': 'd64889c5-b5bd-42be-aa18-7a6149a0a583', 'status': 'completed', 'code': 200} May 25 17:02:15.509289 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7853799a-5179-492a-9dfe-59e85402d5f8 req-3eb82bf9-c771-4b6f-8bf4-5cf1ffc9205f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91830) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:02:15.511003 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-7853799a-5179-492a-9dfe-59e85402d5f8 req-3eb82bf9-c771-4b6f-8bf4-5cf1ffc9205f service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=36c1ffa1d458478bac5893b2ddf98eda&device_id=4413fd77-4f3e-40c8-b7ee-77d416cd7667 HTTP/1.1" status: 200 len: 1097 time: 0.0904162 May 25 17:02:15.597470 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-7853799a-5179-492a-9dfe-59e85402d5f8 req-6bbb9518-a0be-427d-a1e5-57cc1ca88d7a service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=d64889c5-b5bd-42be-aa18-7a6149a0a583 HTTP/1.1" status: 200 len: 217 time: 0.0745511 May 25 17:02:15.611766 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e6882a4d-da08-4f5d-a2be-5b34f59adf9c req-48674288-4082-499a-9723-9367b2deb9ac tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:02:15.613151 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-e6882a4d-da08-4f5d-a2be-5b34f59adf9c req-48674288-4082-499a-9723-9367b2deb9ac tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] 10.222.0.62 "GET /v2.0/ports?device_id=0c32425a-15a9-4c9d-8e31-17183d4909c9 HTTP/1.1" status: 200 len: 944 time: 0.0959327 May 25 17:02:15.667410 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7853799a-5179-492a-9dfe-59e85402d5f8 req-6e901e65-080e-4080-bae8-54388fd5720d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91830) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:02:15.669046 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-7853799a-5179-492a-9dfe-59e85402d5f8 req-6e901e65-080e-4080-bae8-54388fd5720d service neutron] 10.222.0.32 "GET /v2.0/subnets?id=69fba530-cce2-44a2-89bd-18a52f9d454c HTTP/1.1" status: 200 len: 854 time: 0.0601301 May 25 17:02:15.691997 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.rpc [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Device 993b7d31-308c-4414-910f-1a10bea6ed57 details requested by agent hyperv_hv-cinder-79049 with host hv-cinder-79049 {{(pid=91831) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 25 17:02:15.713799 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-e6882a4d-da08-4f5d-a2be-5b34f59adf9c req-f037a0fc-7db3-4fba-8bc1-b811019872af tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] 10.222.0.62 "GET /v2.0/security-groups?id=f73b90a2-df48-48fb-99e0-5dd4d6a63a15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0677342 May 25 17:02:15.741520 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f050c2cb-bbf5-4a03-82b7-c5314a92bf08 req-52eab3d8-c7c6-41b5-8cf4-024b90488472 tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:02:15.743035 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-f050c2cb-bbf5-4a03-82b7-c5314a92bf08 req-52eab3d8-c7c6-41b5-8cf4-024b90488472 tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] 10.222.0.62 "GET /v2.0/ports?device_id=4413fd77-4f3e-40c8-b7ee-77d416cd7667 HTTP/1.1" status: 200 len: 944 time: 0.1290333 May 25 17:02:15.764534 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7853799a-5179-492a-9dfe-59e85402d5f8 req-edc7afb5-db4c-4bd1-8c08-e3fb5fc4eec9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91830) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:02:15.766713 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-7853799a-5179-492a-9dfe-59e85402d5f8 req-edc7afb5-db4c-4bd1-8c08-e3fb5fc4eec9 service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=f3ddbe01-13f7-4e15-b7da-2bdffc278cb7&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0902927 May 25 17:02:15.797310 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-f050c2cb-bbf5-4a03-82b7-c5314a92bf08 req-43e87fe1-a893-4831-a0a0-4ed76d140eea tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] 10.222.0.62 "GET /v2.0/security-groups?id=d7d845a2-937c-4f26-ac5a-1b178146b05e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0474198 May 25 17:02:15.846128 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.db [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] For port 993b7d31-308c-4414-910f-1a10bea6ed57, host hv-cinder-79049, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79049',level=0,port_id=993b7d31-308c-4414-910f-1a10bea6ed57,segment=NetworkSegment(7d7273c2-c6dd-43fe-83a8-cb776d48dc70),segment_id=7d7273c2-c6dd-43fe-83a8-cb776d48dc70)] {{(pid=91831) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 17:02:15.861202 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.rpc [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Returning: {'device': '993b7d31-308c-4414-910f-1a10bea6ed57', 'network_id': '63b1f335-e2c4-48dd-886b-6be853f8a2fc', 'port_id': '993b7d31-308c-4414-910f-1a10bea6ed57', 'mac_address': 'fa:16:3e:2c:cc:a4', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 651, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'b0baa944-cafe-48a4-861a-dae28947b9f0', 'ip_address': '172.20.0.10'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=91831) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 25 17:02:15.920836 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fdc48464-acd3-4523-b931-1d979b250862 req-5d2c6fbe-7976-49d7-baea-bddd1d60f717 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:02:15.922336 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-fdc48464-acd3-4523-b931-1d979b250862 req-5d2c6fbe-7976-49d7-baea-bddd1d60f717 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/ports?device_id=58da9205-0212-4daa-996c-1eef64a2b702 HTTP/1.1" status: 200 len: 945 time: 0.0900946 May 25 17:02:15.933614 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-7853799a-5179-492a-9dfe-59e85402d5f8 req-976edd56-d532-48fe-8e96-78aa24f26483 service neutron] 10.222.0.32 "GET /v2.0/networks/f3ddbe01-13f7-4e15-b7da-2bdffc278cb7?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1593316 May 25 17:02:15.935919 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3832070'] for port, before_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:02:15.954579 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.notifiers.nova [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 993b7d31-308c-4414-910f-1a10bea6ed57 {{(pid=91831) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} May 25 17:02:15.972129 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.db [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] For port 993b7d31-308c-4414-910f-1a10bea6ed57, host hv-cinder-79049, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79049',level=0,port_id=993b7d31-308c-4414-910f-1a10bea6ed57,segment=NetworkSegment(7d7273c2-c6dd-43fe-83a8-cb776d48dc70),segment_id=7d7273c2-c6dd-43fe-83a8-cb776d48dc70)] {{(pid=91831) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 17:02:15.975154 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-fdc48464-acd3-4523-b931-1d979b250862 req-6f82a2d4-45cb-49db-afbc-25371f961ee2 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/security-groups?id=8ee5c4ed-9c60-4e39-9185-7e283704a7dc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0442407 May 25 17:02:15.987079 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8757892955028', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8757892520933', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8757892521750'] for port, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:02:15.989366 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:02:16.061863 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Pushing event updated for resources: {'Port': ['ID=993b7d31-308c-4414-910f-1a10bea6ed57,revision_number=4']} {{(pid=91831) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:02:16.065138 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.076s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:02:16.087361 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-7853799a-5179-492a-9dfe-59e85402d5f8 req-08783e0e-32b4-4dfc-9dde-b3dbfd66d5c8 service neutron] 10.222.0.32 "GET /v2.0/networks/f3ddbe01-13f7-4e15-b7da-2bdffc278cb7?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1439269 May 25 17:02:16.203841 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-790b6391-78ee-4fe3-a0bb-1dc1e35a1ca5 req-41f1d6d3-b92c-4597-9458-b412c4215acd service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91830) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:02:16.205298 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-790b6391-78ee-4fe3-a0bb-1dc1e35a1ca5 req-41f1d6d3-b92c-4597-9458-b412c4215acd service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=36c1ffa1d458478bac5893b2ddf98eda&device_id=4413fd77-4f3e-40c8-b7ee-77d416cd7667 HTTP/1.1" status: 200 len: 1097 time: 0.0705981 May 25 17:02:16.339337 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-790b6391-78ee-4fe3-a0bb-1dc1e35a1ca5 req-c9b8399f-5c70-4439-a23a-86bfa3a5c763 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91830) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:02:16.340745 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-790b6391-78ee-4fe3-a0bb-1dc1e35a1ca5 req-c9b8399f-5c70-4439-a23a-86bfa3a5c763 service neutron] 10.222.0.32 "GET /v2.0/networks?id=f3ddbe01-13f7-4e15-b7da-2bdffc278cb7 HTTP/1.1" status: 200 len: 916 time: 0.1269953 May 25 17:02:16.415259 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-790b6391-78ee-4fe3-a0bb-1dc1e35a1ca5 req-e70af62c-7994-417a-af6a-d96c082821bb service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=d64889c5-b5bd-42be-aa18-7a6149a0a583 HTTP/1.1" status: 200 len: 217 time: 0.0638216 May 25 17:02:16.488511 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-790b6391-78ee-4fe3-a0bb-1dc1e35a1ca5 req-03c97f4a-8ba1-4401-8d32-2918a61f07da service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91830) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:02:16.489967 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-790b6391-78ee-4fe3-a0bb-1dc1e35a1ca5 req-03c97f4a-8ba1-4401-8d32-2918a61f07da service neutron] 10.222.0.32 "GET /v2.0/subnets?id=69fba530-cce2-44a2-89bd-18a52f9d454c HTTP/1.1" status: 200 len: 854 time: 0.0616698 May 25 17:02:16.571395 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-790b6391-78ee-4fe3-a0bb-1dc1e35a1ca5 req-29a0febe-fbca-4729-a123-81e0b2b3fb65 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91830) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:02:16.572846 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-790b6391-78ee-4fe3-a0bb-1dc1e35a1ca5 req-29a0febe-fbca-4729-a123-81e0b2b3fb65 service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=f3ddbe01-13f7-4e15-b7da-2bdffc278cb7&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0748472 May 25 17:02:16.710524 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-790b6391-78ee-4fe3-a0bb-1dc1e35a1ca5 req-5a725a34-6dc5-46e1-8daf-2b9f83d699df service neutron] 10.222.0.32 "GET /v2.0/networks/f3ddbe01-13f7-4e15-b7da-2bdffc278cb7?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1263988 May 25 17:02:16.859613 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-790b6391-78ee-4fe3-a0bb-1dc1e35a1ca5 req-676ad911-1445-452e-9953-f17288d8c331 service neutron] 10.222.0.32 "GET /v2.0/networks/f3ddbe01-13f7-4e15-b7da-2bdffc278cb7?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1406453 May 25 17:02:16.910721 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9fb572a4-5c31-4187-a792-7627be0375aa req-73f4b799-1ac1-4005-b5d1-fb452a2e47e0 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:02:16.912160 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-9fb572a4-5c31-4187-a792-7627be0375aa req-73f4b799-1ac1-4005-b5d1-fb452a2e47e0 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] 10.222.0.62 "GET /v2.0/ports?device_id=0c32425a-15a9-4c9d-8e31-17183d4909c9 HTTP/1.1" status: 200 len: 945 time: 0.0886385 May 25 17:02:17.002761 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-9fb572a4-5c31-4187-a792-7627be0375aa req-7fbf7c10-2d73-470a-8da0-191fce4ab668 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] 10.222.0.62 "GET /v2.0/security-groups?id=f73b90a2-df48-48fb-99e0-5dd4d6a63a15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0604482 May 25 17:02:17.021951 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4d84fa2c-e513-451c-84f4-8a397d8a10cb req-34a71507-c4a9-41c8-af1f-c143bf44ce48 tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:02:17.024066 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-4d84fa2c-e513-451c-84f4-8a397d8a10cb req-34a71507-c4a9-41c8-af1f-c143bf44ce48 tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] 10.222.0.62 "GET /v2.0/ports?device_id=4413fd77-4f3e-40c8-b7ee-77d416cd7667 HTTP/1.1" status: 200 len: 944 time: 0.1104136 May 25 17:02:17.070694 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-4d84fa2c-e513-451c-84f4-8a397d8a10cb req-e24f3878-36f9-4436-9319-d91523bab112 tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] 10.222.0.62 "GET /v2.0/security-groups?id=d7d845a2-937c-4f26-ac5a-1b178146b05e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0410490 May 25 17:02:17.174012 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5f1559ec-daed-413e-ab2c-bcc3e42fa6e3 req-7bd72350-05df-4168-9dab-91ae15e06ff9 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:02:17.175579 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-5f1559ec-daed-413e-ab2c-bcc3e42fa6e3 req-7bd72350-05df-4168-9dab-91ae15e06ff9 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/ports?device_id=58da9205-0212-4daa-996c-1eef64a2b702 HTTP/1.1" status: 200 len: 945 time: 0.0786369 May 25 17:02:17.220869 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-5f1559ec-daed-413e-ab2c-bcc3e42fa6e3 req-68a14c81-b224-48e9-9191-89becf8ef5f6 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/security-groups?id=8ee5c4ed-9c60-4e39-9185-7e283704a7dc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0393183 May 25 17:02:17.242814 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.db [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] get_ports_and_sgs() called for port_ids ['993b7d31-308c-4414-910f-1a10bea6ed57'] {{(pid=91831) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 25 17:02:18.188558 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fb6475b9-47f2-4aa3-81bd-965630bf77f8 req-ccb39262-867d-4e79-9fae-72b82e194df0 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:02:18.190017 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-fb6475b9-47f2-4aa3-81bd-965630bf77f8 req-ccb39262-867d-4e79-9fae-72b82e194df0 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] 10.222.0.62 "GET /v2.0/ports?device_id=0c32425a-15a9-4c9d-8e31-17183d4909c9 HTTP/1.1" status: 200 len: 945 time: 0.0835526 May 25 17:02:18.279185 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-fb6475b9-47f2-4aa3-81bd-965630bf77f8 req-83494847-451a-4675-b8b6-bf325c8a2d52 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] 10.222.0.62 "GET /v2.0/security-groups?id=f73b90a2-df48-48fb-99e0-5dd4d6a63a15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0589716 May 25 17:02:18.298232 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c99072cc-4df4-4c94-9a46-1d4efa1a00af req-fee6e8ea-e9a8-4bf0-bedd-8e4c275e6194 tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:02:18.299609 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-c99072cc-4df4-4c94-9a46-1d4efa1a00af req-fee6e8ea-e9a8-4bf0-bedd-8e4c275e6194 tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] 10.222.0.62 "GET /v2.0/ports?device_id=4413fd77-4f3e-40c8-b7ee-77d416cd7667 HTTP/1.1" status: 200 len: 944 time: 0.1087470 May 25 17:02:18.346988 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-c99072cc-4df4-4c94-9a46-1d4efa1a00af req-2d54bcf3-8f17-4fa7-b2e3-c99a8ab80cc6 tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] 10.222.0.62 "GET /v2.0/security-groups?id=d7d845a2-937c-4f26-ac5a-1b178146b05e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0410333 May 25 17:02:18.451254 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c80ec52c-6ad9-419b-959c-9f34dbeb9dcc req-934ce54d-9a6d-43f7-b337-62bbdff7360a tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:02:18.452676 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-c80ec52c-6ad9-419b-959c-9f34dbeb9dcc req-934ce54d-9a6d-43f7-b337-62bbdff7360a tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/ports?device_id=58da9205-0212-4daa-996c-1eef64a2b702 HTTP/1.1" status: 200 len: 945 time: 0.0785599 May 25 17:02:18.496734 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-c80ec52c-6ad9-419b-959c-9f34dbeb9dcc req-d10f66d3-764e-43bb-8f0e-8a3f9607fd22 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/security-groups?id=8ee5c4ed-9c60-4e39-9185-7e283704a7dc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0385911 May 25 17:02:19.493253 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e6e633df-604f-468e-a919-28b15a43f09b req-3d11560e-470e-49d0-837f-2db7cac13f74 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:02:19.494690 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-e6e633df-604f-468e-a919-28b15a43f09b req-3d11560e-470e-49d0-837f-2db7cac13f74 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] 10.222.0.62 "GET /v2.0/ports?device_id=0c32425a-15a9-4c9d-8e31-17183d4909c9 HTTP/1.1" status: 200 len: 945 time: 0.1134686 May 25 17:02:19.558289 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-e6e633df-604f-468e-a919-28b15a43f09b req-beafbbe8-d6c4-4339-8a8b-1cc055c3bd1d tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] 10.222.0.62 "GET /v2.0/security-groups?id=f73b90a2-df48-48fb-99e0-5dd4d6a63a15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0575864 May 25 17:02:19.589379 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-41f3a22a-502f-4227-b896-7660ad67e74a req-98f9d14f-7998-4534-9dbe-018cb2f88584 tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:02:19.590880 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-41f3a22a-502f-4227-b896-7660ad67e74a req-98f9d14f-7998-4534-9dbe-018cb2f88584 tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] 10.222.0.62 "GET /v2.0/ports?device_id=4413fd77-4f3e-40c8-b7ee-77d416cd7667 HTTP/1.1" status: 200 len: 944 time: 0.1362636 May 25 17:02:19.636016 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-41f3a22a-502f-4227-b896-7660ad67e74a req-64682736-8bc7-4d31-8714-269d1afd9ee4 tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] 10.222.0.62 "GET /v2.0/security-groups?id=d7d845a2-937c-4f26-ac5a-1b178146b05e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0386004 May 25 17:02:19.697522 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.rpc [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Device d64889c5-b5bd-42be-aa18-7a6149a0a583 details requested by agent hyperv_hv-cinder-79049 with host hv-cinder-79049 {{(pid=91831) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 25 17:02:19.700125 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.rpc [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Device 993b7d31-308c-4414-910f-1a10bea6ed57 up at agent hyperv_hv-cinder-79049 {{(pid=91831) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 25 17:02:19.750642 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f908840c-322f-43aa-869c-cc09ebf69c0b req-7d5dd82e-8b6f-40e4-82fa-2e5e0cf70846 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:02:19.753498 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-f908840c-322f-43aa-869c-cc09ebf69c0b req-7d5dd82e-8b6f-40e4-82fa-2e5e0cf70846 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/ports?device_id=58da9205-0212-4daa-996c-1eef64a2b702 HTTP/1.1" status: 200 len: 945 time: 0.0907686 May 25 17:02:19.808270 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-f908840c-322f-43aa-869c-cc09ebf69c0b req-ee8822f5-5dca-49ca-9654-4934009ce312 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/security-groups?id=8ee5c4ed-9c60-4e39-9185-7e283704a7dc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0477118 May 25 17:02:19.872594 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.provisioning_blocks [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Provisioning for port 993b7d31-308c-4414-910f-1a10bea6ed57 completed by entity L2. {{(pid=91831) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 25 17:02:19.880113 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.provisioning_blocks [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Provisioning complete for port 993b7d31-308c-4414-910f-1a10bea6ed57 triggered by entity L2. {{(pid=91831) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 17:02:19.880484 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3854128'] for port, provisioning_complete {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:02:19.989754 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.db [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] For port d64889c5-b5bd-42be-aa18-7a6149a0a583, host hv-cinder-79049, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79049',level=0,port_id=d64889c5-b5bd-42be-aa18-7a6149a0a583,segment=NetworkSegment(5aed6094-89e8-4c7c-ba89-9b30d3e98cd0),segment_id=5aed6094-89e8-4c7c-ba89-9b30d3e98cd0)] {{(pid=91831) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 17:02:19.995765 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.wsgi [-] (91830) accepted ('10.222.0.62', 32976) {{(pid=91830) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:02:20.008591 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.rpc [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Returning: {'device': 'd64889c5-b5bd-42be-aa18-7a6149a0a583', 'network_id': 'f3ddbe01-13f7-4e15-b7da-2bdffc278cb7', 'port_id': 'd64889c5-b5bd-42be-aa18-7a6149a0a583', 'mac_address': 'fa:16:3e:81:db:29', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 692, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '69fba530-cce2-44a2-89bd-18a52f9d454c', 'ip_address': '172.20.0.12'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=91831) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 25 17:02:20.116844 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3832070'] for port, before_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:02:20.129454 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3832070'] for port, before_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:02:20.149926 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.notifiers.nova [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id d64889c5-b5bd-42be-aa18-7a6149a0a583 {{(pid=91831) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} May 25 17:02:20.157938 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-48bec47a-852b-405a-93ca-2e9b2ad23ed5 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:02:20.175576 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '0c32425a-15a9-4c9d-8e31-17183d4909c9', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '993b7d31-308c-4414-910f-1a10bea6ed57'}] {{(pid=91831) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 25 17:02:20.183962 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.quota.driver [None req-48bec47a-852b-405a-93ca-2e9b2ad23ed5 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91830) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 17:02:20.188546 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.db [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] For port d64889c5-b5bd-42be-aa18-7a6149a0a583, host hv-cinder-79049, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79049',level=0,port_id=d64889c5-b5bd-42be-aa18-7a6149a0a583,segment=NetworkSegment(5aed6094-89e8-4c7c-ba89-9b30d3e98cd0),segment_id=5aed6094-89e8-4c7c-ba89-9b30d3e98cd0)] {{(pid=91831) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 17:02:20.188988 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [None req-48bec47a-852b-405a-93ca-2e9b2ad23ed5 admin admin] Usage tracker for resource:security_group_rule and tenant:9a07ada6ab9f4043b0f3ae45e7ec078b is out of sync, need to count used quota {{(pid=91830) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 17:02:20.190474 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.db [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] For port 993b7d31-308c-4414-910f-1a10bea6ed57, host hv-cinder-79049, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79049',level=0,port_id=993b7d31-308c-4414-910f-1a10bea6ed57,segment=NetworkSegment(7d7273c2-c6dd-43fe-83a8-cb776d48dc70),segment_id=7d7273c2-c6dd-43fe-83a8-cb776d48dc70)] {{(pid=91831) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 17:02:20.193053 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [None req-48bec47a-852b-405a-93ca-2e9b2ad23ed5 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91830) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 17:02:20.193952 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8757892955028', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8757892520933', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8757892521750'] for port, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:02:20.196234 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [None req-0acb97c0-a84d-4f3f-bd7b-db003966fbc3 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:02:20.202994 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.quota.driver [None req-48bec47a-852b-405a-93ca-2e9b2ad23ed5 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91830) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 17:02:20.237131 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8757892955028', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8757892520933', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8757892521750'] for port, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:02:20.255435 dv-cinder-790492-4-iscsi neutron-server[91831]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '0c32425a-15a9-4c9d-8e31-17183d4909c9', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '993b7d31-308c-4414-910f-1a10bea6ed57', 'code': 200} May 25 17:02:20.283656 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Pushing event updated for resources: {'Port': ['ID=d64889c5-b5bd-42be-aa18-7a6149a0a583,revision_number=4']} {{(pid=91831) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:02:20.287227 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.091s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:02:20.287712 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [None req-b0d85d62-a45e-4615-b952-f2b33680a7ad None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.034s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:02:20.327978 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-48bec47a-852b-405a-93ca-2e9b2ad23ed5 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:02:20.333708 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-48bec47a-852b-405a-93ca-2e9b2ad23ed5 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-640836'] for security_group, after_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:02:20.344376 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-899bce1d-a9ca-4b77-a01b-d63ab52e4277 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:02:20.371492 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Pushing event updated for resources: {'Port': ['ID=993b7d31-308c-4414-910f-1a10bea6ed57,revision_number=5']} {{(pid=91831) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:02:20.375906 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.088s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:02:20.397668 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [None req-48bec47a-852b-405a-93ca-2e9b2ad23ed5 admin admin] 10.222.0.62 "GET /v2.0/security-groups?tenant_id=9a07ada6ab9f4043b0f3ae45e7ec078b&name=default HTTP/1.1" status: 200 len: 2979 time: 0.3982754 May 25 17:02:20.397668 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-48bec47a-852b-405a-93ca-2e9b2ad23ed5 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b9c6132e-a66c-436d-bb10-3d6ffa722305,revision_number=1']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:02:20.398142 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.wsgi [-] (91829) accepted ('10.222.0.62', 32992) {{(pid=91829) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:02:20.418042 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-48bec47a-852b-405a-93ca-2e9b2ad23ed5 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.073s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:02:20.466247 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-03f5db71-1f7a-487a-9694-a420ccefc745 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:02:20.492842 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-03f5db71-1f7a-487a-9694-a420ccefc745 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:02:20.554065 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c55cf32a-46b3-427e-9ccb-47c5fd1a0ddc req-d2ac6227-3e74-46c1-84fc-244088540bd5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91830) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:02:20.555720 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-c55cf32a-46b3-427e-9ccb-47c5fd1a0ddc req-d2ac6227-3e74-46c1-84fc-244088540bd5 service neutron] 10.222.0.32 "GET /v2.0/ports?device_id=0c32425a-15a9-4c9d-8e31-17183d4909c9 HTTP/1.1" status: 200 len: 1099 time: 0.0805480 May 25 17:02:20.559152 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-03f5db71-1f7a-487a-9694-a420ccefc745 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-640836'] for security_group, after_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:02:20.565073 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-64e1e318-06a7-47e4-b1bc-f947af94a6e1 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:02:20.577371 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-03f5db71-1f7a-487a-9694-a420ccefc745 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b9c6132e-a66c-436d-bb10-3d6ffa722305,revision_number=None']} {{(pid=91829) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:02:20.580292 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-03f5db71-1f7a-487a-9694-a420ccefc745 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.015s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:02:20.581057 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-03f5db71-1f7a-487a-9694-a420ccefc745 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:02:20.584765 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [None req-03f5db71-1f7a-487a-9694-a420ccefc745 admin admin] 10.222.0.62 "DELETE /v2.0/security-groups/b9c6132e-a66c-436d-bb10-3d6ffa722305 HTTP/1.1" status: 204 len: 168 time: 0.1831183 May 25 17:02:20.708809 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-c55cf32a-46b3-427e-9ccb-47c5fd1a0ddc req-7fdd96e0-ba71-43f1-89c3-c562b8e73dbd service neutron] 10.222.0.32 "GET /v2.0/security-groups?id=f73b90a2-df48-48fb-99e0-5dd4d6a63a15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1389625 May 25 17:02:20.729830 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.db [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] get_ports_and_sgs() called for port_ids ['d64889c5-b5bd-42be-aa18-7a6149a0a583'] {{(pid=91831) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 25 17:02:20.785007 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b845ea7e-2b2d-4097-b3bb-93c9bc84d2c8 req-552e7e1a-0f1f-4407-8c20-709d9e7994d3 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:02:20.786656 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-b845ea7e-2b2d-4097-b3bb-93c9bc84d2c8 req-552e7e1a-0f1f-4407-8c20-709d9e7994d3 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] 10.222.0.62 "GET /v2.0/ports?device_id=0c32425a-15a9-4c9d-8e31-17183d4909c9 HTTP/1.1" status: 200 len: 946 time: 0.1089559 May 25 17:02:20.891798 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-b845ea7e-2b2d-4097-b3bb-93c9bc84d2c8 req-ec794144-5dbd-4e11-b2cb-739363cf743e tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] 10.222.0.62 "GET /v2.0/security-groups?id=f73b90a2-df48-48fb-99e0-5dd4d6a63a15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0709748 May 25 17:02:20.911564 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-164c9f22-4557-4e12-847b-183408d16a54 req-1ad1a45b-255a-403d-857f-84092e5bf8e2 tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:02:20.913110 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-164c9f22-4557-4e12-847b-183408d16a54 req-1ad1a45b-255a-403d-857f-84092e5bf8e2 tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] 10.222.0.62 "GET /v2.0/ports?device_id=4413fd77-4f3e-40c8-b7ee-77d416cd7667 HTTP/1.1" status: 200 len: 945 time: 0.1255591 May 25 17:02:20.971047 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-164c9f22-4557-4e12-847b-183408d16a54 req-dc57bf1f-49fd-49af-8d30-0e25655a6a46 tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] 10.222.0.62 "GET /v2.0/security-groups?id=d7d845a2-937c-4f26-ac5a-1b178146b05e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0521042 May 25 17:02:22.078961 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e78f2f35-909f-49fa-98f9-2ecfac2b2e8c req-b6d2a937-08f5-4c66-b672-6ee415c6c863 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:02:22.080432 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-e78f2f35-909f-49fa-98f9-2ecfac2b2e8c req-b6d2a937-08f5-4c66-b672-6ee415c6c863 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] 10.222.0.62 "GET /v2.0/ports?device_id=0c32425a-15a9-4c9d-8e31-17183d4909c9 HTTP/1.1" status: 200 len: 946 time: 0.0809536 May 25 17:02:22.226245 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-e78f2f35-909f-49fa-98f9-2ecfac2b2e8c req-1722e1f2-f800-41a6-8241-39b28cf3dc5a tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] 10.222.0.62 "GET /v2.0/security-groups?id=f73b90a2-df48-48fb-99e0-5dd4d6a63a15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0570784 May 25 17:02:22.245891 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4ff19cad-aac9-42ce-b11a-4d7373b140d8 req-2a03c3ce-5685-4a62-85f2-cafafd155028 tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:02:22.247344 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-4ff19cad-aac9-42ce-b11a-4d7373b140d8 req-2a03c3ce-5685-4a62-85f2-cafafd155028 tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] 10.222.0.62 "GET /v2.0/ports?device_id=4413fd77-4f3e-40c8-b7ee-77d416cd7667 HTTP/1.1" status: 200 len: 945 time: 0.1660504 May 25 17:02:22.291178 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-4ff19cad-aac9-42ce-b11a-4d7373b140d8 req-6e629ebf-45d3-4651-9a03-6e895316d482 tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] 10.222.0.62 "GET /v2.0/security-groups?id=d7d845a2-937c-4f26-ac5a-1b178146b05e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0379944 May 25 17:02:23.480080 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0c5343b7-f553-4678-8c65-2c0e1383a91f req-eb0f22b9-c107-4814-8bc7-42014b1f7549 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:02:23.481528 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-0c5343b7-f553-4678-8c65-2c0e1383a91f req-eb0f22b9-c107-4814-8bc7-42014b1f7549 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] 10.222.0.62 "GET /v2.0/ports?device_id=0c32425a-15a9-4c9d-8e31-17183d4909c9 HTTP/1.1" status: 200 len: 946 time: 0.1489229 May 25 17:02:23.526512 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3a9aa57b-59f3-4f49-bba6-a0703acee8ab req-db54a9f3-7d93-462b-9ef8-2d2099a7fa09 tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:02:23.526512 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-3a9aa57b-59f3-4f49-bba6-a0703acee8ab req-db54a9f3-7d93-462b-9ef8-2d2099a7fa09 tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] 10.222.0.62 "GET /v2.0/ports?device_id=4413fd77-4f3e-40c8-b7ee-77d416cd7667 HTTP/1.1" status: 200 len: 945 time: 0.1213021 May 25 17:02:23.563507 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-0c5343b7-f553-4678-8c65-2c0e1383a91f req-ab1f8815-2d3e-48c6-ae4d-df9dbd0f6c46 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] 10.222.0.62 "GET /v2.0/security-groups?id=f73b90a2-df48-48fb-99e0-5dd4d6a63a15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0749724 May 25 17:02:23.588897 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-3a9aa57b-59f3-4f49-bba6-a0703acee8ab req-6e8acc25-d369-4f32-a417-fd8859f8081e tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] 10.222.0.62 "GET /v2.0/security-groups?id=d7d845a2-937c-4f26-ac5a-1b178146b05e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0525453 May 25 17:02:23.719202 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.rpc [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Device d64889c5-b5bd-42be-aa18-7a6149a0a583 up at agent hyperv_hv-cinder-79049 {{(pid=91831) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 25 17:02:23.790438 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.provisioning_blocks [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Provisioning for port d64889c5-b5bd-42be-aa18-7a6149a0a583 completed by entity L2. {{(pid=91831) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 25 17:02:23.796865 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.provisioning_blocks [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Provisioning complete for port d64889c5-b5bd-42be-aa18-7a6149a0a583 triggered by entity L2. {{(pid=91831) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 17:02:23.797250 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3854128'] for port, provisioning_complete {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:02:23.953221 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3832070'] for port, before_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:02:23.990108 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '4413fd77-4f3e-40c8-b7ee-77d416cd7667', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'd64889c5-b5bd-42be-aa18-7a6149a0a583'}] {{(pid=91831) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 25 17:02:24.001123 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.db [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] For port d64889c5-b5bd-42be-aa18-7a6149a0a583, host hv-cinder-79049, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79049',level=0,port_id=d64889c5-b5bd-42be-aa18-7a6149a0a583,segment=NetworkSegment(5aed6094-89e8-4c7c-ba89-9b30d3e98cd0),segment_id=5aed6094-89e8-4c7c-ba89-9b30d3e98cd0)] {{(pid=91831) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 17:02:24.007956 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8757892955028', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8757892520933', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8757892521750'] for port, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:02:24.009977 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:02:24.050446 dv-cinder-790492-4-iscsi neutron-server[91831]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '4413fd77-4f3e-40c8-b7ee-77d416cd7667', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'd64889c5-b5bd-42be-aa18-7a6149a0a583', 'code': 200} May 25 17:02:24.088909 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Pushing event updated for resources: {'Port': ['ID=d64889c5-b5bd-42be-aa18-7a6149a0a583,revision_number=5']} {{(pid=91831) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:02:24.097186 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91831) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:02:24.097530 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91831) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:02:24.098028 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91831) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:02:24.098222 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91831) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:02:24.098653 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91831) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:02:24.098864 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91831) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:02:24.099184 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91831) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:02:24.099502 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91831) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:02:24.099824 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91831) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:02:24.100142 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91831) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:02:24.100475 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91831) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:02:24.100765 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91831) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:02:24.108070 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.098s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:02:24.294714 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1571d373-5dc0-4b53-9906-a1bee0519c88 req-275840df-4c54-470c-ba7a-1b0bf2c551f7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91830) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:02:24.296064 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-1571d373-5dc0-4b53-9906-a1bee0519c88 req-275840df-4c54-470c-ba7a-1b0bf2c551f7 service neutron] 10.222.0.32 "GET /v2.0/ports?device_id=4413fd77-4f3e-40c8-b7ee-77d416cd7667 HTTP/1.1" status: 200 len: 1099 time: 0.0690410 May 25 17:02:24.336824 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-1571d373-5dc0-4b53-9906-a1bee0519c88 req-f0f0b054-02a2-4a6c-ac70-6dc663aaa597 service neutron] 10.222.0.32 "GET /v2.0/security-groups?id=d7d845a2-937c-4f26-ac5a-1b178146b05e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0326526 May 25 17:02:24.777354 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9e34766c-c081-458e-9e27-fff63961885d req-6c4db7f7-58a3-4cfb-b474-c235c025aade tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:02:24.778835 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-9e34766c-c081-458e-9e27-fff63961885d req-6c4db7f7-58a3-4cfb-b474-c235c025aade tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] 10.222.0.62 "GET /v2.0/ports?device_id=4413fd77-4f3e-40c8-b7ee-77d416cd7667 HTTP/1.1" status: 200 len: 946 time: 0.0828586 May 25 17:02:24.832783 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-9e34766c-c081-458e-9e27-fff63961885d req-cc7351a3-239f-464a-b7d7-45390df05828 tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] 10.222.0.62 "GET /v2.0/security-groups?id=d7d845a2-937c-4f26-ac5a-1b178146b05e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0400774 May 25 17:02:25.284526 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-dde5ef95-b10a-458b-9845-d465c8fb2109 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:02:26.023778 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b8ddbd0c-ecc1-43ec-8eb8-ac1570da7e92 req-685acebb-ba1b-4180-9802-6804d2f8d3e5 tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:02:26.025041 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-b8ddbd0c-ecc1-43ec-8eb8-ac1570da7e92 req-685acebb-ba1b-4180-9802-6804d2f8d3e5 tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] 10.222.0.62 "GET /v2.0/ports?device_id=4413fd77-4f3e-40c8-b7ee-77d416cd7667 HTTP/1.1" status: 200 len: 946 time: 0.0807900 May 25 17:02:26.069821 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-b8ddbd0c-ecc1-43ec-8eb8-ac1570da7e92 req-31043141-e367-4cac-99a2-e6a104489d6a tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] 10.222.0.62 "GET /v2.0/security-groups?id=d7d845a2-937c-4f26-ac5a-1b178146b05e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0383060 May 25 17:02:26.151220 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.db.agents_db [None req-504cb04f-4543-46c1-8db7-349e21db7634 None None] Agent healthcheck: found 6 active agents {{(pid=91832) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} May 25 17:02:27.250404 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-24b433d3-03c8-406b-957a-1f2cb4ad9dc0 req-4864bf93-d0ed-49a3-be03-4cfad8fbc59c tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:02:27.251839 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-24b433d3-03c8-406b-957a-1f2cb4ad9dc0 req-4864bf93-d0ed-49a3-be03-4cfad8fbc59c tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] 10.222.0.62 "GET /v2.0/ports?device_id=4413fd77-4f3e-40c8-b7ee-77d416cd7667 HTTP/1.1" status: 200 len: 946 time: 0.0789316 May 25 17:02:27.301640 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-24b433d3-03c8-406b-957a-1f2cb4ad9dc0 req-2616241c-b715-413e-a6ee-d67bddcd725b tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] 10.222.0.62 "GET /v2.0/security-groups?id=d7d845a2-937c-4f26-ac5a-1b178146b05e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0440309 May 25 17:02:27.678490 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-6796f765-e281-4baf-b61a-e34f45a62f20 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:02:27.859593 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:02:28.482097 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-75d772a4-de51-4a98-a8a1-1ef1785bd3e5 req-d1f12d5b-6d26-4334-aaba-58fe643c3848 tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:02:28.483567 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-75d772a4-de51-4a98-a8a1-1ef1785bd3e5 req-d1f12d5b-6d26-4334-aaba-58fe643c3848 tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] 10.222.0.62 "GET /v2.0/ports?device_id=4413fd77-4f3e-40c8-b7ee-77d416cd7667 HTTP/1.1" status: 200 len: 946 time: 0.0797532 May 25 17:02:28.527076 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-75d772a4-de51-4a98-a8a1-1ef1785bd3e5 req-116e389b-64fc-4dcd-bed8-dd54b95c89dd tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] 10.222.0.62 "GET /v2.0/security-groups?id=d7d845a2-937c-4f26-ac5a-1b178146b05e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0379939 May 25 17:02:28.608471 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-0a55eb4a-8b57-4233-84d6-6b423b4ed6db None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:02:29.716838 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d0a311f2-1adf-4e49-bd7c-ccf9c11eb165 req-ecfec1d9-0d72-467b-8e06-760b66945b8e tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:02:29.718895 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-d0a311f2-1adf-4e49-bd7c-ccf9c11eb165 req-ecfec1d9-0d72-467b-8e06-760b66945b8e tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] 10.222.0.62 "GET /v2.0/ports?device_id=4413fd77-4f3e-40c8-b7ee-77d416cd7667 HTTP/1.1" status: 200 len: 946 time: 0.0849302 May 25 17:02:29.764942 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-d0a311f2-1adf-4e49-bd7c-ccf9c11eb165 req-99815dc2-52a5-4aa6-ac28-792a5bef2b81 tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] 10.222.0.62 "GET /v2.0/security-groups?id=d7d845a2-937c-4f26-ac5a-1b178146b05e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0400863 May 25 17:02:29.863055 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-fe53c798-731f-42b3-b77b-8e5737100f9a req-2705a292-a84a-4022-80ce-79f301e08a30 service neutron] 10.222.0.32 "GET /v2.0/ports?device_id=bca36110-0b4f-419a-92ef-46cbb9d6215e&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0740924 May 25 17:02:30.019554 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fe53c798-731f-42b3-b77b-8e5737100f9a req-c753a7ba-d3ea-4d0b-84c9-8aa60ad3e940 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91830) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:02:30.019554 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-fe53c798-731f-42b3-b77b-8e5737100f9a req-c753a7ba-d3ea-4d0b-84c9-8aa60ad3e940 service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=04e8022f24e3464ab1ab7726d6a07e08&device_id=bca36110-0b4f-419a-92ef-46cbb9d6215e HTTP/1.1" status: 200 len: 1098 time: 0.0743330 May 25 17:02:30.168141 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fe53c798-731f-42b3-b77b-8e5737100f9a req-76a1b500-b899-4516-ae4d-9713db1e295c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91830) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:02:30.169538 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-fe53c798-731f-42b3-b77b-8e5737100f9a req-76a1b500-b899-4516-ae4d-9713db1e295c service neutron] 10.222.0.32 "GET /v2.0/networks?id=63b1f335-e2c4-48dd-886b-6be853f8a2fc HTTP/1.1" status: 200 len: 915 time: 0.1260049 May 25 17:02:30.213730 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-57f11b47-1f51-4191-b7c9-af248a48372c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:02:30.251350 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-fe53c798-731f-42b3-b77b-8e5737100f9a req-a047cb8a-bbfb-42f9-adb2-fe8eeb0decf8 service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=c4b9c0f2-e3d5-4fff-9b3c-a9175b027fb5 HTTP/1.1" status: 200 len: 217 time: 0.0664253 May 25 17:02:30.319374 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fe53c798-731f-42b3-b77b-8e5737100f9a req-31d9038b-7182-446f-b2a0-0027dddeb097 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91830) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:02:30.320768 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-fe53c798-731f-42b3-b77b-8e5737100f9a req-31d9038b-7182-446f-b2a0-0027dddeb097 service neutron] 10.222.0.32 "GET /v2.0/subnets?id=b0baa944-cafe-48a4-861a-dae28947b9f0 HTTP/1.1" status: 200 len: 854 time: 0.0587759 May 25 17:02:30.383140 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-fe53c798-731f-42b3-b77b-8e5737100f9a req-d8d9b622-72e6-41a1-8973-4305e544d188 service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=63b1f335-e2c4-48dd-886b-6be853f8a2fc&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0429537 May 25 17:02:30.525000 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-fe53c798-731f-42b3-b77b-8e5737100f9a req-ff939083-e909-4a8c-9ee9-5d9a07ac154e service neutron] 10.222.0.32 "GET /v2.0/networks/63b1f335-e2c4-48dd-886b-6be853f8a2fc?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1227369 May 25 17:02:30.664022 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-fe53c798-731f-42b3-b77b-8e5737100f9a req-44dbf953-b4b4-462b-a300-b8b020e81473 service neutron] 10.222.0.32 "GET /v2.0/networks/63b1f335-e2c4-48dd-886b-6be853f8a2fc?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1283529 May 25 17:02:30.945982 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3b4642c2-789d-43ff-8a9b-a755d794c6e2 req-c5fc7366-1073-4d13-8c4a-bf964afd8eab tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:02:30.947317 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-3b4642c2-789d-43ff-8a9b-a755d794c6e2 req-c5fc7366-1073-4d13-8c4a-bf964afd8eab tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] 10.222.0.62 "GET /v2.0/ports?device_id=4413fd77-4f3e-40c8-b7ee-77d416cd7667 HTTP/1.1" status: 200 len: 946 time: 0.0786099 May 25 17:02:30.992383 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-3b4642c2-789d-43ff-8a9b-a755d794c6e2 req-287424b8-eb86-4115-a6aa-c6a7e1b53966 tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] 10.222.0.62 "GET /v2.0/security-groups?id=d7d845a2-937c-4f26-ac5a-1b178146b05e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0388281 May 25 17:02:34.389268 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:02:35.794923 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-86b09961-ceb6-4716-b56b-c2ad193b24a9 req-b7999e3b-1a7e-4b02-9ebe-cef8ce2c9777 tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:02:35.796917 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-86b09961-ceb6-4716-b56b-c2ad193b24a9 req-b7999e3b-1a7e-4b02-9ebe-cef8ce2c9777 tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] 10.222.0.62 "GET /v2.0/ports?device_id=4413fd77-4f3e-40c8-b7ee-77d416cd7667 HTTP/1.1" status: 200 len: 946 time: 0.0846915 May 25 17:02:35.840669 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-86b09961-ceb6-4716-b56b-c2ad193b24a9 req-a325a7b7-3d7e-4db2-be04-4324ec7f03a9 tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] 10.222.0.62 "GET /v2.0/security-groups?id=d7d845a2-937c-4f26-ac5a-1b178146b05e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0379524 May 25 17:02:37.032889 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7cfe3749-e298-41cd-aebb-402038689e34 req-01b64d01-5f85-4095-8a5b-950e4b39546e tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:02:37.034397 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-7cfe3749-e298-41cd-aebb-402038689e34 req-01b64d01-5f85-4095-8a5b-950e4b39546e tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] 10.222.0.62 "GET /v2.0/ports?device_id=4413fd77-4f3e-40c8-b7ee-77d416cd7667 HTTP/1.1" status: 200 len: 946 time: 0.0875468 May 25 17:02:37.084908 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-7cfe3749-e298-41cd-aebb-402038689e34 req-b0d5319a-35de-44a8-8d31-6df68c249647 tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] 10.222.0.62 "GET /v2.0/security-groups?id=d7d845a2-937c-4f26-ac5a-1b178146b05e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0440540 May 25 17:02:37.274104 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f508222a-0275-462f-b28e-ead9a502af36 req-9a0530fa-9666-4712-a3de-5feb21cb9bb0 tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:02:37.275545 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-f508222a-0275-462f-b28e-ead9a502af36 req-9a0530fa-9666-4712-a3de-5feb21cb9bb0 tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] 10.222.0.62 "GET /v2.0/ports?device_id=4413fd77-4f3e-40c8-b7ee-77d416cd7667 HTTP/1.1" status: 200 len: 946 time: 0.0807776 May 25 17:02:37.320807 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-f508222a-0275-462f-b28e-ead9a502af36 req-b6c70c7e-b04e-4776-9cb1-fdce5bdefef2 tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] 10.222.0.62 "GET /v2.0/security-groups?id=d7d845a2-937c-4f26-ac5a-1b178146b05e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0391340 May 25 17:02:37.761415 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d48b2a33-b75c-4f32-ba3d-60c093f28cab req-4d799be7-d199-4ef1-8eb6-82c3eaec1a31 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:02:37.762930 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-d48b2a33-b75c-4f32-ba3d-60c093f28cab req-4d799be7-d199-4ef1-8eb6-82c3eaec1a31 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/ports?device_id=d87a1395-92e0-4727-a5ed-a8dcdee587c3 HTTP/1.1" status: 200 len: 945 time: 0.1472595 May 25 17:02:37.775391 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-27bd897b-13a9-4e99-9d1f-f89c0afb3088 req-f571d33f-773a-412e-8fb0-f0e8809a696b tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:02:37.776737 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-27bd897b-13a9-4e99-9d1f-f89c0afb3088 req-f571d33f-773a-412e-8fb0-f0e8809a696b tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] 10.222.0.62 "GET /v2.0/ports?device_id=4413fd77-4f3e-40c8-b7ee-77d416cd7667 HTTP/1.1" status: 200 len: 946 time: 0.1050770 May 25 17:02:37.834243 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-d48b2a33-b75c-4f32-ba3d-60c093f28cab req-ac0cd27d-5065-49c1-a4b6-78503fa970f0 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/security-groups?id=8ee5c4ed-9c60-4e39-9185-7e283704a7dc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0559857 May 25 17:02:37.854709 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-27bd897b-13a9-4e99-9d1f-f89c0afb3088 req-8d3bceb3-4568-43ae-abab-939564bdda36 tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] 10.222.0.62 "GET /v2.0/security-groups?id=d7d845a2-937c-4f26-ac5a-1b178146b05e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0624537 May 25 17:02:39.020430 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b01763d7-0fe0-43e1-b573-4daacdbdc4ee req-5e47a924-d1c4-4b15-af66-2c4a28e217f6 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:02:39.021893 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-b01763d7-0fe0-43e1-b573-4daacdbdc4ee req-5e47a924-d1c4-4b15-af66-2c4a28e217f6 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/ports?device_id=d87a1395-92e0-4727-a5ed-a8dcdee587c3 HTTP/1.1" status: 200 len: 945 time: 0.0828874 May 25 17:02:39.066884 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-b01763d7-0fe0-43e1-b573-4daacdbdc4ee req-ecb0bc93-de2b-4e93-aed3-36b313ccf024 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/security-groups?id=8ee5c4ed-9c60-4e39-9185-7e283704a7dc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0393128 May 25 17:02:40.251900 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-75651e20-3c57-4b82-b45a-de2fa50b1033 req-f2fc089a-6735-4c0c-a203-136964b46a8d tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:02:40.253322 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-75651e20-3c57-4b82-b45a-de2fa50b1033 req-f2fc089a-6735-4c0c-a203-136964b46a8d tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/ports?device_id=d87a1395-92e0-4727-a5ed-a8dcdee587c3 HTTP/1.1" status: 200 len: 945 time: 0.0792618 May 25 17:02:40.299797 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-75651e20-3c57-4b82-b45a-de2fa50b1033 req-10f87d9b-e517-4969-9ea7-2e973970ad55 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/security-groups?id=8ee5c4ed-9c60-4e39-9185-7e283704a7dc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0407829 May 25 17:02:41.481821 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4f0524fe-50a6-433b-bfc6-678651530c6b req-d1e7692c-ad75-4209-8154-8957155a6afc tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:02:41.483292 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-4f0524fe-50a6-433b-bfc6-678651530c6b req-d1e7692c-ad75-4209-8154-8957155a6afc tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/ports?device_id=d87a1395-92e0-4727-a5ed-a8dcdee587c3 HTTP/1.1" status: 200 len: 945 time: 0.0788860 May 25 17:02:41.527503 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-4f0524fe-50a6-433b-bfc6-678651530c6b req-c90a3269-959c-443a-99c6-ced920244be4 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/security-groups?id=8ee5c4ed-9c60-4e39-9185-7e283704a7dc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0385633 May 25 17:02:42.763258 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-694f9ec3-a829-45c9-af60-b838d075487e req-3af7d070-62e5-4fd5-8e32-866e2dddf7ce tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:02:42.764752 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-694f9ec3-a829-45c9-af60-b838d075487e req-3af7d070-62e5-4fd5-8e32-866e2dddf7ce tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/ports?device_id=d87a1395-92e0-4727-a5ed-a8dcdee587c3 HTTP/1.1" status: 200 len: 945 time: 0.1322715 May 25 17:02:42.810581 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-694f9ec3-a829-45c9-af60-b838d075487e req-16dbedbd-1ce6-4989-a924-61008c292952 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/security-groups?id=8ee5c4ed-9c60-4e39-9185-7e283704a7dc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0393915 May 25 17:02:44.003940 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e2cb3035-9de0-42ad-b7a2-f4f2facc875e req-872c34da-f4f7-4bd8-b3ce-2a59dd89a297 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:02:44.005373 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-e2cb3035-9de0-42ad-b7a2-f4f2facc875e req-872c34da-f4f7-4bd8-b3ce-2a59dd89a297 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/ports?device_id=d87a1395-92e0-4727-a5ed-a8dcdee587c3 HTTP/1.1" status: 200 len: 945 time: 0.0842443 May 25 17:02:44.053577 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-e2cb3035-9de0-42ad-b7a2-f4f2facc875e req-56fcc11f-c254-408d-8cb1-a4c22a130806 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/security-groups?id=8ee5c4ed-9c60-4e39-9185-7e283704a7dc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0422688 May 25 17:02:45.254064 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-38903c81-6b62-4c3e-834f-58a10a2865fe req-bb6991ba-0817-48dc-8e29-3aa7bc39cbed tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:02:45.255584 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-38903c81-6b62-4c3e-834f-58a10a2865fe req-bb6991ba-0817-48dc-8e29-3aa7bc39cbed tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/ports?device_id=d87a1395-92e0-4727-a5ed-a8dcdee587c3 HTTP/1.1" status: 200 len: 945 time: 0.0821846 May 25 17:02:45.300566 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-38903c81-6b62-4c3e-834f-58a10a2865fe req-2c4b44cb-8205-4d51-a705-ac2fc1b4ef9a tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/security-groups?id=8ee5c4ed-9c60-4e39-9185-7e283704a7dc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0390308 May 25 17:02:45.725638 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-390ce9bc-cfaa-45a8-934a-cafa5046793d req-8ce36a9d-d039-4306-af36-0edead5cb08f tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91830) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:02:45.727127 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [req-390ce9bc-cfaa-45a8-934a-cafa5046793d req-8ce36a9d-d039-4306-af36-0edead5cb08f tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] Synchronizing usage tracker for tenant:734df673f8b3484d80f35a45fbce9d5e on resource:port {{(pid=91830) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 25 17:02:45.744775 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [req-390ce9bc-cfaa-45a8-934a-cafa5046793d req-8ce36a9d-d039-4306-af36-0edead5cb08f tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] Unset dirty status for tenant:734df673f8b3484d80f35a45fbce9d5e on resource:port {{(pid=91830) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 25 17:02:45.746102 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-390ce9bc-cfaa-45a8-934a-cafa5046793d req-8ce36a9d-d039-4306-af36-0edead5cb08f tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.32 "GET /v2.0/ports?device_id=d87a1395-92e0-4727-a5ed-a8dcdee587c3 HTTP/1.1" status: 200 len: 945 time: 0.1019719 May 25 17:02:45.901364 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.plugins.ml2.plugin [req-390ce9bc-cfaa-45a8-934a-cafa5046793d req-df34a865-d97f-448a-9bd2-9e88941951e4 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] Deleting port 250e0a7c-f7d1-4092-af1f-d50d5b92f68a {{(pid=91830) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 25 17:02:45.901703 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [req-390ce9bc-cfaa-45a8-934a-cafa5046793d req-df34a865-d97f-448a-9bd2-9e88941951e4 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8757892952899'] for port, before_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:02:46.035387 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.plugins.ml2.db [req-390ce9bc-cfaa-45a8-934a-cafa5046793d req-df34a865-d97f-448a-9bd2-9e88941951e4 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] For port 250e0a7c-f7d1-4092-af1f-d50d5b92f68a, host hv-cinder-79049, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79049',level=0,port_id=250e0a7c-f7d1-4092-af1f-d50d5b92f68a,segment=NetworkSegment(f672477b-47fb-432c-acc9-dc57201d80de),segment_id=f672477b-47fb-432c-acc9-dc57201d80de)] {{(pid=91830) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 17:02:46.035748 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [req-390ce9bc-cfaa-45a8-934a-cafa5046793d req-df34a865-d97f-448a-9bd2-9e88941951e4 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-683770'] for port, precommit_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:02:46.167676 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.plugins.ml2.plugin [req-390ce9bc-cfaa-45a8-934a-cafa5046793d req-df34a865-d97f-448a-9bd2-9e88941951e4 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] Calling delete_port for 250e0a7c-f7d1-4092-af1f-d50d5b92f68a owned by compute:nova {{(pid=91830) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 25 17:02:46.295260 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [req-390ce9bc-cfaa-45a8-934a-cafa5046793d req-df34a865-d97f-448a-9bd2-9e88941951e4 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8757892955046', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8757892520924', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-27483019'] for port, after_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:02:46.302887 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-e393b150-46a8-4165-b26b-60df4e8cbdbf service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:02:46.307717 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.db [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] get_ports_and_sgs() called for port_ids ['60078444-24b6-4560-b0a7-7802c4f8f2f8', '250e0a7c-f7d1-4092-af1f-d50d5b92f68a'] {{(pid=91831) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 25 17:02:46.350034 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-df34a865-d97f-448a-9bd2-9e88941951e4 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] Pushing event deleted for resources: {'Port': ['ID=250e0a7c-f7d1-4092-af1f-d50d5b92f68a,revision_number=None']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:02:46.394471 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-df34a865-d97f-448a-9bd2-9e88941951e4 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91830) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:02:46.397113 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-df34a865-d97f-448a-9bd2-9e88941951e4 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91830) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:02:46.397635 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-df34a865-d97f-448a-9bd2-9e88941951e4 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91830) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:02:46.398023 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-df34a865-d97f-448a-9bd2-9e88941951e4 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91830) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:02:46.398379 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-df34a865-d97f-448a-9bd2-9e88941951e4 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91830) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:02:46.398735 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-df34a865-d97f-448a-9bd2-9e88941951e4 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91830) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:02:46.399084 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-df34a865-d97f-448a-9bd2-9e88941951e4 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91830) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:02:46.399431 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-df34a865-d97f-448a-9bd2-9e88941951e4 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91830) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:02:46.400021 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-df34a865-d97f-448a-9bd2-9e88941951e4 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91830) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:02:46.400353 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-df34a865-d97f-448a-9bd2-9e88941951e4 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91830) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:02:46.400702 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-df34a865-d97f-448a-9bd2-9e88941951e4 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91830) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:02:46.401102 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-df34a865-d97f-448a-9bd2-9e88941951e4 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91830) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:02:46.406081 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-df34a865-d97f-448a-9bd2-9e88941951e4 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.105s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:02:46.502605 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-0bbc41cc-389f-4a92-8615-a006bc7515b8 req-ff63c0df-3f13-4d4d-bcae-76402b9aeeac tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/ports?device_id=d87a1395-92e0-4727-a5ed-a8dcdee587c3 HTTP/1.1" status: 200 len: 210 time: 0.0511808 May 25 17:02:46.541553 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.l3_dvrscheduler_db [req-390ce9bc-cfaa-45a8-934a-cafa5046793d req-df34a865-d97f-448a-9bd2-9e88941951e4 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] No DVR routers for this DVR port 250e0a7c-f7d1-4092-af1f-d50d5b92f68a on host hv-cinder-79049 {{(pid=91830) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 25 17:02:46.544123 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [req-390ce9bc-cfaa-45a8-934a-cafa5046793d req-df34a865-d97f-448a-9bd2-9e88941951e4 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-178712'] for port, before_response {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:02:46.547398 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'd87a1395-92e0-4727-a5ed-a8dcdee587c3', 'name': 'network-vif-deleted', 'tag': '250e0a7c-f7d1-4092-af1f-d50d5b92f68a'}] {{(pid=91830) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 25 17:02:46.568522 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-390ce9bc-cfaa-45a8-934a-cafa5046793d req-df34a865-d97f-448a-9bd2-9e88941951e4 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.32 "DELETE /v2.0/ports/250e0a7c-f7d1-4092-af1f-d50d5b92f68a HTTP/1.1" status: 204 len: 173 time: 0.8160238 May 25 17:02:46.592289 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'd87a1395-92e0-4727-a5ed-a8dcdee587c3', 'name': 'network-vif-deleted', 'tag': '250e0a7c-f7d1-4092-af1f-d50d5b92f68a', 'status': 'completed', 'code': 200} May 25 17:02:48.002413 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fad28e3a-42d3-4729-a5c3-8f1d8233d389 req-2a936412-a144-4389-9909-63657360a86f tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:02:48.003892 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-fad28e3a-42d3-4729-a5c3-8f1d8233d389 req-2a936412-a144-4389-9909-63657360a86f tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/ports?device_id=58da9205-0212-4daa-996c-1eef64a2b702 HTTP/1.1" status: 200 len: 945 time: 0.0809317 May 25 17:02:48.047747 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-fad28e3a-42d3-4729-a5c3-8f1d8233d389 req-77a3060b-f80a-49ba-a841-3afd91a786a1 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/security-groups?id=8ee5c4ed-9c60-4e39-9185-7e283704a7dc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0382099 May 25 17:02:49.235975 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-40348373-b881-42e5-9988-e945ce57e49a req-c0ab76c8-282e-467c-9c3b-85929c3c8b2e tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:02:49.237574 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-40348373-b881-42e5-9988-e945ce57e49a req-c0ab76c8-282e-467c-9c3b-85929c3c8b2e tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/ports?device_id=58da9205-0212-4daa-996c-1eef64a2b702 HTTP/1.1" status: 200 len: 945 time: 0.0848186 May 25 17:02:49.279745 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-40348373-b881-42e5-9988-e945ce57e49a req-323ac85c-d919-4fa5-b704-62dd210ca0a1 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/security-groups?id=8ee5c4ed-9c60-4e39-9185-7e283704a7dc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0365458 May 25 17:02:49.823238 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.rpc [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Device 250e0a7c-f7d1-4092-af1f-d50d5b92f68a no longer exists at agent hyperv_hv-cinder-79049 {{(pid=91831) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 25 17:02:49.884295 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.plugin [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] No Port match for: 250e0a7c-f7d1-4092-af1f-d50d5b92f68a {{(pid=91831) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}} May 25 17:02:49.884602 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.rpc [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Device 250e0a7c-f7d1-4092-af1f-d50d5b92f68a not bound to the agent host hv-cinder-79049 {{(pid=91831) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 25 17:02:50.460525 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6e0c0895-41d4-46c7-9df0-426b2f1d6915 req-71510487-d95b-4895-8ee9-10eb58176d31 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:02:50.461966 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-6e0c0895-41d4-46c7-9df0-426b2f1d6915 req-71510487-d95b-4895-8ee9-10eb58176d31 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/ports?device_id=58da9205-0212-4daa-996c-1eef64a2b702 HTTP/1.1" status: 200 len: 945 time: 0.0782154 May 25 17:02:50.506073 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-6e0c0895-41d4-46c7-9df0-426b2f1d6915 req-848bcb19-3706-4460-9769-d12e6cdb4fbd tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/security-groups?id=8ee5c4ed-9c60-4e39-9185-7e283704a7dc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0384483 May 25 17:02:51.693647 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-096106f4-65a1-4112-9926-85c079162f7f req-9c634790-4723-467c-bd61-ae1ede203953 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:02:51.695112 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-096106f4-65a1-4112-9926-85c079162f7f req-9c634790-4723-467c-bd61-ae1ede203953 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/ports?device_id=58da9205-0212-4daa-996c-1eef64a2b702 HTTP/1.1" status: 200 len: 945 time: 0.0859203 May 25 17:02:51.738593 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-096106f4-65a1-4112-9926-85c079162f7f req-f4cad4eb-33a7-49d2-8241-4cf1ec590fa8 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/security-groups?id=8ee5c4ed-9c60-4e39-9185-7e283704a7dc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0378206 May 25 17:02:52.921058 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-916002b3-f728-435d-8e37-f4b3e4e90eed req-1d6d9bd5-2c9e-46cf-9719-e8bf239ea62f tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:02:52.922533 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-916002b3-f728-435d-8e37-f4b3e4e90eed req-1d6d9bd5-2c9e-46cf-9719-e8bf239ea62f tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/ports?device_id=58da9205-0212-4daa-996c-1eef64a2b702 HTTP/1.1" status: 200 len: 945 time: 0.0778995 May 25 17:02:52.966005 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-916002b3-f728-435d-8e37-f4b3e4e90eed req-915ece43-276a-41a9-b693-ad1e98e01e64 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/security-groups?id=8ee5c4ed-9c60-4e39-9185-7e283704a7dc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0378118 May 25 17:02:53.686942 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-de27b143-6b20-4138-9270-54f3fa323484 req-2d2fbf94-4dd5-43f8-ab6f-7f6367466c35 tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:02:53.688335 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-de27b143-6b20-4138-9270-54f3fa323484 req-2d2fbf94-4dd5-43f8-ab6f-7f6367466c35 tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] 10.222.0.62 "GET /v2.0/ports?device_id=4413fd77-4f3e-40c8-b7ee-77d416cd7667 HTTP/1.1" status: 200 len: 946 time: 0.0829577 May 25 17:02:53.731175 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-de27b143-6b20-4138-9270-54f3fa323484 req-f96f156d-1df4-4ce2-a2a6-f134ec9c8445 tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] 10.222.0.62 "GET /v2.0/security-groups?id=d7d845a2-937c-4f26-ac5a-1b178146b05e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0371959 May 25 17:02:53.753770 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.wsgi [-] (91829) accepted ('10.222.0.62', 33368) {{(pid=91829) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:02:53.980818 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d404ac4b-2a37-4a51-9137-69aaf32f9cbe tempest-TestMinimumBasicScenario-1830400244 tempest-TestMinimumBasicScenario-1830400244-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:02:53.981564 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.quota.resource [None req-d404ac4b-2a37-4a51-9137-69aaf32f9cbe tempest-TestMinimumBasicScenario-1830400244 tempest-TestMinimumBasicScenario-1830400244-project-admin] Synchronizing usage tracker for tenant:a60ff90c536747ff984cf0591f1a098b on resource:port {{(pid=91829) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 25 17:02:53.998117 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.quota.resource [None req-d404ac4b-2a37-4a51-9137-69aaf32f9cbe tempest-TestMinimumBasicScenario-1830400244 tempest-TestMinimumBasicScenario-1830400244-project-admin] Unset dirty status for tenant:a60ff90c536747ff984cf0591f1a098b on resource:port {{(pid=91829) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 25 17:02:53.999350 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [None req-d404ac4b-2a37-4a51-9137-69aaf32f9cbe tempest-TestMinimumBasicScenario-1830400244 tempest-TestMinimumBasicScenario-1830400244-project-admin] 10.222.0.62 "GET /v2.0/ports?device_id=4413fd77-4f3e-40c8-b7ee-77d416cd7667 HTTP/1.1" status: 200 len: 1094 time: 0.2446296 May 25 17:02:54.002177 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.wsgi [-] (91829) accepted ('10.222.0.62', 33378) {{(pid=91829) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:02:54.007263 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.v2.base [None req-29714c98-817b-4459-af55-7db1747da55c tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Request body: {'floatingip': {'floating_network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'port_id': 'd64889c5-b5bd-42be-aa18-7a6149a0a583', 'tenant_id': '36c1ffa1d458478bac5893b2ddf98eda', 'fixed_ip_address': '172.20.0.12'}} {{(pid=91829) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 17:02:54.012856 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.quota.driver [None req-29714c98-817b-4459-af55-7db1747da55c tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91829) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 17:02:54.017167 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.quota.resource [None req-29714c98-817b-4459-af55-7db1747da55c tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Usage tracker for resource:floatingip and tenant:36c1ffa1d458478bac5893b2ddf98eda is out of sync, need to count used quota {{(pid=91829) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 17:02:54.020289 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.quota.resource [None req-29714c98-817b-4459-af55-7db1747da55c tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Quota usage for floatingip was recalculated. Used quota:0. {{(pid=91829) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 17:02:54.026028 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.quota.driver [None req-29714c98-817b-4459-af55-7db1747da55c tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Attempting to reserve 1 items for resource floatingip. Total usage: 0; quota limit: 50; headroom:50 {{(pid=91829) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 17:02:54.039611 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-29714c98-817b-4459-af55-7db1747da55c tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Notify callbacks [] for floatingip, before_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:02:54.215883 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ca5cbc74-1ce4-4528-89eb-9a9c2b7dee60 req-aaa14ae4-7791-47f0-8692-a92b785e107c tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:02:54.217288 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-ca5cbc74-1ce4-4528-89eb-9a9c2b7dee60 req-aaa14ae4-7791-47f0-8692-a92b785e107c tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/ports?device_id=58da9205-0212-4daa-996c-1eef64a2b702 HTTP/1.1" status: 200 len: 945 time: 0.1113369 May 25 17:02:54.279457 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-ca5cbc74-1ce4-4528-89eb-9a9c2b7dee60 req-7fa91d5b-56b4-4b84-b8a0-eee14430116f tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/security-groups?id=8ee5c4ed-9c60-4e39-9185-7e283704a7dc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0521646 May 25 17:02:54.280717 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-29714c98-817b-4459-af55-7db1747da55c tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3832070'] for port, before_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:02:54.416495 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.db_base_plugin_common [None req-29714c98-817b-4459-af55-7db1747da55c tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Allocated IP 172.27.2.103 (4364b6ab-4117-4a92-baeb-f5ee2f45bf74/b947e790-d731-4b63-afc4-4aa112afe0f6/9eb5148e-299d-412e-a8de-9f6e73bc63f0) {{(pid=91829) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 25 17:02:54.564297 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-29714c98-817b-4459-af55-7db1747da55c tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Notify callbacks [] for port, precommit_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:02:54.597131 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-29714c98-817b-4459-af55-7db1747da55c tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8757892520915', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28230808'] for port, after_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:02:54.601517 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:02:54.666039 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-29714c98-817b-4459-af55-7db1747da55c tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Network 4364b6ab-4117-4a92-baeb-f5ee2f45bf74 is already hosted by enough agents. {{(pid=91829) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 25 17:02:54.668591 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.scheduler.base_scheduler [None req-29714c98-817b-4459-af55-7db1747da55c tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Resources bound (agent type, host, resource id): {{(pid=91829) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 17:02:54.672724 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.l3_dvrscheduler_db [None req-29714c98-817b-4459-af55-7db1747da55c tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Received port after_create {{(pid=91829) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 25 17:02:54.701515 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-29714c98-817b-4459-af55-7db1747da55c tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Pushing event updated for resources: {'Port': ['ID=9eb5148e-299d-412e-a8de-9f6e73bc63f0,revision_number=1']} {{(pid=91829) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:02:54.718938 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-29714c98-817b-4459-af55-7db1747da55c tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91829) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:02:54.719300 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-29714c98-817b-4459-af55-7db1747da55c tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91829) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:02:54.719654 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-29714c98-817b-4459-af55-7db1747da55c tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91829) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:02:54.720000 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-29714c98-817b-4459-af55-7db1747da55c tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91829) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:02:54.720345 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-29714c98-817b-4459-af55-7db1747da55c tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91829) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:02:54.720688 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-29714c98-817b-4459-af55-7db1747da55c tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91829) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:02:54.721025 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-29714c98-817b-4459-af55-7db1747da55c tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91829) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:02:54.721362 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-29714c98-817b-4459-af55-7db1747da55c tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91829) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:02:54.721697 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-29714c98-817b-4459-af55-7db1747da55c tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91829) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:02:54.722060 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-29714c98-817b-4459-af55-7db1747da55c tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91829) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:02:54.722401 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-29714c98-817b-4459-af55-7db1747da55c tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91829) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:02:54.722732 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-29714c98-817b-4459-af55-7db1747da55c tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91829) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:02:54.727461 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-29714c98-817b-4459-af55-7db1747da55c tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.126s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:02:55.288813 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-1768b4eb-dfc1-494b-9544-b68d09e79aae None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:02:55.337276 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-29714c98-817b-4459-af55-7db1747da55c tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Notify callbacks [] for floatingip, precommit_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:02:55.512318 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-29714c98-817b-4459-af55-7db1747da55c tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3832070'] for port, before_update {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:02:55.587782 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3e39af43-3810-4a96-88d6-85d147e31c88 req-45a063fc-c229-46c8-88ae-d1c968d6bbf9 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:02:55.589190 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-3e39af43-3810-4a96-88d6-85d147e31c88 req-45a063fc-c229-46c8-88ae-d1c968d6bbf9 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/ports?device_id=58da9205-0212-4daa-996c-1eef64a2b702 HTTP/1.1" status: 200 len: 945 time: 0.1539104 May 25 17:02:55.705497 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-3e39af43-3810-4a96-88d6-85d147e31c88 req-b91a5c75-4e74-4dd2-aad9-9a42cc304544 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/security-groups?id=8ee5c4ed-9c60-4e39-9185-7e283704a7dc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1007800 May 25 17:02:55.769614 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-29714c98-817b-4459-af55-7db1747da55c tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Notify callbacks [] for port, precommit_update {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:02:55.775124 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-29714c98-817b-4459-af55-7db1747da55c tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8757892955028', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8757892520933', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8757892521750', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28230801'] for port, after_update {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:02:55.779916 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-8b7ad329-1351-4080-af76-84380928ac8a admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:02:55.888089 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-29714c98-817b-4459-af55-7db1747da55c tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Pushing event updated for resources: {'Port': ['ID=9eb5148e-299d-412e-a8de-9f6e73bc63f0,revision_number=2']} {{(pid=91829) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:02:55.893275 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-29714c98-817b-4459-af55-7db1747da55c tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.113s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:02:55.900145 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-29714c98-817b-4459-af55-7db1747da55c tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-683033'] for floatingip, after_update {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:02:56.075642 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.db.l3_db [None req-29714c98-817b-4459-af55-7db1747da55c tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Floating IP 5efceaf8-e80b-4e6e-9280-121545183c1d associated. External IP: 172.27.2.103, port: d64889c5-b5bd-42be-aa18-7a6149a0a583. May 25 17:02:56.573542 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-29714c98-817b-4459-af55-7db1747da55c tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Router b37963ac-b2c2-4729-b4f8-6c604a1e5a2b has already been hosted by L3 agent a2d427c1-2d07-43e8-afbe-218c9f7d0445 {{(pid=91829) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 25 17:02:56.624610 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bf82a267-e0a2-4de5-a5ca-65bd60b5c894 req-f30de642-e096-4601-bac4-67cdd375d6e9 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91830) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:02:56.625385 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [req-bf82a267-e0a2-4de5-a5ca-65bd60b5c894 req-f30de642-e096-4601-bac4-67cdd375d6e9 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] Synchronizing usage tracker for tenant:734df673f8b3484d80f35a45fbce9d5e on resource:port {{(pid=91830) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 25 17:02:56.640516 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [req-bf82a267-e0a2-4de5-a5ca-65bd60b5c894 req-f30de642-e096-4601-bac4-67cdd375d6e9 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] Unset dirty status for tenant:734df673f8b3484d80f35a45fbce9d5e on resource:port {{(pid=91830) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 25 17:02:56.641971 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-bf82a267-e0a2-4de5-a5ca-65bd60b5c894 req-f30de642-e096-4601-bac4-67cdd375d6e9 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.32 "GET /v2.0/ports?device_id=58da9205-0212-4daa-996c-1eef64a2b702 HTTP/1.1" status: 200 len: 945 time: 0.1060109 May 25 17:02:56.650731 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b1322e5b-65b5-42eb-9005-8ce3198e7450 req-fa977628-395c-416a-aab7-0fef0f357bdd tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:02:56.652156 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-b1322e5b-65b5-42eb-9005-8ce3198e7450 req-fa977628-395c-416a-aab7-0fef0f357bdd tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] 10.222.0.62 "GET /v2.0/ports?device_id=0c32425a-15a9-4c9d-8e31-17183d4909c9 HTTP/1.1" status: 200 len: 946 time: 0.1630273 May 25 17:02:56.784536 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-b1322e5b-65b5-42eb-9005-8ce3198e7450 req-87d52853-cf67-49f7-b2bb-2bbe6db749cf tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] 10.222.0.62 "GET /v2.0/security-groups?id=f73b90a2-df48-48fb-99e0-5dd4d6a63a15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1242623 May 25 17:02:56.791295 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.plugins.ml2.plugin [req-bf82a267-e0a2-4de5-a5ca-65bd60b5c894 req-a1077313-36b0-401c-ab2d-0646413d44d4 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] Deleting port 60078444-24b6-4560-b0a7-7802c4f8f2f8 {{(pid=91830) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 25 17:02:56.791640 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [req-bf82a267-e0a2-4de5-a5ca-65bd60b5c894 req-a1077313-36b0-401c-ab2d-0646413d44d4 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8757892952899'] for port, before_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:02:56.804364 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-29714c98-817b-4459-af55-7db1747da55c tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Notify agent at l3_agent.dv-cinder-790492-4-iscsi the message routers_updated {{(pid=91829) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 25 17:02:56.816768 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-33140fc5-9995-470a-8605-188c73cd3bb5 None None] Sync routers for ids ['b37963ac-b2c2-4729-b4f8-6c604a1e5a2b'] in dv-cinder-790492-4-iscsi {{(pid=91832) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 25 17:02:56.833566 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.db.l3_dvrscheduler_db [None req-33140fc5-9995-470a-8605-188c73cd3bb5 None None] Routers {'b37963ac-b2c2-4729-b4f8-6c604a1e5a2b'} bound to L3 agent in host dv-cinder-790492-4-iscsi {{(pid=91832) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 17:02:56.834585 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.db.l3_hamode_db [None req-33140fc5-9995-470a-8605-188c73cd3bb5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-790492-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-05-25T16:50:28Z,description=,heartbeat_timestamp=2021-05-25T17:02:28Z,host='dv-cinder-790492-4-iscsi',id=a2d427c1-2d07-43e8-afbe-218c9f7d0445,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T16:50:28Z,topic='l3_agent')) {'router_ids': ['b37963ac-b2c2-4729-b4f8-6c604a1e5a2b'], 'active': True} {{(pid=91832) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 17:02:56.880150 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-29714c98-817b-4459-af55-7db1747da55c tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-178712'] for floatingip, before_response {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:02:56.940966 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [None req-29714c98-817b-4459-af55-7db1747da55c tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] 10.222.0.62 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 997 time: 2.9377441 May 25 17:02:56.942548 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '4413fd77-4f3e-40c8-b7ee-77d416cd7667', 'tag': 'd64889c5-b5bd-42be-aa18-7a6149a0a583'}] {{(pid=91829) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 25 17:02:56.943684 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.plugins.ml2.db [req-bf82a267-e0a2-4de5-a5ca-65bd60b5c894 req-a1077313-36b0-401c-ab2d-0646413d44d4 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] For port 60078444-24b6-4560-b0a7-7802c4f8f2f8, host hv-cinder-79049, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79049',level=0,port_id=60078444-24b6-4560-b0a7-7802c4f8f2f8,segment=NetworkSegment(f672477b-47fb-432c-acc9-dc57201d80de),segment_id=f672477b-47fb-432c-acc9-dc57201d80de)] {{(pid=91830) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 17:02:56.944234 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [req-bf82a267-e0a2-4de5-a5ca-65bd60b5c894 req-a1077313-36b0-401c-ab2d-0646413d44d4 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-683770'] for port, precommit_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:02:56.947315 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.wsgi [-] (91829) accepted ('10.222.0.62', 33412) {{(pid=91829) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:02:56.956880 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.v2.base [None req-e09f82d9-6a65-47c8-a32f-7d33de56463b tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-262025281', 'description': 'tempest-secgroup-smoke-262025281 description', 'project_id': '36c1ffa1d458478bac5893b2ddf98eda'}} {{(pid=91829) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 17:02:56.967445 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.quota.driver [None req-e09f82d9-6a65-47c8-a32f-7d33de56463b tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91829) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 17:02:56.973475 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.quota.resource [None req-e09f82d9-6a65-47c8-a32f-7d33de56463b tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Usage tracker for resource:security_group and tenant:36c1ffa1d458478bac5893b2ddf98eda is out of sync, need to count used quota {{(pid=91829) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 17:02:56.981177 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.quota.resource [None req-e09f82d9-6a65-47c8-a32f-7d33de56463b tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Quota usage for security_group was recalculated. Used quota:1. {{(pid=91829) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 17:02:56.987999 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.quota.driver [None req-e09f82d9-6a65-47c8-a32f-7d33de56463b tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=91829) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 17:02:57.004779 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-65ac5e3e-c99b-4d81-954e-729d97336c83 req-b1afa9c2-5ae6-40a8-88bf-b52e9f348e76 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:02:57.006620 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-65ac5e3e-c99b-4d81-954e-729d97336c83 req-b1afa9c2-5ae6-40a8-88bf-b52e9f348e76 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/ports?device_id=58da9205-0212-4daa-996c-1eef64a2b702 HTTP/1.1" status: 200 len: 945 time: 0.1834161 May 25 17:02:57.016542 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-e09f82d9-6a65-47c8-a32f-7d33de56463b tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Notify callbacks [] for security_group, before_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:02:57.064041 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.quota.driver [None req-e09f82d9-6a65-47c8-a32f-7d33de56463b tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91829) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 17:02:57.072190 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.quota.resource [None req-e09f82d9-6a65-47c8-a32f-7d33de56463b tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Usage tracker for resource:security_group_rule and tenant:36c1ffa1d458478bac5893b2ddf98eda is out of sync, need to count used quota {{(pid=91829) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 17:02:57.076493 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.quota.resource [None req-e09f82d9-6a65-47c8-a32f-7d33de56463b tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=91829) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 17:02:57.082132 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-65ac5e3e-c99b-4d81-954e-729d97336c83 req-b0c007a7-f5ae-450a-90c1-4f0ff283219f tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/security-groups?id=8ee5c4ed-9c60-4e39-9185-7e283704a7dc&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0686116 May 25 17:02:57.082323 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.plugins.ml2.plugin [req-bf82a267-e0a2-4de5-a5ca-65bd60b5c894 req-a1077313-36b0-401c-ab2d-0646413d44d4 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] Calling delete_port for 60078444-24b6-4560-b0a7-7802c4f8f2f8 owned by compute:nova {{(pid=91830) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 25 17:02:57.085847 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.quota.driver [None req-e09f82d9-6a65-47c8-a32f-7d33de56463b tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=91829) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 17:02:57.090008 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.db.l3_dvr_db [None req-33140fc5-9995-470a-8605-188c73cd3bb5 None None] Set router b37963ac-b2c2-4729-b4f8-6c604a1e5a2b gateway port host: dv-cinder-790492-4-iscsi {{(pid=91832) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 17:02:57.167593 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '4413fd77-4f3e-40c8-b7ee-77d416cd7667', 'tag': 'd64889c5-b5bd-42be-aa18-7a6149a0a583', 'status': 'completed', 'code': 200} May 25 17:02:57.184047 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-e09f82d9-6a65-47c8-a32f-7d33de56463b tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Notify callbacks [] for security_group, precommit_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:02:57.189109 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-e09f82d9-6a65-47c8-a32f-7d33de56463b tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-640836'] for security_group, after_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:02:57.195196 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-e99bee91-eeef-48a0-9efc-0b445f9f1ac0 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:02:57.229455 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e09f82d9-6a65-47c8-a32f-7d33de56463b tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Pushing event updated for resources: {'SecurityGroup': ['ID=8af4439c-b905-435b-836a-90c7f9007b51,revision_number=1']} {{(pid=91829) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:02:57.236205 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-e09f82d9-6a65-47c8-a32f-7d33de56463b tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.040s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:02:57.257128 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-e09f82d9-6a65-47c8-a32f-7d33de56463b tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Notify callbacks [] for security_group, before_response {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:02:57.263155 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [None req-e09f82d9-6a65-47c8-a32f-7d33de56463b tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] 10.222.0.62 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1792 time: 0.3134892 May 25 17:02:57.264050 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.wsgi [-] (91829) accepted ('10.222.0.62', 33420) {{(pid=91829) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:02:57.269603 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.v2.base [None req-52160227-8538-41fe-8f69-ae01c532d7c3 tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Request body: {'security_group_rule': {'security_group_id': '8af4439c-b905-435b-836a-90c7f9007b51', 'project_id': '36c1ffa1d458478bac5893b2ddf98eda', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=91829) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 17:02:57.276257 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.quota.driver [None req-52160227-8538-41fe-8f69-ae01c532d7c3 tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91829) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 17:02:57.280839 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.quota.resource [None req-52160227-8538-41fe-8f69-ae01c532d7c3 tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Usage tracker for resource:security_group_rule and tenant:36c1ffa1d458478bac5893b2ddf98eda is out of sync, need to count used quota {{(pid=91829) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 17:02:57.286280 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.quota.resource [None req-52160227-8538-41fe-8f69-ae01c532d7c3 tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=91829) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 17:02:57.295947 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.quota.driver [None req-52160227-8538-41fe-8f69-ae01c532d7c3 tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=91829) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 17:02:57.312908 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [req-bf82a267-e0a2-4de5-a5ca-65bd60b5c894 req-a1077313-36b0-401c-ab2d-0646413d44d4 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8757892955046', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8757892520924', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-27483019'] for port, after_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:02:57.317922 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-52160227-8538-41fe-8f69-ae01c532d7c3 tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Notify callbacks [] for security_group_rule, before_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:02:57.325696 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:02:57.329593 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.db [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] get_ports_and_sgs() called for port_ids ['60078444-24b6-4560-b0a7-7802c4f8f2f8'] {{(pid=91831) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 25 17:02:57.374704 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a1077313-36b0-401c-ab2d-0646413d44d4 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] Pushing event deleted for resources: {'Port': ['ID=60078444-24b6-4560-b0a7-7802c4f8f2f8,revision_number=None']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:02:57.387955 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-a1077313-36b0-401c-ab2d-0646413d44d4 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.062s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:02:57.463396 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-52160227-8538-41fe-8f69-ae01c532d7c3 tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:02:57.466467 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.l3_dvrscheduler_db [req-bf82a267-e0a2-4de5-a5ca-65bd60b5c894 req-a1077313-36b0-401c-ab2d-0646413d44d4 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] No DVR routers for this DVR port 60078444-24b6-4560-b0a7-7802c4f8f2f8 on host hv-cinder-79049 {{(pid=91830) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 25 17:02:57.470082 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [req-bf82a267-e0a2-4de5-a5ca-65bd60b5c894 req-a1077313-36b0-401c-ab2d-0646413d44d4 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-178712'] for port, before_response {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:02:57.470730 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-52160227-8538-41fe-8f69-ae01c532d7c3 tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-640874'] for security_group_rule, after_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:02:57.472700 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '58da9205-0212-4daa-996c-1eef64a2b702', 'name': 'network-vif-deleted', 'tag': '60078444-24b6-4560-b0a7-7802c4f8f2f8'}] {{(pid=91830) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 25 17:02:57.475506 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:02:57.494916 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-088f467f-7058-4085-9d0b-e24e6e37a9e6 req-03c92baa-821d-41eb-a3d3-e4fbf49500cb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91830) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:02:57.496474 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-088f467f-7058-4085-9d0b-e24e6e37a9e6 req-03c92baa-821d-41eb-a3d3-e4fbf49500cb service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=36c1ffa1d458478bac5893b2ddf98eda&device_id=4413fd77-4f3e-40c8-b7ee-77d416cd7667 HTTP/1.1" status: 200 len: 1099 time: 0.2548249 May 25 17:02:57.497868 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7a7c1fed-c03a-424b-a58b-e6c70b441f65 req-0ec3b69d-222a-4462-b2c7-19aef5b1302d tempest-VolumesSnapshotTestJSON-991813121 tempest-VolumesSnapshotTestJSON-991813121-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:02:57.498314 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-bf82a267-e0a2-4de5-a5ca-65bd60b5c894 req-a1077313-36b0-401c-ab2d-0646413d44d4 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.32 "DELETE /v2.0/ports/60078444-24b6-4560-b0a7-7802c4f8f2f8 HTTP/1.1" status: 204 len: 173 time: 0.8462071 May 25 17:02:57.499386 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-7a7c1fed-c03a-424b-a58b-e6c70b441f65 req-0ec3b69d-222a-4462-b2c7-19aef5b1302d tempest-VolumesSnapshotTestJSON-991813121 tempest-VolumesSnapshotTestJSON-991813121-project] 10.222.0.62 "GET /v2.0/ports?device_id=5cf3f093-ba27-473b-93f8-52a5bb9d9ec8 HTTP/1.1" status: 200 len: 945 time: 0.1517262 May 25 17:02:57.504234 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-52160227-8538-41fe-8f69-ae01c532d7c3 tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=5a7fa44b-2e27-46aa-a4ac-62032fb25451,revision_number=0']} {{(pid=91829) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:02:57.514748 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-52160227-8538-41fe-8f69-ae01c532d7c3 tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.039s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:02:57.552040 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-52160227-8538-41fe-8f69-ae01c532d7c3 tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Notify callbacks [] for security_group_rule, before_response {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:02:57.553472 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [None req-52160227-8538-41fe-8f69-ae01c532d7c3 tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] 10.222.0.62 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.2880926 May 25 17:02:57.556309 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.wsgi [-] (91830) accepted ('10.222.0.62', 33426) {{(pid=91830) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:02:57.564886 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-7a7c1fed-c03a-424b-a58b-e6c70b441f65 req-9debfd2d-6182-4de8-9a66-30ef033b2649 tempest-VolumesSnapshotTestJSON-991813121 tempest-VolumesSnapshotTestJSON-991813121-project] 10.222.0.62 "GET /v2.0/security-groups?id=b5f47757-8dd4-4226-9a13-ca15ee498213&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0540664 May 25 17:02:57.595150 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.db.l3_hamode_db [None req-33140fc5-9995-470a-8605-188c73cd3bb5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'b37963ac-b2c2-4729-b4f8-6c604a1e5a2b', 'name': 'tempest-TestMinimumBasicScenario-1175520845-router', 'tenant_id': '36c1ffa1d458478bac5893b2ddf98eda', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'external_fixed_ips': [{'subnet_id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'ip_address': '172.27.2.22'}], 'enable_snat': True}, 'gw_port_id': 'abb48be3-09be-464d-887e-584de580da17', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T17:01:12Z', 'updated_at': '2021-05-25T17:01:17Z', 'revision_number': 4, 'project_id': '36c1ffa1d458478bac5893b2ddf98eda', 'gw_port': {'id': 'abb48be3-09be-464d-887e-584de580da17', 'name': '', 'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'tenant_id': '', 'mac_address': 'fa:16:3e:3f:15:26', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b37963ac-b2c2-4729-b4f8-6c604a1e5a2b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 432, 'fixed_ips': [{'subnet_id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'ip_address': '172.27.2.22', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790492-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:01:13Z', 'updated_at': '2021-05-25T17:01:20Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-790492-4-iscsi', '_floatingips': [{'id': '5efceaf8-e80b-4e6e-9280-121545183c1d', 'tenant_id': '36c1ffa1d458478bac5893b2ddf98eda', 'floating_ip_address': '172.27.2.103', 'floating_network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'router_id': 'b37963ac-b2c2-4729-b4f8-6c604a1e5a2b', 'port_id': 'd64889c5-b5bd-42be-aa18-7a6149a0a583', 'fixed_ip_address': '172.20.0.12', 'status': 'DOWN', 'standard_attr_id': 457, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'f3ddbe01-13f7-4e15-b7da-2bdffc278cb7', 'mac_address': 'fa:16:3e:81:db:29', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4413fd77-4f3e-40c8-b7ee-77d416cd7667', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-25T17:02:55Z', 'updated_at': '2021-05-25T17:02:55Z', 'revision_number': 0, 'project_id': '36c1ffa1d458478bac5893b2ddf98eda', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'bcd1bd96-7471-48e7-844a-de3c2de0ab2b', 'name': '', 'network_id': 'f3ddbe01-13f7-4e15-b7da-2bdffc278cb7', 'tenant_id': '36c1ffa1d458478bac5893b2ddf98eda', 'mac_address': 'fa:16:3e:a1:cb:e4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b37963ac-b2c2-4729-b4f8-6c604a1e5a2b', 'device_owner': 'network:router_interface', 'standard_attr_id': 433, 'fixed_ips': [{'subnet_id': '69fba530-cce2-44a2-89bd-18a52f9d454c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790492-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:01:16Z', 'updated_at': '2021-05-25T17:01:24Z', 'revision_number': 5, 'project_id': '36c1ffa1d458478bac5893b2ddf98eda', 'subnets': [{'id': '69fba530-cce2-44a2-89bd-18a52f9d454c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-790492-4-iscsi', False) {} {{(pid=91832) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 17:02:57.599765 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-33140fc5-9995-470a-8605-188c73cd3bb5 None None] Checking router: b37963ac-b2c2-4729-b4f8-6c604a1e5a2b for host: dv-cinder-790492-4-iscsi {{(pid=91832) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 25 17:02:57.608549 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.db.l3_dvrscheduler_db [None req-33140fc5-9995-470a-8605-188c73cd3bb5 None None] Routers {'b37963ac-b2c2-4729-b4f8-6c604a1e5a2b'} bound to L3 agent in host dv-cinder-790492-4-iscsi {{(pid=91832) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 17:02:57.609991 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.db.l3_hamode_db [None req-33140fc5-9995-470a-8605-188c73cd3bb5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-790492-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-05-25T16:50:28Z,description=,heartbeat_timestamp=2021-05-25T17:02:28Z,host='dv-cinder-790492-4-iscsi',id=a2d427c1-2d07-43e8-afbe-218c9f7d0445,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T16:50:28Z,topic='l3_agent')) {'router_ids': ['b37963ac-b2c2-4729-b4f8-6c604a1e5a2b'], 'active': True} {{(pid=91832) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 17:02:57.617453 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.v2.base [None req-0a0bc2c7-4893-4870-bed2-fcdafac72547 tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Request body: {'security_group_rule': {'security_group_id': '8af4439c-b905-435b-836a-90c7f9007b51', 'project_id': '36c1ffa1d458478bac5893b2ddf98eda', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=91830) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 17:02:57.623287 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.quota.driver [None req-0a0bc2c7-4893-4870-bed2-fcdafac72547 tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91830) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 17:02:57.627505 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [None req-0a0bc2c7-4893-4870-bed2-fcdafac72547 tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Usage tracker for resource:security_group_rule and tenant:36c1ffa1d458478bac5893b2ddf98eda is out of sync, need to count used quota {{(pid=91830) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 17:02:57.630998 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [None req-0a0bc2c7-4893-4870-bed2-fcdafac72547 tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Quota usage for security_group_rule was recalculated. Used quota:7. {{(pid=91830) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 17:02:57.638816 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '58da9205-0212-4daa-996c-1eef64a2b702', 'name': 'network-vif-deleted', 'tag': '60078444-24b6-4560-b0a7-7802c4f8f2f8', 'status': 'completed', 'code': 200} May 25 17:02:57.641785 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.quota.driver [None req-0a0bc2c7-4893-4870-bed2-fcdafac72547 tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 7; quota limit: 100; headroom:93 {{(pid=91830) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 17:02:57.680004 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-0a0bc2c7-4893-4870-bed2-fcdafac72547 tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Notify callbacks [] for security_group_rule, before_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:02:57.683285 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-29f999a6-f8f4-4e29-84f1-7400c038ca5e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:02:57.763064 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-088f467f-7058-4085-9d0b-e24e6e37a9e6 req-68a51645-14a3-465e-a14e-803b5c52b8ff service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91830) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:02:57.764531 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-088f467f-7058-4085-9d0b-e24e6e37a9e6 req-68a51645-14a3-465e-a14e-803b5c52b8ff service neutron] 10.222.0.32 "GET /v2.0/networks?id=f3ddbe01-13f7-4e15-b7da-2bdffc278cb7 HTTP/1.1" status: 200 len: 916 time: 0.2422202 May 25 17:02:57.815415 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.db.l3_dvr_db [None req-33140fc5-9995-470a-8605-188c73cd3bb5 None None] Set router b37963ac-b2c2-4729-b4f8-6c604a1e5a2b gateway port host: dv-cinder-790492-4-iscsi {{(pid=91832) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 17:02:57.838192 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-0a0bc2c7-4893-4870-bed2-fcdafac72547 tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:02:57.857178 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-0a0bc2c7-4893-4870-bed2-fcdafac72547 tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-640874'] for security_group_rule, after_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:02:57.870997 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:02:57.883714 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:02:57.900236 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-0a0bc2c7-4893-4870-bed2-fcdafac72547 tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Notify callbacks [] for security_group_rule, before_response {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:02:57.902367 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [None req-0a0bc2c7-4893-4870-bed2-fcdafac72547 tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] 10.222.0.62 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.3450692 May 25 17:02:57.904154 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.wsgi [-] (91829) accepted ('10.222.0.62', 33434) {{(pid=91829) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:02:57.908716 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0a0bc2c7-4893-4870-bed2-fcdafac72547 tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=b3247ce3-884e-4aef-9357-d43eb360655c,revision_number=0']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:02:57.912026 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-0a0bc2c7-4893-4870-bed2-fcdafac72547 tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.028s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:02:57.918919 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.v2.base [None req-7f969274-dac6-4c59-a4c0-c851c8ee191e tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Request body: {'security_group_rule': {'security_group_id': '8af4439c-b905-435b-836a-90c7f9007b51', 'project_id': '36c1ffa1d458478bac5893b2ddf98eda', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=91829) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 17:02:57.926577 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.quota.driver [None req-7f969274-dac6-4c59-a4c0-c851c8ee191e tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91829) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 17:02:57.931446 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.quota.resource [None req-7f969274-dac6-4c59-a4c0-c851c8ee191e tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Usage tracker for resource:security_group_rule and tenant:36c1ffa1d458478bac5893b2ddf98eda is out of sync, need to count used quota {{(pid=91829) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 17:02:57.932810 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-088f467f-7058-4085-9d0b-e24e6e37a9e6 req-0cbeb7e0-f703-4d6d-9379-5fa5023bfe53 service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=d64889c5-b5bd-42be-aa18-7a6149a0a583 HTTP/1.1" status: 200 len: 1000 time: 0.1501763 May 25 17:02:57.935295 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.quota.resource [None req-7f969274-dac6-4c59-a4c0-c851c8ee191e tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Quota usage for security_group_rule was recalculated. Used quota:8. {{(pid=91829) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 17:02:57.979125 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.quota.driver [None req-7f969274-dac6-4c59-a4c0-c851c8ee191e tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 8; quota limit: 100; headroom:92 {{(pid=91829) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 17:02:58.004175 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-088f467f-7058-4085-9d0b-e24e6e37a9e6 req-9fdbc12e-28e0-4eec-b3ea-95f4e6df3fa7 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91830) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:02:58.005607 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-088f467f-7058-4085-9d0b-e24e6e37a9e6 req-9fdbc12e-28e0-4eec-b3ea-95f4e6df3fa7 service neutron] 10.222.0.32 "GET /v2.0/subnets?id=69fba530-cce2-44a2-89bd-18a52f9d454c HTTP/1.1" status: 200 len: 854 time: 0.0643215 May 25 17:02:58.019309 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-7f969274-dac6-4c59-a4c0-c851c8ee191e tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Notify callbacks [] for security_group_rule, before_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:02:58.085814 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9e992749-783e-4df4-901b-5bc2a9531488 req-6092117e-03e7-47ad-91c2-4b5a1cd5bee4 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:02:58.086874 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-9e992749-783e-4df4-901b-5bc2a9531488 req-6092117e-03e7-47ad-91c2-4b5a1cd5bee4 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] 10.222.0.62 "GET /v2.0/ports?device_id=0c32425a-15a9-4c9d-8e31-17183d4909c9 HTTP/1.1" status: 200 len: 946 time: 0.1468349 May 25 17:02:58.090176 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-088f467f-7058-4085-9d0b-e24e6e37a9e6 req-74ab3e2e-8ddc-4fbd-b82c-e480f3fe4cf8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91830) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:02:58.091847 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-088f467f-7058-4085-9d0b-e24e6e37a9e6 req-74ab3e2e-8ddc-4fbd-b82c-e480f3fe4cf8 service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=f3ddbe01-13f7-4e15-b7da-2bdffc278cb7&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0751548 May 25 17:02:58.132268 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-7f969274-dac6-4c59-a4c0-c851c8ee191e tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:02:58.142945 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-7f969274-dac6-4c59-a4c0-c851c8ee191e tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-640874'] for security_group_rule, after_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:02:58.155410 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-32aa12bf-0b66-4533-8939-7a3b6367bcba tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:02:58.177244 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-9e992749-783e-4df4-901b-5bc2a9531488 req-84a7dd67-679b-4b20-981f-20c9736bd959 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] 10.222.0.62 "GET /v2.0/security-groups?id=f73b90a2-df48-48fb-99e0-5dd4d6a63a15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0841355 May 25 17:02:58.189102 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7f969274-dac6-4c59-a4c0-c851c8ee191e tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=0b00cbd7-fccf-4e00-a8ef-d81dd509635e,revision_number=0']} {{(pid=91829) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:02:58.193268 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-7f969274-dac6-4c59-a4c0-c851c8ee191e tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.038s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:02:58.202640 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-7f969274-dac6-4c59-a4c0-c851c8ee191e tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Notify callbacks [] for security_group_rule, before_response {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:02:58.204818 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [None req-7f969274-dac6-4c59-a4c0-c851c8ee191e tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] 10.222.0.62 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.2992966 May 25 17:02:58.207931 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.wsgi [-] (91829) accepted ('10.222.0.62', 33440) {{(pid=91829) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:02:58.219410 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.v2.base [None req-062a1495-3781-4851-aa2f-03c9bc04a805 tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Request body: {'security_group_rule': {'security_group_id': '8af4439c-b905-435b-836a-90c7f9007b51', 'project_id': '36c1ffa1d458478bac5893b2ddf98eda', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=91829) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 17:02:58.225988 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.quota.driver [None req-062a1495-3781-4851-aa2f-03c9bc04a805 tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91829) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 17:02:58.229974 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.quota.resource [None req-062a1495-3781-4851-aa2f-03c9bc04a805 tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Usage tracker for resource:security_group_rule and tenant:36c1ffa1d458478bac5893b2ddf98eda is out of sync, need to count used quota {{(pid=91829) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 17:02:58.233874 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.quota.resource [None req-062a1495-3781-4851-aa2f-03c9bc04a805 tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Quota usage for security_group_rule was recalculated. Used quota:9. {{(pid=91829) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 17:02:58.243133 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.quota.driver [None req-062a1495-3781-4851-aa2f-03c9bc04a805 tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 9; quota limit: 100; headroom:91 {{(pid=91829) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 17:02:58.245247 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.db.l3_hamode_db [None req-33140fc5-9995-470a-8605-188c73cd3bb5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'b37963ac-b2c2-4729-b4f8-6c604a1e5a2b', 'name': 'tempest-TestMinimumBasicScenario-1175520845-router', 'tenant_id': '36c1ffa1d458478bac5893b2ddf98eda', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'external_fixed_ips': [{'subnet_id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'ip_address': '172.27.2.22'}], 'enable_snat': True}, 'gw_port_id': 'abb48be3-09be-464d-887e-584de580da17', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T17:01:12Z', 'updated_at': '2021-05-25T17:01:17Z', 'revision_number': 4, 'project_id': '36c1ffa1d458478bac5893b2ddf98eda', 'gw_port': {'id': 'abb48be3-09be-464d-887e-584de580da17', 'name': '', 'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'tenant_id': '', 'mac_address': 'fa:16:3e:3f:15:26', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b37963ac-b2c2-4729-b4f8-6c604a1e5a2b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 432, 'fixed_ips': [{'subnet_id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'ip_address': '172.27.2.22', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790492-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:01:13Z', 'updated_at': '2021-05-25T17:01:20Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-790492-4-iscsi', '_floatingips': [{'id': '5efceaf8-e80b-4e6e-9280-121545183c1d', 'tenant_id': '36c1ffa1d458478bac5893b2ddf98eda', 'floating_ip_address': '172.27.2.103', 'floating_network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'router_id': 'b37963ac-b2c2-4729-b4f8-6c604a1e5a2b', 'port_id': 'd64889c5-b5bd-42be-aa18-7a6149a0a583', 'fixed_ip_address': '172.20.0.12', 'status': 'DOWN', 'standard_attr_id': 457, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'f3ddbe01-13f7-4e15-b7da-2bdffc278cb7', 'mac_address': 'fa:16:3e:81:db:29', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4413fd77-4f3e-40c8-b7ee-77d416cd7667', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-25T17:02:55Z', 'updated_at': '2021-05-25T17:02:55Z', 'revision_number': 0, 'project_id': '36c1ffa1d458478bac5893b2ddf98eda', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'bcd1bd96-7471-48e7-844a-de3c2de0ab2b', 'name': '', 'network_id': 'f3ddbe01-13f7-4e15-b7da-2bdffc278cb7', 'tenant_id': '36c1ffa1d458478bac5893b2ddf98eda', 'mac_address': 'fa:16:3e:a1:cb:e4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b37963ac-b2c2-4729-b4f8-6c604a1e5a2b', 'device_owner': 'network:router_interface', 'standard_attr_id': 433, 'fixed_ips': [{'subnet_id': '69fba530-cce2-44a2-89bd-18a52f9d454c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790492-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:01:16Z', 'updated_at': '2021-05-25T17:01:24Z', 'revision_number': 5, 'project_id': '36c1ffa1d458478bac5893b2ddf98eda', 'subnets': [{'id': '69fba530-cce2-44a2-89bd-18a52f9d454c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-790492-4-iscsi', False) {} {{(pid=91832) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 17:02:58.251461 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-33140fc5-9995-470a-8605-188c73cd3bb5 None None] The sync data for ids ['b37963ac-b2c2-4729-b4f8-6c604a1e5a2b'] in dv-cinder-790492-4-iscsi is: [{'id': 'b37963ac-b2c2-4729-b4f8-6c604a1e5a2b', 'name': 'tempest-TestMinimumBasicScenario-1175520845-router', 'tenant_id': '36c1ffa1d458478bac5893b2ddf98eda', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'external_fixed_ips': [{'subnet_id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'ip_address': '172.27.2.22'}], 'enable_snat': True}, 'gw_port_id': 'abb48be3-09be-464d-887e-584de580da17', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T17:01:12Z', 'updated_at': '2021-05-25T17:01:17Z', 'revision_number': 4, 'project_id': '36c1ffa1d458478bac5893b2ddf98eda', 'gw_port': {'id': 'abb48be3-09be-464d-887e-584de580da17', 'name': '', 'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'tenant_id': '', 'mac_address': 'fa:16:3e:3f:15:26', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b37963ac-b2c2-4729-b4f8-6c604a1e5a2b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 432, 'fixed_ips': [{'subnet_id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'ip_address': '172.27.2.22', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790492-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:01:13Z', 'updated_at': '2021-05-25T17:01:20Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-790492-4-iscsi', '_floatingips': [{'id': '5efceaf8-e80b-4e6e-9280-121545183c1d', 'tenant_id': '36c1ffa1d458478bac5893b2ddf98eda', 'floating_ip_address': '172.27.2.103', 'floating_network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'router_id': 'b37963ac-b2c2-4729-b4f8-6c604a1e5a2b', 'port_id': 'd64889c5-b5bd-42be-aa18-7a6149a0a583', 'fixed_ip_address': '172.20.0.12', 'status': 'DOWN', 'standard_attr_id': 457, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'f3ddbe01-13f7-4e15-b7da-2bdffc278cb7', 'mac_address': 'fa:16:3e:81:db:29', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4413fd77-4f3e-40c8-b7ee-77d416cd7667', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-25T17:02:55Z', 'updated_at': '2021-05-25T17:02:55Z', 'revision_number': 0, 'project_id': '36c1ffa1d458478bac5893b2ddf98eda', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'bcd1bd96-7471-48e7-844a-de3c2de0ab2b', 'name': '', 'network_id': 'f3ddbe01-13f7-4e15-b7da-2bdffc278cb7', 'tenant_id': '36c1ffa1d458478bac5893b2ddf98eda', 'mac_address': 'fa:16:3e:a1:cb:e4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b37963ac-b2c2-4729-b4f8-6c604a1e5a2b', 'device_owner': 'network:router_interface', 'standard_attr_id': 433, 'fixed_ips': [{'subnet_id': '69fba530-cce2-44a2-89bd-18a52f9d454c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790492-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:01:16Z', 'updated_at': '2021-05-25T17:01:24Z', 'revision_number': 5, 'project_id': '36c1ffa1d458478bac5893b2ddf98eda', 'subnets': [{'id': '69fba530-cce2-44a2-89bd-18a52f9d454c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=91832) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 25 17:02:58.269301 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-062a1495-3781-4851-aa2f-03c9bc04a805 tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Notify callbacks [] for security_group_rule, before_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:02:58.308064 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-088f467f-7058-4085-9d0b-e24e6e37a9e6 req-fbe44e01-9441-4fc5-babc-68d51ea062f6 service neutron] 10.222.0.32 "GET /v2.0/networks/f3ddbe01-13f7-4e15-b7da-2bdffc278cb7?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2057533 May 25 17:02:58.391061 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-062a1495-3781-4851-aa2f-03c9bc04a805 tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:02:58.393661 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-cd4c750c-eb0c-47aa-a03e-e3ddecf3a9e0 req-2ee6cba3-daee-4213-b95b-68360b5823d3 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] 10.222.0.62 "GET /v2.0/ports?device_id=58da9205-0212-4daa-996c-1eef64a2b702 HTTP/1.1" status: 200 len: 210 time: 0.0546796 May 25 17:02:58.394945 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-062a1495-3781-4851-aa2f-03c9bc04a805 tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-640874'] for security_group_rule, after_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:02:58.397634 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:02:58.418908 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-062a1495-3781-4851-aa2f-03c9bc04a805 tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=4b173f86-b7e4-4fbd-aadc-a2f3985fee77,revision_number=0']} {{(pid=91829) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:02:58.424554 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-062a1495-3781-4851-aa2f-03c9bc04a805 tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.026s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:02:58.431415 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-062a1495-3781-4851-aa2f-03c9bc04a805 tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Notify callbacks [] for security_group_rule, before_response {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:02:58.432673 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [None req-062a1495-3781-4851-aa2f-03c9bc04a805 tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] 10.222.0.62 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.2236660 May 25 17:02:58.435800 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.wsgi [-] (91829) accepted ('10.222.0.62', 33444) {{(pid=91829) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:02:58.441554 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.v2.base [None req-7b69127f-9cf6-4c98-ac35-701caf89b731 tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Request body: {'security_group_rule': {'security_group_id': '8af4439c-b905-435b-836a-90c7f9007b51', 'project_id': '36c1ffa1d458478bac5893b2ddf98eda', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=91829) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 17:02:58.447363 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.quota.driver [None req-7b69127f-9cf6-4c98-ac35-701caf89b731 tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91829) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 17:02:58.451289 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.quota.resource [None req-7b69127f-9cf6-4c98-ac35-701caf89b731 tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Usage tracker for resource:security_group_rule and tenant:36c1ffa1d458478bac5893b2ddf98eda is out of sync, need to count used quota {{(pid=91829) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 17:02:58.454824 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.quota.resource [None req-7b69127f-9cf6-4c98-ac35-701caf89b731 tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Quota usage for security_group_rule was recalculated. Used quota:10. {{(pid=91829) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 17:02:58.460681 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.quota.driver [None req-7b69127f-9cf6-4c98-ac35-701caf89b731 tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 10; quota limit: 100; headroom:90 {{(pid=91829) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 17:02:58.470986 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.db.securitygroups_db [None req-7b69127f-9cf6-4c98-ac35-701caf89b731 tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Project 36c1ffa1d458478bac5893b2ddf98eda added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. May 25 17:02:58.477131 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-7b69127f-9cf6-4c98-ac35-701caf89b731 tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Notify callbacks [] for security_group_rule, before_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:02:58.480177 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-088f467f-7058-4085-9d0b-e24e6e37a9e6 req-cac4fb96-6d9e-4c1b-9cda-102598011f2b service neutron] 10.222.0.32 "GET /v2.0/networks/f3ddbe01-13f7-4e15-b7da-2bdffc278cb7?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1636384 May 25 17:02:58.522121 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-749db6e1-dffe-406b-ba49-394caa685b0e None None] New status for floating IP 5efceaf8-e80b-4e6e-9280-121545183c1d: ACTIVE {{(pid=91831) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} May 25 17:02:58.547113 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-7b69127f-9cf6-4c98-ac35-701caf89b731 tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:02:58.550927 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-7b69127f-9cf6-4c98-ac35-701caf89b731 tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-640874'] for security_group_rule, after_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:02:58.553105 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:02:58.575221 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7b69127f-9cf6-4c98-ac35-701caf89b731 tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=9135912e-440e-42a5-8b16-a58f49500200,revision_number=0']} {{(pid=91829) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:02:58.579741 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-7b69127f-9cf6-4c98-ac35-701caf89b731 tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.027s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:02:58.585195 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-7b69127f-9cf6-4c98-ac35-701caf89b731 tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Notify callbacks [] for security_group_rule, before_response {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:02:58.586406 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [None req-7b69127f-9cf6-4c98-ac35-701caf89b731 tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] 10.222.0.62 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 774 time: 0.1496761 May 25 17:02:58.589355 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.wsgi [-] (91830) accepted ('10.222.0.62', 33448) {{(pid=91830) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:02:58.595088 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.v2.base [None req-f637ca7f-d248-46f1-8e22-b8ca54674981 tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Request body: {'security_group_rule': {'security_group_id': '8af4439c-b905-435b-836a-90c7f9007b51', 'project_id': '36c1ffa1d458478bac5893b2ddf98eda', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=91830) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 17:02:58.602120 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.quota.driver [None req-f637ca7f-d248-46f1-8e22-b8ca54674981 tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91830) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 17:02:58.605833 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [None req-f637ca7f-d248-46f1-8e22-b8ca54674981 tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Usage tracker for resource:security_group_rule and tenant:36c1ffa1d458478bac5893b2ddf98eda is out of sync, need to count used quota {{(pid=91830) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 17:02:58.610445 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [None req-f637ca7f-d248-46f1-8e22-b8ca54674981 tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Quota usage for security_group_rule was recalculated. Used quota:11. {{(pid=91830) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 17:02:58.616766 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.quota.driver [None req-f637ca7f-d248-46f1-8e22-b8ca54674981 tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 11; quota limit: 100; headroom:89 {{(pid=91830) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 17:02:58.626945 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-0a55eb4a-8b57-4233-84d6-6b423b4ed6db None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:02:58.629601 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.db.securitygroups_db [None req-f637ca7f-d248-46f1-8e22-b8ca54674981 tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Project 36c1ffa1d458478bac5893b2ddf98eda added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. May 25 17:02:58.636067 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-f637ca7f-d248-46f1-8e22-b8ca54674981 tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Notify callbacks [] for security_group_rule, before_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:02:58.792667 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-f637ca7f-d248-46f1-8e22-b8ca54674981 tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:02:58.797802 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-f637ca7f-d248-46f1-8e22-b8ca54674981 tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-640874'] for security_group_rule, after_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:02:58.800348 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-0a0bc2c7-4893-4870-bed2-fcdafac72547 tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:02:58.824617 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1b05ca40-9933-4bd3-9000-a7aa9720523d req-160f4692-80ff-4566-a412-d2cf521a1061 tempest-VolumesSnapshotTestJSON-991813121 tempest-VolumesSnapshotTestJSON-991813121-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:02:58.826151 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-1b05ca40-9933-4bd3-9000-a7aa9720523d req-160f4692-80ff-4566-a412-d2cf521a1061 tempest-VolumesSnapshotTestJSON-991813121 tempest-VolumesSnapshotTestJSON-991813121-project] 10.222.0.62 "GET /v2.0/ports?device_id=5cf3f093-ba27-473b-93f8-52a5bb9d9ec8 HTTP/1.1" status: 200 len: 945 time: 0.1424201 May 25 17:02:58.831388 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f637ca7f-d248-46f1-8e22-b8ca54674981 tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=9de92aa5-a3f5-4d1c-9fd9-33dfe401081a,revision_number=0']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:02:58.841418 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-f637ca7f-d248-46f1-8e22-b8ca54674981 tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.041s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:02:58.845771 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-f637ca7f-d248-46f1-8e22-b8ca54674981 tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Notify callbacks [] for security_group_rule, before_response {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:02:58.849730 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [None req-f637ca7f-d248-46f1-8e22-b8ca54674981 tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] 10.222.0.62 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 773 time: 0.2567763 May 25 17:02:58.877099 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-1b05ca40-9933-4bd3-9000-a7aa9720523d req-630fdc9e-a0b7-4bc4-9049-da28b2ce10b1 tempest-VolumesSnapshotTestJSON-991813121 tempest-VolumesSnapshotTestJSON-991813121-project] 10.222.0.62 "GET /v2.0/security-groups?id=b5f47757-8dd4-4226-9a13-ca15ee498213&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0433726 May 25 17:02:59.006156 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.quota.resource [req-42b42f67-aa38-4ad9-8247-bb91d2ffa043 req-8e87745a-7317-4691-86ef-ed4625e4d6a2 tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Synchronizing usage tracker for tenant:36c1ffa1d458478bac5893b2ddf98eda on resource:security_group {{(pid=91829) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 25 17:02:59.022293 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.quota.resource [req-42b42f67-aa38-4ad9-8247-bb91d2ffa043 req-8e87745a-7317-4691-86ef-ed4625e4d6a2 tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Unset dirty status for tenant:36c1ffa1d458478bac5893b2ddf98eda on resource:security_group {{(pid=91829) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 25 17:02:59.023509 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-42b42f67-aa38-4ad9-8247-bb91d2ffa043 req-8e87745a-7317-4691-86ef-ed4625e4d6a2 tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] 10.222.0.62 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-262025281&fields=id&tenant_id=36c1ffa1d458478bac5893b2ddf98eda HTTP/1.1" status: 200 len: 267 time: 0.0562232 May 25 17:02:59.059461 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3997b9b4-bca1-49fe-bee6-ce6b4d41be3e req-6f219908-e5ff-491f-9578-4633dbf5c21d tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91830) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:02:59.060146 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [req-3997b9b4-bca1-49fe-bee6-ce6b4d41be3e req-6f219908-e5ff-491f-9578-4633dbf5c21d tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] Synchronizing usage tracker for tenant:04e8022f24e3464ab1ab7726d6a07e08 on resource:port {{(pid=91830) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 25 17:02:59.071624 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [req-3997b9b4-bca1-49fe-bee6-ce6b4d41be3e req-6f219908-e5ff-491f-9578-4633dbf5c21d tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] Unset dirty status for tenant:04e8022f24e3464ab1ab7726d6a07e08 on resource:port {{(pid=91830) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 25 17:02:59.072693 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-3997b9b4-bca1-49fe-bee6-ce6b4d41be3e req-6f219908-e5ff-491f-9578-4633dbf5c21d tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] 10.222.0.32 "GET /v2.0/ports?device_id=0c32425a-15a9-4c9d-8e31-17183d4909c9 HTTP/1.1" status: 200 len: 946 time: 0.0917230 May 25 17:02:59.197257 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-42b42f67-aa38-4ad9-8247-bb91d2ffa043 req-04b39b20-8a29-465f-b7d0-5377de50a0a4 tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:02:59.198831 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-42b42f67-aa38-4ad9-8247-bb91d2ffa043 req-04b39b20-8a29-465f-b7d0-5377de50a0a4 tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] 10.222.0.62 "GET /v2.0/ports?device_id=4413fd77-4f3e-40c8-b7ee-77d416cd7667 HTTP/1.1" status: 200 len: 946 time: 0.1692019 May 25 17:02:59.209765 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.v2.base [req-42b42f67-aa38-4ad9-8247-bb91d2ffa043 req-e55415eb-7371-4b80-a3e5-6a95a9b61f3b tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Request body: {'port': {'security_groups': ['d7d845a2-937c-4f26-ac5a-1b178146b05e', '8af4439c-b905-435b-836a-90c7f9007b51']}} {{(pid=91829) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 17:02:59.211652 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.plugins.ml2.plugin [req-3997b9b4-bca1-49fe-bee6-ce6b4d41be3e req-53aed091-e8c2-4860-9ae4-0e2389881683 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] Deleting port 993b7d31-308c-4414-910f-1a10bea6ed57 {{(pid=91830) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 25 17:02:59.211994 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [req-3997b9b4-bca1-49fe-bee6-ce6b4d41be3e req-53aed091-e8c2-4860-9ae4-0e2389881683 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8757892952899'] for port, before_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:02:59.362495 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.plugins.ml2.db [req-3997b9b4-bca1-49fe-bee6-ce6b4d41be3e req-53aed091-e8c2-4860-9ae4-0e2389881683 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] For port 993b7d31-308c-4414-910f-1a10bea6ed57, host hv-cinder-79049, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79049',level=0,port_id=993b7d31-308c-4414-910f-1a10bea6ed57,segment=NetworkSegment(7d7273c2-c6dd-43fe-83a8-cb776d48dc70),segment_id=7d7273c2-c6dd-43fe-83a8-cb776d48dc70)] {{(pid=91830) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 17:02:59.362889 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [req-3997b9b4-bca1-49fe-bee6-ce6b4d41be3e req-53aed091-e8c2-4860-9ae4-0e2389881683 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-683770'] for port, precommit_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:02:59.388963 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [req-42b42f67-aa38-4ad9-8247-bb91d2ffa043 req-e55415eb-7371-4b80-a3e5-6a95a9b61f3b tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3832070'] for port, before_update {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:02:59.480106 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a2188b18-ffb3-4a08-90af-2aa58265ecfa req-31e087a5-6cf6-43e5-a4eb-fe8154bea80e tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:02:59.482278 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-a2188b18-ffb3-4a08-90af-2aa58265ecfa req-31e087a5-6cf6-43e5-a4eb-fe8154bea80e tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] 10.222.0.62 "GET /v2.0/ports?device_id=0c32425a-15a9-4c9d-8e31-17183d4909c9 HTTP/1.1" status: 200 len: 946 time: 0.1572292 May 25 17:02:59.488917 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.plugins.ml2.plugin [req-3997b9b4-bca1-49fe-bee6-ce6b4d41be3e req-53aed091-e8c2-4860-9ae4-0e2389881683 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] Calling delete_port for 993b7d31-308c-4414-910f-1a10bea6ed57 owned by compute:nova {{(pid=91830) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 25 17:02:59.561935 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-a2188b18-ffb3-4a08-90af-2aa58265ecfa req-6852b2b1-ef07-4692-9158-bf7b104fb25e tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] 10.222.0.62 "GET /v2.0/security-groups?id=f73b90a2-df48-48fb-99e0-5dd4d6a63a15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0693924 May 25 17:02:59.618574 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [req-3997b9b4-bca1-49fe-bee6-ce6b4d41be3e req-53aed091-e8c2-4860-9ae4-0e2389881683 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8757892955046', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8757892520924', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-27483019'] for port, after_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:02:59.625272 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-16c7f921-9ac3-4a93-8dd9-90ee7d84d9fd admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:02:59.630364 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.db [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] get_ports_and_sgs() called for port_ids ['c4b9c0f2-e3d5-4fff-9b3c-a9175b027fb5', '46a1adbe-ec54-4c57-aa7a-9f257475e01c', '85443de0-772c-4d18-bd76-026a72cc754d', '993b7d31-308c-4414-910f-1a10bea6ed57'] {{(pid=91831) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 25 17:02:59.656057 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.wsgi [-] (91829) accepted ('10.222.0.62', 33462) {{(pid=91829) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:02:59.688425 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-53aed091-e8c2-4860-9ae4-0e2389881683 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] Pushing event deleted for resources: {'Port': ['ID=993b7d31-308c-4414-910f-1a10bea6ed57,revision_number=None']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:02:59.691853 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-53aed091-e8c2-4860-9ae4-0e2389881683 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.067s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:02:59.823233 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.l3_dvrscheduler_db [req-3997b9b4-bca1-49fe-bee6-ce6b4d41be3e req-53aed091-e8c2-4860-9ae4-0e2389881683 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] No DVR routers for this DVR port 993b7d31-308c-4414-910f-1a10bea6ed57 on host hv-cinder-79049 {{(pid=91830) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 25 17:02:59.826567 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [req-3997b9b4-bca1-49fe-bee6-ce6b4d41be3e req-53aed091-e8c2-4860-9ae4-0e2389881683 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-178712'] for port, before_response {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:02:59.830161 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '0c32425a-15a9-4c9d-8e31-17183d4909c9', 'name': 'network-vif-deleted', 'tag': '993b7d31-308c-4414-910f-1a10bea6ed57'}] {{(pid=91830) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 25 17:02:59.861474 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-3997b9b4-bca1-49fe-bee6-ce6b4d41be3e req-53aed091-e8c2-4860-9ae4-0e2389881683 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] 10.222.0.32 "DELETE /v2.0/ports/993b7d31-308c-4414-910f-1a10bea6ed57 HTTP/1.1" status: 204 len: 173 time: 0.7828503 May 25 17:02:59.863733 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.plugins.ml2.db [req-42b42f67-aa38-4ad9-8247-bb91d2ffa043 req-e55415eb-7371-4b80-a3e5-6a95a9b61f3b tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] For port d64889c5-b5bd-42be-aa18-7a6149a0a583, host hv-cinder-79049, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79049',level=0,port_id=d64889c5-b5bd-42be-aa18-7a6149a0a583,segment=NetworkSegment(5aed6094-89e8-4c7c-ba89-9b30d3e98cd0),segment_id=5aed6094-89e8-4c7c-ba89-9b30d3e98cd0)] {{(pid=91829) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 17:02:59.876237 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fe841fce-dffe-429e-9240-3041403323df req-c87b0056-a226-4d96-baa2-d91067a6cb18 tempest-VolumesSnapshotTestJSON-991813121 tempest-VolumesSnapshotTestJSON-991813121-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91830) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:02:59.877729 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-fe841fce-dffe-429e-9240-3041403323df req-c87b0056-a226-4d96-baa2-d91067a6cb18 tempest-VolumesSnapshotTestJSON-991813121 tempest-VolumesSnapshotTestJSON-991813121-project] 10.222.0.32 "GET /v2.0/ports?device_id=5cf3f093-ba27-473b-93f8-52a5bb9d9ec8 HTTP/1.1" status: 200 len: 945 time: 0.1918759 May 25 17:02:59.882499 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '0c32425a-15a9-4c9d-8e31-17183d4909c9', 'name': 'network-vif-deleted', 'tag': '993b7d31-308c-4414-910f-1a10bea6ed57', 'status': 'completed', 'code': 200} May 25 17:03:00.098471 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.plugins.ml2.plugin [req-fe841fce-dffe-429e-9240-3041403323df req-4baa5ddf-03c6-4570-8909-68ce30a18a53 tempest-VolumesSnapshotTestJSON-991813121 tempest-VolumesSnapshotTestJSON-991813121-project] Deleting port 041fa5ca-9be5-4356-af06-2fe633a19ad8 {{(pid=91830) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 25 17:03:00.099949 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [req-fe841fce-dffe-429e-9240-3041403323df req-4baa5ddf-03c6-4570-8909-68ce30a18a53 tempest-VolumesSnapshotTestJSON-991813121 tempest-VolumesSnapshotTestJSON-991813121-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8757892952899'] for port, before_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:03:00.101033 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [req-42b42f67-aa38-4ad9-8247-bb91d2ffa043 req-e55415eb-7371-4b80-a3e5-6a95a9b61f3b tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Notify callbacks [] for port, precommit_update {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:03:00.158936 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [req-42b42f67-aa38-4ad9-8247-bb91d2ffa043 req-e55415eb-7371-4b80-a3e5-6a95a9b61f3b tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8757892955028', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8757892520933', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8757892521750', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28230801'] for port, after_update {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:03:00.168708 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-8b7ad329-1351-4080-af76-84380928ac8a admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:03:00.218045 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-57f11b47-1f51-4191-b7c9-af248a48372c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:03:00.262002 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.plugins.ml2.db [req-fe841fce-dffe-429e-9240-3041403323df req-4baa5ddf-03c6-4570-8909-68ce30a18a53 tempest-VolumesSnapshotTestJSON-991813121 tempest-VolumesSnapshotTestJSON-991813121-project] For port 041fa5ca-9be5-4356-af06-2fe633a19ad8, host hv-cinder-79049, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79049',level=0,port_id=041fa5ca-9be5-4356-af06-2fe633a19ad8,segment=NetworkSegment(bba065e2-1e75-4ab9-bc0e-e3037ef57277),segment_id=bba065e2-1e75-4ab9-bc0e-e3037ef57277)] {{(pid=91830) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 17:03:00.262363 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [req-fe841fce-dffe-429e-9240-3041403323df req-4baa5ddf-03c6-4570-8909-68ce30a18a53 tempest-VolumesSnapshotTestJSON-991813121 tempest-VolumesSnapshotTestJSON-991813121-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-683770'] for port, precommit_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:03:00.301526 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-42b42f67-aa38-4ad9-8247-bb91d2ffa043 req-e55415eb-7371-4b80-a3e5-6a95a9b61f3b tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:03:00.302176 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [req-42b42f67-aa38-4ad9-8247-bb91d2ffa043 req-e55415eb-7371-4b80-a3e5-6a95a9b61f3b tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-178712', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-551373'] for port, before_response {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:03:00.303833 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-42b42f67-aa38-4ad9-8247-bb91d2ffa043 req-e55415eb-7371-4b80-a3e5-6a95a9b61f3b tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] 10.222.0.62 "PUT /v2.0/ports/d64889c5-b5bd-42be-aa18-7a6149a0a583 HTTP/1.1" status: 200 len: 982 time: 1.0985150 May 25 17:03:00.304348 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '4413fd77-4f3e-40c8-b7ee-77d416cd7667', 'tag': 'd64889c5-b5bd-42be-aa18-7a6149a0a583'}] {{(pid=91829) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 25 17:03:00.395618 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e55415eb-7371-4b80-a3e5-6a95a9b61f3b tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Pushing event updated for resources: {'Port': ['ID=d64889c5-b5bd-42be-aa18-7a6149a0a583,revision_number=6']} {{(pid=91829) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:03:00.398571 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-e55415eb-7371-4b80-a3e5-6a95a9b61f3b tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.230s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:03:00.409037 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.plugins.ml2.plugin [req-fe841fce-dffe-429e-9240-3041403323df req-4baa5ddf-03c6-4570-8909-68ce30a18a53 tempest-VolumesSnapshotTestJSON-991813121 tempest-VolumesSnapshotTestJSON-991813121-project] Calling delete_port for 041fa5ca-9be5-4356-af06-2fe633a19ad8 owned by compute:nova {{(pid=91830) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 25 17:03:00.435530 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e826420e-3a76-4c00-902b-1b793d178089 req-23daaf75-c030-46ae-a6cd-f7fca95d6161 tempest-VolumesSnapshotTestJSON-991813121 tempest-VolumesSnapshotTestJSON-991813121-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:03:00.442433 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-e826420e-3a76-4c00-902b-1b793d178089 req-23daaf75-c030-46ae-a6cd-f7fca95d6161 tempest-VolumesSnapshotTestJSON-991813121 tempest-VolumesSnapshotTestJSON-991813121-project] 10.222.0.62 "GET /v2.0/ports?device_id=5cf3f093-ba27-473b-93f8-52a5bb9d9ec8 HTTP/1.1" status: 200 len: 945 time: 0.2094810 May 25 17:03:00.464188 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.db [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] get_ports_and_sgs() called for port_ids ['d64889c5-b5bd-42be-aa18-7a6149a0a583'] {{(pid=91831) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 25 17:03:00.516647 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-e826420e-3a76-4c00-902b-1b793d178089 req-a22ce00c-b623-4ef1-bba1-3020331a1334 tempest-VolumesSnapshotTestJSON-991813121 tempest-VolumesSnapshotTestJSON-991813121-project] 10.222.0.62 "GET /v2.0/security-groups?id=b5f47757-8dd4-4226-9a13-ca15ee498213&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0732000 May 25 17:03:00.624285 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [req-fe841fce-dffe-429e-9240-3041403323df req-4baa5ddf-03c6-4570-8909-68ce30a18a53 tempest-VolumesSnapshotTestJSON-991813121 tempest-VolumesSnapshotTestJSON-991813121-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8757892955046', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8757892520924', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-27483019'] for port, after_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:03:00.649620 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:03:00.657741 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '4413fd77-4f3e-40c8-b7ee-77d416cd7667', 'tag': 'd64889c5-b5bd-42be-aa18-7a6149a0a583', 'status': 'completed', 'code': 200} May 25 17:03:00.685469 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.provisioning_blocks [None req-f9129c79-0e94-46df-8a32-4d8e84178262 None None] Provisioning complete for port d64889c5-b5bd-42be-aa18-7a6149a0a583 triggered by entity DHCP. {{(pid=91831) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 17:03:00.686650 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-f9129c79-0e94-46df-8a32-4d8e84178262 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3854128'] for port, provisioning_complete {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:03:00.707268 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-9a6c48b3-3d85-4d75-8c27-40673fc49cb0 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-679979'] for router_interface, before_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:03:00.801382 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4baa5ddf-03c6-4570-8909-68ce30a18a53 tempest-VolumesSnapshotTestJSON-991813121 tempest-VolumesSnapshotTestJSON-991813121-project] Pushing event deleted for resources: {'Port': ['ID=041fa5ca-9be5-4356-af06-2fe633a19ad8,revision_number=None']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:03:00.808991 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a9332913-f8ed-4a47-81cc-e9c6496d7b2e req-c7237cc6-37b8-44b1-91cd-b468b7f6e8f6 tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:03:00.810664 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-a9332913-f8ed-4a47-81cc-e9c6496d7b2e req-c7237cc6-37b8-44b1-91cd-b468b7f6e8f6 tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] 10.222.0.62 "GET /v2.0/ports?device_id=4413fd77-4f3e-40c8-b7ee-77d416cd7667 HTTP/1.1" status: 200 len: 985 time: 0.2070379 May 25 17:03:00.946659 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-4baa5ddf-03c6-4570-8909-68ce30a18a53 tempest-VolumesSnapshotTestJSON-991813121 tempest-VolumesSnapshotTestJSON-991813121-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.297s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:03:00.951414 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.l3_dvrscheduler_db [req-fe841fce-dffe-429e-9240-3041403323df req-4baa5ddf-03c6-4570-8909-68ce30a18a53 tempest-VolumesSnapshotTestJSON-991813121 tempest-VolumesSnapshotTestJSON-991813121-project] No DVR routers for this DVR port 041fa5ca-9be5-4356-af06-2fe633a19ad8 on host hv-cinder-79049 {{(pid=91830) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 25 17:03:00.956246 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [req-fe841fce-dffe-429e-9240-3041403323df req-4baa5ddf-03c6-4570-8909-68ce30a18a53 tempest-VolumesSnapshotTestJSON-991813121 tempest-VolumesSnapshotTestJSON-991813121-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-178712'] for port, before_response {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:03:00.980593 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-fe841fce-dffe-429e-9240-3041403323df req-4baa5ddf-03c6-4570-8909-68ce30a18a53 tempest-VolumesSnapshotTestJSON-991813121 tempest-VolumesSnapshotTestJSON-991813121-project] 10.222.0.32 "DELETE /v2.0/ports/041fa5ca-9be5-4356-af06-2fe633a19ad8 HTTP/1.1" status: 204 len: 173 time: 1.0793064 May 25 17:03:01.011140 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b2f85173-88e1-4f73-a4c9-d0d7c936f07f req-cff83d19-1bf2-4cc8-959d-e0a4b60057a0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91830) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:03:01.012668 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-b2f85173-88e1-4f73-a4c9-d0d7c936f07f req-cff83d19-1bf2-4cc8-959d-e0a4b60057a0 service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=36c1ffa1d458478bac5893b2ddf98eda&device_id=4413fd77-4f3e-40c8-b7ee-77d416cd7667 HTTP/1.1" status: 200 len: 1138 time: 0.2746320 May 25 17:03:01.067261 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.db [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] get_ports_and_sgs() called for port_ids ['d64889c5-b5bd-42be-aa18-7a6149a0a583'] {{(pid=91831) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 25 17:03:01.095722 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-a9332913-f8ed-4a47-81cc-e9c6496d7b2e req-4ee1aa6d-f2ef-4f18-a6cd-5383fc9c913e tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] 10.222.0.62 "GET /v2.0/security-groups?id=8af4439c-b905-435b-836a-90c7f9007b51&id=d7d845a2-937c-4f26-ac5a-1b178146b05e&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.2779510 May 25 17:03:01.169798 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b2f85173-88e1-4f73-a4c9-d0d7c936f07f req-0d6a65a0-d462-454b-b633-3c4406fe582f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91830) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:03:01.171368 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-b2f85173-88e1-4f73-a4c9-d0d7c936f07f req-0d6a65a0-d462-454b-b633-3c4406fe582f service neutron] 10.222.0.32 "GET /v2.0/networks?id=f3ddbe01-13f7-4e15-b7da-2bdffc278cb7 HTTP/1.1" status: 200 len: 916 time: 0.1518912 May 25 17:03:01.301880 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-b2f85173-88e1-4f73-a4c9-d0d7c936f07f req-4c98f993-772c-4e24-a057-05b42c4be021 service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=d64889c5-b5bd-42be-aa18-7a6149a0a583 HTTP/1.1" status: 200 len: 1002 time: 0.1212561 May 25 17:03:01.360104 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.plugins.ml2.plugin [None req-9a6c48b3-3d85-4d75-8c27-40673fc49cb0 admin admin] Deleting port c201e735-51e1-4301-a2d9-d3c9ffbbd910 {{(pid=91829) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 25 17:03:01.360688 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-9a6c48b3-3d85-4d75-8c27-40673fc49cb0 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8757892952899'] for port, before_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:03:01.383775 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b2f85173-88e1-4f73-a4c9-d0d7c936f07f req-d980903b-b5cd-4524-be52-fded458ade35 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91830) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:03:01.385452 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-b2f85173-88e1-4f73-a4c9-d0d7c936f07f req-d980903b-b5cd-4524-be52-fded458ade35 service neutron] 10.222.0.32 "GET /v2.0/subnets?id=69fba530-cce2-44a2-89bd-18a52f9d454c HTTP/1.1" status: 200 len: 854 time: 0.0742302 May 25 17:03:01.477859 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b2f85173-88e1-4f73-a4c9-d0d7c936f07f req-47ae7ef6-52e8-4433-8fb8-c4257c233c8d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91830) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:03:01.479376 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-b2f85173-88e1-4f73-a4c9-d0d7c936f07f req-47ae7ef6-52e8-4433-8fb8-c4257c233c8d service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=f3ddbe01-13f7-4e15-b7da-2bdffc278cb7&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0837245 May 25 17:03:01.488079 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.plugins.ml2.db [None req-9a6c48b3-3d85-4d75-8c27-40673fc49cb0 admin admin] For port c201e735-51e1-4301-a2d9-d3c9ffbbd910, host dv-cinder-790492-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-790492-4-iscsi',level=0,port_id=c201e735-51e1-4301-a2d9-d3c9ffbbd910,segment=NetworkSegment(f672477b-47fb-432c-acc9-dc57201d80de),segment_id=f672477b-47fb-432c-acc9-dc57201d80de)] {{(pid=91829) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 17:03:01.488430 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-9a6c48b3-3d85-4d75-8c27-40673fc49cb0 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-683770'] for port, precommit_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:03:01.498196 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.db [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] get_ports_and_sgs() called for port_ids ['041fa5ca-9be5-4356-af06-2fe633a19ad8'] {{(pid=91831) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 25 17:03:01.663677 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-b2f85173-88e1-4f73-a4c9-d0d7c936f07f req-60831faa-03c6-4238-92af-d724ceef785d service neutron] 10.222.0.32 "GET /v2.0/networks/f3ddbe01-13f7-4e15-b7da-2bdffc278cb7?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1762378 May 25 17:03:01.725826 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.plugins.ml2.plugin [None req-9a6c48b3-3d85-4d75-8c27-40673fc49cb0 admin admin] Calling delete_port for c201e735-51e1-4301-a2d9-d3c9ffbbd910 owned by network:router_interface {{(pid=91829) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 25 17:03:01.742349 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-7bf997fa-92cd-45e7-aa6a-0511c3cd9ec3 req-19c8a183-0553-408b-a37e-391235afe0c9 tempest-VolumesSnapshotTestJSON-991813121 tempest-VolumesSnapshotTestJSON-991813121-project] 10.222.0.62 "GET /v2.0/ports?device_id=5cf3f093-ba27-473b-93f8-52a5bb9d9ec8 HTTP/1.1" status: 200 len: 210 time: 0.0584924 May 25 17:03:01.806073 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-b2f85173-88e1-4f73-a4c9-d0d7c936f07f req-4af562cc-b613-4545-ba86-86bf4fd0d366 service neutron] 10.222.0.32 "GET /v2.0/networks/f3ddbe01-13f7-4e15-b7da-2bdffc278cb7?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1346056 May 25 17:03:01.856125 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.rpc [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Device 60078444-24b6-4560-b0a7-7802c4f8f2f8 no longer exists at agent hyperv_hv-cinder-79049 {{(pid=91831) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 25 17:03:01.883872 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '5cf3f093-ba27-473b-93f8-52a5bb9d9ec8', 'name': 'network-vif-deleted', 'tag': '041fa5ca-9be5-4356-af06-2fe633a19ad8'}] {{(pid=91830) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 25 17:03:01.892256 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.plugin [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] No Port match for: 60078444-24b6-4560-b0a7-7802c4f8f2f8 {{(pid=91831) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}} May 25 17:03:01.892608 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.rpc [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Device 60078444-24b6-4560-b0a7-7802c4f8f2f8 not bound to the agent host hv-cinder-79049 {{(pid=91831) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 25 17:03:01.929460 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '5cf3f093-ba27-473b-93f8-52a5bb9d9ec8', 'name': 'network-vif-deleted', 'tag': '041fa5ca-9be5-4356-af06-2fe633a19ad8', 'status': 'completed', 'code': 200} May 25 17:03:02.088076 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-9a6c48b3-3d85-4d75-8c27-40673fc49cb0 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8757892955046', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8757892520924', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28230808'] for port, after_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:03:02.092721 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-be7579e0-8835-4775-a346-c87d7efa41ac admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:03:02.136067 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9a6c48b3-3d85-4d75-8c27-40673fc49cb0 admin admin] Pushing event deleted for resources: {'Port': ['ID=c201e735-51e1-4301-a2d9-d3c9ffbbd910,revision_number=None']} {{(pid=91829) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:03:02.167025 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-9a6c48b3-3d85-4d75-8c27-40673fc49cb0 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.074s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:03:02.456281 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-9a6c48b3-3d85-4d75-8c27-40673fc49cb0 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-551393', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-682171'] for router_interface, after_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:03:02.640314 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-866775d7-6bb5-4ebd-8325-3afe0b8981e8 req-73cd11f0-c564-4a51-ae05-712aaaa70d29 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:03:02.641757 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-866775d7-6bb5-4ebd-8325-3afe0b8981e8 req-73cd11f0-c564-4a51-ae05-712aaaa70d29 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] 10.222.0.62 "GET /v2.0/ports?device_id=6b63b4a6-5261-4e1c-b796-2f153fc24933 HTTP/1.1" status: 200 len: 945 time: 0.2751598 May 25 17:03:02.765710 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-866775d7-6bb5-4ebd-8325-3afe0b8981e8 req-5a7ceecc-67e4-4cb8-b389-57757f52d007 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] 10.222.0.62 "GET /v2.0/security-groups?id=f73b90a2-df48-48fb-99e0-5dd4d6a63a15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1163526 May 25 17:03:02.957419 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-9a6c48b3-3d85-4d75-8c27-40673fc49cb0 admin admin] Router 84b3a1b2-10cf-465f-ae5c-ffc9b189ed05 has already been hosted by L3 agent a2d427c1-2d07-43e8-afbe-218c9f7d0445 {{(pid=91829) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 25 17:03:03.141743 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-9a6c48b3-3d85-4d75-8c27-40673fc49cb0 admin admin] Notify agent at l3_agent.dv-cinder-790492-4-iscsi the message routers_updated {{(pid=91829) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 25 17:03:03.154729 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [None req-9a6c48b3-3d85-4d75-8c27-40673fc49cb0 admin admin] 10.222.0.62 "PUT /v2.0/routers/84b3a1b2-10cf-465f-ae5c-ffc9b189ed05/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 3.4976695 May 25 17:03:03.155255 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.db.agents_db [None req-504cb04f-4543-46c1-8db7-349e21db7634 None None] Agent healthcheck: found 6 active agents {{(pid=91832) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} May 25 17:03:03.156773 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9e8b892a-3c54-4d5f-ae69-182ed6921cf0 None None] Sync routers for ids ['84b3a1b2-10cf-465f-ae5c-ffc9b189ed05'] in dv-cinder-790492-4-iscsi {{(pid=91832) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 25 17:03:03.157777 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.wsgi [-] (91829) accepted ('10.222.0.62', 33504) {{(pid=91829) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:03:03.165532 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9e8b892a-3c54-4d5f-ae69-182ed6921cf0 None None] Routers {'84b3a1b2-10cf-465f-ae5c-ffc9b189ed05'} bound to L3 agent in host dv-cinder-790492-4-iscsi {{(pid=91832) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 17:03:03.166185 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.db.l3_hamode_db [None req-9e8b892a-3c54-4d5f-ae69-182ed6921cf0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-790492-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-05-25T16:50:28Z,description=,heartbeat_timestamp=2021-05-25T17:02:58Z,host='dv-cinder-790492-4-iscsi',id=a2d427c1-2d07-43e8-afbe-218c9f7d0445,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T16:50:28Z,topic='l3_agent')) {'router_ids': ['84b3a1b2-10cf-465f-ae5c-ffc9b189ed05'], 'active': True} {{(pid=91832) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 17:03:03.331300 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-56f40224-9733-4a16-a301-e067d5fc8037 admin admin] Notify callbacks [] for router, before_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:03:03.349716 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.db.l3_dvr_db [None req-9e8b892a-3c54-4d5f-ae69-182ed6921cf0 None None] Set router 84b3a1b2-10cf-465f-ae5c-ffc9b189ed05 gateway port host: dv-cinder-790492-4-iscsi {{(pid=91832) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 17:03:03.504873 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-56f40224-9733-4a16-a301-e067d5fc8037 admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:03:03.576381 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.plugins.ml2.plugin [None req-56f40224-9733-4a16-a301-e067d5fc8037 admin admin] Deleting port 37da5a3a-087e-4df7-9900-7e680c1f0064 {{(pid=91829) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 25 17:03:03.576714 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-56f40224-9733-4a16-a301-e067d5fc8037 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8757892952899'] for port, before_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:03:03.633479 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.db.l3_hamode_db [None req-9e8b892a-3c54-4d5f-ae69-182ed6921cf0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '84b3a1b2-10cf-465f-ae5c-ffc9b189ed05', 'name': 'tempest-ServerRescueNegativeTestJSON-116675553-router', 'tenant_id': '734df673f8b3484d80f35a45fbce9d5e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'external_fixed_ips': [{'subnet_id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'ip_address': '172.27.2.115'}], 'enable_snat': True}, 'gw_port_id': '37da5a3a-087e-4df7-9900-7e680c1f0064', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T16:58:08Z', 'updated_at': '2021-05-25T17:03:02Z', 'revision_number': 5, 'project_id': '734df673f8b3484d80f35a45fbce9d5e', 'gw_port': {'id': '37da5a3a-087e-4df7-9900-7e680c1f0064', 'name': '', 'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'tenant_id': '', 'mac_address': 'fa:16:3e:1e:d4:9c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '84b3a1b2-10cf-465f-ae5c-ffc9b189ed05', 'device_owner': 'network:router_gateway', 'standard_attr_id': 40, 'fixed_ips': [{'subnet_id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'ip_address': '172.27.2.115', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790492-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T16:58:09Z', 'updated_at': '2021-05-25T16:58:16Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-790492-4-iscsi'}], 'dv-cinder-790492-4-iscsi', False) {} {{(pid=91832) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 17:03:03.637339 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9e8b892a-3c54-4d5f-ae69-182ed6921cf0 None None] Checking router: 84b3a1b2-10cf-465f-ae5c-ffc9b189ed05 for host: dv-cinder-790492-4-iscsi {{(pid=91832) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 25 17:03:03.646372 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9e8b892a-3c54-4d5f-ae69-182ed6921cf0 None None] Routers {'84b3a1b2-10cf-465f-ae5c-ffc9b189ed05'} bound to L3 agent in host dv-cinder-790492-4-iscsi {{(pid=91832) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 17:03:03.646980 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.db.l3_hamode_db [None req-9e8b892a-3c54-4d5f-ae69-182ed6921cf0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-790492-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-05-25T16:50:28Z,description=,heartbeat_timestamp=2021-05-25T17:02:58Z,host='dv-cinder-790492-4-iscsi',id=a2d427c1-2d07-43e8-afbe-218c9f7d0445,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T16:50:28Z,topic='l3_agent')) {'router_ids': ['84b3a1b2-10cf-465f-ae5c-ffc9b189ed05'], 'active': True} {{(pid=91832) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 17:03:03.698068 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.plugins.ml2.db [None req-56f40224-9733-4a16-a301-e067d5fc8037 admin admin] For port 37da5a3a-087e-4df7-9900-7e680c1f0064, host dv-cinder-790492-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-790492-4-iscsi',level=0,port_id=37da5a3a-087e-4df7-9900-7e680c1f0064,segment=NetworkSegment(414a8468-1d66-4792-9e81-d8ac5ccf1512),segment_id=414a8468-1d66-4792-9e81-d8ac5ccf1512)] {{(pid=91829) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 17:03:03.698431 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-56f40224-9733-4a16-a301-e067d5fc8037 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-683770'] for port, precommit_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:03:03.835477 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.plugins.ml2.plugin [None req-56f40224-9733-4a16-a301-e067d5fc8037 admin admin] Calling delete_port for 37da5a3a-087e-4df7-9900-7e680c1f0064 owned by network:router_gateway {{(pid=91829) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 25 17:03:03.840460 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.db.l3_dvr_db [None req-9e8b892a-3c54-4d5f-ae69-182ed6921cf0 None None] Set router 84b3a1b2-10cf-465f-ae5c-ffc9b189ed05 gateway port host: None {{(pid=91832) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 17:03:03.903064 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.rpc [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Device 993b7d31-308c-4414-910f-1a10bea6ed57 no longer exists at agent hyperv_hv-cinder-79049 {{(pid=91831) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 25 17:03:03.938666 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.plugin [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] No Port match for: 993b7d31-308c-4414-910f-1a10bea6ed57 {{(pid=91831) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}} May 25 17:03:03.939168 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.rpc [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Device 993b7d31-308c-4414-910f-1a10bea6ed57 not bound to the agent host hv-cinder-79049 {{(pid=91831) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 25 17:03:03.939702 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.rpc [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Device 041fa5ca-9be5-4356-af06-2fe633a19ad8 no longer exists at agent hyperv_hv-cinder-79049 {{(pid=91831) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 25 17:03:03.954602 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.db.l3_hamode_db [None req-9e8b892a-3c54-4d5f-ae69-182ed6921cf0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '84b3a1b2-10cf-465f-ae5c-ffc9b189ed05', 'name': 'tempest-ServerRescueNegativeTestJSON-116675553-router', 'tenant_id': '734df673f8b3484d80f35a45fbce9d5e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T16:58:08Z', 'updated_at': '2021-05-25T17:03:03Z', 'revision_number': 6, 'project_id': '734df673f8b3484d80f35a45fbce9d5e', 'gw_port_host': None}], 'dv-cinder-790492-4-iscsi', False) {} {{(pid=91832) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 17:03:03.959274 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9e8b892a-3c54-4d5f-ae69-182ed6921cf0 None None] The sync data for ids ['84b3a1b2-10cf-465f-ae5c-ffc9b189ed05'] in dv-cinder-790492-4-iscsi is: [{'id': '84b3a1b2-10cf-465f-ae5c-ffc9b189ed05', 'name': 'tempest-ServerRescueNegativeTestJSON-116675553-router', 'tenant_id': '734df673f8b3484d80f35a45fbce9d5e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T16:58:08Z', 'updated_at': '2021-05-25T17:03:03Z', 'revision_number': 6, 'project_id': '734df673f8b3484d80f35a45fbce9d5e', 'gw_port_host': None}] {{(pid=91832) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 25 17:03:03.980088 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.plugin [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] No Port match for: 041fa5ca-9be5-4356-af06-2fe633a19ad8 {{(pid=91831) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}} May 25 17:03:03.980537 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.rpc [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Device 041fa5ca-9be5-4356-af06-2fe633a19ad8 not bound to the agent host hv-cinder-79049 {{(pid=91831) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 25 17:03:04.119765 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4e2cdd06-90a4-4b00-aa95-44b45205a902 req-a5d93e5a-fc29-4b82-8ac9-1f7e161e67c8 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:03:04.121174 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-4e2cdd06-90a4-4b00-aa95-44b45205a902 req-a5d93e5a-fc29-4b82-8ac9-1f7e161e67c8 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] 10.222.0.62 "GET /v2.0/ports?device_id=6b63b4a6-5261-4e1c-b796-2f153fc24933 HTTP/1.1" status: 200 len: 945 time: 0.2329502 May 25 17:03:04.182898 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-4e2cdd06-90a4-4b00-aa95-44b45205a902 req-6531476f-358e-490e-a23a-b9c9fa4450c2 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] 10.222.0.62 "GET /v2.0/security-groups?id=f73b90a2-df48-48fb-99e0-5dd4d6a63a15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0551176 May 25 17:03:04.184008 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-56f40224-9733-4a16-a301-e067d5fc8037 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8757892955046', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8757892520924', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28230808'] for port, after_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:03:04.187636 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-2dfcd7ce-2023-49aa-9728-a381803c759e admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:03:04.232535 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-56f40224-9733-4a16-a301-e067d5fc8037 admin admin] Pushing event deleted for resources: {'Port': ['ID=37da5a3a-087e-4df7-9900-7e680c1f0064,revision_number=None']} {{(pid=91829) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:03:04.235471 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-56f40224-9733-4a16-a301-e067d5fc8037 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.048s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:03:04.324913 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-56f40224-9733-4a16-a301-e067d5fc8037 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-683062'] for router_gateway, after_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:03:04.498237 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-56f40224-9733-4a16-a301-e067d5fc8037 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-684987', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-31024'] for router, precommit_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:03:04.500415 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-56f40224-9733-4a16-a301-e067d5fc8037 admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:03:04.584421 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-56f40224-9733-4a16-a301-e067d5fc8037 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-685959'] for router, after_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:03:04.585142 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-56f40224-9733-4a16-a301-e067d5fc8037 admin admin] Fanout notify agent at l3_agent the message router_deleted on router 84b3a1b2-10cf-465f-ae5c-ffc9b189ed05 {{(pid=91829) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}} May 25 17:03:04.597851 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-56f40224-9733-4a16-a301-e067d5fc8037 admin admin] Notify callbacks [] for router, before_response {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:03:04.598971 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [None req-56f40224-9733-4a16-a301-e067d5fc8037 admin admin] 10.222.0.62 "DELETE /v2.0/routers/84b3a1b2-10cf-465f-ae5c-ffc9b189ed05 HTTP/1.1" status: 204 len: 168 time: 1.4402885 May 25 17:03:04.601443 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.wsgi [-] (91829) accepted ('10.222.0.62', 33514) {{(pid=91829) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:03:04.662420 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.db_base_plugin_v2 [None req-f3844a8d-2d10-4118-b7c8-bde5ee381465 admin admin] Deleting subnet 927bd65a-c4de-491b-b501-302852f4c784 {{(pid=91829) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}} May 25 17:03:04.665276 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-f3844a8d-2d10-4118-b7c8-bde5ee381465 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:03:04.715136 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-f3844a8d-2d10-4118-b7c8-bde5ee381465 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-28283188'] for subnet, precommit_delete_associations {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:03:04.769139 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-f3844a8d-2d10-4118-b7c8-bde5ee381465 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3856586'] for subnet, precommit_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:03:05.028874 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-f3844a8d-2d10-4118-b7c8-bde5ee381465 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3857535', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55886', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-27333739', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-28266126'] for subnet, after_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:03:05.032779 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:03:05.066298 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f3844a8d-2d10-4118-b7c8-bde5ee381465 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=927bd65a-c4de-491b-b501-302852f4c784,revision_number=None']} {{(pid=91829) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:03:05.069620 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-f3844a8d-2d10-4118-b7c8-bde5ee381465 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.037s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:03:05.072530 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-f3844a8d-2d10-4118-b7c8-bde5ee381465 admin admin] Notify callbacks [] for subnet, before_response {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:03:05.078625 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [None req-f3844a8d-2d10-4118-b7c8-bde5ee381465 admin admin] 10.222.0.62 "DELETE /v2.0/subnets/927bd65a-c4de-491b-b501-302852f4c784 HTTP/1.1" status: 204 len: 168 time: 0.4762509 May 25 17:03:05.081382 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.wsgi [-] (91829) accepted ('10.222.0.62', 33522) {{(pid=91829) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:03:05.184055 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-da80f632-dfa8-4a78-ab81-6327bd4f9186 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3867326'] for network, before_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:03:05.184755 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:03:05.345286 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-da80f632-dfa8-4a78-ab81-6327bd4f9186 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3858245', 'neutron.services.segments.db._delete_segments_for_network-8757892982492'] for network, precommit_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:03:05.365641 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.services.segments.db [None req-da80f632-dfa8-4a78-ab81-6327bd4f9186 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['55a46372-d583-4435-a0f6-b9397668217d']}} {{(pid=91829) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 17:03:05.380122 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.services.segments.db [None req-da80f632-dfa8-4a78-ab81-6327bd4f9186 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'f672477b-47fb-432c-acc9-dc57201d80de') {'for_net_delete': True} {{(pid=91829) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 17:03:05.380411 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.services.segments.db [None req-da80f632-dfa8-4a78-ab81-6327bd4f9186 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'f672477b-47fb-432c-acc9-dc57201d80de') {} {{(pid=91829) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 17:03:05.400275 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-da80f632-dfa8-4a78-ab81-6327bd4f9186 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8757892991389', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-28283199'] for segment, before_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:03:05.419741 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-da80f632-dfa8-4a78-ab81-6327bd4f9186 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3809789'] for segment, precommit_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:03:05.428741 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-da80f632-dfa8-4a78-ab81-6327bd4f9186 admin admin] Releasing vlan 697 on physical network physnet1 to pool {{(pid=91829) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 25 17:03:05.429105 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-da80f632-dfa8-4a78-ab81-6327bd4f9186 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3809789', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-28230861'] for segment, after_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:03:05.442829 dv-cinder-790492-4-iscsi neutron-server[91829]: Traceback (most recent call last): May 25 17:03:05.442829 dv-cinder-790492-4-iscsi neutron-server[91829]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 25 17:03:05.442829 dv-cinder-790492-4-iscsi neutron-server[91829]: timer() May 25 17:03:05.442829 dv-cinder-790492-4-iscsi neutron-server[91829]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 25 17:03:05.442829 dv-cinder-790492-4-iscsi neutron-server[91829]: cb(*args, **kw) May 25 17:03:05.442829 dv-cinder-790492-4-iscsi neutron-server[91829]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper May 25 17:03:05.442829 dv-cinder-790492-4-iscsi neutron-server[91829]: return func(*args, **kwargs) May 25 17:03:05.442829 dv-cinder-790492-4-iscsi neutron-server[91829]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 25 17:03:05.442829 dv-cinder-790492-4-iscsi neutron-server[91829]: self._notify() May 25 17:03:05.442829 dv-cinder-790492-4-iscsi neutron-server[91829]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 25 17:03:05.442829 dv-cinder-790492-4-iscsi neutron-server[91829]: self.callback(batched_events) May 25 17:03:05.442829 dv-cinder-790492-4-iscsi neutron-server[91829]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 25 17:03:05.442829 dv-cinder-790492-4-iscsi neutron-server[91829]: event.method(event) May 25 17:03:05.442829 dv-cinder-790492-4-iscsi neutron-server[91829]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 25 17:03:05.442829 dv-cinder-790492-4-iscsi neutron-server[91829]: aggregate_id = self._get_aggregate_id(event.segment_id) May 25 17:03:05.442829 dv-cinder-790492-4-iscsi neutron-server[91829]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 25 17:03:05.442829 dv-cinder-790492-4-iscsi neutron-server[91829]: aggregate_uuid = self.p_client.list_aggregates( May 25 17:03:05.442829 dv-cinder-790492-4-iscsi neutron-server[91829]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 25 17:03:05.442829 dv-cinder-790492-4-iscsi neutron-server[91829]: return f(self, *a, **k) May 25 17:03:05.442829 dv-cinder-790492-4-iscsi neutron-server[91829]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 25 17:03:05.442829 dv-cinder-790492-4-iscsi neutron-server[91829]: return self._get(url).json() May 25 17:03:05.442829 dv-cinder-790492-4-iscsi neutron-server[91829]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 25 17:03:05.442829 dv-cinder-790492-4-iscsi neutron-server[91829]: return self._client.get(url, endpoint_filter=self._ks_filter, May 25 17:03:05.442829 dv-cinder-790492-4-iscsi neutron-server[91829]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 25 17:03:05.442829 dv-cinder-790492-4-iscsi neutron-server[91829]: return self.request(url, 'GET', **kwargs) May 25 17:03:05.442829 dv-cinder-790492-4-iscsi neutron-server[91829]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 25 17:03:05.442829 dv-cinder-790492-4-iscsi neutron-server[91829]: base_url = self.get_endpoint(auth, allow=allow, May 25 17:03:05.442829 dv-cinder-790492-4-iscsi neutron-server[91829]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 25 17:03:05.442829 dv-cinder-790492-4-iscsi neutron-server[91829]: auth = self._auth_required(auth, 'determine endpoint URL') May 25 17:03:05.442829 dv-cinder-790492-4-iscsi neutron-server[91829]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 25 17:03:05.442829 dv-cinder-790492-4-iscsi neutron-server[91829]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 25 17:03:05.442829 dv-cinder-790492-4-iscsi neutron-server[91829]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 25 17:03:05.450219 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e382d4e7-3406-4f69-9bba-9242b6121224 req-c2eccf07-fc6a-4d70-9391-4400163fb52c tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:03:05.451639 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-e382d4e7-3406-4f69-9bba-9242b6121224 req-c2eccf07-fc6a-4d70-9391-4400163fb52c tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] 10.222.0.62 "GET /v2.0/ports?device_id=6b63b4a6-5261-4e1c-b796-2f153fc24933 HTTP/1.1" status: 200 len: 945 time: 0.1564298 May 25 17:03:05.630557 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-da80f632-dfa8-4a78-ab81-6327bd4f9186 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3858252', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-640806', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-551400', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-683051'] for network, after_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:03:05.637113 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-65c292ee-e1f6-497e-9ac0-0015f66543cd admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:03:05.652081 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-e382d4e7-3406-4f69-9bba-9242b6121224 req-62ccdc4d-af2d-4ab4-a4bb-fd87f32258ac tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] 10.222.0.62 "GET /v2.0/security-groups?id=f73b90a2-df48-48fb-99e0-5dd4d6a63a15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0716984 May 25 17:03:05.653085 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-da80f632-dfa8-4a78-ab81-6327bd4f9186 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-551373'] for network, before_response {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:03:05.663791 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-da80f632-dfa8-4a78-ab81-6327bd4f9186 admin admin] Pushing event deleted for resources: {'Network': ['ID=55a46372-d583-4435-a0f6-b9397668217d,revision_number=None']} {{(pid=91829) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:03:05.672656 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [None req-da80f632-dfa8-4a78-ab81-6327bd4f9186 admin admin] 10.222.0.62 "DELETE /v2.0/networks/55a46372-d583-4435-a0f6-b9397668217d HTTP/1.1" status: 204 len: 168 time: 0.5903401 May 25 17:03:05.675991 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-da80f632-dfa8-4a78-ab81-6327bd4f9186 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.039s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:03:05.761278 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.rpc [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Device 37da5a3a-087e-4df7-9900-7e680c1f0064 no longer exists at agent ovs-agent-dv-cinder-790492-4-iscsi {{(pid=91831) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 25 17:03:05.797349 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.plugin [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] No Port match for: 37da5a3a-087e-4df7-9900-7e680c1f0064 {{(pid=91831) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}} May 25 17:03:05.797698 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.rpc [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Device 37da5a3a-087e-4df7-9900-7e680c1f0064 not bound to the agent host dv-cinder-790492-4-iscsi {{(pid=91831) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 25 17:03:05.798156 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.rpc [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Device c201e735-51e1-4301-a2d9-d3c9ffbbd910 no longer exists at agent ovs-agent-dv-cinder-790492-4-iscsi {{(pid=91831) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 25 17:03:05.831106 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.plugin [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] No Port match for: c201e735-51e1-4301-a2d9-d3c9ffbbd910 {{(pid=91831) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}} May 25 17:03:05.831462 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.rpc [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Device c201e735-51e1-4301-a2d9-d3c9ffbbd910 not bound to the agent host dv-cinder-790492-4-iscsi {{(pid=91831) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 25 17:03:05.849013 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.wsgi [-] (91830) accepted ('10.222.0.62', 33532) {{(pid=91830) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:03:05.896484 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [None req-2e81e18e-765c-4344-a9b3-fa867eabc0b9 admin admin] 10.222.0.62 "GET /v2.0/security-groups?tenant_id=734df673f8b3484d80f35a45fbce9d5e&name=default HTTP/1.1" status: 200 len: 2975 time: 0.0462155 May 25 17:03:05.898692 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.wsgi [-] (91830) accepted ('10.222.0.62', 33536) {{(pid=91830) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:03:05.958356 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-5fe90d83-5ca9-4a41-9403-3f89bb2bc2e7 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:03:05.983563 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-5fe90d83-5ca9-4a41-9403-3f89bb2bc2e7 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:03:06.035771 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-5fe90d83-5ca9-4a41-9403-3f89bb2bc2e7 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-640836'] for security_group, after_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:03:06.041196 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-a1a6b936-fe2f-4ec5-98a4-8fa899f6677b admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:03:06.054487 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5fe90d83-5ca9-4a41-9403-3f89bb2bc2e7 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=8ee5c4ed-9c60-4e39-9185-7e283704a7dc,revision_number=None']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:03:06.057306 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-5fe90d83-5ca9-4a41-9403-3f89bb2bc2e7 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.016s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:03:06.066828 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-5fe90d83-5ca9-4a41-9403-3f89bb2bc2e7 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:03:06.068003 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [None req-5fe90d83-5ca9-4a41-9403-3f89bb2bc2e7 admin admin] 10.222.0.62 "DELETE /v2.0/security-groups/8ee5c4ed-9c60-4e39-9185-7e283704a7dc HTTP/1.1" status: 204 len: 168 time: 0.1684504 May 25 17:03:06.799982 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.wsgi [-] (91830) accepted ('10.222.0.62', 33566) {{(pid=91830) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:03:06.859934 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ef5bb17a-2709-4089-8b58-63b4c824ac9e req-be288c64-a85f-4cf4-af47-067e754bc94a tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:03:06.866417 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-ef5bb17a-2709-4089-8b58-63b4c824ac9e req-be288c64-a85f-4cf4-af47-067e754bc94a tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] 10.222.0.62 "GET /v2.0/ports?device_id=6b63b4a6-5261-4e1c-b796-2f153fc24933 HTTP/1.1" status: 200 len: 945 time: 0.0995443 May 25 17:03:06.909934 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-ef5bb17a-2709-4089-8b58-63b4c824ac9e req-e8f4b354-1e83-41f0-8578-b93a5414077f tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] 10.222.0.62 "GET /v2.0/security-groups?id=f73b90a2-df48-48fb-99e0-5dd4d6a63a15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0405345 May 25 17:03:06.917663 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.v2.base [None req-deb58874-c29a-42e4-a2ef-29435e4a2ec2 admin admin] Request body: {'network': {'name': 'tempest-AttachVolumeTestJSON-312968156-network', 'tenant_id': '70dac097fff04aed99a4976fa955579b'}} {{(pid=91830) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 17:03:06.922216 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.quota.driver [None req-deb58874-c29a-42e4-a2ef-29435e4a2ec2 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91830) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 17:03:06.926108 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [None req-deb58874-c29a-42e4-a2ef-29435e4a2ec2 admin admin] Usage tracker for resource:network and tenant:70dac097fff04aed99a4976fa955579b is out of sync, need to count used quota {{(pid=91830) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 17:03:06.929313 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [None req-deb58874-c29a-42e4-a2ef-29435e4a2ec2 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=91830) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 17:03:06.934991 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.quota.driver [None req-deb58874-c29a-42e4-a2ef-29435e4a2ec2 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91830) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 17:03:06.945878 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-deb58874-c29a-42e4-a2ef-29435e4a2ec2 admin admin] Made reservation on behalf of 70dac097fff04aed99a4976fa955579b for: {'network': 1} {{(pid=91830) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 25 17:03:06.948347 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-deb58874-c29a-42e4-a2ef-29435e4a2ec2 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-3832077'] for network, before_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:03:06.961764 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-deb58874-c29a-42e4-a2ef-29435e4a2ec2 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:03:06.976226 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.quota.driver [None req-deb58874-c29a-42e4-a2ef-29435e4a2ec2 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91830) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 17:03:06.980099 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [None req-deb58874-c29a-42e4-a2ef-29435e4a2ec2 admin admin] Usage tracker for resource:security_group_rule and tenant:70dac097fff04aed99a4976fa955579b is out of sync, need to count used quota {{(pid=91830) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 17:03:06.984818 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [None req-deb58874-c29a-42e4-a2ef-29435e4a2ec2 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91830) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 17:03:06.990520 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.quota.driver [None req-deb58874-c29a-42e4-a2ef-29435e4a2ec2 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91830) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 17:03:07.076732 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-deb58874-c29a-42e4-a2ef-29435e4a2ec2 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:03:07.080767 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-deb58874-c29a-42e4-a2ef-29435e4a2ec2 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-640836'] for security_group, after_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:03:07.083594 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-1d5e1f16-4c21-4a24-af84-fa780644a59b admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:03:07.113662 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-deb58874-c29a-42e4-a2ef-29435e4a2ec2 admin admin] vlan segment allocate from pool success with {'vlan_id': 655, 'physical_network': 'physnet1'} {{(pid=91830) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 25 17:03:07.121700 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-deb58874-c29a-42e4-a2ef-29435e4a2ec2 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=4fa291c6-377c-43b1-9dfb-6af266e140cd,revision_number=1']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:03:07.125724 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-deb58874-c29a-42e4-a2ef-29435e4a2ec2 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.042s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:03:07.128083 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-deb58874-c29a-42e4-a2ef-29435e4a2ec2 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3809789'] for segment, precommit_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:03:07.128410 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.db.segments_db [None req-deb58874-c29a-42e4-a2ef-29435e4a2ec2 admin admin] Added segment b8ba5240-28ce-40db-a6e6-b4a42435e0b6 of type vlan for network b351598a-3f6f-4a37-8095-8d9371896ccc May 25 17:03:07.154799 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-deb58874-c29a-42e4-a2ef-29435e4a2ec2 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8757892541013'] for network, precommit_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:03:07.183561 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-deb58874-c29a-42e4-a2ef-29435e4a2ec2 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-640806', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-551400'] for network, after_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:03:07.184844 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-deb58874-c29a-42e4-a2ef-29435e4a2ec2 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91830) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:03:07.185423 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-deb58874-c29a-42e4-a2ef-29435e4a2ec2 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-551373'] for network, before_response {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:03:07.189973 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-6097c204-3721-40e2-b75e-41fc3bd03097 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:03:07.291123 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-deb58874-c29a-42e4-a2ef-29435e4a2ec2 admin admin] Pushing event updated for resources: {'Network': ['ID=b351598a-3f6f-4a37-8095-8d9371896ccc,revision_number=1']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:03:07.293943 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [None req-deb58874-c29a-42e4-a2ef-29435e4a2ec2 admin admin] 10.222.0.62 "POST /v2.0/networks HTTP/1.1" status: 201 len: 883 time: 0.4929523 May 25 17:03:07.295093 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-deb58874-c29a-42e4-a2ef-29435e4a2ec2 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.105s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:03:07.297473 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.wsgi [-] (91830) accepted ('10.222.0.62', 33576) {{(pid=91830) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:03:07.302417 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.rpc [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Network b351598a-3f6f-4a37-8095-8d9371896ccc details requested by agent ovs-agent-dv-cinder-790492-4-iscsi with host dv-cinder-790492-4-iscsi {{(pid=91831) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 25 17:03:07.303030 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.v2.base [None req-93e9160a-bacb-42fe-a630-cd67bc6772ea admin admin] Request body: {'subnet': {'network_id': 'b351598a-3f6f-4a37-8095-8d9371896ccc', 'cidr': '172.20.0.0/28', 'name': 'tempest-AttachVolumeTestJSON-312968156-subnet', 'tenant_id': '70dac097fff04aed99a4976fa955579b', 'enable_dhcp': True, 'ip_version': 4}} {{(pid=91830) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 17:03:07.308321 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.quota.driver [None req-93e9160a-bacb-42fe-a630-cd67bc6772ea admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91830) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 17:03:07.312169 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [None req-93e9160a-bacb-42fe-a630-cd67bc6772ea admin admin] Usage tracker for resource:subnet and tenant:70dac097fff04aed99a4976fa955579b is out of sync, need to count used quota {{(pid=91830) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 17:03:07.315103 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [None req-93e9160a-bacb-42fe-a630-cd67bc6772ea admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=91830) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 17:03:07.320976 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.quota.driver [None req-93e9160a-bacb-42fe-a630-cd67bc6772ea admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91830) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 17:03:07.331551 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-93e9160a-bacb-42fe-a630-cd67bc6772ea admin admin] Made reservation on behalf of 70dac097fff04aed99a4976fa955579b for: {'subnet': 1} {{(pid=91830) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 25 17:03:07.334413 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-93e9160a-bacb-42fe-a630-cd67bc6772ea admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1152763'] for subnet, before_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:03:07.722807 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-93e9160a-bacb-42fe-a630-cd67bc6772ea admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55886', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-28085051', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-1152749'] for subnet, after_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:03:07.727367 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:03:07.802021 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-93e9160a-bacb-42fe-a630-cd67bc6772ea admin admin] Pushing event updated for resources: {'Subnet': ['ID=4bbae145-74ed-4fda-b7c0-ae77a3202a83,revision_number=0']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:03:07.806572 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-93e9160a-bacb-42fe-a630-cd67bc6772ea admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.079s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:03:07.810514 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-93e9160a-bacb-42fe-a630-cd67bc6772ea admin admin] Checking segment: {'id': 'b8ba5240-28ce-40db-a6e6-b4a42435e0b6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 655, 'network_id': 'b351598a-3f6f-4a37-8095-8d9371896ccc'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91830) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 25 17:03:07.810867 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-93e9160a-bacb-42fe-a630-cd67bc6772ea admin admin] Network hostable DHCP agents. Network: b351598a-3f6f-4a37-8095-8d9371896ccc, hostable agents: ['8d7401c6-8951-4f2b-ace4-208761782bfc'], hosted agents: [] {{(pid=91830) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 25 17:03:07.827191 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-93e9160a-bacb-42fe-a630-cd67bc6772ea admin admin] Network b351598a-3f6f-4a37-8095-8d9371896ccc is scheduled to be hosted by DHCP agent 8d7401c6-8951-4f2b-ace4-208761782bfc with binding_index 1 {{(pid=91830) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 25 17:03:07.836662 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.scheduler.base_scheduler [None req-93e9160a-bacb-42fe-a630-cd67bc6772ea admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-790492-4-iscsi, b351598a-3f6f-4a37-8095-8d9371896ccc) {{(pid=91830) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 17:03:07.845813 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-df632284-af33-4457-8ce9-bd1346084798 None None] Network b351598a-3f6f-4a37-8095-8d9371896ccc requested from dv-cinder-790492-4-iscsi {{(pid=91831) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} May 25 17:03:07.851301 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-93e9160a-bacb-42fe-a630-cd67bc6772ea admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=91830) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:03:07.851859 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-93e9160a-bacb-42fe-a630-cd67bc6772ea admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-551373'] for subnet, before_response {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:03:07.872480 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [None req-93e9160a-bacb-42fe-a630-cd67bc6772ea admin admin] 10.222.0.62 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 846 time: 0.5740333 May 25 17:03:07.875846 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.wsgi [-] (91830) accepted ('10.222.0.62', 33580) {{(pid=91830) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:03:07.880707 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.v2.base [None req-8f8ea177-ebab-4446-b910-939a3571c194 admin admin] Request body: {'router': {'name': 'tempest-AttachVolumeTestJSON-312968156-router', 'tenant_id': '70dac097fff04aed99a4976fa955579b', 'external_gateway_info': {'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74'}}} {{(pid=91830) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 17:03:07.885066 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.quota.driver [None req-8f8ea177-ebab-4446-b910-939a3571c194 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91830) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 17:03:07.888977 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [None req-8f8ea177-ebab-4446-b910-939a3571c194 admin admin] Usage tracker for resource:router and tenant:70dac097fff04aed99a4976fa955579b is out of sync, need to count used quota {{(pid=91830) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 17:03:07.892508 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [None req-8f8ea177-ebab-4446-b910-939a3571c194 admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=91830) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 17:03:07.898134 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.quota.driver [None req-8f8ea177-ebab-4446-b910-939a3571c194 admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91830) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 17:03:07.907807 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-8f8ea177-ebab-4446-b910-939a3571c194 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-684888', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-31042'] for router, before_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:03:07.908914 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-8f8ea177-ebab-4446-b910-939a3571c194 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-684376', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-683143', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-647018', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-31049'] for router, precommit_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:03:07.923184 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-8f8ea177-ebab-4446-b910-939a3571c194 admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:03:08.070684 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-838925ed-adbb-430b-876f-1b3a0f72d481 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp6d7ebc81-b6b5-52ec-b8f5-10a9de34bf46-b351598a-3f6f-4a37-8095-8d9371896ccc', 'network_id': 'b351598a-3f6f-4a37-8095-8d9371896ccc', 'tenant_id': '70dac097fff04aed99a4976fa955579b', 'fixed_ips': [{'subnet_id': '4bbae145-74ed-4fda-b7c0-ae77a3202a83'}]}} from dv-cinder-790492-4-iscsi. {{(pid=91831) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} May 25 17:03:08.071672 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-838925ed-adbb-430b-876f-1b3a0f72d481 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3832070'] for port, before_create {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:03:08.111311 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-756bab74-48d8-4cc1-8704-5d8cf54ccc9d req-2b99ab90-dfbe-4428-952f-3948b9f99f08 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:03:08.112745 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-756bab74-48d8-4cc1-8704-5d8cf54ccc9d req-2b99ab90-dfbe-4428-952f-3948b9f99f08 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] 10.222.0.62 "GET /v2.0/ports?device_id=6b63b4a6-5261-4e1c-b796-2f153fc24933 HTTP/1.1" status: 200 len: 945 time: 0.0846076 May 25 17:03:08.164416 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-756bab74-48d8-4cc1-8704-5d8cf54ccc9d req-70f844e0-642c-4a71-90bd-e94c591b3900 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] 10.222.0.62 "GET /v2.0/security-groups?id=f73b90a2-df48-48fb-99e0-5dd4d6a63a15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0455389 May 25 17:03:08.229468 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.db_base_plugin_common [None req-838925ed-adbb-430b-876f-1b3a0f72d481 None None] Allocated IP 172.20.0.2 (b351598a-3f6f-4a37-8095-8d9371896ccc/4bbae145-74ed-4fda-b7c0-ae77a3202a83/ccbdad71-4af5-49d2-8788-764f277b297e) {{(pid=91831) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 25 17:03:08.281796 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-8f8ea177-ebab-4446-b910-939a3571c194 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-683170', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-684906', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-31039'] for router, precommit_update {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:03:08.447710 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-838925ed-adbb-430b-876f-1b3a0f72d481 None None] Notify callbacks [] for port, precommit_create {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:03:08.457615 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.provisioning_blocks [None req-838925ed-adbb-430b-876f-1b3a0f72d481 None None] Transition to ACTIVE for port object ccbdad71-4af5-49d2-8788-764f277b297e will not be triggered until provisioned by entity L2. {{(pid=91831) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 25 17:03:08.475497 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.provisioning_blocks [None req-838925ed-adbb-430b-876f-1b3a0f72d481 None None] Transition to ACTIVE for port object ccbdad71-4af5-49d2-8788-764f277b297e will not be triggered until provisioned by entity DHCP. {{(pid=91831) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 25 17:03:08.480458 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-838925ed-adbb-430b-876f-1b3a0f72d481 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8757892520915'] for port, after_create {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:03:08.485198 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [None req-c91819b5-6e14-4d37-a4d3-3507b6bc3f02 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:03:08.548157 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-838925ed-adbb-430b-876f-1b3a0f72d481 None None] Network b351598a-3f6f-4a37-8095-8d9371896ccc is already hosted by enough agents. {{(pid=91831) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 25 17:03:08.550742 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.scheduler.base_scheduler [None req-838925ed-adbb-430b-876f-1b3a0f72d481 None None] Resources bound (agent type, host, resource id): {{(pid=91831) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 17:03:08.554534 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.l3_dvrscheduler_db [None req-838925ed-adbb-430b-876f-1b3a0f72d481 None None] Received port after_create {{(pid=91831) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 25 17:03:08.560106 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-838925ed-adbb-430b-876f-1b3a0f72d481 None None] Pushing event updated for resources: {'Port': ['ID=ccbdad71-4af5-49d2-8788-764f277b297e,revision_number=1']} {{(pid=91831) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:03:08.564427 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [None req-838925ed-adbb-430b-876f-1b3a0f72d481 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.079s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:03:08.598131 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-8f8ea177-ebab-4446-b910-939a3571c194 admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:03:08.628227 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-8f8ea177-ebab-4446-b910-939a3571c194 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3832070'] for port, before_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:03:08.647883 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.managers [None req-838925ed-adbb-430b-876f-1b3a0f72d481 None None] Attempting to bind port ccbdad71-4af5-49d2-8788-764f277b297e on host dv-cinder-790492-4-iscsi for vnic_type normal with profile {{(pid=91831) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 25 17:03:08.648253 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.managers [None req-838925ed-adbb-430b-876f-1b3a0f72d481 None None] Attempting to bind port ccbdad71-4af5-49d2-8788-764f277b297e by drivers openvswitch,hyperv on host dv-cinder-790492-4-iscsi at level 0 using segments [{'id': 'b8ba5240-28ce-40db-a6e6-b4a42435e0b6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 655, 'network_id': 'b351598a-3f6f-4a37-8095-8d9371896ccc'}] {{(pid=91831) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 25 17:03:08.648612 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-838925ed-adbb-430b-876f-1b3a0f72d481 None None] Attempting to bind port ccbdad71-4af5-49d2-8788-764f277b297e on network b351598a-3f6f-4a37-8095-8d9371896ccc {{(pid=91831) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 25 17:03:08.653863 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-838925ed-adbb-430b-876f-1b3a0f72d481 None None] Checking agent: {'id': 'fc8251e1-071c-49f7-bc10-1337f1d37d1b', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-790492-4-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 25, 16, 50, 28), 'started_at': datetime.datetime(2021, 5, 25, 16, 50, 58), 'heartbeat_timestamp': datetime.datetime(2021, 5, 25, 17, 2, 58), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-790492-4-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=91831) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 25 17:03:08.654265 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-838925ed-adbb-430b-876f-1b3a0f72d481 None None] Checking segment: {'id': 'b8ba5240-28ce-40db-a6e6-b4a42435e0b6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 655, 'network_id': 'b351598a-3f6f-4a37-8095-8d9371896ccc'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91831) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 25 17:03:08.654662 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-838925ed-adbb-430b-876f-1b3a0f72d481 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:03:08.655055 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-838925ed-adbb-430b-876f-1b3a0f72d481 None None] Bound using segment: {'id': 'b8ba5240-28ce-40db-a6e6-b4a42435e0b6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 655, 'network_id': 'b351598a-3f6f-4a37-8095-8d9371896ccc'} {{(pid=91831) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 25 17:03:08.656083 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.managers [None req-838925ed-adbb-430b-876f-1b3a0f72d481 None None] Bound port: ccbdad71-4af5-49d2-8788-764f277b297e, host: dv-cinder-790492-4-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'b8ba5240-28ce-40db-a6e6-b4a42435e0b6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 655, 'network_id': 'b351598a-3f6f-4a37-8095-8d9371896ccc'}}] {{(pid=91831) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 25 17:03:08.656454 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-838925ed-adbb-430b-876f-1b3a0f72d481 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3832070'] for port, before_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:03:08.744629 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.db [None req-838925ed-adbb-430b-876f-1b3a0f72d481 None None] For port ccbdad71-4af5-49d2-8788-764f277b297e, host dv-cinder-790492-4-iscsi, cleared binding levels {{(pid=91831) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 25 17:03:08.747792 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.db [None req-838925ed-adbb-430b-876f-1b3a0f72d481 None None] For port ccbdad71-4af5-49d2-8788-764f277b297e, host dv-cinder-790492-4-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-790492-4-iscsi',level=0,port_id=ccbdad71-4af5-49d2-8788-764f277b297e,segment=NetworkSegment(b8ba5240-28ce-40db-a6e6-b4a42435e0b6),segment_id=b8ba5240-28ce-40db-a6e6-b4a42435e0b6)] {{(pid=91831) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 25 17:03:08.752389 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-838925ed-adbb-430b-876f-1b3a0f72d481 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8757892955028', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8757892520933', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8757892521750'] for port, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:03:08.756688 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:03:08.767541 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.db_base_plugin_common [None req-8f8ea177-ebab-4446-b910-939a3571c194 admin admin] Allocated IP 172.27.2.63 (4364b6ab-4117-4a92-baeb-f5ee2f45bf74/b947e790-d731-4b63-afc4-4aa112afe0f6/d0e34ea8-e4eb-48d0-812d-3e5358c5b247) {{(pid=91830) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 25 17:03:08.828497 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-838925ed-adbb-430b-876f-1b3a0f72d481 None None] Pushing event updated for resources: {'Port': ['ID=ccbdad71-4af5-49d2-8788-764f277b297e,revision_number=2']} {{(pid=91831) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:03:08.831518 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [None req-838925ed-adbb-430b-876f-1b3a0f72d481 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.075s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:03:08.976525 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-8f8ea177-ebab-4446-b910-939a3571c194 admin admin] Notify callbacks [] for port, precommit_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:03:09.035664 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-8f8ea177-ebab-4446-b910-939a3571c194 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8757892520915', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-27483019'] for port, after_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:03:09.040094 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:03:09.083945 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bc1b6b86-b7a6-4afd-ba29-1e3798d3b54c req-7e1d27eb-1d9b-44ea-87ed-d8def6c8f219 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91830) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:03:09.084673 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [req-bc1b6b86-b7a6-4afd-ba29-1e3798d3b54c req-7e1d27eb-1d9b-44ea-87ed-d8def6c8f219 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] Synchronizing usage tracker for tenant:04e8022f24e3464ab1ab7726d6a07e08 on resource:port {{(pid=91830) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 25 17:03:09.132807 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8f8ea177-ebab-4446-b910-939a3571c194 admin admin] Network 4364b6ab-4117-4a92-baeb-f5ee2f45bf74 is already hosted by enough agents. {{(pid=91830) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 25 17:03:09.136557 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.scheduler.base_scheduler [None req-8f8ea177-ebab-4446-b910-939a3571c194 admin admin] Resources bound (agent type, host, resource id): {{(pid=91830) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 17:03:09.141380 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8f8ea177-ebab-4446-b910-939a3571c194 admin admin] Received port after_create {{(pid=91830) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 25 17:03:09.170965 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [req-bc1b6b86-b7a6-4afd-ba29-1e3798d3b54c req-7e1d27eb-1d9b-44ea-87ed-d8def6c8f219 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] Unset dirty status for tenant:04e8022f24e3464ab1ab7726d6a07e08 on resource:port {{(pid=91830) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 25 17:03:09.172104 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-bc1b6b86-b7a6-4afd-ba29-1e3798d3b54c req-7e1d27eb-1d9b-44ea-87ed-d8def6c8f219 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] 10.222.0.32 "GET /v2.0/ports?device_id=6b63b4a6-5261-4e1c-b796-2f153fc24933 HTTP/1.1" status: 200 len: 945 time: 0.3294673 May 25 17:03:09.180191 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8f8ea177-ebab-4446-b910-939a3571c194 admin admin] Pushing event updated for resources: {'Port': ['ID=d0e34ea8-e4eb-48d0-812d-3e5358c5b247,revision_number=1']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:03:09.217895 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-8f8ea177-ebab-4446-b910-939a3571c194 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.177s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:03:09.720549 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.plugins.ml2.plugin [req-bc1b6b86-b7a6-4afd-ba29-1e3798d3b54c req-0b51f08d-69c2-4bef-a85f-a6e6f51d96d1 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] Deleting port 85443de0-772c-4d18-bd76-026a72cc754d {{(pid=91830) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 25 17:03:09.720991 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [req-bc1b6b86-b7a6-4afd-ba29-1e3798d3b54c req-0b51f08d-69c2-4bef-a85f-a6e6f51d96d1 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8757892952899'] for port, before_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:03:09.740756 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cc2903b2-442d-4b49-a2ef-e8c50a7ccfda req-3cbef532-88d9-4c27-97cc-cd76dcda4011 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:03:09.750401 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-cc2903b2-442d-4b49-a2ef-e8c50a7ccfda req-3cbef532-88d9-4c27-97cc-cd76dcda4011 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] 10.222.0.62 "GET /v2.0/ports?device_id=6b63b4a6-5261-4e1c-b796-2f153fc24933 HTTP/1.1" status: 200 len: 945 time: 0.3290548 May 25 17:03:09.800473 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-cc2903b2-442d-4b49-a2ef-e8c50a7ccfda req-7a85d95a-4be0-4002-b020-ccf240e8b109 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] 10.222.0.62 "GET /v2.0/security-groups?id=f73b90a2-df48-48fb-99e0-5dd4d6a63a15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0486758 May 25 17:03:09.845453 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.rpc [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Device ccbdad71-4af5-49d2-8788-764f277b297e up at agent ovs-agent-dv-cinder-790492-4-iscsi {{(pid=91831) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 25 17:03:09.877440 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-69dd473d-6f7d-459b-bfcb-2f3995b44bd7 None None] Network b351598a-3f6f-4a37-8095-8d9371896ccc requested from dv-cinder-790492-4-iscsi {{(pid=91831) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} May 25 17:03:09.980580 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-8f8ea177-ebab-4446-b910-939a3571c194 admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:03:09.994953 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.provisioning_blocks [None req-cae8c690-afd9-4f94-9a72-d0367a5d45d4 None None] Provisioning for port ccbdad71-4af5-49d2-8788-764f277b297e completed by entity DHCP. {{(pid=91831) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 25 17:03:10.038249 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.provisioning_blocks [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Provisioning for port ccbdad71-4af5-49d2-8788-764f277b297e completed by entity L2. {{(pid=91831) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 25 17:03:10.073845 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.provisioning_blocks [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Provisioning complete for port ccbdad71-4af5-49d2-8788-764f277b297e triggered by entity L2. {{(pid=91831) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 17:03:10.074254 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3854128'] for port, provisioning_complete {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:03:10.090174 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.plugins.ml2.db [req-bc1b6b86-b7a6-4afd-ba29-1e3798d3b54c req-0b51f08d-69c2-4bef-a85f-a6e6f51d96d1 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] For port 85443de0-772c-4d18-bd76-026a72cc754d, host hv-cinder-79049, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79049',level=0,port_id=85443de0-772c-4d18-bd76-026a72cc754d,segment=NetworkSegment(7d7273c2-c6dd-43fe-83a8-cb776d48dc70),segment_id=7d7273c2-c6dd-43fe-83a8-cb776d48dc70)] {{(pid=91830) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 17:03:10.090574 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [req-bc1b6b86-b7a6-4afd-ba29-1e3798d3b54c req-0b51f08d-69c2-4bef-a85f-a6e6f51d96d1 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-683770'] for port, precommit_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:03:10.259512 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3832070'] for port, before_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:03:10.289358 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.plugins.ml2.plugin [req-bc1b6b86-b7a6-4afd-ba29-1e3798d3b54c req-0b51f08d-69c2-4bef-a85f-a6e6f51d96d1 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] Calling delete_port for 85443de0-772c-4d18-bd76-026a72cc754d owned by compute:nova {{(pid=91830) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 25 17:03:10.299052 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.db [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] For port ccbdad71-4af5-49d2-8788-764f277b297e, host dv-cinder-790492-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-790492-4-iscsi',level=0,port_id=ccbdad71-4af5-49d2-8788-764f277b297e,segment=NetworkSegment(b8ba5240-28ce-40db-a6e6-b4a42435e0b6),segment_id=b8ba5240-28ce-40db-a6e6-b4a42435e0b6)] {{(pid=91831) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 17:03:10.305998 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8757892955028', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8757892520933', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8757892521750'] for port, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:03:10.314161 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [None req-12a18a89-5b44-4402-8d0e-0f0a132bc88f None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:03:10.387512 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Pushing event updated for resources: {'Port': ['ID=ccbdad71-4af5-49d2-8788-764f277b297e,revision_number=3']} {{(pid=91831) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:03:10.392065 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.078s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:03:10.512926 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-8f8ea177-ebab-4446-b910-939a3571c194 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-684881', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-683233'] for router, after_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:03:10.534466 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.provisioning_blocks [None req-08aa9ff0-7adf-4223-9e05-fe9a11e09e89 None None] Provisioning complete for port ccbdad71-4af5-49d2-8788-764f277b297e triggered by entity DHCP. {{(pid=91831) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 17:03:10.534860 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-08aa9ff0-7adf-4223-9e05-fe9a11e09e89 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3854128'] for port, provisioning_complete {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:03:10.717093 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [req-bc1b6b86-b7a6-4afd-ba29-1e3798d3b54c req-0b51f08d-69c2-4bef-a85f-a6e6f51d96d1 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8757892955046', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8757892520924', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-27483019'] for port, after_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:03:10.726270 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-f6713847-03cd-4004-8410-4ad749a02e63 tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:03:10.729058 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.db [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] get_ports_and_sgs() called for port_ids ['c4b9c0f2-e3d5-4fff-9b3c-a9175b027fb5', '46a1adbe-ec54-4c57-aa7a-9f257475e01c', '85443de0-772c-4d18-bd76-026a72cc754d'] {{(pid=91831) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 25 17:03:10.807962 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0b51f08d-69c2-4bef-a85f-a6e6f51d96d1 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] Pushing event deleted for resources: {'Port': ['ID=85443de0-772c-4d18-bd76-026a72cc754d,revision_number=None']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:03:10.810323 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-0b51f08d-69c2-4bef-a85f-a6e6f51d96d1 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.084s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:03:10.863092 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.l3_dvrscheduler_db [req-bc1b6b86-b7a6-4afd-ba29-1e3798d3b54c req-0b51f08d-69c2-4bef-a85f-a6e6f51d96d1 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] No DVR routers for this DVR port 85443de0-772c-4d18-bd76-026a72cc754d on host hv-cinder-79049 {{(pid=91830) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 25 17:03:10.865832 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [req-bc1b6b86-b7a6-4afd-ba29-1e3798d3b54c req-0b51f08d-69c2-4bef-a85f-a6e6f51d96d1 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-178712'] for port, before_response {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:03:10.870048 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '6b63b4a6-5261-4e1c-b796-2f153fc24933', 'name': 'network-vif-deleted', 'tag': '85443de0-772c-4d18-bd76-026a72cc754d'}] {{(pid=91830) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 25 17:03:10.904435 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-bc1b6b86-b7a6-4afd-ba29-1e3798d3b54c req-0b51f08d-69c2-4bef-a85f-a6e6f51d96d1 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] 10.222.0.32 "DELETE /v2.0/ports/85443de0-772c-4d18-bd76-026a72cc754d HTTP/1.1" status: 204 len: 173 time: 1.7250643 May 25 17:03:10.930747 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-8f8ea177-ebab-4446-b910-939a3571c194 admin admin] Router f1e3cf65-0e20-4226-8986-652055868473 is scheduled to L3 agent a2d427c1-2d07-43e8-afbe-218c9f7d0445 with binding_index 1 {{(pid=91830) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}} May 25 17:03:11.130132 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '6b63b4a6-5261-4e1c-b796-2f153fc24933', 'name': 'network-vif-deleted', 'tag': '85443de0-772c-4d18-bd76-026a72cc754d', 'status': 'completed', 'code': 200} May 25 17:03:11.236895 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-151eaeb0-0622-4983-b860-00797ae91ae7 req-aa86b16e-e664-4d5e-92db-07b089fdbd25 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] 10.222.0.62 "GET /v2.0/ports?device_id=6b63b4a6-5261-4e1c-b796-2f153fc24933 HTTP/1.1" status: 200 len: 210 time: 0.2054138 May 25 17:03:11.270179 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-8f8ea177-ebab-4446-b910-939a3571c194 admin admin] Notify agent at l3_agent.dv-cinder-790492-4-iscsi the message routers_updated {{(pid=91830) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 25 17:03:11.280184 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e55d8644-7040-463f-b847-4f9f50933f12 None None] Sync routers for ids ['f1e3cf65-0e20-4226-8986-652055868473'] in dv-cinder-790492-4-iscsi {{(pid=91831) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 25 17:03:11.288556 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-8f8ea177-ebab-4446-b910-939a3571c194 admin admin] Notify callbacks [] for router, before_response {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:03:11.289978 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e55d8644-7040-463f-b847-4f9f50933f12 None None] Routers {'f1e3cf65-0e20-4226-8986-652055868473'} bound to L3 agent in host dv-cinder-790492-4-iscsi {{(pid=91831) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 17:03:11.290313 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [None req-8f8ea177-ebab-4446-b910-939a3571c194 admin admin] 10.222.0.62 "POST /v2.0/routers HTTP/1.1" status: 201 len: 921 time: 3.4135642 May 25 17:03:11.290931 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.l3_hamode_db [None req-e55d8644-7040-463f-b847-4f9f50933f12 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-790492-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-05-25T16:50:28Z,description=,heartbeat_timestamp=2021-05-25T17:02:58Z,host='dv-cinder-790492-4-iscsi',id=a2d427c1-2d07-43e8-afbe-218c9f7d0445,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T16:50:28Z,topic='l3_agent')) {'router_ids': ['f1e3cf65-0e20-4226-8986-652055868473'], 'active': True} {{(pid=91831) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 17:03:11.293065 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.wsgi [-] (91830) accepted ('10.222.0.62', 33624) {{(pid=91830) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:03:11.477726 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.l3_dvr_db [None req-e55d8644-7040-463f-b847-4f9f50933f12 None None] Set router f1e3cf65-0e20-4226-8986-652055868473 gateway port host: dv-cinder-790492-4-iscsi {{(pid=91831) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 17:03:11.767972 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.l3_hamode_db [None req-e55d8644-7040-463f-b847-4f9f50933f12 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'f1e3cf65-0e20-4226-8986-652055868473', 'name': 'tempest-AttachVolumeTestJSON-312968156-router', 'tenant_id': '70dac097fff04aed99a4976fa955579b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'external_fixed_ips': [{'subnet_id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'ip_address': '172.27.2.63'}], 'enable_snat': True}, 'gw_port_id': 'd0e34ea8-e4eb-48d0-812d-3e5358c5b247', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T17:03:07Z', 'updated_at': '2021-05-25T17:03:09Z', 'revision_number': 3, 'project_id': '70dac097fff04aed99a4976fa955579b', 'gw_port': {'id': 'd0e34ea8-e4eb-48d0-812d-3e5358c5b247', 'name': '', 'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'tenant_id': '', 'mac_address': 'fa:16:3e:be:2a:11', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'f1e3cf65-0e20-4226-8986-652055868473', 'device_owner': 'network:router_gateway', 'standard_attr_id': 477, 'fixed_ips': [{'subnet_id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'ip_address': '172.27.2.63', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:03:08Z', 'updated_at': '2021-05-25T17:03:08Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-790492-4-iscsi'}], 'dv-cinder-790492-4-iscsi', False) {} {{(pid=91831) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 17:03:11.770238 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.rpc [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Device ccbdad71-4af5-49d2-8788-764f277b297e up at agent ovs-agent-dv-cinder-790492-4-iscsi {{(pid=91831) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 25 17:03:11.816207 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e55d8644-7040-463f-b847-4f9f50933f12 None None] Checking router: f1e3cf65-0e20-4226-8986-652055868473 for host: dv-cinder-790492-4-iscsi {{(pid=91831) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 25 17:03:11.816558 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e55d8644-7040-463f-b847-4f9f50933f12 None None] Updating router f1e3cf65-0e20-4226-8986-652055868473 port d0e34ea8-e4eb-48d0-812d-3e5358c5b247 binding host dv-cinder-790492-4-iscsi {{(pid=91831) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} May 25 17:03:11.883645 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-e55d8644-7040-463f-b847-4f9f50933f12 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3832070'] for port, before_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:03:11.979510 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.provisioning_blocks [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Provisioning complete for port ccbdad71-4af5-49d2-8788-764f277b297e triggered by entity L2. {{(pid=91831) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 17:03:11.979799 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3854128'] for port, provisioning_complete {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:03:11.987508 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-39832d44-63ae-4e83-b8ae-4fa49fd193a6 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3832070'] for port, before_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:03:12.204329 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.db_base_plugin_common [None req-39832d44-63ae-4e83-b8ae-4fa49fd193a6 admin admin] Allocated IP 172.20.0.1 (b351598a-3f6f-4a37-8095-8d9371896ccc/4bbae145-74ed-4fda-b7c0-ae77a3202a83/6561ca57-f5fa-4bba-803c-ac716f98a0fb) {{(pid=91830) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 25 17:03:12.330767 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-e55d8644-7040-463f-b847-4f9f50933f12 None None] Notify callbacks [] for port, precommit_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:03:12.343962 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.provisioning_blocks [None req-e55d8644-7040-463f-b847-4f9f50933f12 None None] Transition to ACTIVE for port object d0e34ea8-e4eb-48d0-812d-3e5358c5b247 will not be triggered until provisioned by entity L2. {{(pid=91831) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 25 17:03:12.351529 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-e55d8644-7040-463f-b847-4f9f50933f12 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8757892955028', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8757892520933', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8757892521750'] for port, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:03:12.356663 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [None req-dbccdb86-a843-4579-865e-b4299e6f33cf None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:03:12.362612 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-39832d44-63ae-4e83-b8ae-4fa49fd193a6 admin admin] Notify callbacks [] for port, precommit_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:03:12.378313 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.provisioning_blocks [None req-39832d44-63ae-4e83-b8ae-4fa49fd193a6 admin admin] Transition to ACTIVE for port object 6561ca57-f5fa-4bba-803c-ac716f98a0fb will not be triggered until provisioned by entity DHCP. {{(pid=91830) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 25 17:03:12.404341 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-39832d44-63ae-4e83-b8ae-4fa49fd193a6 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8757892520915', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-27483019'] for port, after_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:03:12.408985 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-91b43151-d64d-47f8-8e6e-86c6c40ce00c service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:03:12.434248 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.managers [None req-e55d8644-7040-463f-b847-4f9f50933f12 None None] Attempting to bind port d0e34ea8-e4eb-48d0-812d-3e5358c5b247 on host dv-cinder-790492-4-iscsi for vnic_type normal with profile {{(pid=91831) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 25 17:03:12.434626 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.managers [None req-e55d8644-7040-463f-b847-4f9f50933f12 None None] Attempting to bind port d0e34ea8-e4eb-48d0-812d-3e5358c5b247 by drivers openvswitch,hyperv on host dv-cinder-790492-4-iscsi at level 0 using segments [{'id': '414a8468-1d66-4792-9e81-d8ac5ccf1512', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74'}] {{(pid=91831) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 25 17:03:12.434996 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e55d8644-7040-463f-b847-4f9f50933f12 None None] Attempting to bind port d0e34ea8-e4eb-48d0-812d-3e5358c5b247 on network 4364b6ab-4117-4a92-baeb-f5ee2f45bf74 {{(pid=91831) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 25 17:03:12.444537 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0c176240-54ab-4c4f-9583-59c938361492 None None] Pushing event updated for resources: {'Port': ['ID=d0e34ea8-e4eb-48d0-812d-3e5358c5b247,revision_number=2']} {{(pid=91831) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:03:12.447026 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e55d8644-7040-463f-b847-4f9f50933f12 None None] Checking agent: {'id': 'fc8251e1-071c-49f7-bc10-1337f1d37d1b', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-790492-4-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 25, 16, 50, 28), 'started_at': datetime.datetime(2021, 5, 25, 16, 50, 58), 'heartbeat_timestamp': datetime.datetime(2021, 5, 25, 17, 2, 58), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-790492-4-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=91831) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 25 17:03:12.447406 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e55d8644-7040-463f-b847-4f9f50933f12 None None] Checking segment: {'id': '414a8468-1d66-4792-9e81-d8ac5ccf1512', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91831) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 25 17:03:12.447813 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-e55d8644-7040-463f-b847-4f9f50933f12 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:03:12.448207 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e55d8644-7040-463f-b847-4f9f50933f12 None None] Bound using segment: {'id': '414a8468-1d66-4792-9e81-d8ac5ccf1512', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74'} {{(pid=91831) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 25 17:03:12.448675 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.managers [None req-e55d8644-7040-463f-b847-4f9f50933f12 None None] Bound port: d0e34ea8-e4eb-48d0-812d-3e5358c5b247, host: dv-cinder-790492-4-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '414a8468-1d66-4792-9e81-d8ac5ccf1512', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74'}}] {{(pid=91831) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 25 17:03:12.449061 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-e55d8644-7040-463f-b847-4f9f50933f12 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3832070'] for port, before_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:03:12.478480 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [None req-0c176240-54ab-4c4f-9583-59c938361492 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.122s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:03:12.489838 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-39832d44-63ae-4e83-b8ae-4fa49fd193a6 admin admin] Pushing event updated for resources: {'Port': ['ID=6561ca57-f5fa-4bba-803c-ac716f98a0fb,revision_number=1']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:03:12.496439 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-39832d44-63ae-4e83-b8ae-4fa49fd193a6 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.087s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:03:12.510344 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-39832d44-63ae-4e83-b8ae-4fa49fd193a6 admin admin] Network b351598a-3f6f-4a37-8095-8d9371896ccc is already hosted by enough agents. {{(pid=91830) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 25 17:03:12.511776 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.scheduler.base_scheduler [None req-39832d44-63ae-4e83-b8ae-4fa49fd193a6 admin admin] Resources bound (agent type, host, resource id): {{(pid=91830) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 17:03:12.514555 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.l3_dvrscheduler_db [None req-39832d44-63ae-4e83-b8ae-4fa49fd193a6 admin admin] Received port after_create {{(pid=91830) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 25 17:03:12.532204 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.db [None req-e55d8644-7040-463f-b847-4f9f50933f12 None None] For port d0e34ea8-e4eb-48d0-812d-3e5358c5b247, host dv-cinder-790492-4-iscsi, cleared binding levels {{(pid=91831) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 25 17:03:12.536649 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.db [None req-e55d8644-7040-463f-b847-4f9f50933f12 None None] For port d0e34ea8-e4eb-48d0-812d-3e5358c5b247, host dv-cinder-790492-4-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-790492-4-iscsi',level=0,port_id=d0e34ea8-e4eb-48d0-812d-3e5358c5b247,segment=NetworkSegment(414a8468-1d66-4792-9e81-d8ac5ccf1512),segment_id=414a8468-1d66-4792-9e81-d8ac5ccf1512)] {{(pid=91831) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 25 17:03:12.542934 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-e55d8644-7040-463f-b847-4f9f50933f12 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8757892955028', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8757892520933', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8757892521750'] for port, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:03:12.548617 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [None req-b0d85d62-a45e-4615-b952-f2b33680a7ad None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:03:12.591947 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-39832d44-63ae-4e83-b8ae-4fa49fd193a6 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-680080'] for router_interface, before_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:03:12.631498 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e55d8644-7040-463f-b847-4f9f50933f12 None None] Routers {'f1e3cf65-0e20-4226-8986-652055868473'} bound to L3 agent in host dv-cinder-790492-4-iscsi {{(pid=91831) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 17:03:12.632139 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.l3_hamode_db [None req-e55d8644-7040-463f-b847-4f9f50933f12 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-790492-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-05-25T16:50:28Z,description=,heartbeat_timestamp=2021-05-25T17:02:58Z,host='dv-cinder-790492-4-iscsi',id=a2d427c1-2d07-43e8-afbe-218c9f7d0445,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T16:50:28Z,topic='l3_agent')) {'router_ids': ['f1e3cf65-0e20-4226-8986-652055868473'], 'active': True} {{(pid=91831) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 17:03:12.731436 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0c176240-54ab-4c4f-9583-59c938361492 None None] Pushing event updated for resources: {'Port': ['ID=d0e34ea8-e4eb-48d0-812d-3e5358c5b247,revision_number=3']} {{(pid=91831) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:03:12.746898 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-39832d44-63ae-4e83-b8ae-4fa49fd193a6 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3832070'] for port, before_update {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:03:12.752989 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [None req-0c176240-54ab-4c4f-9583-59c938361492 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.204s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:03:12.829366 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c9655470-807b-4386-8ac0-d13d1b7787e5 req-b5601063-a35d-4b49-957a-b53b6580a4d1 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:03:12.831079 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-c9655470-807b-4386-8ac0-d13d1b7787e5 req-b5601063-a35d-4b49-957a-b53b6580a4d1 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] 10.222.0.62 "GET /v2.0/ports?device_id=e2dfa29d-fe86-4425-b12b-d984d7f0584a HTTP/1.1" status: 200 len: 946 time: 0.1530509 May 25 17:03:12.859535 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.provisioning_blocks [None req-acd8a1b2-be08-4635-89cb-a5e8e71e9c55 None None] Provisioning for port 6561ca57-f5fa-4bba-803c-ac716f98a0fb completed by entity DHCP. {{(pid=91831) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 25 17:03:12.871229 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.provisioning_blocks [None req-acd8a1b2-be08-4635-89cb-a5e8e71e9c55 None None] Provisioning complete for port 6561ca57-f5fa-4bba-803c-ac716f98a0fb triggered by entity DHCP. {{(pid=91831) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 17:03:12.871604 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-acd8a1b2-be08-4635-89cb-a5e8e71e9c55 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3854128'] for port, provisioning_complete {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:03:12.883573 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-c9655470-807b-4386-8ac0-d13d1b7787e5 req-66894b2a-f832-438f-8a9a-f64a7e63d969 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] 10.222.0.62 "GET /v2.0/security-groups?id=f73b90a2-df48-48fb-99e0-5dd4d6a63a15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0461705 May 25 17:03:12.915230 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.l3_dvr_db [None req-e55d8644-7040-463f-b847-4f9f50933f12 None None] Set router f1e3cf65-0e20-4226-8986-652055868473 gateway port host: dv-cinder-790492-4-iscsi {{(pid=91831) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 17:03:12.995242 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.plugin [None req-acd8a1b2-be08-4635-89cb-a5e8e71e9c55 None None] Port 6561ca57-f5fa-4bba-803c-ac716f98a0fb cannot update to ACTIVE because it is not bound. {{(pid=91831) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 25 17:03:13.072578 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-39832d44-63ae-4e83-b8ae-4fa49fd193a6 admin admin] Notify callbacks [] for port, precommit_update {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:03:13.077901 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-39832d44-63ae-4e83-b8ae-4fa49fd193a6 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8757892955028', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8757892520933', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8757892521750', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-27483010'] for port, after_update {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:03:13.104486 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:03:13.184500 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-39832d44-63ae-4e83-b8ae-4fa49fd193a6 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-549138', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-679997'] for router_interface, after_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:03:13.188764 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-39832d44-63ae-4e83-b8ae-4fa49fd193a6 admin admin] Pushing event updated for resources: {'Port': ['ID=6561ca57-f5fa-4bba-803c-ac716f98a0fb,revision_number=2']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:03:13.193007 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-39832d44-63ae-4e83-b8ae-4fa49fd193a6 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.088s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:03:13.242240 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.l3_hamode_db [None req-e55d8644-7040-463f-b847-4f9f50933f12 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'f1e3cf65-0e20-4226-8986-652055868473', 'name': 'tempest-AttachVolumeTestJSON-312968156-router', 'tenant_id': '70dac097fff04aed99a4976fa955579b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'external_fixed_ips': [{'subnet_id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'ip_address': '172.27.2.63'}], 'enable_snat': True}, 'gw_port_id': 'd0e34ea8-e4eb-48d0-812d-3e5358c5b247', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T17:03:07Z', 'updated_at': '2021-05-25T17:03:12Z', 'revision_number': 4, 'project_id': '70dac097fff04aed99a4976fa955579b', 'gw_port': {'id': 'd0e34ea8-e4eb-48d0-812d-3e5358c5b247', 'name': '', 'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'tenant_id': '', 'mac_address': 'fa:16:3e:be:2a:11', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'f1e3cf65-0e20-4226-8986-652055868473', 'device_owner': 'network:router_gateway', 'standard_attr_id': 477, 'fixed_ips': [{'subnet_id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'ip_address': '172.27.2.63', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790492-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:03:08Z', 'updated_at': '2021-05-25T17:03:12Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-790492-4-iscsi', '_interfaces': [{'id': '6561ca57-f5fa-4bba-803c-ac716f98a0fb', 'name': '', 'network_id': 'b351598a-3f6f-4a37-8095-8d9371896ccc', 'tenant_id': '70dac097fff04aed99a4976fa955579b', 'mac_address': 'fa:16:3e:2f:70:71', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'f1e3cf65-0e20-4226-8986-652055868473', 'device_owner': 'network:router_interface', 'standard_attr_id': 478, 'fixed_ips': [{'subnet_id': '4bbae145-74ed-4fda-b7c0-ae77a3202a83', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:03:12Z', 'updated_at': '2021-05-25T17:03:12Z', 'revision_number': 1, 'project_id': '70dac097fff04aed99a4976fa955579b', 'subnets': [{'id': '4bbae145-74ed-4fda-b7c0-ae77a3202a83', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-790492-4-iscsi', False) {} {{(pid=91831) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 17:03:13.246566 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e55d8644-7040-463f-b847-4f9f50933f12 None None] The sync data for ids ['f1e3cf65-0e20-4226-8986-652055868473'] in dv-cinder-790492-4-iscsi is: [{'id': 'f1e3cf65-0e20-4226-8986-652055868473', 'name': 'tempest-AttachVolumeTestJSON-312968156-router', 'tenant_id': '70dac097fff04aed99a4976fa955579b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'external_fixed_ips': [{'subnet_id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'ip_address': '172.27.2.63'}], 'enable_snat': True}, 'gw_port_id': 'd0e34ea8-e4eb-48d0-812d-3e5358c5b247', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T17:03:07Z', 'updated_at': '2021-05-25T17:03:12Z', 'revision_number': 4, 'project_id': '70dac097fff04aed99a4976fa955579b', 'gw_port': {'id': 'd0e34ea8-e4eb-48d0-812d-3e5358c5b247', 'name': '', 'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'tenant_id': '', 'mac_address': 'fa:16:3e:be:2a:11', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'f1e3cf65-0e20-4226-8986-652055868473', 'device_owner': 'network:router_gateway', 'standard_attr_id': 477, 'fixed_ips': [{'subnet_id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'ip_address': '172.27.2.63', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790492-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:03:08Z', 'updated_at': '2021-05-25T17:03:12Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-790492-4-iscsi', '_interfaces': [{'id': '6561ca57-f5fa-4bba-803c-ac716f98a0fb', 'name': '', 'network_id': 'b351598a-3f6f-4a37-8095-8d9371896ccc', 'tenant_id': '70dac097fff04aed99a4976fa955579b', 'mac_address': 'fa:16:3e:2f:70:71', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'f1e3cf65-0e20-4226-8986-652055868473', 'device_owner': 'network:router_interface', 'standard_attr_id': 478, 'fixed_ips': [{'subnet_id': '4bbae145-74ed-4fda-b7c0-ae77a3202a83', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:03:12Z', 'updated_at': '2021-05-25T17:03:12Z', 'revision_number': 1, 'project_id': '70dac097fff04aed99a4976fa955579b', 'subnets': [{'id': '4bbae145-74ed-4fda-b7c0-ae77a3202a83', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=91831) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 25 17:03:13.323961 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-39832d44-63ae-4e83-b8ae-4fa49fd193a6 admin admin] Network b351598a-3f6f-4a37-8095-8d9371896ccc is already hosted by enough agents. {{(pid=91830) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 25 17:03:13.325214 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.scheduler.base_scheduler [None req-39832d44-63ae-4e83-b8ae-4fa49fd193a6 admin admin] Resources bound (agent type, host, resource id): {{(pid=91830) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 17:03:13.544420 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-39832d44-63ae-4e83-b8ae-4fa49fd193a6 admin admin] Router f1e3cf65-0e20-4226-8986-652055868473 has already been hosted by L3 agent a2d427c1-2d07-43e8-afbe-218c9f7d0445 {{(pid=91830) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 25 17:03:13.617740 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.provisioning_blocks [None req-01860fa0-75ce-4ead-88c7-a98853d0f179 None None] Provisioning complete for port 6561ca57-f5fa-4bba-803c-ac716f98a0fb triggered by entity DHCP. {{(pid=91831) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 17:03:13.618375 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-01860fa0-75ce-4ead-88c7-a98853d0f179 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3854128'] for port, provisioning_complete {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:03:13.676964 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.plugin [None req-01860fa0-75ce-4ead-88c7-a98853d0f179 None None] Port 6561ca57-f5fa-4bba-803c-ac716f98a0fb cannot update to ACTIVE because it is not bound. {{(pid=91831) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 25 17:03:13.728568 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-39832d44-63ae-4e83-b8ae-4fa49fd193a6 admin admin] Notify agent at l3_agent.dv-cinder-790492-4-iscsi the message routers_updated {{(pid=91830) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 25 17:03:13.737671 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [None req-39832d44-63ae-4e83-b8ae-4fa49fd193a6 admin admin] 10.222.0.62 "PUT /v2.0/routers/f1e3cf65-0e20-4226-8986-652055868473/add_router_interface HTTP/1.1" status: 200 len: 503 time: 2.4435120 May 25 17:03:14.257693 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.rpc [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Device 85443de0-772c-4d18-bd76-026a72cc754d no longer exists at agent hyperv_hv-cinder-79049 {{(pid=91831) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 25 17:03:14.300855 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.plugin [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] No Port match for: 85443de0-772c-4d18-bd76-026a72cc754d {{(pid=91831) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}} May 25 17:03:14.301216 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.rpc [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Device 85443de0-772c-4d18-bd76-026a72cc754d not bound to the agent host hv-cinder-79049 {{(pid=91831) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 25 17:03:14.352873 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.wsgi [-] (91830) accepted ('10.222.0.62', 33654) {{(pid=91830) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:03:14.358399 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.v2.base [None req-0359d694-209e-40f3-b9f0-909aec736f53 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Request body: {'security_group': {'name': 'tempest-securitygroup--991132492', 'description': 'tempest-description--2423638'}} {{(pid=91830) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 17:03:14.364467 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.quota.driver [None req-0359d694-209e-40f3-b9f0-909aec736f53 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91830) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 17:03:14.371018 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [None req-0359d694-209e-40f3-b9f0-909aec736f53 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Usage tracker for resource:security_group and tenant:70dac097fff04aed99a4976fa955579b is out of sync, need to count used quota {{(pid=91830) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 17:03:14.374469 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [None req-0359d694-209e-40f3-b9f0-909aec736f53 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Quota usage for security_group was recalculated. Used quota:1. {{(pid=91830) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 17:03:14.380266 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.quota.driver [None req-0359d694-209e-40f3-b9f0-909aec736f53 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=91830) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 17:03:14.392776 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-0359d694-209e-40f3-b9f0-909aec736f53 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Notify callbacks [] for security_group, before_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:03:14.417707 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.quota.driver [None req-0359d694-209e-40f3-b9f0-909aec736f53 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91830) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 17:03:14.422137 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [None req-0359d694-209e-40f3-b9f0-909aec736f53 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Usage tracker for resource:security_group_rule and tenant:70dac097fff04aed99a4976fa955579b is out of sync, need to count used quota {{(pid=91830) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 17:03:14.425072 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [None req-0359d694-209e-40f3-b9f0-909aec736f53 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=91830) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 17:03:14.431348 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.quota.driver [None req-0359d694-209e-40f3-b9f0-909aec736f53 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=91830) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 17:03:14.510122 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-0359d694-209e-40f3-b9f0-909aec736f53 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Notify callbacks [] for security_group, precommit_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:03:14.515256 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-0359d694-209e-40f3-b9f0-909aec736f53 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-640836'] for security_group, after_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:03:14.520284 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-635d8fdb-df1a-43da-af11-7ddcc1ea0533 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:03:14.525215 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3000d234-1afb-43ea-b20c-628443d68ef5 req-4973ac14-7e9c-472e-98b6-f6f125db7557 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:03:14.526721 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-3000d234-1afb-43ea-b20c-628443d68ef5 req-4973ac14-7e9c-472e-98b6-f6f125db7557 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] 10.222.0.62 "GET /v2.0/ports?device_id=e2dfa29d-fe86-4425-b12b-d984d7f0584a HTTP/1.1" status: 200 len: 946 time: 0.0967557 May 25 17:03:14.558703 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0359d694-209e-40f3-b9f0-909aec736f53 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Pushing event updated for resources: {'SecurityGroup': ['ID=7cad7118-dc73-4cab-9cb2-fa41cd4499bd,revision_number=1']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:03:14.561174 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-0359d694-209e-40f3-b9f0-909aec736f53 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Notify callbacks [] for security_group, before_response {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:03:14.564980 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [None req-0359d694-209e-40f3-b9f0-909aec736f53 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] 10.222.0.62 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1776 time: 0.2085383 May 25 17:03:14.564980 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-0359d694-209e-40f3-b9f0-909aec736f53 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.043s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:03:14.565228 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.wsgi [-] (91830) accepted ('10.222.0.62', 33658) {{(pid=91830) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:03:14.573041 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.v2.base [None req-8e081232-cf87-431c-9164-cf1063ef3624 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Request body: {'security_group_rule': {'security_group_id': '7cad7118-dc73-4cab-9cb2-fa41cd4499bd', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=91830) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 17:03:14.579387 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.quota.driver [None req-8e081232-cf87-431c-9164-cf1063ef3624 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91830) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 17:03:14.582406 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-3000d234-1afb-43ea-b20c-628443d68ef5 req-ea84a711-0925-4f10-9154-7259e62dc4fa tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] 10.222.0.62 "GET /v2.0/security-groups?id=f73b90a2-df48-48fb-99e0-5dd4d6a63a15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0487158 May 25 17:03:14.583150 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [None req-8e081232-cf87-431c-9164-cf1063ef3624 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Usage tracker for resource:security_group_rule and tenant:70dac097fff04aed99a4976fa955579b is out of sync, need to count used quota {{(pid=91830) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 17:03:14.586184 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [None req-8e081232-cf87-431c-9164-cf1063ef3624 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=91830) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 17:03:14.591975 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.quota.driver [None req-8e081232-cf87-431c-9164-cf1063ef3624 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=91830) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 17:03:14.609234 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-8e081232-cf87-431c-9164-cf1063ef3624 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Notify callbacks [] for security_group_rule, before_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:03:14.669003 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-8e081232-cf87-431c-9164-cf1063ef3624 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:03:14.672564 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-8e081232-cf87-431c-9164-cf1063ef3624 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-640874'] for security_group_rule, after_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:03:14.678183 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:03:14.696850 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e081232-cf87-431c-9164-cf1063ef3624 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=00eec70c-9a4e-4d9b-aaf5-cf9181a4b0bd,revision_number=0']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:03:14.699175 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-8e081232-cf87-431c-9164-cf1063ef3624 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.021s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:03:14.708128 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-8e081232-cf87-431c-9164-cf1063ef3624 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Notify callbacks [] for security_group_rule, before_response {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:03:14.709293 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [None req-8e081232-cf87-431c-9164-cf1063ef3624 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] 10.222.0.62 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.1431851 May 25 17:03:14.711853 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.wsgi [-] (91830) accepted ('10.222.0.62', 33662) {{(pid=91830) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:03:14.716923 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.v2.base [None req-4e36b31f-31af-4903-9300-c17c6aabd856 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Request body: {'security_group_rule': {'security_group_id': '7cad7118-dc73-4cab-9cb2-fa41cd4499bd', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=91830) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 17:03:14.722421 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.quota.driver [None req-4e36b31f-31af-4903-9300-c17c6aabd856 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91830) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 17:03:14.726098 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [None req-4e36b31f-31af-4903-9300-c17c6aabd856 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Usage tracker for resource:security_group_rule and tenant:70dac097fff04aed99a4976fa955579b is out of sync, need to count used quota {{(pid=91830) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 17:03:14.728895 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [None req-4e36b31f-31af-4903-9300-c17c6aabd856 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Quota usage for security_group_rule was recalculated. Used quota:7. {{(pid=91830) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 17:03:14.734583 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.quota.driver [None req-4e36b31f-31af-4903-9300-c17c6aabd856 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 7; quota limit: 100; headroom:93 {{(pid=91830) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 17:03:14.750796 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-4e36b31f-31af-4903-9300-c17c6aabd856 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Notify callbacks [] for security_group_rule, before_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:03:14.817367 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-4e36b31f-31af-4903-9300-c17c6aabd856 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:03:14.829753 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-4e36b31f-31af-4903-9300-c17c6aabd856 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-640874'] for security_group_rule, after_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:03:14.832146 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-b0bff771-3a8c-4531-b3b4-15d6264369c1 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:03:14.856474 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4e36b31f-31af-4903-9300-c17c6aabd856 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=ad64f12b-b08c-492b-be11-f8a6c25e5df3,revision_number=0']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:03:14.859474 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-4e36b31f-31af-4903-9300-c17c6aabd856 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.027s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:03:14.867932 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-4e36b31f-31af-4903-9300-c17c6aabd856 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Notify callbacks [] for security_group_rule, before_response {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:03:14.869287 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [None req-4e36b31f-31af-4903-9300-c17c6aabd856 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] 10.222.0.62 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.1564813 May 25 17:03:14.872482 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.wsgi [-] (91830) accepted ('10.222.0.62', 33666) {{(pid=91830) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:03:14.878444 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.v2.base [None req-b497bade-28f9-4a02-be35-5fb97f089477 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Request body: {'floatingip': {'floating_network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74'}} {{(pid=91830) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 17:03:14.884362 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.quota.driver [None req-b497bade-28f9-4a02-be35-5fb97f089477 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91830) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 17:03:14.888194 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [None req-b497bade-28f9-4a02-be35-5fb97f089477 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Usage tracker for resource:floatingip and tenant:70dac097fff04aed99a4976fa955579b is out of sync, need to count used quota {{(pid=91830) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 17:03:14.892581 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [None req-b497bade-28f9-4a02-be35-5fb97f089477 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Quota usage for floatingip was recalculated. Used quota:0. {{(pid=91830) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 17:03:14.898328 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.quota.driver [None req-b497bade-28f9-4a02-be35-5fb97f089477 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Attempting to reserve 1 items for resource floatingip. Total usage: 0; quota limit: 50; headroom:50 {{(pid=91830) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 17:03:14.909184 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-b497bade-28f9-4a02-be35-5fb97f089477 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Notify callbacks [] for floatingip, before_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:03:15.048762 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-b497bade-28f9-4a02-be35-5fb97f089477 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3832070'] for port, before_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:03:15.186223 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.db_base_plugin_common [None req-b497bade-28f9-4a02-be35-5fb97f089477 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Allocated IP 172.27.2.221 (4364b6ab-4117-4a92-baeb-f5ee2f45bf74/b947e790-d731-4b63-afc4-4aa112afe0f6/4046cecc-5593-4f96-8536-d712f0d987ad) {{(pid=91830) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 25 17:03:15.195924 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-48cbf83e-3bf9-41bb-b9e1-a21eda61065a None None] Sync routers for ids ['f1e3cf65-0e20-4226-8986-652055868473'] in dv-cinder-790492-4-iscsi {{(pid=91832) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 25 17:03:15.206134 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.db.l3_dvrscheduler_db [None req-48cbf83e-3bf9-41bb-b9e1-a21eda61065a None None] Routers {'f1e3cf65-0e20-4226-8986-652055868473'} bound to L3 agent in host dv-cinder-790492-4-iscsi {{(pid=91832) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 17:03:15.206883 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.db.l3_hamode_db [None req-48cbf83e-3bf9-41bb-b9e1-a21eda61065a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-790492-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-05-25T16:50:28Z,description=,heartbeat_timestamp=2021-05-25T17:02:58Z,host='dv-cinder-790492-4-iscsi',id=a2d427c1-2d07-43e8-afbe-218c9f7d0445,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T16:50:28Z,topic='l3_agent')) {'router_ids': ['f1e3cf65-0e20-4226-8986-652055868473'], 'active': True} {{(pid=91832) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 17:03:15.333421 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-b497bade-28f9-4a02-be35-5fb97f089477 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Notify callbacks [] for port, precommit_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:03:15.366815 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-b497bade-28f9-4a02-be35-5fb97f089477 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8757892520915', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-27483019'] for port, after_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:03:15.371513 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-4baa5ddf-03c6-4570-8909-68ce30a18a53 tempest-VolumesSnapshotTestJSON-991813121 tempest-VolumesSnapshotTestJSON-991813121-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:03:15.385037 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.db.l3_dvr_db [None req-48cbf83e-3bf9-41bb-b9e1-a21eda61065a None None] Set router f1e3cf65-0e20-4226-8986-652055868473 gateway port host: dv-cinder-790492-4-iscsi {{(pid=91832) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 17:03:15.523407 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b497bade-28f9-4a02-be35-5fb97f089477 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Network 4364b6ab-4117-4a92-baeb-f5ee2f45bf74 is already hosted by enough agents. {{(pid=91830) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 25 17:03:15.526264 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.scheduler.base_scheduler [None req-b497bade-28f9-4a02-be35-5fb97f089477 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Resources bound (agent type, host, resource id): {{(pid=91830) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 17:03:15.529843 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b497bade-28f9-4a02-be35-5fb97f089477 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Received port after_create {{(pid=91830) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 25 17:03:15.566611 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b497bade-28f9-4a02-be35-5fb97f089477 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Pushing event updated for resources: {'Port': ['ID=4046cecc-5593-4f96-8536-d712f0d987ad,revision_number=1']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:03:15.574231 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-b497bade-28f9-4a02-be35-5fb97f089477 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.202s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:03:15.617416 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-b497bade-28f9-4a02-be35-5fb97f089477 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Notify callbacks [] for floatingip, precommit_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:03:15.681385 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-b497bade-28f9-4a02-be35-5fb97f089477 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3832070'] for port, before_update {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:03:15.714033 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.db.l3_hamode_db [None req-48cbf83e-3bf9-41bb-b9e1-a21eda61065a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'f1e3cf65-0e20-4226-8986-652055868473', 'name': 'tempest-AttachVolumeTestJSON-312968156-router', 'tenant_id': '70dac097fff04aed99a4976fa955579b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'external_fixed_ips': [{'subnet_id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'ip_address': '172.27.2.63'}], 'enable_snat': True}, 'gw_port_id': 'd0e34ea8-e4eb-48d0-812d-3e5358c5b247', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T17:03:07Z', 'updated_at': '2021-05-25T17:03:12Z', 'revision_number': 4, 'project_id': '70dac097fff04aed99a4976fa955579b', 'gw_port': {'id': 'd0e34ea8-e4eb-48d0-812d-3e5358c5b247', 'name': '', 'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'tenant_id': '', 'mac_address': 'fa:16:3e:be:2a:11', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'f1e3cf65-0e20-4226-8986-652055868473', 'device_owner': 'network:router_gateway', 'standard_attr_id': 477, 'fixed_ips': [{'subnet_id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'ip_address': '172.27.2.63', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790492-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:03:08Z', 'updated_at': '2021-05-25T17:03:12Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-790492-4-iscsi', '_interfaces': [{'id': '6561ca57-f5fa-4bba-803c-ac716f98a0fb', 'name': '', 'network_id': 'b351598a-3f6f-4a37-8095-8d9371896ccc', 'tenant_id': '70dac097fff04aed99a4976fa955579b', 'mac_address': 'fa:16:3e:2f:70:71', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'f1e3cf65-0e20-4226-8986-652055868473', 'device_owner': 'network:router_interface', 'standard_attr_id': 478, 'fixed_ips': [{'subnet_id': '4bbae145-74ed-4fda-b7c0-ae77a3202a83', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:03:12Z', 'updated_at': '2021-05-25T17:03:12Z', 'revision_number': 2, 'project_id': '70dac097fff04aed99a4976fa955579b', 'subnets': [{'id': '4bbae145-74ed-4fda-b7c0-ae77a3202a83', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-790492-4-iscsi', False) {} {{(pid=91832) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 17:03:15.718383 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-48cbf83e-3bf9-41bb-b9e1-a21eda61065a None None] Checking router: f1e3cf65-0e20-4226-8986-652055868473 for host: dv-cinder-790492-4-iscsi {{(pid=91832) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 25 17:03:15.718733 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-48cbf83e-3bf9-41bb-b9e1-a21eda61065a None None] Updating router f1e3cf65-0e20-4226-8986-652055868473 port 6561ca57-f5fa-4bba-803c-ac716f98a0fb binding host dv-cinder-790492-4-iscsi {{(pid=91832) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} May 25 17:03:15.777500 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron_lib.callbacks.manager [None req-48cbf83e-3bf9-41bb-b9e1-a21eda61065a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3832070'] for port, before_update {{(pid=91832) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:03:15.800103 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f849b618-7f1f-4264-b7b5-84b731b63a53 req-2926de03-df11-4c0d-bdae-ac47bff03ed9 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:03:15.801705 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-f849b618-7f1f-4264-b7b5-84b731b63a53 req-2926de03-df11-4c0d-bdae-ac47bff03ed9 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] 10.222.0.62 "GET /v2.0/ports?device_id=e2dfa29d-fe86-4425-b12b-d984d7f0584a HTTP/1.1" status: 200 len: 946 time: 0.1132243 May 25 17:03:15.826129 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.rpc [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Device d0e34ea8-e4eb-48d0-812d-3e5358c5b247 up at agent ovs-agent-dv-cinder-790492-4-iscsi {{(pid=91831) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 25 17:03:15.857086 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-f849b618-7f1f-4264-b7b5-84b731b63a53 req-14eba8a8-33ce-43e6-bfd5-6a1c911d6b74 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] 10.222.0.62 "GET /v2.0/security-groups?id=f73b90a2-df48-48fb-99e0-5dd4d6a63a15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0470262 May 25 17:03:15.912347 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.provisioning_blocks [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Provisioning for port d0e34ea8-e4eb-48d0-812d-3e5358c5b247 completed by entity L2. {{(pid=91831) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 25 17:03:15.917112 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.provisioning_blocks [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Provisioning complete for port d0e34ea8-e4eb-48d0-812d-3e5358c5b247 triggered by entity L2. {{(pid=91831) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 17:03:15.917558 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3854128'] for port, provisioning_complete {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:03:15.919017 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-b497bade-28f9-4a02-be35-5fb97f089477 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Notify callbacks [] for port, precommit_update {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:03:15.924814 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-b497bade-28f9-4a02-be35-5fb97f089477 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8757892955028', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8757892520933', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8757892521750', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-27483010'] for port, after_update {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:03:15.929056 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-0b51f08d-69c2-4bef-a85f-a6e6f51d96d1 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:03:16.042579 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b497bade-28f9-4a02-be35-5fb97f089477 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Pushing event updated for resources: {'Port': ['ID=4046cecc-5593-4f96-8536-d712f0d987ad,revision_number=2']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:03:16.047665 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-b497bade-28f9-4a02-be35-5fb97f089477 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.119s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:03:16.052675 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3832070'] for port, before_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:03:16.058405 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-b497bade-28f9-4a02-be35-5fb97f089477 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-683033'] for floatingip, after_update {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:03:16.071462 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.db [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] For port d0e34ea8-e4eb-48d0-812d-3e5358c5b247, host dv-cinder-790492-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-790492-4-iscsi',level=0,port_id=d0e34ea8-e4eb-48d0-812d-3e5358c5b247,segment=NetworkSegment(414a8468-1d66-4792-9e81-d8ac5ccf1512),segment_id=414a8468-1d66-4792-9e81-d8ac5ccf1512)] {{(pid=91831) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 17:03:16.076770 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8757892955028', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8757892520933', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8757892521750'] for port, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:03:16.081540 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:03:16.085065 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-b497bade-28f9-4a02-be35-5fb97f089477 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-178712'] for floatingip, before_response {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:03:16.090341 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [None req-b497bade-28f9-4a02-be35-5fb97f089477 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] 10.222.0.62 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 693 time: 1.2168529 May 25 17:03:16.142429 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron_lib.callbacks.manager [None req-48cbf83e-3bf9-41bb-b9e1-a21eda61065a None None] Notify callbacks [] for port, precommit_update {{(pid=91832) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:03:16.153269 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Pushing event updated for resources: {'Port': ['ID=d0e34ea8-e4eb-48d0-812d-3e5358c5b247,revision_number=4']} {{(pid=91831) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:03:16.154425 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.db.provisioning_blocks [None req-48cbf83e-3bf9-41bb-b9e1-a21eda61065a None None] Transition to ACTIVE for port object 6561ca57-f5fa-4bba-803c-ac716f98a0fb will not be triggered until provisioned by entity L2. {{(pid=91832) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 25 17:03:16.156893 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.075s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:03:16.162693 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron_lib.callbacks.manager [None req-48cbf83e-3bf9-41bb-b9e1-a21eda61065a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8757892955028', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8757892520933', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8757892521750'] for port, after_update {{(pid=91832) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:03:16.166883 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:03:16.262513 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-9e90af47-4007-410e-8221-5ebb523fa8b8 req-f93ecf46-2a0f-4971-bd47-fa297d565be0 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] 10.222.0.62 "GET /v2.0/security-groups?name=tempest-securitygroup--991132492&fields=id&tenant_id=70dac097fff04aed99a4976fa955579b HTTP/1.1" status: 200 len: 267 time: 0.0463595 May 25 17:03:16.321995 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-347cb80c-223c-4216-b04e-6074bbab2e7a None None] Pushing event updated for resources: {'Port': ['ID=6561ca57-f5fa-4bba-803c-ac716f98a0fb,revision_number=3']} {{(pid=91832) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:03:16.382782 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-347cb80c-223c-4216-b04e-6074bbab2e7a None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91832) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:03:16.383250 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-347cb80c-223c-4216-b04e-6074bbab2e7a None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91832) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:03:16.383592 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-347cb80c-223c-4216-b04e-6074bbab2e7a None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91832) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:03:16.383919 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-347cb80c-223c-4216-b04e-6074bbab2e7a None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91832) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:03:16.384248 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-347cb80c-223c-4216-b04e-6074bbab2e7a None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91832) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:03:16.384572 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-347cb80c-223c-4216-b04e-6074bbab2e7a None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91832) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:03:16.384897 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-347cb80c-223c-4216-b04e-6074bbab2e7a None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91832) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:03:16.385219 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-347cb80c-223c-4216-b04e-6074bbab2e7a None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91832) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:03:16.385558 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-347cb80c-223c-4216-b04e-6074bbab2e7a None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91832) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:03:16.385877 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-347cb80c-223c-4216-b04e-6074bbab2e7a None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91832) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:03:16.386268 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-347cb80c-223c-4216-b04e-6074bbab2e7a None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91832) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:03:16.386579 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-347cb80c-223c-4216-b04e-6074bbab2e7a None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91832) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:03:16.421184 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG oslo_concurrency.lockutils [None req-347cb80c-223c-4216-b04e-6074bbab2e7a None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.254s {{(pid=91832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:03:16.439410 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9e90af47-4007-410e-8221-5ebb523fa8b8 req-a619de5e-155b-407c-92d9-2efa0b0f7320 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:03:16.440848 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-9e90af47-4007-410e-8221-5ebb523fa8b8 req-a619de5e-155b-407c-92d9-2efa0b0f7320 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] 10.222.0.62 "GET /v2.0/networks?id=b351598a-3f6f-4a37-8095-8d9371896ccc HTTP/1.1" status: 200 len: 810 time: 0.1712775 May 25 17:03:16.448141 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.plugins.ml2.managers [None req-48cbf83e-3bf9-41bb-b9e1-a21eda61065a None None] Attempting to bind port 6561ca57-f5fa-4bba-803c-ac716f98a0fb on host dv-cinder-790492-4-iscsi for vnic_type normal with profile {{(pid=91832) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 25 17:03:16.448516 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.plugins.ml2.managers [None req-48cbf83e-3bf9-41bb-b9e1-a21eda61065a None None] Attempting to bind port 6561ca57-f5fa-4bba-803c-ac716f98a0fb by drivers openvswitch,hyperv on host dv-cinder-790492-4-iscsi at level 0 using segments [{'id': 'b8ba5240-28ce-40db-a6e6-b4a42435e0b6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 655, 'network_id': 'b351598a-3f6f-4a37-8095-8d9371896ccc'}] {{(pid=91832) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 25 17:03:16.448873 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-48cbf83e-3bf9-41bb-b9e1-a21eda61065a None None] Attempting to bind port 6561ca57-f5fa-4bba-803c-ac716f98a0fb on network b351598a-3f6f-4a37-8095-8d9371896ccc {{(pid=91832) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 25 17:03:16.455387 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-48cbf83e-3bf9-41bb-b9e1-a21eda61065a None None] Checking agent: {'id': 'fc8251e1-071c-49f7-bc10-1337f1d37d1b', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-790492-4-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 25, 16, 50, 28), 'started_at': datetime.datetime(2021, 5, 25, 16, 50, 58), 'heartbeat_timestamp': datetime.datetime(2021, 5, 25, 17, 2, 58), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-790492-4-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=91832) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 25 17:03:16.455756 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-48cbf83e-3bf9-41bb-b9e1-a21eda61065a None None] Checking segment: {'id': 'b8ba5240-28ce-40db-a6e6-b4a42435e0b6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 655, 'network_id': 'b351598a-3f6f-4a37-8095-8d9371896ccc'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91832) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 25 17:03:16.456149 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron_lib.callbacks.manager [None req-48cbf83e-3bf9-41bb-b9e1-a21eda61065a None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=91832) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:03:16.456529 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-48cbf83e-3bf9-41bb-b9e1-a21eda61065a None None] Bound using segment: {'id': 'b8ba5240-28ce-40db-a6e6-b4a42435e0b6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 655, 'network_id': 'b351598a-3f6f-4a37-8095-8d9371896ccc'} {{(pid=91832) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 25 17:03:16.457169 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.plugins.ml2.managers [None req-48cbf83e-3bf9-41bb-b9e1-a21eda61065a None None] Bound port: 6561ca57-f5fa-4bba-803c-ac716f98a0fb, host: dv-cinder-790492-4-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'b8ba5240-28ce-40db-a6e6-b4a42435e0b6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 655, 'network_id': 'b351598a-3f6f-4a37-8095-8d9371896ccc'}}] {{(pid=91832) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 25 17:03:16.457344 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron_lib.callbacks.manager [None req-48cbf83e-3bf9-41bb-b9e1-a21eda61065a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3832070'] for port, before_update {{(pid=91832) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:03:16.459965 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-9e90af47-4007-410e-8221-5ebb523fa8b8 req-43d1d4d1-436d-46cb-9d9a-9a448d72fdc3 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] 10.222.0.62 "GET /v2.0/quotas/70dac097fff04aed99a4976fa955579b HTTP/1.1" status: 200 len: 375 time: 0.0137842 May 25 17:03:16.552515 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.plugins.ml2.db [None req-48cbf83e-3bf9-41bb-b9e1-a21eda61065a None None] For port 6561ca57-f5fa-4bba-803c-ac716f98a0fb, host dv-cinder-790492-4-iscsi, cleared binding levels {{(pid=91832) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 25 17:03:16.559462 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.plugins.ml2.db [None req-48cbf83e-3bf9-41bb-b9e1-a21eda61065a None None] For port 6561ca57-f5fa-4bba-803c-ac716f98a0fb, host dv-cinder-790492-4-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-790492-4-iscsi',level=0,port_id=6561ca57-f5fa-4bba-803c-ac716f98a0fb,segment=NetworkSegment(b8ba5240-28ce-40db-a6e6-b4a42435e0b6),segment_id=b8ba5240-28ce-40db-a6e6-b4a42435e0b6)] {{(pid=91832) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 25 17:03:16.561523 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-9e90af47-4007-410e-8221-5ebb523fa8b8 req-760b8e9a-52e9-4187-9da7-6cace7dd0516 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] 10.222.0.62 "GET /v2.0/ports?tenant_id=70dac097fff04aed99a4976fa955579b&fields=id HTTP/1.1" status: 200 len: 348 time: 0.0953410 May 25 17:03:16.565245 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron_lib.callbacks.manager [None req-48cbf83e-3bf9-41bb-b9e1-a21eda61065a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8757892955028', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8757892520933', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8757892521750'] for port, after_update {{(pid=91832) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:03:16.570710 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:03:16.643785 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.db.l3_dvrscheduler_db [None req-48cbf83e-3bf9-41bb-b9e1-a21eda61065a None None] Routers {'f1e3cf65-0e20-4226-8986-652055868473'} bound to L3 agent in host dv-cinder-790492-4-iscsi {{(pid=91832) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 17:03:16.644401 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.db.l3_hamode_db [None req-48cbf83e-3bf9-41bb-b9e1-a21eda61065a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-790492-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-05-25T16:50:28Z,description=,heartbeat_timestamp=2021-05-25T17:02:58Z,host='dv-cinder-790492-4-iscsi',id=a2d427c1-2d07-43e8-afbe-218c9f7d0445,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T16:50:28Z,topic='l3_agent')) {'router_ids': ['f1e3cf65-0e20-4226-8986-652055868473'], 'active': True} {{(pid=91832) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 17:03:16.709706 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-347cb80c-223c-4216-b04e-6074bbab2e7a None None] Pushing event updated for resources: {'Port': ['ID=6561ca57-f5fa-4bba-803c-ac716f98a0fb,revision_number=4']} {{(pid=91832) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:03:16.720979 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG oslo_concurrency.lockutils [None req-347cb80c-223c-4216-b04e-6074bbab2e7a None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.150s {{(pid=91832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:03:16.828011 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.db.l3_dvr_db [None req-48cbf83e-3bf9-41bb-b9e1-a21eda61065a None None] Set router f1e3cf65-0e20-4226-8986-652055868473 gateway port host: dv-cinder-790492-4-iscsi {{(pid=91832) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 17:03:16.831468 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-9e90af47-4007-410e-8221-5ebb523fa8b8 req-ae4c1858-547d-40ba-a264-7854bf22940e service neutron] 10.222.0.62 "GET /v2.0/networks/b351598a-3f6f-4a37-8095-8d9371896ccc?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2587144 May 25 17:03:16.841025 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4cc967bc-5b90-4574-8e01-1300f67e9a92 req-a5c508c8-14e8-4ffb-ba9d-de60f1746a6f tempest-VolumesSnapshotTestJSON-991813121 tempest-VolumesSnapshotTestJSON-991813121-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:03:16.842747 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-4cc967bc-5b90-4574-8e01-1300f67e9a92 req-a5c508c8-14e8-4ffb-ba9d-de60f1746a6f tempest-VolumesSnapshotTestJSON-991813121 tempest-VolumesSnapshotTestJSON-991813121-project] 10.222.0.62 "GET /v2.0/networks?id=c8b64023-a7f5-4c0f-847b-8a8aef981caa HTTP/1.1" status: 200 len: 813 time: 0.1988990 May 25 17:03:16.926257 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-4cc967bc-5b90-4574-8e01-1300f67e9a92 req-25cc8356-a812-4630-89fa-d38521fa373f tempest-VolumesSnapshotTestJSON-991813121 tempest-VolumesSnapshotTestJSON-991813121-project] 10.222.0.62 "GET /v2.0/quotas/1314f62bcf90411cadb06fa2d9392828 HTTP/1.1" status: 200 len: 375 time: 0.0614386 May 25 17:03:16.982944 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-4cc967bc-5b90-4574-8e01-1300f67e9a92 req-f8e4f6b9-858f-4077-bd36-eb15f71a1f8d tempest-VolumesSnapshotTestJSON-991813121 tempest-VolumesSnapshotTestJSON-991813121-project] 10.222.0.62 "GET /v2.0/ports?tenant_id=1314f62bcf90411cadb06fa2d9392828&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0490739 May 25 17:03:17.025471 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-9e90af47-4007-410e-8221-5ebb523fa8b8 req-befa1c63-991c-4cb9-86c2-85f594141d6d service neutron] 10.222.0.62 "GET /v2.0/networks/b351598a-3f6f-4a37-8095-8d9371896ccc?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1811607 May 25 17:03:17.162097 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.db.l3_hamode_db [None req-48cbf83e-3bf9-41bb-b9e1-a21eda61065a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'f1e3cf65-0e20-4226-8986-652055868473', 'name': 'tempest-AttachVolumeTestJSON-312968156-router', 'tenant_id': '70dac097fff04aed99a4976fa955579b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'external_fixed_ips': [{'subnet_id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'ip_address': '172.27.2.63'}], 'enable_snat': True}, 'gw_port_id': 'd0e34ea8-e4eb-48d0-812d-3e5358c5b247', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T17:03:07Z', 'updated_at': '2021-05-25T17:03:12Z', 'revision_number': 4, 'project_id': '70dac097fff04aed99a4976fa955579b', 'gw_port': {'id': 'd0e34ea8-e4eb-48d0-812d-3e5358c5b247', 'name': '', 'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'tenant_id': '', 'mac_address': 'fa:16:3e:be:2a:11', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f1e3cf65-0e20-4226-8986-652055868473', 'device_owner': 'network:router_gateway', 'standard_attr_id': 477, 'fixed_ips': [{'subnet_id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'ip_address': '172.27.2.63', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790492-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:03:08Z', 'updated_at': '2021-05-25T17:03:16Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-790492-4-iscsi', '_interfaces': [{'id': '6561ca57-f5fa-4bba-803c-ac716f98a0fb', 'name': '', 'network_id': 'b351598a-3f6f-4a37-8095-8d9371896ccc', 'tenant_id': '70dac097fff04aed99a4976fa955579b', 'mac_address': 'fa:16:3e:2f:70:71', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'f1e3cf65-0e20-4226-8986-652055868473', 'device_owner': 'network:router_interface', 'standard_attr_id': 478, 'fixed_ips': [{'subnet_id': '4bbae145-74ed-4fda-b7c0-ae77a3202a83', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790492-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:03:12Z', 'updated_at': '2021-05-25T17:03:16Z', 'revision_number': 4, 'project_id': '70dac097fff04aed99a4976fa955579b', 'subnets': [{'id': '4bbae145-74ed-4fda-b7c0-ae77a3202a83', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-790492-4-iscsi', False) {} {{(pid=91832) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 17:03:17.167516 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-48cbf83e-3bf9-41bb-b9e1-a21eda61065a None None] The sync data for ids ['f1e3cf65-0e20-4226-8986-652055868473'] in dv-cinder-790492-4-iscsi is: [{'id': 'f1e3cf65-0e20-4226-8986-652055868473', 'name': 'tempest-AttachVolumeTestJSON-312968156-router', 'tenant_id': '70dac097fff04aed99a4976fa955579b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'external_fixed_ips': [{'subnet_id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'ip_address': '172.27.2.63'}], 'enable_snat': True}, 'gw_port_id': 'd0e34ea8-e4eb-48d0-812d-3e5358c5b247', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T17:03:07Z', 'updated_at': '2021-05-25T17:03:12Z', 'revision_number': 4, 'project_id': '70dac097fff04aed99a4976fa955579b', 'gw_port': {'id': 'd0e34ea8-e4eb-48d0-812d-3e5358c5b247', 'name': '', 'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'tenant_id': '', 'mac_address': 'fa:16:3e:be:2a:11', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f1e3cf65-0e20-4226-8986-652055868473', 'device_owner': 'network:router_gateway', 'standard_attr_id': 477, 'fixed_ips': [{'subnet_id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'ip_address': '172.27.2.63', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790492-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:03:08Z', 'updated_at': '2021-05-25T17:03:16Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-790492-4-iscsi', '_interfaces': [{'id': '6561ca57-f5fa-4bba-803c-ac716f98a0fb', 'name': '', 'network_id': 'b351598a-3f6f-4a37-8095-8d9371896ccc', 'tenant_id': '70dac097fff04aed99a4976fa955579b', 'mac_address': 'fa:16:3e:2f:70:71', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'f1e3cf65-0e20-4226-8986-652055868473', 'device_owner': 'network:router_interface', 'standard_attr_id': 478, 'fixed_ips': [{'subnet_id': '4bbae145-74ed-4fda-b7c0-ae77a3202a83', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790492-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:03:12Z', 'updated_at': '2021-05-25T17:03:16Z', 'revision_number': 4, 'project_id': '70dac097fff04aed99a4976fa955579b', 'subnets': [{'id': '4bbae145-74ed-4fda-b7c0-ae77a3202a83', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=91832) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 25 17:03:17.213778 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-4cc967bc-5b90-4574-8e01-1300f67e9a92 req-1a69e375-64e5-4713-b3b1-21afe41acfbe service neutron] 10.222.0.62 "GET /v2.0/networks/c8b64023-a7f5-4c0f-847b-8a8aef981caa?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2184632 May 25 17:03:17.517575 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-4cc967bc-5b90-4574-8e01-1300f67e9a92 req-22b396ca-2398-4832-b543-f81effab1436 service neutron] 10.222.0.62 "GET /v2.0/networks/c8b64023-a7f5-4c0f-847b-8a8aef981caa?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2975204 May 25 17:03:17.540853 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9f32a488-d8d3-458d-9651-c9bd0ddf739d req-4c32e6db-7653-42f0-9ddf-c16c12dc4764 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:03:17.542382 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-9f32a488-d8d3-458d-9651-c9bd0ddf739d req-4c32e6db-7653-42f0-9ddf-c16c12dc4764 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] 10.222.0.62 "GET /v2.0/ports?device_id=e2dfa29d-fe86-4425-b12b-d984d7f0584a HTTP/1.1" status: 200 len: 946 time: 0.1452110 May 25 17:03:17.598222 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-9f32a488-d8d3-458d-9651-c9bd0ddf739d req-52f68847-704a-4376-b5d7-43452d255dc6 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] 10.222.0.62 "GET /v2.0/security-groups?id=f73b90a2-df48-48fb-99e0-5dd4d6a63a15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0473549 May 25 17:03:17.783859 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-d60cb3f2-8d13-4f44-9350-e30d4c0a88b1 req-ff94c305-5a35-4e07-bdd7-462fb1da743d tempest-VolumesSnapshotTestJSON-991813121 tempest-VolumesSnapshotTestJSON-991813121-project] 10.222.0.62 "GET /v2.0/ports?device_id=3ba29874-8ce5-4252-aa6d-7c8f6419aa93 HTTP/1.1" status: 200 len: 210 time: 0.0880563 May 25 17:03:17.798005 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-0dc5b301-9bde-4c48-9483-f141a0e21cf6 req-637e2903-954e-4505-94fa-62e5b5ab135c tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] 10.222.0.62 "GET /v2.0/ports?device_id=4758207a-3093-4ef3-802c-dc11d895da7a HTTP/1.1" status: 200 len: 210 time: 0.1327181 May 25 17:03:17.823191 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.rpc [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Device 6561ca57-f5fa-4bba-803c-ac716f98a0fb up at agent ovs-agent-dv-cinder-790492-4-iscsi {{(pid=91831) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 25 17:03:17.913701 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.provisioning_blocks [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Provisioning for port 6561ca57-f5fa-4bba-803c-ac716f98a0fb completed by entity L2. {{(pid=91831) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 25 17:03:17.923867 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.provisioning_blocks [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Provisioning complete for port 6561ca57-f5fa-4bba-803c-ac716f98a0fb triggered by entity L2. {{(pid=91831) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 17:03:17.924562 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3854128'] for port, provisioning_complete {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:03:17.994952 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c0086258-f213-461c-a7c2-d438cb32b839 req-571eec04-e7ed-4aa0-8843-b7efd76ff3d4 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91830) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:03:17.995719 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [req-c0086258-f213-461c-a7c2-d438cb32b839 req-571eec04-e7ed-4aa0-8843-b7efd76ff3d4 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] Synchronizing usage tracker for tenant:04e8022f24e3464ab1ab7726d6a07e08 on resource:port {{(pid=91830) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 25 17:03:18.014299 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [req-c0086258-f213-461c-a7c2-d438cb32b839 req-571eec04-e7ed-4aa0-8843-b7efd76ff3d4 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] Unset dirty status for tenant:04e8022f24e3464ab1ab7726d6a07e08 on resource:port {{(pid=91830) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 25 17:03:18.021617 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-c0086258-f213-461c-a7c2-d438cb32b839 req-571eec04-e7ed-4aa0-8843-b7efd76ff3d4 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] 10.222.0.32 "GET /v2.0/ports?device_id=e2dfa29d-fe86-4425-b12b-d984d7f0584a HTTP/1.1" status: 200 len: 946 time: 0.1576135 May 25 17:03:18.127853 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3832070'] for port, before_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:03:18.171642 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.db [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] For port 6561ca57-f5fa-4bba-803c-ac716f98a0fb, host dv-cinder-790492-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-790492-4-iscsi',level=0,port_id=6561ca57-f5fa-4bba-803c-ac716f98a0fb,segment=NetworkSegment(b8ba5240-28ce-40db-a6e6-b4a42435e0b6),segment_id=b8ba5240-28ce-40db-a6e6-b4a42435e0b6)] {{(pid=91831) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 17:03:18.176462 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8757892955028', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8757892520933', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8757892521750'] for port, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:03:18.177538 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.rpc [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Device d0e34ea8-e4eb-48d0-812d-3e5358c5b247 up at agent ovs-agent-dv-cinder-790492-4-iscsi {{(pid=91831) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 25 17:03:18.209082 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:03:18.212100 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.plugins.ml2.plugin [req-c0086258-f213-461c-a7c2-d438cb32b839 req-bd25d8f1-f2d7-4316-b35f-71f1b84f20eb tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] Deleting port 46a1adbe-ec54-4c57-aa7a-9f257475e01c {{(pid=91830) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 25 17:03:18.212499 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [req-c0086258-f213-461c-a7c2-d438cb32b839 req-bd25d8f1-f2d7-4316-b35f-71f1b84f20eb tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8757892952899'] for port, before_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:03:18.305783 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Pushing event updated for resources: {'Port': ['ID=6561ca57-f5fa-4bba-803c-ac716f98a0fb,revision_number=5']} {{(pid=91831) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:03:18.323461 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.114s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:03:18.324943 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.provisioning_blocks [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Provisioning complete for port d0e34ea8-e4eb-48d0-812d-3e5358c5b247 triggered by entity L2. {{(pid=91831) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 17:03:18.325434 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3854128'] for port, provisioning_complete {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:03:18.391002 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.plugins.ml2.db [req-c0086258-f213-461c-a7c2-d438cb32b839 req-bd25d8f1-f2d7-4316-b35f-71f1b84f20eb tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] For port 46a1adbe-ec54-4c57-aa7a-9f257475e01c, host hv-cinder-79049, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79049',level=0,port_id=46a1adbe-ec54-4c57-aa7a-9f257475e01c,segment=NetworkSegment(7d7273c2-c6dd-43fe-83a8-cb776d48dc70),segment_id=7d7273c2-c6dd-43fe-83a8-cb776d48dc70)] {{(pid=91830) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 17:03:18.391357 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [req-c0086258-f213-461c-a7c2-d438cb32b839 req-bd25d8f1-f2d7-4316-b35f-71f1b84f20eb tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-683770'] for port, precommit_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:03:18.520552 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.plugins.ml2.plugin [req-c0086258-f213-461c-a7c2-d438cb32b839 req-bd25d8f1-f2d7-4316-b35f-71f1b84f20eb tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] Calling delete_port for 46a1adbe-ec54-4c57-aa7a-9f257475e01c owned by compute:nova {{(pid=91830) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 25 17:03:18.627049 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [req-c0086258-f213-461c-a7c2-d438cb32b839 req-bd25d8f1-f2d7-4316-b35f-71f1b84f20eb tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8757892955046', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8757892520924', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-27483019'] for port, after_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:03:18.632240 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:03:18.644661 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.db [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] get_ports_and_sgs() called for port_ids ['c4b9c0f2-e3d5-4fff-9b3c-a9175b027fb5', '46a1adbe-ec54-4c57-aa7a-9f257475e01c'] {{(pid=91831) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 25 17:03:18.677029 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bd25d8f1-f2d7-4316-b35f-71f1b84f20eb tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] Pushing event deleted for resources: {'Port': ['ID=46a1adbe-ec54-4c57-aa7a-9f257475e01c,revision_number=None']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:03:18.681133 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-bd25d8f1-f2d7-4316-b35f-71f1b84f20eb tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.049s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:03:18.784313 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.l3_dvrscheduler_db [req-c0086258-f213-461c-a7c2-d438cb32b839 req-bd25d8f1-f2d7-4316-b35f-71f1b84f20eb tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] No DVR routers for this DVR port 46a1adbe-ec54-4c57-aa7a-9f257475e01c on host hv-cinder-79049 {{(pid=91830) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 25 17:03:18.788369 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [req-c0086258-f213-461c-a7c2-d438cb32b839 req-bd25d8f1-f2d7-4316-b35f-71f1b84f20eb tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-178712'] for port, before_response {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:03:18.794624 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'e2dfa29d-fe86-4425-b12b-d984d7f0584a', 'name': 'network-vif-deleted', 'tag': '46a1adbe-ec54-4c57-aa7a-9f257475e01c'}] {{(pid=91830) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 25 17:03:18.823831 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-6ba50f81-d68e-4703-a1f7-0b133c4aed58 req-88c9203f-c8c0-4b79-af9a-5b426645121b tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] 10.222.0.62 "GET /v2.0/ports?device_id=e2dfa29d-fe86-4425-b12b-d984d7f0584a HTTP/1.1" status: 200 len: 210 time: 0.0607448 May 25 17:03:18.869065 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-c0086258-f213-461c-a7c2-d438cb32b839 req-bd25d8f1-f2d7-4316-b35f-71f1b84f20eb tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] 10.222.0.32 "DELETE /v2.0/ports/46a1adbe-ec54-4c57-aa7a-9f257475e01c HTTP/1.1" status: 204 len: 173 time: 0.8427587 May 25 17:03:19.034819 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-02ddb3e9-fe32-4e00-a42f-f55a94d26001 req-8287bd93-686e-4d20-8fca-b3dc22a94479 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] 10.222.0.62 "GET /v2.0/ports?device_id=4758207a-3093-4ef3-802c-dc11d895da7a HTTP/1.1" status: 200 len: 210 time: 0.1032205 May 25 17:03:19.049596 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-d8750212-8ab5-466f-8570-72bfb2217630 req-16b9794c-cc35-4100-8288-9a9eb2b5705b tempest-VolumesSnapshotTestJSON-991813121 tempest-VolumesSnapshotTestJSON-991813121-project] 10.222.0.62 "GET /v2.0/ports?device_id=3ba29874-8ce5-4252-aa6d-7c8f6419aa93 HTTP/1.1" status: 200 len: 210 time: 0.0602396 May 25 17:03:19.050805 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9e90af47-4007-410e-8221-5ebb523fa8b8 req-04f718c2-38b7-4a35-8764-f5a201b20f7f tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=91830) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:03:19.051507 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [req-9e90af47-4007-410e-8221-5ebb523fa8b8 req-04f718c2-38b7-4a35-8764-f5a201b20f7f tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Synchronizing usage tracker for tenant:70dac097fff04aed99a4976fa955579b on resource:network {{(pid=91830) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 25 17:03:19.090716 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [req-9e90af47-4007-410e-8221-5ebb523fa8b8 req-04f718c2-38b7-4a35-8764-f5a201b20f7f tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Unset dirty status for tenant:70dac097fff04aed99a4976fa955579b on resource:network {{(pid=91830) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 25 17:03:19.091929 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-9e90af47-4007-410e-8221-5ebb523fa8b8 req-04f718c2-38b7-4a35-8764-f5a201b20f7f tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] 10.222.0.32 "GET /v2.0/networks?id=b351598a-3f6f-4a37-8095-8d9371896ccc HTTP/1.1" status: 200 len: 810 time: 0.2657108 May 25 17:03:19.105594 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'e2dfa29d-fe86-4425-b12b-d984d7f0584a', 'name': 'network-vif-deleted', 'tag': '46a1adbe-ec54-4c57-aa7a-9f257475e01c', 'status': 'completed', 'code': 200} May 25 17:03:19.164449 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [req-9e90af47-4007-410e-8221-5ebb523fa8b8 req-d9110fdd-9b0f-4501-ba97-9a020c5fde36 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Synchronizing usage tracker for tenant:70dac097fff04aed99a4976fa955579b on resource:security_group {{(pid=91830) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 25 17:03:19.182415 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [req-9e90af47-4007-410e-8221-5ebb523fa8b8 req-d9110fdd-9b0f-4501-ba97-9a020c5fde36 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Unset dirty status for tenant:70dac097fff04aed99a4976fa955579b on resource:security_group {{(pid=91830) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 25 17:03:19.184052 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-9e90af47-4007-410e-8221-5ebb523fa8b8 req-d9110fdd-9b0f-4501-ba97-9a020c5fde36 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] 10.222.0.32 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=70dac097fff04aed99a4976fa955579b HTTP/1.1" status: 200 len: 379 time: 0.0623188 May 25 17:03:19.195487 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.v2.base [req-9e90af47-4007-410e-8221-5ebb523fa8b8 req-b6a57449-94d8-4558-858f-fd3a84032035 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Request body: {'port': {'device_id': '4758207a-3093-4ef3-802c-dc11d895da7a', 'network_id': 'b351598a-3f6f-4a37-8095-8d9371896ccc', 'admin_state_up': True, 'tenant_id': '70dac097fff04aed99a4976fa955579b', 'security_groups': ['7cad7118-dc73-4cab-9cb2-fa41cd4499bd']}} {{(pid=91830) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 17:03:19.543024 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.quota.driver [req-9e90af47-4007-410e-8221-5ebb523fa8b8 req-b6a57449-94d8-4558-858f-fd3a84032035 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91830) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 17:03:19.549306 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [req-9e90af47-4007-410e-8221-5ebb523fa8b8 req-b6a57449-94d8-4558-858f-fd3a84032035 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Usage tracker for resource:port and tenant:70dac097fff04aed99a4976fa955579b is out of sync, need to count used quota {{(pid=91830) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 17:03:19.557775 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4cc967bc-5b90-4574-8e01-1300f67e9a92 req-b6357a62-18d1-40c3-8a09-e122c4af0177 tempest-VolumesSnapshotTestJSON-991813121 tempest-VolumesSnapshotTestJSON-991813121-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=91830) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:03:19.558469 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [req-4cc967bc-5b90-4574-8e01-1300f67e9a92 req-b6357a62-18d1-40c3-8a09-e122c4af0177 tempest-VolumesSnapshotTestJSON-991813121 tempest-VolumesSnapshotTestJSON-991813121-project] Synchronizing usage tracker for tenant:1314f62bcf90411cadb06fa2d9392828 on resource:network {{(pid=91830) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 25 17:03:19.560783 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [req-9e90af47-4007-410e-8221-5ebb523fa8b8 req-b6a57449-94d8-4558-858f-fd3a84032035 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Quota usage for port was recalculated. Used quota:3. {{(pid=91830) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 17:03:19.568064 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.quota.driver [req-9e90af47-4007-410e-8221-5ebb523fa8b8 req-b6a57449-94d8-4558-858f-fd3a84032035 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Attempting to reserve 1 items for resource port. Total usage: 3; quota limit: 500; headroom:497 {{(pid=91830) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 17:03:19.588746 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-9e90af47-4007-410e-8221-5ebb523fa8b8 req-b6a57449-94d8-4558-858f-fd3a84032035 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Made reservation on behalf of 70dac097fff04aed99a4976fa955579b for: {'port': 1} {{(pid=91830) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 25 17:03:19.593485 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [req-9e90af47-4007-410e-8221-5ebb523fa8b8 req-b6a57449-94d8-4558-858f-fd3a84032035 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3832070'] for port, before_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:03:19.609389 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [req-4cc967bc-5b90-4574-8e01-1300f67e9a92 req-b6357a62-18d1-40c3-8a09-e122c4af0177 tempest-VolumesSnapshotTestJSON-991813121 tempest-VolumesSnapshotTestJSON-991813121-project] Unset dirty status for tenant:1314f62bcf90411cadb06fa2d9392828 on resource:network {{(pid=91830) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 25 17:03:19.610522 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-4cc967bc-5b90-4574-8e01-1300f67e9a92 req-b6357a62-18d1-40c3-8a09-e122c4af0177 tempest-VolumesSnapshotTestJSON-991813121 tempest-VolumesSnapshotTestJSON-991813121-project] 10.222.0.32 "GET /v2.0/networks?id=c8b64023-a7f5-4c0f-847b-8a8aef981caa HTTP/1.1" status: 200 len: 813 time: 0.3420973 May 25 17:03:19.660382 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.v2.base [req-4cc967bc-5b90-4574-8e01-1300f67e9a92 req-5d4e4bae-db38-4911-8f71-2592abdbdfc1 tempest-VolumesSnapshotTestJSON-991813121 tempest-VolumesSnapshotTestJSON-991813121-project] Request body: {'port': {'device_id': '3ba29874-8ce5-4252-aa6d-7c8f6419aa93', 'network_id': 'c8b64023-a7f5-4c0f-847b-8a8aef981caa', 'admin_state_up': True, 'tenant_id': '1314f62bcf90411cadb06fa2d9392828'}} {{(pid=91830) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 17:03:19.776354 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.rpc [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Device 6561ca57-f5fa-4bba-803c-ac716f98a0fb up at agent ovs-agent-dv-cinder-790492-4-iscsi {{(pid=91831) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 25 17:03:19.856786 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.provisioning_blocks [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Provisioning complete for port 6561ca57-f5fa-4bba-803c-ac716f98a0fb triggered by entity L2. {{(pid=91831) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 17:03:19.857368 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3854128'] for port, provisioning_complete {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:03:19.889613 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.quota.driver [req-4cc967bc-5b90-4574-8e01-1300f67e9a92 req-5d4e4bae-db38-4911-8f71-2592abdbdfc1 tempest-VolumesSnapshotTestJSON-991813121 tempest-VolumesSnapshotTestJSON-991813121-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91830) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 17:03:19.899569 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [req-4cc967bc-5b90-4574-8e01-1300f67e9a92 req-5d4e4bae-db38-4911-8f71-2592abdbdfc1 tempest-VolumesSnapshotTestJSON-991813121 tempest-VolumesSnapshotTestJSON-991813121-project] Usage tracker for resource:port and tenant:1314f62bcf90411cadb06fa2d9392828 is out of sync, need to count used quota {{(pid=91830) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 17:03:19.904659 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [req-4cc967bc-5b90-4574-8e01-1300f67e9a92 req-5d4e4bae-db38-4911-8f71-2592abdbdfc1 tempest-VolumesSnapshotTestJSON-991813121 tempest-VolumesSnapshotTestJSON-991813121-project] Quota usage for port was recalculated. Used quota:0. {{(pid=91830) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 17:03:19.907427 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.db_base_plugin_common [req-9e90af47-4007-410e-8221-5ebb523fa8b8 req-b6a57449-94d8-4558-858f-fd3a84032035 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Allocated IP 172.20.0.10 (b351598a-3f6f-4a37-8095-8d9371896ccc/4bbae145-74ed-4fda-b7c0-ae77a3202a83/13752a02-2ccb-4f85-b36f-38ca98958db9) {{(pid=91830) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 25 17:03:19.913646 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.quota.driver [req-4cc967bc-5b90-4574-8e01-1300f67e9a92 req-5d4e4bae-db38-4911-8f71-2592abdbdfc1 tempest-VolumesSnapshotTestJSON-991813121 tempest-VolumesSnapshotTestJSON-991813121-project] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=91830) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 17:03:19.931032 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-4cc967bc-5b90-4574-8e01-1300f67e9a92 req-5d4e4bae-db38-4911-8f71-2592abdbdfc1 tempest-VolumesSnapshotTestJSON-991813121 tempest-VolumesSnapshotTestJSON-991813121-project] Made reservation on behalf of 1314f62bcf90411cadb06fa2d9392828 for: {'port': 1} {{(pid=91830) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 25 17:03:19.935014 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [req-4cc967bc-5b90-4574-8e01-1300f67e9a92 req-5d4e4bae-db38-4911-8f71-2592abdbdfc1 tempest-VolumesSnapshotTestJSON-991813121 tempest-VolumesSnapshotTestJSON-991813121-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3832070'] for port, before_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:03:20.257446 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-15d69ed7-bf69-4cb2-860d-bab8c3d624be req-81f57043-88ab-4a20-8be0-4e3bed127532 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] 10.222.0.62 "GET /v2.0/ports?device_id=4758207a-3093-4ef3-802c-dc11d895da7a HTTP/1.1" status: 200 len: 210 time: 0.0815628 May 25 17:03:20.264088 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-56aab277-33df-4136-9d8f-03f2be8f0bea req-09c17875-8f93-49a1-a05f-fb302c460511 tempest-VolumesSnapshotTestJSON-991813121 tempest-VolumesSnapshotTestJSON-991813121-project] 10.222.0.62 "GET /v2.0/ports?device_id=3ba29874-8ce5-4252-aa6d-7c8f6419aa93 HTTP/1.1" status: 200 len: 210 time: 0.0510826 May 25 17:03:20.267707 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [req-9e90af47-4007-410e-8221-5ebb523fa8b8 req-b6a57449-94d8-4558-858f-fd3a84032035 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Notify callbacks [] for port, precommit_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:03:20.276966 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.db_base_plugin_common [req-4cc967bc-5b90-4574-8e01-1300f67e9a92 req-5d4e4bae-db38-4911-8f71-2592abdbdfc1 tempest-VolumesSnapshotTestJSON-991813121 tempest-VolumesSnapshotTestJSON-991813121-project] Allocated IP 172.20.0.5 (c8b64023-a7f5-4c0f-847b-8a8aef981caa/e21793ea-1820-4ec5-b3fc-a7d9b7129124/4653ac1b-8d11-4595-8487-58704e147494) {{(pid=91830) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 25 17:03:20.297166 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.provisioning_blocks [req-9e90af47-4007-410e-8221-5ebb523fa8b8 req-b6a57449-94d8-4558-858f-fd3a84032035 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Transition to ACTIVE for port object 13752a02-2ccb-4f85-b36f-38ca98958db9 will not be triggered until provisioned by entity DHCP. {{(pid=91830) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 25 17:03:20.447341 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [req-9e90af47-4007-410e-8221-5ebb523fa8b8 req-b6a57449-94d8-4558-858f-fd3a84032035 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8757892520915', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-27483019'] for port, after_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:03:20.455608 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-7233908d-3846-4713-9fa0-be18a7b01f89 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:03:20.548808 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-9e90af47-4007-410e-8221-5ebb523fa8b8 req-b6a57449-94d8-4558-858f-fd3a84032035 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Network b351598a-3f6f-4a37-8095-8d9371896ccc is already hosted by enough agents. {{(pid=91830) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 25 17:03:20.554402 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.scheduler.base_scheduler [req-9e90af47-4007-410e-8221-5ebb523fa8b8 req-b6a57449-94d8-4558-858f-fd3a84032035 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Resources bound (agent type, host, resource id): {{(pid=91830) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 17:03:20.565752 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.l3_dvrscheduler_db [req-9e90af47-4007-410e-8221-5ebb523fa8b8 req-b6a57449-94d8-4558-858f-fd3a84032035 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Received port after_create {{(pid=91830) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 25 17:03:20.601519 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b6a57449-94d8-4558-858f-fd3a84032035 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Pushing event updated for resources: {'Port': ['ID=13752a02-2ccb-4f85-b36f-38ca98958db9,revision_number=1']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:03:20.610567 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-b6a57449-94d8-4558-858f-fd3a84032035 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.155s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:03:20.635766 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [req-4cc967bc-5b90-4574-8e01-1300f67e9a92 req-5d4e4bae-db38-4911-8f71-2592abdbdfc1 tempest-VolumesSnapshotTestJSON-991813121 tempest-VolumesSnapshotTestJSON-991813121-project] Notify callbacks [] for port, precommit_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:03:20.659717 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9e90af47-4007-410e-8221-5ebb523fa8b8 req-b6a57449-94d8-4558-858f-fd3a84032035 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=91830) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:03:20.660341 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [req-9e90af47-4007-410e-8221-5ebb523fa8b8 req-b6a57449-94d8-4558-858f-fd3a84032035 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-178712'] for port, before_response {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:03:20.692329 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-9e90af47-4007-410e-8221-5ebb523fa8b8 req-b6a57449-94d8-4558-858f-fd3a84032035 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] 10.222.0.32 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 1.5013170 May 25 17:03:20.704228 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [req-4cc967bc-5b90-4574-8e01-1300f67e9a92 req-5d4e4bae-db38-4911-8f71-2592abdbdfc1 tempest-VolumesSnapshotTestJSON-991813121 tempest-VolumesSnapshotTestJSON-991813121-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8757892520915', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-27483019'] for port, after_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:03:20.709981 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-8f8ea177-ebab-4446-b910-939a3571c194 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:03:20.751376 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.v2.base [req-9e90af47-4007-410e-8221-5ebb523fa8b8 req-45c8c85b-2a86-42e8-beb9-2fedb9ea32dc service neutron] Request body: {'port': {'device_id': '4758207a-3093-4ef3-802c-dc11d895da7a', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-79049'}} {{(pid=91830) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 17:03:20.800274 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.provisioning_blocks [None req-35cfaaa4-9c36-47e9-9077-f0fd91f08fd4 None None] Provisioning for port 13752a02-2ccb-4f85-b36f-38ca98958db9 completed by entity DHCP. {{(pid=91831) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 25 17:03:20.805249 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.provisioning_blocks [None req-35cfaaa4-9c36-47e9-9077-f0fd91f08fd4 None None] Provisioning complete for port 13752a02-2ccb-4f85-b36f-38ca98958db9 triggered by entity DHCP. {{(pid=91831) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 17:03:20.805706 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-35cfaaa4-9c36-47e9-9077-f0fd91f08fd4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3854128'] for port, provisioning_complete {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:03:20.834046 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-4cc967bc-5b90-4574-8e01-1300f67e9a92 req-5d4e4bae-db38-4911-8f71-2592abdbdfc1 tempest-VolumesSnapshotTestJSON-991813121 tempest-VolumesSnapshotTestJSON-991813121-project] Network c8b64023-a7f5-4c0f-847b-8a8aef981caa is already hosted by enough agents. {{(pid=91830) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 25 17:03:20.841171 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.scheduler.base_scheduler [req-4cc967bc-5b90-4574-8e01-1300f67e9a92 req-5d4e4bae-db38-4911-8f71-2592abdbdfc1 tempest-VolumesSnapshotTestJSON-991813121 tempest-VolumesSnapshotTestJSON-991813121-project] Resources bound (agent type, host, resource id): {{(pid=91830) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 17:03:20.844685 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5d4e4bae-db38-4911-8f71-2592abdbdfc1 tempest-VolumesSnapshotTestJSON-991813121 tempest-VolumesSnapshotTestJSON-991813121-project] Pushing event updated for resources: {'Port': ['ID=4653ac1b-8d11-4595-8487-58704e147494,revision_number=1']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:03:20.849444 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.l3_dvrscheduler_db [req-4cc967bc-5b90-4574-8e01-1300f67e9a92 req-5d4e4bae-db38-4911-8f71-2592abdbdfc1 tempest-VolumesSnapshotTestJSON-991813121 tempest-VolumesSnapshotTestJSON-991813121-project] Received port after_create {{(pid=91830) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 25 17:03:20.862416 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.plugin [None req-35cfaaa4-9c36-47e9-9077-f0fd91f08fd4 None None] Port 13752a02-2ccb-4f85-b36f-38ca98958db9 cannot update to ACTIVE because it is not bound. {{(pid=91831) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 25 17:03:20.880339 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-5d4e4bae-db38-4911-8f71-2592abdbdfc1 tempest-VolumesSnapshotTestJSON-991813121 tempest-VolumesSnapshotTestJSON-991813121-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.170s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:03:20.962489 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4cc967bc-5b90-4574-8e01-1300f67e9a92 req-5d4e4bae-db38-4911-8f71-2592abdbdfc1 tempest-VolumesSnapshotTestJSON-991813121 tempest-VolumesSnapshotTestJSON-991813121-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=91830) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:03:20.963089 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [req-4cc967bc-5b90-4574-8e01-1300f67e9a92 req-5d4e4bae-db38-4911-8f71-2592abdbdfc1 tempest-VolumesSnapshotTestJSON-991813121 tempest-VolumesSnapshotTestJSON-991813121-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-178712'] for port, before_response {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:03:20.970465 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [req-9e90af47-4007-410e-8221-5ebb523fa8b8 req-45c8c85b-2a86-42e8-beb9-2fedb9ea32dc service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3832070'] for port, before_update {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:03:21.023288 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-4cc967bc-5b90-4574-8e01-1300f67e9a92 req-5d4e4bae-db38-4911-8f71-2592abdbdfc1 tempest-VolumesSnapshotTestJSON-991813121 tempest-VolumesSnapshotTestJSON-991813121-project] 10.222.0.32 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 1.3669906 May 25 17:03:21.043340 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.v2.base [req-4cc967bc-5b90-4574-8e01-1300f67e9a92 req-4e460861-9934-411b-ac4d-726f1f5a043b service neutron] Request body: {'port': {'device_id': '3ba29874-8ce5-4252-aa6d-7c8f6419aa93', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-79049'}} {{(pid=91830) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 17:03:21.229020 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [req-4cc967bc-5b90-4574-8e01-1300f67e9a92 req-4e460861-9934-411b-ac4d-726f1f5a043b service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3832070'] for port, before_update {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:03:21.465474 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9f1d0fb8-0bfc-4697-b104-de0da24c0b85 req-16a4fed6-fa1b-4051-9e58-815deec440b5 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:03:21.467020 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-9f1d0fb8-0bfc-4697-b104-de0da24c0b85 req-16a4fed6-fa1b-4051-9e58-815deec440b5 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] 10.222.0.62 "GET /v2.0/ports?device_id=4758207a-3093-4ef3-802c-dc11d895da7a HTTP/1.1" status: 200 len: 932 time: 0.0833726 May 25 17:03:21.563576 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-9f1d0fb8-0bfc-4697-b104-de0da24c0b85 req-8cde460b-6a78-441e-8fd1-fea047e79ad8 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] 10.222.0.62 "GET /v2.0/security-groups?id=7cad7118-dc73-4cab-9cb2-fa41cd4499bd&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0611417 May 25 17:03:21.590349 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-52c77d4d-e3c4-4ac3-830a-b1645bd68961 req-f6e9e649-6aa1-4109-acd5-148568a555e7 tempest-VolumesSnapshotTestJSON-991813121 tempest-VolumesSnapshotTestJSON-991813121-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:03:21.591868 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-52c77d4d-e3c4-4ac3-830a-b1645bd68961 req-f6e9e649-6aa1-4109-acd5-148568a555e7 tempest-VolumesSnapshotTestJSON-991813121 tempest-VolumesSnapshotTestJSON-991813121-project] 10.222.0.62 "GET /v2.0/ports?device_id=3ba29874-8ce5-4252-aa6d-7c8f6419aa93 HTTP/1.1" status: 200 len: 931 time: 0.1355865 May 25 17:03:21.637696 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-52c77d4d-e3c4-4ac3-830a-b1645bd68961 req-516b1650-8ea7-48ff-9f63-66fbf5690c40 tempest-VolumesSnapshotTestJSON-991813121 tempest-VolumesSnapshotTestJSON-991813121-project] 10.222.0.62 "GET /v2.0/security-groups?id=b5f47757-8dd4-4226-9a13-ca15ee498213&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0394931 May 25 17:03:21.747961 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9d3bb272-256c-4de1-9813-4d1a8c200f7f req-8e8d64bd-ff69-4243-9e1c-38554c0b8689 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:03:21.749507 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-9d3bb272-256c-4de1-9813-4d1a8c200f7f req-8e8d64bd-ff69-4243-9e1c-38554c0b8689 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] 10.222.0.62 "GET /v2.0/ports?device_id=bca36110-0b4f-419a-92ef-46cbb9d6215e HTTP/1.1" status: 200 len: 945 time: 0.0810962 May 25 17:03:21.777658 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.notifiers.nova [req-9e90af47-4007-410e-8221-5ebb523fa8b8 req-45c8c85b-2a86-42e8-beb9-2fedb9ea32dc service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 13752a02-2ccb-4f85-b36f-38ca98958db9 {{(pid=91830) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} May 25 17:03:21.795510 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [req-9e90af47-4007-410e-8221-5ebb523fa8b8 req-45c8c85b-2a86-42e8-beb9-2fedb9ea32dc service neutron] Notify callbacks [] for port, precommit_update {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:03:21.799323 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-9d3bb272-256c-4de1-9813-4d1a8c200f7f req-f6991650-31c8-4df2-9c29-f849ebb7b104 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] 10.222.0.62 "GET /v2.0/security-groups?id=f73b90a2-df48-48fb-99e0-5dd4d6a63a15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0429525 May 25 17:03:21.819313 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.provisioning_blocks [req-9e90af47-4007-410e-8221-5ebb523fa8b8 req-45c8c85b-2a86-42e8-beb9-2fedb9ea32dc service neutron] Transition to ACTIVE for port object 13752a02-2ccb-4f85-b36f-38ca98958db9 will not be triggered until provisioned by entity L2. {{(pid=91830) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 25 17:03:21.830827 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [req-9e90af47-4007-410e-8221-5ebb523fa8b8 req-45c8c85b-2a86-42e8-beb9-2fedb9ea32dc service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8757892955028', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8757892520933', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8757892521750', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-27483010'] for port, after_update {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:03:21.838138 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:03:22.041069 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.notifiers.nova [req-4cc967bc-5b90-4574-8e01-1300f67e9a92 req-4e460861-9934-411b-ac4d-726f1f5a043b service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 4653ac1b-8d11-4595-8487-58704e147494 {{(pid=91830) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} May 25 17:03:22.060007 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-45c8c85b-2a86-42e8-beb9-2fedb9ea32dc service neutron] Pushing event updated for resources: {'Port': ['ID=13752a02-2ccb-4f85-b36f-38ca98958db9,revision_number=2']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:03:22.064454 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [req-4cc967bc-5b90-4574-8e01-1300f67e9a92 req-4e460861-9934-411b-ac4d-726f1f5a043b service neutron] Notify callbacks [] for port, precommit_update {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:03:22.095896 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-45c8c85b-2a86-42e8-beb9-2fedb9ea32dc service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.258s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:03:22.121015 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.provisioning_blocks [req-4cc967bc-5b90-4574-8e01-1300f67e9a92 req-4e460861-9934-411b-ac4d-726f1f5a043b service neutron] Transition to ACTIVE for port object 4653ac1b-8d11-4595-8487-58704e147494 will not be triggered until provisioned by entity L2. {{(pid=91830) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 25 17:03:22.126477 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [req-4cc967bc-5b90-4574-8e01-1300f67e9a92 req-4e460861-9934-411b-ac4d-726f1f5a043b service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8757892955028', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8757892520933', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8757892521750', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-27483010'] for port, after_update {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:03:22.132324 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-b6a57449-94d8-4558-858f-fd3a84032035 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:03:22.266156 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.plugins.ml2.managers [req-9e90af47-4007-410e-8221-5ebb523fa8b8 req-45c8c85b-2a86-42e8-beb9-2fedb9ea32dc service neutron] Attempting to bind port 13752a02-2ccb-4f85-b36f-38ca98958db9 on host hv-cinder-79049 for vnic_type normal with profile {{(pid=91830) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 25 17:03:22.266484 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.plugins.ml2.managers [req-9e90af47-4007-410e-8221-5ebb523fa8b8 req-45c8c85b-2a86-42e8-beb9-2fedb9ea32dc service neutron] Attempting to bind port 13752a02-2ccb-4f85-b36f-38ca98958db9 by drivers openvswitch,hyperv on host hv-cinder-79049 at level 0 using segments [{'id': 'b8ba5240-28ce-40db-a6e6-b4a42435e0b6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 655, 'network_id': 'b351598a-3f6f-4a37-8095-8d9371896ccc'}] {{(pid=91830) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 25 17:03:22.266809 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9e90af47-4007-410e-8221-5ebb523fa8b8 req-45c8c85b-2a86-42e8-beb9-2fedb9ea32dc service neutron] Attempting to bind port 13752a02-2ccb-4f85-b36f-38ca98958db9 on network b351598a-3f6f-4a37-8095-8d9371896ccc {{(pid=91830) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 25 17:03:22.277432 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.rpc [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Device 46a1adbe-ec54-4c57-aa7a-9f257475e01c no longer exists at agent hyperv_hv-cinder-79049 {{(pid=91831) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 25 17:03:22.302232 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4e460861-9934-411b-ac4d-726f1f5a043b service neutron] Pushing event updated for resources: {'Port': ['ID=4653ac1b-8d11-4595-8487-58704e147494,revision_number=2']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:03:22.309542 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9e90af47-4007-410e-8221-5ebb523fa8b8 req-45c8c85b-2a86-42e8-beb9-2fedb9ea32dc service neutron] Port 13752a02-2ccb-4f85-b36f-38ca98958db9 on network b351598a-3f6f-4a37-8095-8d9371896ccc not bound, no agent of type Open vSwitch agent registered on host hv-cinder-79049 {{(pid=91830) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 25 17:03:22.309864 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9e90af47-4007-410e-8221-5ebb523fa8b8 req-45c8c85b-2a86-42e8-beb9-2fedb9ea32dc service neutron] Attempting to bind port 13752a02-2ccb-4f85-b36f-38ca98958db9 on network b351598a-3f6f-4a37-8095-8d9371896ccc {{(pid=91830) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 25 17:03:22.312626 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-4e460861-9934-411b-ac4d-726f1f5a043b service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.180s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:03:22.316122 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.plugin [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] No Port match for: 46a1adbe-ec54-4c57-aa7a-9f257475e01c {{(pid=91831) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}} May 25 17:03:22.316475 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.rpc [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Device 46a1adbe-ec54-4c57-aa7a-9f257475e01c not bound to the agent host hv-cinder-79049 {{(pid=91831) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 25 17:03:22.344774 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9e90af47-4007-410e-8221-5ebb523fa8b8 req-45c8c85b-2a86-42e8-beb9-2fedb9ea32dc service neutron] Checking agent: {'id': '3a1fdee1-bff0-49fb-b470-e13b95ee1b4d', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-79049', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 25, 16, 56, 32), 'started_at': datetime.datetime(2021, 5, 25, 16, 56, 32), 'heartbeat_timestamp': datetime.datetime(2021, 5, 25, 17, 3, 5), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=91830) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 25 17:03:22.345108 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9e90af47-4007-410e-8221-5ebb523fa8b8 req-45c8c85b-2a86-42e8-beb9-2fedb9ea32dc service neutron] Checking segment: {'id': 'b8ba5240-28ce-40db-a6e6-b4a42435e0b6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 655, 'network_id': 'b351598a-3f6f-4a37-8095-8d9371896ccc'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91830) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 25 17:03:22.345482 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9e90af47-4007-410e-8221-5ebb523fa8b8 req-45c8c85b-2a86-42e8-beb9-2fedb9ea32dc service neutron] Bound using segment: {'id': 'b8ba5240-28ce-40db-a6e6-b4a42435e0b6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 655, 'network_id': 'b351598a-3f6f-4a37-8095-8d9371896ccc'} {{(pid=91830) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 25 17:03:22.345935 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.plugins.ml2.managers [req-9e90af47-4007-410e-8221-5ebb523fa8b8 req-45c8c85b-2a86-42e8-beb9-2fedb9ea32dc service neutron] Bound port: 13752a02-2ccb-4f85-b36f-38ca98958db9, host: hv-cinder-79049, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'b8ba5240-28ce-40db-a6e6-b4a42435e0b6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 655, 'network_id': 'b351598a-3f6f-4a37-8095-8d9371896ccc'}}] {{(pid=91830) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 25 17:03:22.346275 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [req-9e90af47-4007-410e-8221-5ebb523fa8b8 req-45c8c85b-2a86-42e8-beb9-2fedb9ea32dc service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3832070'] for port, before_update {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:03:22.459718 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.plugins.ml2.managers [req-4cc967bc-5b90-4574-8e01-1300f67e9a92 req-4e460861-9934-411b-ac4d-726f1f5a043b service neutron] Attempting to bind port 4653ac1b-8d11-4595-8487-58704e147494 on host hv-cinder-79049 for vnic_type normal with profile {{(pid=91830) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 25 17:03:22.459962 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.plugins.ml2.managers [req-4cc967bc-5b90-4574-8e01-1300f67e9a92 req-4e460861-9934-411b-ac4d-726f1f5a043b service neutron] Attempting to bind port 4653ac1b-8d11-4595-8487-58704e147494 by drivers openvswitch,hyperv on host hv-cinder-79049 at level 0 using segments [{'id': 'bba065e2-1e75-4ab9-bc0e-e3037ef57277', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 654, 'network_id': 'c8b64023-a7f5-4c0f-847b-8a8aef981caa'}] {{(pid=91830) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 25 17:03:22.460281 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4cc967bc-5b90-4574-8e01-1300f67e9a92 req-4e460861-9934-411b-ac4d-726f1f5a043b service neutron] Attempting to bind port 4653ac1b-8d11-4595-8487-58704e147494 on network c8b64023-a7f5-4c0f-847b-8a8aef981caa {{(pid=91830) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 25 17:03:22.469862 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4cc967bc-5b90-4574-8e01-1300f67e9a92 req-4e460861-9934-411b-ac4d-726f1f5a043b service neutron] Port 4653ac1b-8d11-4595-8487-58704e147494 on network c8b64023-a7f5-4c0f-847b-8a8aef981caa not bound, no agent of type Open vSwitch agent registered on host hv-cinder-79049 {{(pid=91830) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 25 17:03:22.470217 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4cc967bc-5b90-4574-8e01-1300f67e9a92 req-4e460861-9934-411b-ac4d-726f1f5a043b service neutron] Attempting to bind port 4653ac1b-8d11-4595-8487-58704e147494 on network c8b64023-a7f5-4c0f-847b-8a8aef981caa {{(pid=91830) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 25 17:03:22.475058 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.plugins.ml2.db [req-9e90af47-4007-410e-8221-5ebb523fa8b8 req-45c8c85b-2a86-42e8-beb9-2fedb9ea32dc service neutron] For port 13752a02-2ccb-4f85-b36f-38ca98958db9, host hv-cinder-79049, cleared binding levels {{(pid=91830) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 25 17:03:22.479647 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.plugins.ml2.db [req-9e90af47-4007-410e-8221-5ebb523fa8b8 req-45c8c85b-2a86-42e8-beb9-2fedb9ea32dc service neutron] For port 13752a02-2ccb-4f85-b36f-38ca98958db9, host hv-cinder-79049, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79049',level=0,port_id=13752a02-2ccb-4f85-b36f-38ca98958db9,segment=NetworkSegment(b8ba5240-28ce-40db-a6e6-b4a42435e0b6),segment_id=b8ba5240-28ce-40db-a6e6-b4a42435e0b6)] {{(pid=91830) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 25 17:03:22.480715 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4cc967bc-5b90-4574-8e01-1300f67e9a92 req-4e460861-9934-411b-ac4d-726f1f5a043b service neutron] Checking agent: {'id': '3a1fdee1-bff0-49fb-b470-e13b95ee1b4d', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-79049', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 25, 16, 56, 32), 'started_at': datetime.datetime(2021, 5, 25, 16, 56, 32), 'heartbeat_timestamp': datetime.datetime(2021, 5, 25, 17, 3, 5), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=91830) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 25 17:03:22.481132 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4cc967bc-5b90-4574-8e01-1300f67e9a92 req-4e460861-9934-411b-ac4d-726f1f5a043b service neutron] Checking segment: {'id': 'bba065e2-1e75-4ab9-bc0e-e3037ef57277', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 654, 'network_id': 'c8b64023-a7f5-4c0f-847b-8a8aef981caa'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91830) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 25 17:03:22.481509 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4cc967bc-5b90-4574-8e01-1300f67e9a92 req-4e460861-9934-411b-ac4d-726f1f5a043b service neutron] Bound using segment: {'id': 'bba065e2-1e75-4ab9-bc0e-e3037ef57277', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 654, 'network_id': 'c8b64023-a7f5-4c0f-847b-8a8aef981caa'} {{(pid=91830) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 25 17:03:22.482045 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.plugins.ml2.managers [req-4cc967bc-5b90-4574-8e01-1300f67e9a92 req-4e460861-9934-411b-ac4d-726f1f5a043b service neutron] Bound port: 4653ac1b-8d11-4595-8487-58704e147494, host: hv-cinder-79049, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'bba065e2-1e75-4ab9-bc0e-e3037ef57277', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 654, 'network_id': 'c8b64023-a7f5-4c0f-847b-8a8aef981caa'}}] {{(pid=91830) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 25 17:03:22.482470 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [req-4cc967bc-5b90-4574-8e01-1300f67e9a92 req-4e460861-9934-411b-ac4d-726f1f5a043b service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3832070'] for port, before_update {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:03:22.496211 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [req-9e90af47-4007-410e-8221-5ebb523fa8b8 req-45c8c85b-2a86-42e8-beb9-2fedb9ea32dc service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8757892955028', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8757892520933', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8757892521750', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-27483010'] for port, after_update {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:03:22.502596 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-7233908d-3846-4713-9fa0-be18a7b01f89 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:03:22.605099 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9e90af47-4007-410e-8221-5ebb523fa8b8 req-45c8c85b-2a86-42e8-beb9-2fedb9ea32dc service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91830) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:03:22.605714 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [req-9e90af47-4007-410e-8221-5ebb523fa8b8 req-45c8c85b-2a86-42e8-beb9-2fedb9ea32dc service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-178712'] for port, before_response {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:03:22.607109 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-9e90af47-4007-410e-8221-5ebb523fa8b8 req-45c8c85b-2a86-42e8-beb9-2fedb9ea32dc service neutron] 10.222.0.32 "PUT /v2.0/ports/13752a02-2ccb-4f85-b36f-38ca98958db9 HTTP/1.1" status: 200 len: 1094 time: 1.8618162 May 25 17:03:22.607601 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '4758207a-3093-4ef3-802c-dc11d895da7a', 'tag': '13752a02-2ccb-4f85-b36f-38ca98958db9'}] {{(pid=91830) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 25 17:03:22.660257 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-45c8c85b-2a86-42e8-beb9-2fedb9ea32dc service neutron] Pushing event updated for resources: {'Port': ['ID=13752a02-2ccb-4f85-b36f-38ca98958db9,revision_number=3']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:03:22.708443 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-45c8c85b-2a86-42e8-beb9-2fedb9ea32dc service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.206s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:03:22.710662 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '4758207a-3093-4ef3-802c-dc11d895da7a', 'tag': '13752a02-2ccb-4f85-b36f-38ca98958db9', 'status': 'completed', 'code': 200} May 25 17:03:22.723888 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.plugins.ml2.db [req-4cc967bc-5b90-4574-8e01-1300f67e9a92 req-4e460861-9934-411b-ac4d-726f1f5a043b service neutron] For port 4653ac1b-8d11-4595-8487-58704e147494, host hv-cinder-79049, cleared binding levels {{(pid=91830) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 25 17:03:22.742248 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.plugins.ml2.db [req-4cc967bc-5b90-4574-8e01-1300f67e9a92 req-4e460861-9934-411b-ac4d-726f1f5a043b service neutron] For port 4653ac1b-8d11-4595-8487-58704e147494, host hv-cinder-79049, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79049',level=0,port_id=4653ac1b-8d11-4595-8487-58704e147494,segment=NetworkSegment(bba065e2-1e75-4ab9-bc0e-e3037ef57277),segment_id=bba065e2-1e75-4ab9-bc0e-e3037ef57277)] {{(pid=91830) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 25 17:03:22.752351 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [req-4cc967bc-5b90-4574-8e01-1300f67e9a92 req-4e460861-9934-411b-ac4d-726f1f5a043b service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8757892955028', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8757892520933', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8757892521750', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-27483010'] for port, after_update {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:03:22.757412 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-45c8c85b-2a86-42e8-beb9-2fedb9ea32dc service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:03:22.768368 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-90bf0323-61db-480a-828a-47d86307c69b req-ea0ac989-fc8f-4b03-8fa9-c076b0478732 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:03:22.769879 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-90bf0323-61db-480a-828a-47d86307c69b req-ea0ac989-fc8f-4b03-8fa9-c076b0478732 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] 10.222.0.62 "GET /v2.0/ports?device_id=4758207a-3093-4ef3-802c-dc11d895da7a HTTP/1.1" status: 200 len: 944 time: 0.0906472 May 25 17:03:22.828742 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4cc967bc-5b90-4574-8e01-1300f67e9a92 req-4e460861-9934-411b-ac4d-726f1f5a043b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91830) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:03:22.829348 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [req-4cc967bc-5b90-4574-8e01-1300f67e9a92 req-4e460861-9934-411b-ac4d-726f1f5a043b service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-178712'] for port, before_response {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:03:22.830734 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-4cc967bc-5b90-4574-8e01-1300f67e9a92 req-4e460861-9934-411b-ac4d-726f1f5a043b service neutron] 10.222.0.32 "PUT /v2.0/ports/4653ac1b-8d11-4595-8487-58704e147494 HTTP/1.1" status: 200 len: 1093 time: 1.7934864 May 25 17:03:22.837094 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9e90af47-4007-410e-8221-5ebb523fa8b8 req-cfa8eb59-7082-4b89-892a-125b516322fc service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91830) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:03:22.838479 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-9e90af47-4007-410e-8221-5ebb523fa8b8 req-cfa8eb59-7082-4b89-892a-125b516322fc service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=70dac097fff04aed99a4976fa955579b&device_id=4758207a-3093-4ef3-802c-dc11d895da7a HTTP/1.1" status: 200 len: 1097 time: 0.1678984 May 25 17:03:22.878678 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-90bf0323-61db-480a-828a-47d86307c69b req-938494d1-b5b6-4e8b-9f4c-9bb4e478ddca tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] 10.222.0.62 "GET /v2.0/security-groups?id=7cad7118-dc73-4cab-9cb2-fa41cd4499bd&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1025915 May 25 17:03:22.913137 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b5836820-149c-4aaf-851b-bd25f1c60adb req-0e3ffb27-b19e-4ee8-98e4-99679b5ca392 tempest-VolumesSnapshotTestJSON-991813121 tempest-VolumesSnapshotTestJSON-991813121-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:03:22.914592 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-b5836820-149c-4aaf-851b-bd25f1c60adb req-0e3ffb27-b19e-4ee8-98e4-99679b5ca392 tempest-VolumesSnapshotTestJSON-991813121 tempest-VolumesSnapshotTestJSON-991813121-project] 10.222.0.62 "GET /v2.0/ports?device_id=3ba29874-8ce5-4252-aa6d-7c8f6419aa93 HTTP/1.1" status: 200 len: 943 time: 0.1040127 May 25 17:03:22.953229 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4e460861-9934-411b-ac4d-726f1f5a043b service neutron] Pushing event updated for resources: {'Port': ['ID=4653ac1b-8d11-4595-8487-58704e147494,revision_number=3']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:03:22.962125 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-9e90af47-4007-410e-8221-5ebb523fa8b8 req-c57fed90-8141-414d-bb75-67a6fa98bb56 service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=13752a02-2ccb-4f85-b36f-38ca98958db9 HTTP/1.1" status: 200 len: 217 time: 0.1114159 May 25 17:03:22.962308 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-b5836820-149c-4aaf-851b-bd25f1c60adb req-89318434-d9af-462f-8460-5d299ec363dc tempest-VolumesSnapshotTestJSON-991813121 tempest-VolumesSnapshotTestJSON-991813121-project] 10.222.0.62 "GET /v2.0/security-groups?id=b5f47757-8dd4-4226-9a13-ca15ee498213&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0414519 May 25 17:03:22.962913 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-4e460861-9934-411b-ac4d-726f1f5a043b service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.206s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:03:23.038174 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9e90af47-4007-410e-8221-5ebb523fa8b8 req-546c48d7-2423-449e-bf7a-35354f07cd5b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91830) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:03:23.039595 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-9e90af47-4007-410e-8221-5ebb523fa8b8 req-546c48d7-2423-449e-bf7a-35354f07cd5b service neutron] 10.222.0.32 "GET /v2.0/subnets?id=4bbae145-74ed-4fda-b7c0-ae77a3202a83 HTTP/1.1" status: 200 len: 849 time: 0.0689838 May 25 17:03:23.077768 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-215ea352-d159-472c-a9c9-3373559501d5 req-a8967369-fc35-4d0b-9fa9-894ca3ba8277 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:03:23.079284 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-215ea352-d159-472c-a9c9-3373559501d5 req-a8967369-fc35-4d0b-9fa9-894ca3ba8277 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] 10.222.0.62 "GET /v2.0/ports?device_id=bca36110-0b4f-419a-92ef-46cbb9d6215e HTTP/1.1" status: 200 len: 945 time: 0.0908427 May 25 17:03:23.086363 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4cc967bc-5b90-4574-8e01-1300f67e9a92 req-f6cdca4a-13bb-4bf9-893b-88ceae09e290 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91830) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:03:23.087808 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-4cc967bc-5b90-4574-8e01-1300f67e9a92 req-f6cdca4a-13bb-4bf9-893b-88ceae09e290 service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=1314f62bcf90411cadb06fa2d9392828&device_id=3ba29874-8ce5-4252-aa6d-7c8f6419aa93 HTTP/1.1" status: 200 len: 1096 time: 0.1857996 May 25 17:03:23.126445 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-215ea352-d159-472c-a9c9-3373559501d5 req-be2ca9f7-172f-4cf6-b597-7a2b9d263283 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] 10.222.0.62 "GET /v2.0/security-groups?id=f73b90a2-df48-48fb-99e0-5dd4d6a63a15&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0402875 May 25 17:03:23.259898 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-4cc967bc-5b90-4574-8e01-1300f67e9a92 req-ce903f30-2060-4047-b436-0bdfb9663c20 service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=4653ac1b-8d11-4595-8487-58704e147494 HTTP/1.1" status: 200 len: 217 time: 0.0707161 May 25 17:03:23.332766 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4cc967bc-5b90-4574-8e01-1300f67e9a92 req-9e769ab5-6bae-4778-8a4d-fcd6cd8a081f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91830) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:03:23.334177 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-4cc967bc-5b90-4574-8e01-1300f67e9a92 req-9e769ab5-6bae-4778-8a4d-fcd6cd8a081f service neutron] 10.222.0.32 "GET /v2.0/subnets?id=e21793ea-1820-4ec5-b3fc-a7d9b7129124 HTTP/1.1" status: 200 len: 853 time: 0.0673075 May 25 17:03:23.336816 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9e90af47-4007-410e-8221-5ebb523fa8b8 req-e0748954-d197-4b2f-b469-1d2878f1d424 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91830) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:03:23.338180 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-9e90af47-4007-410e-8221-5ebb523fa8b8 req-e0748954-d197-4b2f-b469-1d2878f1d424 service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=b351598a-3f6f-4a37-8095-8d9371896ccc&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.2892218 May 25 17:03:23.423417 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-4cc967bc-5b90-4574-8e01-1300f67e9a92 req-00f730f5-f29b-49a2-866b-0497a9442b20 service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=c8b64023-a7f5-4c0f-847b-8a8aef981caa&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0696723 May 25 17:03:23.635620 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cbf263e2-2ca7-44de-8a2f-38302e070b47 req-cc73a153-c356-4444-89ee-807f4ce1c02b tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:03:23.637037 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-cbf263e2-2ca7-44de-8a2f-38302e070b47 req-cc73a153-c356-4444-89ee-807f4ce1c02b tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] 10.222.0.32 "GET /v2.0/ports?device_id=bca36110-0b4f-419a-92ef-46cbb9d6215e HTTP/1.1" status: 200 len: 945 time: 0.0879526 May 25 17:03:23.641181 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-9e90af47-4007-410e-8221-5ebb523fa8b8 req-34d2aa97-3b6e-47e6-9539-bc93495e2ad2 service neutron] 10.222.0.32 "GET /v2.0/networks/b351598a-3f6f-4a37-8095-8d9371896ccc?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2572615 May 25 17:03:23.648345 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-4cc967bc-5b90-4574-8e01-1300f67e9a92 req-03b91fd2-32b4-4bd6-a75a-1debb6638a34 service neutron] 10.222.0.32 "GET /v2.0/networks/c8b64023-a7f5-4c0f-847b-8a8aef981caa?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1782939 May 25 17:03:23.785633 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.plugins.ml2.plugin [req-cbf263e2-2ca7-44de-8a2f-38302e070b47 req-649faa7b-8601-49a5-904d-c5c84f26c6d3 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] Deleting port c4b9c0f2-e3d5-4fff-9b3c-a9175b027fb5 {{(pid=91829) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 25 17:03:23.786320 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [req-cbf263e2-2ca7-44de-8a2f-38302e070b47 req-649faa7b-8601-49a5-904d-c5c84f26c6d3 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8757892952899'] for port, before_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:03:23.900379 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-9e90af47-4007-410e-8221-5ebb523fa8b8 req-53fe7fad-e56e-4902-a603-9b6970cb68d0 service neutron] 10.222.0.32 "GET /v2.0/networks/b351598a-3f6f-4a37-8095-8d9371896ccc?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2437375 May 25 17:03:23.902163 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-4cc967bc-5b90-4574-8e01-1300f67e9a92 req-72a148be-57dd-496d-828c-088bc59de760 service neutron] 10.222.0.32 "GET /v2.0/networks/c8b64023-a7f5-4c0f-847b-8a8aef981caa?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2446818 May 25 17:03:23.918725 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.plugins.ml2.db [req-cbf263e2-2ca7-44de-8a2f-38302e070b47 req-649faa7b-8601-49a5-904d-c5c84f26c6d3 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] For port c4b9c0f2-e3d5-4fff-9b3c-a9175b027fb5, host hv-cinder-79049, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79049',level=0,port_id=c4b9c0f2-e3d5-4fff-9b3c-a9175b027fb5,segment=NetworkSegment(7d7273c2-c6dd-43fe-83a8-cb776d48dc70),segment_id=7d7273c2-c6dd-43fe-83a8-cb776d48dc70)] {{(pid=91829) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 17:03:23.918963 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [req-cbf263e2-2ca7-44de-8a2f-38302e070b47 req-649faa7b-8601-49a5-904d-c5c84f26c6d3 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-683770'] for port, precommit_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:03:24.040522 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c4b4d686-101c-4b09-b836-e4844c506ae2 req-24d3f39c-1de1-4785-a5d6-1bb9f565adde service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91830) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:03:24.042294 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-c4b4d686-101c-4b09-b836-e4844c506ae2 req-24d3f39c-1de1-4785-a5d6-1bb9f565adde service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=70dac097fff04aed99a4976fa955579b&device_id=4758207a-3093-4ef3-802c-dc11d895da7a HTTP/1.1" status: 200 len: 1097 time: 0.0811379 May 25 17:03:24.154006 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.plugins.ml2.plugin [req-cbf263e2-2ca7-44de-8a2f-38302e070b47 req-649faa7b-8601-49a5-904d-c5c84f26c6d3 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] Calling delete_port for c4b9c0f2-e3d5-4fff-9b3c-a9175b027fb5 owned by compute:nova {{(pid=91829) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 25 17:03:24.177511 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c4b4d686-101c-4b09-b836-e4844c506ae2 req-3eecd91b-07c8-41e9-9316-d4bf462696a2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91830) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:03:24.179258 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-c4b4d686-101c-4b09-b836-e4844c506ae2 req-3eecd91b-07c8-41e9-9316-d4bf462696a2 service neutron] 10.222.0.32 "GET /v2.0/networks?id=b351598a-3f6f-4a37-8095-8d9371896ccc HTTP/1.1" status: 200 len: 911 time: 0.1304512 May 25 17:03:24.247941 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-c4b4d686-101c-4b09-b836-e4844c506ae2 req-7b023787-6241-462e-9d1f-8b0aeb066c3c service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=13752a02-2ccb-4f85-b36f-38ca98958db9 HTTP/1.1" status: 200 len: 217 time: 0.0607424 May 25 17:03:24.313122 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c4b4d686-101c-4b09-b836-e4844c506ae2 req-1ca65528-21ea-4e98-8f5a-58d7cc3b774e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91830) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:03:24.314583 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-c4b4d686-101c-4b09-b836-e4844c506ae2 req-1ca65528-21ea-4e98-8f5a-58d7cc3b774e service neutron] 10.222.0.32 "GET /v2.0/subnets?id=4bbae145-74ed-4fda-b7c0-ae77a3202a83 HTTP/1.1" status: 200 len: 849 time: 0.0605571 May 25 17:03:24.326177 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-37713e1b-a8ed-4bb6-8265-3a4743ca2a21 req-b8c75fd3-a0fa-4a87-bc73-6f2b9f82f7d3 tempest-VolumesSnapshotTestJSON-991813121 tempest-VolumesSnapshotTestJSON-991813121-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:03:24.328200 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-37713e1b-a8ed-4bb6-8265-3a4743ca2a21 req-b8c75fd3-a0fa-4a87-bc73-6f2b9f82f7d3 tempest-VolumesSnapshotTestJSON-991813121 tempest-VolumesSnapshotTestJSON-991813121-project] 10.222.0.62 "GET /v2.0/ports?device_id=3ba29874-8ce5-4252-aa6d-7c8f6419aa93 HTTP/1.1" status: 200 len: 943 time: 0.1824832 May 25 17:03:24.337704 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f71d1296-6dba-4470-ab70-a5896bebabaa req-15382d1c-208f-4d5f-96fc-0d31864d09e0 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:03:24.339108 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-f71d1296-6dba-4470-ab70-a5896bebabaa req-15382d1c-208f-4d5f-96fc-0d31864d09e0 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] 10.222.0.62 "GET /v2.0/ports?device_id=4758207a-3093-4ef3-802c-dc11d895da7a HTTP/1.1" status: 200 len: 944 time: 0.1922834 May 25 17:03:24.394958 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c4b4d686-101c-4b09-b836-e4844c506ae2 req-9b30766c-7975-4381-9558-99efd6801aa3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91830) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:03:24.396406 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-c4b4d686-101c-4b09-b836-e4844c506ae2 req-9b30766c-7975-4381-9558-99efd6801aa3 service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=b351598a-3f6f-4a37-8095-8d9371896ccc&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0714097 May 25 17:03:24.461412 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-37713e1b-a8ed-4bb6-8265-3a4743ca2a21 req-743d0f2d-9eec-46a9-bdda-02ed40e2c899 tempest-VolumesSnapshotTestJSON-991813121 tempest-VolumesSnapshotTestJSON-991813121-project] 10.222.0.62 "GET /v2.0/security-groups?id=b5f47757-8dd4-4226-9a13-ca15ee498213&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1212609 May 25 17:03:24.479395 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-f71d1296-6dba-4470-ab70-a5896bebabaa req-116804d4-65b7-4605-afe0-88dec2e0abe1 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] 10.222.0.62 "GET /v2.0/security-groups?id=7cad7118-dc73-4cab-9cb2-fa41cd4499bd&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1209621 May 25 17:03:24.499499 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [req-cbf263e2-2ca7-44de-8a2f-38302e070b47 req-649faa7b-8601-49a5-904d-c5c84f26c6d3 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8757892955046', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8757892520924', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28230808'] for port, after_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:03:24.506866 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-e55415eb-7371-4b80-a3e5-6a95a9b61f3b tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:03:24.526073 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.db [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] get_ports_and_sgs() called for port_ids ['c4b9c0f2-e3d5-4fff-9b3c-a9175b027fb5'] {{(pid=91831) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 25 17:03:24.547552 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-c4b4d686-101c-4b09-b836-e4844c506ae2 req-28d606bf-4989-48b3-930c-c4e8eef53c4a service neutron] 10.222.0.32 "GET /v2.0/networks/b351598a-3f6f-4a37-8095-8d9371896ccc?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1432586 May 25 17:03:24.582514 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-649faa7b-8601-49a5-904d-c5c84f26c6d3 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] Pushing event deleted for resources: {'Port': ['ID=c4b9c0f2-e3d5-4fff-9b3c-a9175b027fb5,revision_number=None']} {{(pid=91829) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:03:24.584871 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-649faa7b-8601-49a5-904d-c5c84f26c6d3 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.078s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:03:24.688827 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-c4b4d686-101c-4b09-b836-e4844c506ae2 req-0b981935-f5e2-4a61-bd07-f701534505da service neutron] 10.222.0.32 "GET /v2.0/networks/b351598a-3f6f-4a37-8095-8d9371896ccc?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1339087 May 25 17:03:24.692308 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-b925e56e-bbde-4de8-b264-47067a4fef1d req-9e03290c-9593-4fe4-8227-454b0cfabcae tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] 10.222.0.62 "GET /v2.0/ports?device_id=bca36110-0b4f-419a-92ef-46cbb9d6215e HTTP/1.1" status: 200 len: 210 time: 0.1062019 May 25 17:03:24.701445 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.l3_dvrscheduler_db [req-cbf263e2-2ca7-44de-8a2f-38302e070b47 req-649faa7b-8601-49a5-904d-c5c84f26c6d3 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] No DVR routers for this DVR port c4b9c0f2-e3d5-4fff-9b3c-a9175b027fb5 on host hv-cinder-79049 {{(pid=91829) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 25 17:03:24.704332 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [req-cbf263e2-2ca7-44de-8a2f-38302e070b47 req-649faa7b-8601-49a5-904d-c5c84f26c6d3 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-178712'] for port, before_response {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:03:24.708012 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'bca36110-0b4f-419a-92ef-46cbb9d6215e', 'name': 'network-vif-deleted', 'tag': 'c4b9c0f2-e3d5-4fff-9b3c-a9175b027fb5'}] {{(pid=91829) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 25 17:03:24.711644 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '3ba29874-8ce5-4252-aa6d-7c8f6419aa93', 'tag': '4653ac1b-8d11-4595-8487-58704e147494'}] {{(pid=91830) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 25 17:03:24.720712 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-cbf263e2-2ca7-44de-8a2f-38302e070b47 req-649faa7b-8601-49a5-904d-c5c84f26c6d3 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] 10.222.0.32 "DELETE /v2.0/ports/c4b9c0f2-e3d5-4fff-9b3c-a9175b027fb5 HTTP/1.1" status: 204 len: 173 time: 1.0705242 May 25 17:03:24.755267 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '3ba29874-8ce5-4252-aa6d-7c8f6419aa93', 'tag': '4653ac1b-8d11-4595-8487-58704e147494', 'status': 'completed', 'code': 200} May 25 17:03:24.759918 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'bca36110-0b4f-419a-92ef-46cbb9d6215e', 'name': 'network-vif-deleted', 'tag': 'c4b9c0f2-e3d5-4fff-9b3c-a9175b027fb5', 'status': 'completed', 'code': 200} May 25 17:03:24.863097 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e9a01ba0-6407-4b56-9be6-d0cdcba93945 req-80463969-0ec0-4dff-aa88-1e735ad7ceda service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:03:24.864568 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-e9a01ba0-6407-4b56-9be6-d0cdcba93945 req-80463969-0ec0-4dff-aa88-1e735ad7ceda service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=1314f62bcf90411cadb06fa2d9392828&device_id=3ba29874-8ce5-4252-aa6d-7c8f6419aa93 HTTP/1.1" status: 200 len: 1096 time: 0.0770328 May 25 17:03:25.003781 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e9a01ba0-6407-4b56-9be6-d0cdcba93945 req-afbf2d02-15b2-406f-8637-4c87530f2681 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:03:25.005133 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-e9a01ba0-6407-4b56-9be6-d0cdcba93945 req-afbf2d02-15b2-406f-8637-4c87530f2681 service neutron] 10.222.0.32 "GET /v2.0/networks?id=c8b64023-a7f5-4c0f-847b-8a8aef981caa HTTP/1.1" status: 200 len: 914 time: 0.1283433 May 25 17:03:25.076062 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-e9a01ba0-6407-4b56-9be6-d0cdcba93945 req-a882f6c3-5c4d-4dc5-8d41-838bef8e8bfb service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=4653ac1b-8d11-4595-8487-58704e147494 HTTP/1.1" status: 200 len: 217 time: 0.0632780 May 25 17:03:25.137370 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e9a01ba0-6407-4b56-9be6-d0cdcba93945 req-113cafd8-de9d-4a22-8d14-8cd514f758be service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:03:25.138772 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-e9a01ba0-6407-4b56-9be6-d0cdcba93945 req-113cafd8-de9d-4a22-8d14-8cd514f758be service neutron] 10.222.0.32 "GET /v2.0/subnets?id=e21793ea-1820-4ec5-b3fc-a7d9b7129124 HTTP/1.1" status: 200 len: 853 time: 0.0561132 May 25 17:03:25.185340 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-e9a01ba0-6407-4b56-9be6-d0cdcba93945 req-9a6f101e-2b2f-404a-bad4-c107e6972c9c service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=c8b64023-a7f5-4c0f-847b-8a8aef981caa&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0386019 May 25 17:03:25.292718 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-d3564417-dfa9-4f8a-a35a-31bf4d922ca8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:03:25.321892 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-e9a01ba0-6407-4b56-9be6-d0cdcba93945 req-9f217fb9-c7e1-47d6-a30f-604e376cda7c service neutron] 10.222.0.32 "GET /v2.0/networks/c8b64023-a7f5-4c0f-847b-8a8aef981caa?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1256499 May 25 17:03:25.455640 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-e9a01ba0-6407-4b56-9be6-d0cdcba93945 req-207bc351-0700-4c55-8e50-371212cc66ff service neutron] 10.222.0.32 "GET /v2.0/networks/c8b64023-a7f5-4c0f-847b-8a8aef981caa?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1270018 May 25 17:03:25.717107 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3361667d-57f1-45a0-a46a-9b9bf4bea12f req-77ab73fe-57cd-4f21-a99a-41eda96087e5 tempest-VolumesSnapshotTestJSON-991813121 tempest-VolumesSnapshotTestJSON-991813121-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:03:25.719173 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-3361667d-57f1-45a0-a46a-9b9bf4bea12f req-77ab73fe-57cd-4f21-a99a-41eda96087e5 tempest-VolumesSnapshotTestJSON-991813121 tempest-VolumesSnapshotTestJSON-991813121-project] 10.222.0.62 "GET /v2.0/ports?device_id=3ba29874-8ce5-4252-aa6d-7c8f6419aa93 HTTP/1.1" status: 200 len: 943 time: 0.1495264 May 25 17:03:25.727807 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d37472e3-06fc-4371-a129-4639bc1babd4 req-f6dcd456-b896-41c5-9890-c68b83eb9b0b tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:03:25.729140 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-d37472e3-06fc-4371-a129-4639bc1babd4 req-f6dcd456-b896-41c5-9890-c68b83eb9b0b tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] 10.222.0.62 "GET /v2.0/ports?device_id=4758207a-3093-4ef3-802c-dc11d895da7a HTTP/1.1" status: 200 len: 944 time: 0.1236944 May 25 17:03:25.800852 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-d37472e3-06fc-4371-a129-4639bc1babd4 req-acb8b752-3042-4175-bc71-ed3b364fb3d7 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] 10.222.0.62 "GET /v2.0/security-groups?id=7cad7118-dc73-4cab-9cb2-fa41cd4499bd&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0581808 May 25 17:03:25.803903 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-3361667d-57f1-45a0-a46a-9b9bf4bea12f req-a255b9c0-5d25-4ddd-babc-a69d7325aa16 tempest-VolumesSnapshotTestJSON-991813121 tempest-VolumesSnapshotTestJSON-991813121-project] 10.222.0.62 "GET /v2.0/security-groups?id=b5f47757-8dd4-4226-9a13-ca15ee498213&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0735874 May 25 17:03:25.891337 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.wsgi [-] (91829) accepted ('10.222.0.62', 33808) {{(pid=91829) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:03:25.994667 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.db_base_plugin_v2 [None req-5f0deea3-760d-479c-ad89-c97d55347b3a admin admin] Deleting subnet b0baa944-cafe-48a4-861a-dae28947b9f0 {{(pid=91829) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}} May 25 17:03:25.997432 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-5f0deea3-760d-479c-ad89-c97d55347b3a admin admin] Notify callbacks [] for subnet, before_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:03:26.049936 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-5f0deea3-760d-479c-ad89-c97d55347b3a admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-28283188'] for subnet, precommit_delete_associations {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:03:26.198001 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-5f0deea3-760d-479c-ad89-c97d55347b3a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3856586'] for subnet, precommit_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:03:26.438217 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-5f0deea3-760d-479c-ad89-c97d55347b3a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3857535', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55886', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-27333739', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-28266126'] for subnet, after_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:03:26.441852 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:03:26.474226 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5f0deea3-760d-479c-ad89-c97d55347b3a admin admin] Pushing event deleted for resources: {'Subnet': ['ID=b0baa944-cafe-48a4-861a-dae28947b9f0,revision_number=None']} {{(pid=91829) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:03:26.477134 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-5f0deea3-760d-479c-ad89-c97d55347b3a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.035s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:03:26.478108 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-5f0deea3-760d-479c-ad89-c97d55347b3a admin admin] Notify callbacks [] for subnet, before_response {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:03:26.484178 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [None req-5f0deea3-760d-479c-ad89-c97d55347b3a admin admin] 10.222.0.62 "DELETE /v2.0/subnets/b0baa944-cafe-48a4-861a-dae28947b9f0 HTTP/1.1" status: 204 len: 168 time: 0.5911160 May 25 17:03:26.486611 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.wsgi [-] (91829) accepted ('10.222.0.62', 33814) {{(pid=91829) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:03:26.588387 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-df3ec8cb-c4b1-48f9-b691-7e979bd07016 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3867326'] for network, before_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:03:26.708583 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-df3ec8cb-c4b1-48f9-b691-7e979bd07016 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3858245', 'neutron.services.segments.db._delete_segments_for_network-8757892982492'] for network, precommit_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:03:26.721125 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.services.segments.db [None req-df3ec8cb-c4b1-48f9-b691-7e979bd07016 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['63b1f335-e2c4-48dd-886b-6be853f8a2fc']}} {{(pid=91829) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 17:03:26.732946 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.services.segments.db [None req-df3ec8cb-c4b1-48f9-b691-7e979bd07016 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '7d7273c2-c6dd-43fe-83a8-cb776d48dc70') {'for_net_delete': True} {{(pid=91829) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 17:03:26.733855 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.services.segments.db [None req-df3ec8cb-c4b1-48f9-b691-7e979bd07016 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '7d7273c2-c6dd-43fe-83a8-cb776d48dc70') {} {{(pid=91829) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 17:03:26.744758 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-df3ec8cb-c4b1-48f9-b691-7e979bd07016 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8757892991389', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-28283199'] for segment, before_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:03:26.760097 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-df3ec8cb-c4b1-48f9-b691-7e979bd07016 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3809789'] for segment, precommit_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:03:26.766060 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-df3ec8cb-c4b1-48f9-b691-7e979bd07016 admin admin] Releasing vlan 651 on physical network physnet1 to pool {{(pid=91829) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 25 17:03:26.766435 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-df3ec8cb-c4b1-48f9-b691-7e979bd07016 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3809789', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-28230861'] for segment, after_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:03:26.778885 dv-cinder-790492-4-iscsi neutron-server[91829]: Traceback (most recent call last): May 25 17:03:26.778885 dv-cinder-790492-4-iscsi neutron-server[91829]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 25 17:03:26.778885 dv-cinder-790492-4-iscsi neutron-server[91829]: timer() May 25 17:03:26.778885 dv-cinder-790492-4-iscsi neutron-server[91829]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 25 17:03:26.778885 dv-cinder-790492-4-iscsi neutron-server[91829]: cb(*args, **kw) May 25 17:03:26.778885 dv-cinder-790492-4-iscsi neutron-server[91829]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper May 25 17:03:26.778885 dv-cinder-790492-4-iscsi neutron-server[91829]: return func(*args, **kwargs) May 25 17:03:26.778885 dv-cinder-790492-4-iscsi neutron-server[91829]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 25 17:03:26.778885 dv-cinder-790492-4-iscsi neutron-server[91829]: self._notify() May 25 17:03:26.778885 dv-cinder-790492-4-iscsi neutron-server[91829]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 25 17:03:26.778885 dv-cinder-790492-4-iscsi neutron-server[91829]: self.callback(batched_events) May 25 17:03:26.778885 dv-cinder-790492-4-iscsi neutron-server[91829]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 25 17:03:26.778885 dv-cinder-790492-4-iscsi neutron-server[91829]: event.method(event) May 25 17:03:26.778885 dv-cinder-790492-4-iscsi neutron-server[91829]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 25 17:03:26.778885 dv-cinder-790492-4-iscsi neutron-server[91829]: aggregate_id = self._get_aggregate_id(event.segment_id) May 25 17:03:26.778885 dv-cinder-790492-4-iscsi neutron-server[91829]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 25 17:03:26.778885 dv-cinder-790492-4-iscsi neutron-server[91829]: aggregate_uuid = self.p_client.list_aggregates( May 25 17:03:26.778885 dv-cinder-790492-4-iscsi neutron-server[91829]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 25 17:03:26.778885 dv-cinder-790492-4-iscsi neutron-server[91829]: return f(self, *a, **k) May 25 17:03:26.778885 dv-cinder-790492-4-iscsi neutron-server[91829]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 25 17:03:26.778885 dv-cinder-790492-4-iscsi neutron-server[91829]: return self._get(url).json() May 25 17:03:26.778885 dv-cinder-790492-4-iscsi neutron-server[91829]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 25 17:03:26.778885 dv-cinder-790492-4-iscsi neutron-server[91829]: return self._client.get(url, endpoint_filter=self._ks_filter, May 25 17:03:26.778885 dv-cinder-790492-4-iscsi neutron-server[91829]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 25 17:03:26.778885 dv-cinder-790492-4-iscsi neutron-server[91829]: return self.request(url, 'GET', **kwargs) May 25 17:03:26.778885 dv-cinder-790492-4-iscsi neutron-server[91829]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 25 17:03:26.778885 dv-cinder-790492-4-iscsi neutron-server[91829]: base_url = self.get_endpoint(auth, allow=allow, May 25 17:03:26.778885 dv-cinder-790492-4-iscsi neutron-server[91829]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 25 17:03:26.778885 dv-cinder-790492-4-iscsi neutron-server[91829]: auth = self._auth_required(auth, 'determine endpoint URL') May 25 17:03:26.778885 dv-cinder-790492-4-iscsi neutron-server[91829]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 25 17:03:26.778885 dv-cinder-790492-4-iscsi neutron-server[91829]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 25 17:03:26.778885 dv-cinder-790492-4-iscsi neutron-server[91829]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 25 17:03:26.856525 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-df3ec8cb-c4b1-48f9-b691-7e979bd07016 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3858252', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-640806', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-551400', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-683051'] for network, after_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:03:26.861202 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:03:26.876774 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-df3ec8cb-c4b1-48f9-b691-7e979bd07016 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-551373'] for network, before_response {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:03:26.885109 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-df3ec8cb-c4b1-48f9-b691-7e979bd07016 admin admin] Pushing event deleted for resources: {'Network': ['ID=63b1f335-e2c4-48dd-886b-6be853f8a2fc,revision_number=None']} {{(pid=91829) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:03:26.888183 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-df3ec8cb-c4b1-48f9-b691-7e979bd07016 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.027s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:03:26.893978 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [None req-df3ec8cb-c4b1-48f9-b691-7e979bd07016 admin admin] 10.222.0.62 "DELETE /v2.0/networks/63b1f335-e2c4-48dd-886b-6be853f8a2fc HTTP/1.1" status: 204 len: 168 time: 0.4063230 May 25 17:03:27.012307 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.wsgi [-] (91830) accepted ('10.222.0.62', 33826) {{(pid=91830) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:03:27.060118 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a3dc344b-e433-4112-9d29-95e267d8eab2 req-a7bcc44d-8105-4fcf-9d04-90bf131bc679 tempest-VolumesSnapshotTestJSON-991813121 tempest-VolumesSnapshotTestJSON-991813121-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:03:27.061575 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-a3dc344b-e433-4112-9d29-95e267d8eab2 req-a7bcc44d-8105-4fcf-9d04-90bf131bc679 tempest-VolumesSnapshotTestJSON-991813121 tempest-VolumesSnapshotTestJSON-991813121-project] 10.222.0.62 "GET /v2.0/ports?device_id=3ba29874-8ce5-4252-aa6d-7c8f6419aa93 HTTP/1.1" status: 200 len: 943 time: 0.1101513 May 25 17:03:27.061772 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [None req-83b558d4-19cb-4d6f-a4bb-89a1f2accc65 admin admin] 10.222.0.62 "GET /v2.0/security-groups?tenant_id=04e8022f24e3464ab1ab7726d6a07e08&name=default HTTP/1.1" status: 200 len: 2975 time: 0.0482614 May 25 17:03:27.064132 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.wsgi [-] (91830) accepted ('10.222.0.62', 33832) {{(pid=91830) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:03:27.069400 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e23d5264-cf47-42ad-81c2-5461721deed3 req-004cdca5-8d86-472a-8e28-22182aeacdb5 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:03:27.070793 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-e23d5264-cf47-42ad-81c2-5461721deed3 req-004cdca5-8d86-472a-8e28-22182aeacdb5 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] 10.222.0.62 "GET /v2.0/ports?device_id=4758207a-3093-4ef3-802c-dc11d895da7a HTTP/1.1" status: 200 len: 944 time: 0.1563785 May 25 17:03:27.142920 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-a3dc344b-e433-4112-9d29-95e267d8eab2 req-b93ac3d4-5873-417e-a370-a2689a4e1968 tempest-VolumesSnapshotTestJSON-991813121 tempest-VolumesSnapshotTestJSON-991813121-project] 10.222.0.62 "GET /v2.0/security-groups?id=b5f47757-8dd4-4226-9a13-ca15ee498213&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0711796 May 25 17:03:27.150501 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-e23d5264-cf47-42ad-81c2-5461721deed3 req-faed23ff-8e07-4c19-b94e-ef91d847b281 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] 10.222.0.62 "GET /v2.0/security-groups?id=7cad7118-dc73-4cab-9cb2-fa41cd4499bd&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0657389 May 25 17:03:27.221682 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-315c3727-21d4-4a87-9945-88ddf7d59291 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:03:27.247399 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-315c3727-21d4-4a87-9945-88ddf7d59291 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:03:27.298557 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-315c3727-21d4-4a87-9945-88ddf7d59291 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-640836'] for security_group, after_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:03:27.304902 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-0b5501f5-9fab-4ed6-8138-26ad30a51c5c admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:03:27.313780 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-315c3727-21d4-4a87-9945-88ddf7d59291 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=f73b90a2-df48-48fb-99e0-5dd4d6a63a15,revision_number=None']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:03:27.317859 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-315c3727-21d4-4a87-9945-88ddf7d59291 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.015s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:03:27.321969 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-315c3727-21d4-4a87-9945-88ddf7d59291 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:03:27.323108 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [None req-315c3727-21d4-4a87-9945-88ddf7d59291 admin admin] 10.222.0.62 "DELETE /v2.0/security-groups/f73b90a2-df48-48fb-99e0-5dd4d6a63a15 HTTP/1.1" status: 204 len: 168 time: 0.2580948 May 25 17:03:27.678280 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-2c296fed-755b-4782-b8d6-7ab45909246f None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:03:27.865058 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:03:28.293767 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.rpc [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Device 13752a02-2ccb-4f85-b36f-38ca98958db9 details requested by agent hyperv_hv-cinder-79049 with host hv-cinder-79049 {{(pid=91831) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 25 17:03:28.297174 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.rpc [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Device c4b9c0f2-e3d5-4fff-9b3c-a9175b027fb5 no longer exists at agent hyperv_hv-cinder-79049 {{(pid=91831) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 25 17:03:28.338486 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.plugin [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] No Port match for: c4b9c0f2-e3d5-4fff-9b3c-a9175b027fb5 {{(pid=91831) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}} May 25 17:03:28.338781 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.rpc [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Device c4b9c0f2-e3d5-4fff-9b3c-a9175b027fb5 not bound to the agent host hv-cinder-79049 {{(pid=91831) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 25 17:03:28.408796 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b74b9b19-dfd1-4f62-965d-0b1fac1badab req-221cae49-0474-4124-b8c2-ffd72b770462 tempest-VolumesSnapshotTestJSON-991813121 tempest-VolumesSnapshotTestJSON-991813121-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:03:28.410380 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-b74b9b19-dfd1-4f62-965d-0b1fac1badab req-221cae49-0474-4124-b8c2-ffd72b770462 tempest-VolumesSnapshotTestJSON-991813121 tempest-VolumesSnapshotTestJSON-991813121-project] 10.222.0.62 "GET /v2.0/ports?device_id=3ba29874-8ce5-4252-aa6d-7c8f6419aa93 HTTP/1.1" status: 200 len: 943 time: 0.1481407 May 25 17:03:28.442834 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2ae93e25-b911-43bc-97d8-f47fd152b184 req-bddaa709-4dbe-404d-81d3-bb6d40f489e3 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:03:28.444262 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-2ae93e25-b911-43bc-97d8-f47fd152b184 req-bddaa709-4dbe-404d-81d3-bb6d40f489e3 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] 10.222.0.62 "GET /v2.0/ports?device_id=4758207a-3093-4ef3-802c-dc11d895da7a HTTP/1.1" status: 200 len: 944 time: 0.1445696 May 25 17:03:28.471705 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.db [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] For port 13752a02-2ccb-4f85-b36f-38ca98958db9, host hv-cinder-79049, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79049',level=0,port_id=13752a02-2ccb-4f85-b36f-38ca98958db9,segment=NetworkSegment(b8ba5240-28ce-40db-a6e6-b4a42435e0b6),segment_id=b8ba5240-28ce-40db-a6e6-b4a42435e0b6)] {{(pid=91831) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 17:03:28.485493 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.rpc [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Returning: {'device': '13752a02-2ccb-4f85-b36f-38ca98958db9', 'network_id': 'b351598a-3f6f-4a37-8095-8d9371896ccc', 'port_id': '13752a02-2ccb-4f85-b36f-38ca98958db9', 'mac_address': 'fa:16:3e:d3:e8:22', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 655, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '4bbae145-74ed-4fda-b7c0-ae77a3202a83', 'ip_address': '172.20.0.10'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=91831) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 25 17:03:28.494464 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-b74b9b19-dfd1-4f62-965d-0b1fac1badab req-24361f46-817f-43f0-a8d4-080a1725339e tempest-VolumesSnapshotTestJSON-991813121 tempest-VolumesSnapshotTestJSON-991813121-project] 10.222.0.62 "GET /v2.0/security-groups?id=b5f47757-8dd4-4226-9a13-ca15ee498213&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0719998 May 25 17:03:28.518064 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-2ae93e25-b911-43bc-97d8-f47fd152b184 req-16e68789-6a15-4750-b0eb-1db9f5e05833 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] 10.222.0.62 "GET /v2.0/security-groups?id=7cad7118-dc73-4cab-9cb2-fa41cd4499bd&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0650008 May 25 17:03:28.543380 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3832070'] for port, before_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:03:28.560690 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.notifiers.nova [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 13752a02-2ccb-4f85-b36f-38ca98958db9 {{(pid=91831) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} May 25 17:03:28.576558 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.db [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] For port 13752a02-2ccb-4f85-b36f-38ca98958db9, host hv-cinder-79049, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79049',level=0,port_id=13752a02-2ccb-4f85-b36f-38ca98958db9,segment=NetworkSegment(b8ba5240-28ce-40db-a6e6-b4a42435e0b6),segment_id=b8ba5240-28ce-40db-a6e6-b4a42435e0b6)] {{(pid=91831) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 17:03:28.582097 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8757892955028', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8757892520933', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8757892521750'] for port, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:03:28.582898 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.rpc [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Device 4653ac1b-8d11-4595-8487-58704e147494 details requested by agent hyperv_hv-cinder-79049 with host hv-cinder-79049 {{(pid=91831) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 25 17:03:28.584974 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:03:28.661439 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-0a55eb4a-8b57-4233-84d6-6b423b4ed6db None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:03:28.732743 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Pushing event updated for resources: {'Port': ['ID=13752a02-2ccb-4f85-b36f-38ca98958db9,revision_number=4']} {{(pid=91831) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:03:28.752875 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91831) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:03:28.753216 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91831) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:03:28.753549 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91831) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:03:28.753878 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91831) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:03:28.754229 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91831) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:03:28.754554 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91831) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:03:28.754874 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91831) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:03:28.755191 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91831) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:03:28.755509 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91831) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:03:28.755824 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91831) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:03:28.756151 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91831) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:03:28.756452 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91831) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:03:28.761565 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.177s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:03:28.804533 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.db [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] For port 4653ac1b-8d11-4595-8487-58704e147494, host hv-cinder-79049, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79049',level=0,port_id=4653ac1b-8d11-4595-8487-58704e147494,segment=NetworkSegment(bba065e2-1e75-4ab9-bc0e-e3037ef57277),segment_id=bba065e2-1e75-4ab9-bc0e-e3037ef57277)] {{(pid=91831) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 17:03:28.817521 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.rpc [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Returning: {'device': '4653ac1b-8d11-4595-8487-58704e147494', 'network_id': 'c8b64023-a7f5-4c0f-847b-8a8aef981caa', 'port_id': '4653ac1b-8d11-4595-8487-58704e147494', 'mac_address': 'fa:16:3e:f7:8e:d3', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 654, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'e21793ea-1820-4ec5-b3fc-a7d9b7129124', 'ip_address': '172.20.0.5'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=91831) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 25 17:03:28.875578 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3832070'] for port, before_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:03:28.893878 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.notifiers.nova [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 4653ac1b-8d11-4595-8487-58704e147494 {{(pid=91831) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} May 25 17:03:28.909246 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.db [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] For port 4653ac1b-8d11-4595-8487-58704e147494, host hv-cinder-79049, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79049',level=0,port_id=4653ac1b-8d11-4595-8487-58704e147494,segment=NetworkSegment(bba065e2-1e75-4ab9-bc0e-e3037ef57277),segment_id=bba065e2-1e75-4ab9-bc0e-e3037ef57277)] {{(pid=91831) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 17:03:28.913100 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8757892955028', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8757892520933', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8757892521750'] for port, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:03:28.915044 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:03:28.983372 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Pushing event updated for resources: {'Port': ['ID=4653ac1b-8d11-4595-8487-58704e147494,revision_number=4']} {{(pid=91831) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:03:28.986388 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.071s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:03:29.339309 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.db [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] get_ports_and_sgs() called for port_ids ['13752a02-2ccb-4f85-b36f-38ca98958db9'] {{(pid=91831) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 25 17:03:29.370306 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.db [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] get_ports_and_sgs() called for port_ids ['4653ac1b-8d11-4595-8487-58704e147494'] {{(pid=91831) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 25 17:03:29.414150 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.wsgi [-] (91830) accepted ('10.222.0.62', 33898) {{(pid=91830) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:03:29.533963 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-b5c0e513-9be5-4a14-9b8e-5e61fcb52b36 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:03:29.561937 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.quota.driver [None req-b5c0e513-9be5-4a14-9b8e-5e61fcb52b36 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91830) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 17:03:29.566843 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [None req-b5c0e513-9be5-4a14-9b8e-5e61fcb52b36 admin admin] Usage tracker for resource:security_group_rule and tenant:240f886f17aa4cc997e647084d89cff5 is out of sync, need to count used quota {{(pid=91830) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 17:03:29.570520 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [None req-b5c0e513-9be5-4a14-9b8e-5e61fcb52b36 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91830) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 17:03:29.577394 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.quota.driver [None req-b5c0e513-9be5-4a14-9b8e-5e61fcb52b36 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91830) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 17:03:29.673900 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-b5c0e513-9be5-4a14-9b8e-5e61fcb52b36 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:03:29.679438 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-b5c0e513-9be5-4a14-9b8e-5e61fcb52b36 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-640836'] for security_group, after_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:03:29.688032 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-579afa2f-f1f6-464b-a0fa-72fc1254622f admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:03:29.731877 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b5c0e513-9be5-4a14-9b8e-5e61fcb52b36 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=fa380fe9-1613-4de7-a5d5-492785982b94,revision_number=1']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:03:29.735388 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-b5c0e513-9be5-4a14-9b8e-5e61fcb52b36 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.047s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:03:29.738321 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [None req-b5c0e513-9be5-4a14-9b8e-5e61fcb52b36 admin admin] 10.222.0.62 "GET /v2.0/security-groups?tenant_id=240f886f17aa4cc997e647084d89cff5&name=default HTTP/1.1" status: 200 len: 2979 time: 0.3227730 May 25 17:03:29.740625 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.wsgi [-] (91830) accepted ('10.222.0.62', 33912) {{(pid=91830) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:03:29.746180 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5070888b-74a1-49b0-b9b5-a2c458a4cf06 req-03936d44-b681-48c4-af6c-f6228d7fb849 tempest-VolumesSnapshotTestJSON-991813121 tempest-VolumesSnapshotTestJSON-991813121-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:03:29.750357 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-5070888b-74a1-49b0-b9b5-a2c458a4cf06 req-03936d44-b681-48c4-af6c-f6228d7fb849 tempest-VolumesSnapshotTestJSON-991813121 tempest-VolumesSnapshotTestJSON-991813121-project] 10.222.0.62 "GET /v2.0/ports?device_id=3ba29874-8ce5-4252-aa6d-7c8f6419aa93 HTTP/1.1" status: 200 len: 944 time: 0.1546376 May 25 17:03:29.782941 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-137c8ff7-2196-40b5-a454-e6f499c0c4c2 req-7a59389a-4a44-4af2-b5b5-d4e2b854ccb3 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:03:29.784356 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-137c8ff7-2196-40b5-a454-e6f499c0c4c2 req-7a59389a-4a44-4af2-b5b5-d4e2b854ccb3 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] 10.222.0.62 "GET /v2.0/ports?device_id=4758207a-3093-4ef3-802c-dc11d895da7a HTTP/1.1" status: 200 len: 945 time: 0.1320128 May 25 17:03:29.800569 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-89825042-3af1-497a-8b02-53f00c1f4bbb admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:03:29.821470 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-5070888b-74a1-49b0-b9b5-a2c458a4cf06 req-2db3dbc4-5b16-4f06-8dba-371fd6b6fcf4 tempest-VolumesSnapshotTestJSON-991813121 tempest-VolumesSnapshotTestJSON-991813121-project] 10.222.0.62 "GET /v2.0/security-groups?id=b5f47757-8dd4-4226-9a13-ca15ee498213&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0667770 May 25 17:03:29.827457 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-89825042-3af1-497a-8b02-53f00c1f4bbb admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:03:29.849853 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-137c8ff7-2196-40b5-a454-e6f499c0c4c2 req-c342a5a8-d4cc-4493-bb44-c5c5c91b519c tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] 10.222.0.62 "GET /v2.0/security-groups?id=7cad7118-dc73-4cab-9cb2-fa41cd4499bd&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0550725 May 25 17:03:29.892439 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-89825042-3af1-497a-8b02-53f00c1f4bbb admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-640836'] for security_group, after_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:03:29.896049 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:03:29.906715 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-89825042-3af1-497a-8b02-53f00c1f4bbb admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=fa380fe9-1613-4de7-a5d5-492785982b94,revision_number=None']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:03:29.909597 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-89825042-3af1-497a-8b02-53f00c1f4bbb admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.013s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:03:29.915401 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-89825042-3af1-497a-8b02-53f00c1f4bbb admin admin] Notify callbacks [] for security_group, before_response {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:03:29.916511 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [None req-89825042-3af1-497a-8b02-53f00c1f4bbb admin admin] 10.222.0.62 "DELETE /v2.0/security-groups/fa380fe9-1613-4de7-a5d5-492785982b94 HTTP/1.1" status: 204 len: 168 time: 0.1749034 May 25 17:03:30.192431 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.wsgi [-] (91829) accepted ('10.222.0.62', 33920) {{(pid=91829) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:03:30.210356 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-f396a8d1-b84a-4e82-a000-40d89b1a2555 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:03:30.220364 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-57f11b47-1f51-4191-b7c9-af248a48372c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:03:30.224878 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.quota.driver [None req-f396a8d1-b84a-4e82-a000-40d89b1a2555 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91829) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 17:03:30.228627 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.quota.resource [None req-f396a8d1-b84a-4e82-a000-40d89b1a2555 admin admin] Usage tracker for resource:security_group_rule and tenant:d74bbe92f9cc43f998b8d1bd97d6aadc is out of sync, need to count used quota {{(pid=91829) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 17:03:30.231471 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.quota.resource [None req-f396a8d1-b84a-4e82-a000-40d89b1a2555 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91829) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 17:03:30.237550 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.quota.driver [None req-f396a8d1-b84a-4e82-a000-40d89b1a2555 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91829) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 17:03:30.321703 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-f396a8d1-b84a-4e82-a000-40d89b1a2555 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:03:30.325368 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-f396a8d1-b84a-4e82-a000-40d89b1a2555 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-640836'] for security_group, after_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:03:30.333513 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-18bd6063-fa56-43fe-8cef-9eab4b22ed00 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:03:30.372857 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [None req-f396a8d1-b84a-4e82-a000-40d89b1a2555 admin admin] 10.222.0.62 "GET /v2.0/security-groups?tenant_id=d74bbe92f9cc43f998b8d1bd97d6aadc&name=default HTTP/1.1" status: 200 len: 2979 time: 0.1793835 May 25 17:03:30.373726 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f396a8d1-b84a-4e82-a000-40d89b1a2555 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=22caf729-1449-4139-9395-308122ea9f5e,revision_number=1']} {{(pid=91829) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:03:30.376372 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.wsgi [-] (91830) accepted ('10.222.0.62', 33924) {{(pid=91830) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:03:30.376979 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-f396a8d1-b84a-4e82-a000-40d89b1a2555 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.043s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:03:30.434378 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-98e4b1c2-d2ab-4b65-8bea-702864ab27c8 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:03:30.465550 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-98e4b1c2-d2ab-4b65-8bea-702864ab27c8 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:03:30.518540 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-98e4b1c2-d2ab-4b65-8bea-702864ab27c8 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-640836'] for security_group, after_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:03:30.522749 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-f209bcf0-5579-422b-99ed-3f8a41a1110a admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:03:30.534561 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-98e4b1c2-d2ab-4b65-8bea-702864ab27c8 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=22caf729-1449-4139-9395-308122ea9f5e,revision_number=None']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:03:30.537472 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-98e4b1c2-d2ab-4b65-8bea-702864ab27c8 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.015s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:03:30.539396 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-98e4b1c2-d2ab-4b65-8bea-702864ab27c8 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:03:30.540474 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [None req-98e4b1c2-d2ab-4b65-8bea-702864ab27c8 admin admin] 10.222.0.62 "DELETE /v2.0/security-groups/22caf729-1449-4139-9395-308122ea9f5e HTTP/1.1" status: 204 len: 168 time: 0.1629419 May 25 17:03:31.188919 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2c8f4825-aa85-44d8-b3ef-63ca604eb627 req-1b599988-224f-4742-a727-240da8253bce tempest-VolumesSnapshotTestJSON-991813121 tempest-VolumesSnapshotTestJSON-991813121-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:03:31.190425 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-2c8f4825-aa85-44d8-b3ef-63ca604eb627 req-1b599988-224f-4742-a727-240da8253bce tempest-VolumesSnapshotTestJSON-991813121 tempest-VolumesSnapshotTestJSON-991813121-project] 10.222.0.62 "GET /v2.0/ports?device_id=3ba29874-8ce5-4252-aa6d-7c8f6419aa93 HTTP/1.1" status: 200 len: 944 time: 0.2489769 May 25 17:03:31.200738 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-06de6d1e-ab47-4e3a-a0b5-28f9d128cc1a req-06225985-8468-48f1-babd-cbc49e08f648 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:03:31.202747 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-06de6d1e-ab47-4e3a-a0b5-28f9d128cc1a req-06225985-8468-48f1-babd-cbc49e08f648 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] 10.222.0.62 "GET /v2.0/ports?device_id=4758207a-3093-4ef3-802c-dc11d895da7a HTTP/1.1" status: 200 len: 945 time: 0.2255080 May 25 17:03:31.271559 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-2c8f4825-aa85-44d8-b3ef-63ca604eb627 req-8a87156d-9257-4546-b55d-8d4975a216c0 tempest-VolumesSnapshotTestJSON-991813121 tempest-VolumesSnapshotTestJSON-991813121-project] 10.222.0.62 "GET /v2.0/security-groups?id=b5f47757-8dd4-4226-9a13-ca15ee498213&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0677760 May 25 17:03:31.275861 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-06de6d1e-ab47-4e3a-a0b5-28f9d128cc1a req-d8d7b0da-cec2-4224-a89f-16f0fdbfe4bd tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] 10.222.0.62 "GET /v2.0/security-groups?id=7cad7118-dc73-4cab-9cb2-fa41cd4499bd&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0591512 May 25 17:03:31.682314 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.wsgi [-] (91830) accepted ('10.222.0.62', 33962) {{(pid=91830) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:03:31.805369 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-d0a3db3b-9cce-4508-8297-0dd97d748476 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:03:31.820076 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.quota.driver [None req-d0a3db3b-9cce-4508-8297-0dd97d748476 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91830) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 17:03:31.823818 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [None req-d0a3db3b-9cce-4508-8297-0dd97d748476 admin admin] Usage tracker for resource:security_group_rule and tenant:f619ec54ccae4718b8c88adf943dbdab is out of sync, need to count used quota {{(pid=91830) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 17:03:31.826643 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [None req-d0a3db3b-9cce-4508-8297-0dd97d748476 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91830) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 17:03:31.832685 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.quota.driver [None req-d0a3db3b-9cce-4508-8297-0dd97d748476 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91830) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 17:03:31.917391 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-d0a3db3b-9cce-4508-8297-0dd97d748476 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:03:31.921888 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-d0a3db3b-9cce-4508-8297-0dd97d748476 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-640836'] for security_group, after_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:03:31.928032 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-6a999bb3-2bd0-46f3-83e4-4b9c3807da27 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:03:31.967235 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d0a3db3b-9cce-4508-8297-0dd97d748476 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=286e813e-220b-45c7-abde-00e4145ae12c,revision_number=1']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:03:31.972249 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [None req-d0a3db3b-9cce-4508-8297-0dd97d748476 admin admin] 10.222.0.62 "GET /v2.0/security-groups?tenant_id=f619ec54ccae4718b8c88adf943dbdab&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2889540 May 25 17:03:31.973098 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-d0a3db3b-9cce-4508-8297-0dd97d748476 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.045s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:03:31.974999 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.wsgi [-] (91830) accepted ('10.222.0.62', 33968) {{(pid=91830) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:03:32.037184 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-4addf58e-a8f2-4693-aef1-f5fd4d672848 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:03:32.062659 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-4addf58e-a8f2-4693-aef1-f5fd4d672848 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:03:32.112342 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-4addf58e-a8f2-4693-aef1-f5fd4d672848 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-640836'] for security_group, after_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:03:32.116830 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:03:32.127132 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4addf58e-a8f2-4693-aef1-f5fd4d672848 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=286e813e-220b-45c7-abde-00e4145ae12c,revision_number=None']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:03:32.130459 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-4addf58e-a8f2-4693-aef1-f5fd4d672848 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.014s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:03:32.134436 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-4addf58e-a8f2-4693-aef1-f5fd4d672848 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:03:32.135559 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [None req-4addf58e-a8f2-4693-aef1-f5fd4d672848 admin admin] 10.222.0.62 "DELETE /v2.0/security-groups/286e813e-220b-45c7-abde-00e4145ae12c HTTP/1.1" status: 204 len: 168 time: 0.1596246 May 25 17:03:32.310349 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.rpc [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Device 13752a02-2ccb-4f85-b36f-38ca98958db9 up at agent hyperv_hv-cinder-79049 {{(pid=91831) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 25 17:03:32.388445 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.provisioning_blocks [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Provisioning for port 13752a02-2ccb-4f85-b36f-38ca98958db9 completed by entity L2. {{(pid=91831) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 25 17:03:32.396074 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.provisioning_blocks [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Provisioning complete for port 13752a02-2ccb-4f85-b36f-38ca98958db9 triggered by entity L2. {{(pid=91831) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 17:03:32.396454 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3854128'] for port, provisioning_complete {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:03:32.551468 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3832070'] for port, before_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:03:32.571543 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f932e862-ac48-443f-ba52-2adca511c96c req-5e0b78de-6f3e-48a2-8184-212030f453dc tempest-VolumesSnapshotTestJSON-991813121 tempest-VolumesSnapshotTestJSON-991813121-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:03:32.572939 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-f932e862-ac48-443f-ba52-2adca511c96c req-5e0b78de-6f3e-48a2-8184-212030f453dc tempest-VolumesSnapshotTestJSON-991813121 tempest-VolumesSnapshotTestJSON-991813121-project] 10.222.0.62 "GET /v2.0/ports?device_id=3ba29874-8ce5-4252-aa6d-7c8f6419aa93 HTTP/1.1" status: 200 len: 944 time: 0.1234405 May 25 17:03:32.581773 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '4758207a-3093-4ef3-802c-dc11d895da7a', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '13752a02-2ccb-4f85-b36f-38ca98958db9'}] {{(pid=91831) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 25 17:03:32.588217 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-53dea67c-52af-4752-8d3e-05f544936ba3 req-da21af69-34b3-4fa2-ae44-07ed439a08bd tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:03:32.589778 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-53dea67c-52af-4752-8d3e-05f544936ba3 req-da21af69-34b3-4fa2-ae44-07ed439a08bd tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] 10.222.0.62 "GET /v2.0/ports?device_id=4758207a-3093-4ef3-802c-dc11d895da7a HTTP/1.1" status: 200 len: 945 time: 0.1829145 May 25 17:03:32.592256 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.db [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] For port 13752a02-2ccb-4f85-b36f-38ca98958db9, host hv-cinder-79049, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79049',level=0,port_id=13752a02-2ccb-4f85-b36f-38ca98958db9,segment=NetworkSegment(b8ba5240-28ce-40db-a6e6-b4a42435e0b6),segment_id=b8ba5240-28ce-40db-a6e6-b4a42435e0b6)] {{(pid=91831) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 17:03:32.596418 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8757892955028', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8757892520933', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8757892521750'] for port, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:03:32.597279 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.rpc [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Device 4653ac1b-8d11-4595-8487-58704e147494 up at agent hyperv_hv-cinder-79049 {{(pid=91831) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 25 17:03:32.627682 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [None req-838925ed-adbb-430b-876f-1b3a0f72d481 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:03:32.724278 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-f932e862-ac48-443f-ba52-2adca511c96c req-b524d21b-7ee7-4571-a6af-92ac4b708793 tempest-VolumesSnapshotTestJSON-991813121 tempest-VolumesSnapshotTestJSON-991813121-project] 10.222.0.62 "GET /v2.0/security-groups?id=b5f47757-8dd4-4226-9a13-ca15ee498213&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1453316 May 25 17:03:32.728607 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-53dea67c-52af-4752-8d3e-05f544936ba3 req-639d6a70-1527-4e16-8e31-8bf673628db9 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] 10.222.0.62 "GET /v2.0/security-groups?id=7cad7118-dc73-4cab-9cb2-fa41cd4499bd&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1252570 May 25 17:03:32.759895 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Pushing event updated for resources: {'Port': ['ID=13752a02-2ccb-4f85-b36f-38ca98958db9,revision_number=5']} {{(pid=91831) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:03:32.763180 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.136s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:03:32.772646 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-7294ec51-381b-400f-9a60-43a273848a1f req-ddd2c71a-b8ae-47e9-bc10-7c1a14f20f30 service neutron] 10.222.0.32 "GET /v2.0/ports?device_id=3ead96ee-e427-4e87-9879-a1cdf303f894&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.1321528 May 25 17:03:32.774597 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.provisioning_blocks [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Provisioning for port 4653ac1b-8d11-4595-8487-58704e147494 completed by entity L2. {{(pid=91831) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 25 17:03:32.780784 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.provisioning_blocks [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Provisioning complete for port 4653ac1b-8d11-4595-8487-58704e147494 triggered by entity L2. {{(pid=91831) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 17:03:32.781284 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3854128'] for port, provisioning_complete {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:03:32.839680 dv-cinder-790492-4-iscsi neutron-server[91831]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '4758207a-3093-4ef3-802c-dc11d895da7a', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '13752a02-2ccb-4f85-b36f-38ca98958db9', 'code': 200} May 25 17:03:32.924137 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7294ec51-381b-400f-9a60-43a273848a1f req-0506d8de-c67a-4ee8-bb1d-c073fe87b08e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:03:32.926280 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-7294ec51-381b-400f-9a60-43a273848a1f req-0506d8de-c67a-4ee8-bb1d-c073fe87b08e service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=bbb9e99759bc47d08005f3b1e036a6cf&device_id=3ead96ee-e427-4e87-9879-a1cdf303f894 HTTP/1.1" status: 200 len: 1099 time: 0.1336093 May 25 17:03:32.932421 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3832070'] for port, before_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:03:32.971312 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.db [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] For port 4653ac1b-8d11-4595-8487-58704e147494, host hv-cinder-79049, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79049',level=0,port_id=4653ac1b-8d11-4595-8487-58704e147494,segment=NetworkSegment(bba065e2-1e75-4ab9-bc0e-e3037ef57277),segment_id=bba065e2-1e75-4ab9-bc0e-e3037ef57277)] {{(pid=91831) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 17:03:32.975424 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8757892955028', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8757892520933', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8757892521750'] for port, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:03:32.980886 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [None req-0c176240-54ab-4c4f-9583-59c938361492 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:03:33.057866 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Pushing event updated for resources: {'Port': ['ID=4653ac1b-8d11-4595-8487-58704e147494,revision_number=5']} {{(pid=91831) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:03:33.061399 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.083s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:03:33.088090 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7294ec51-381b-400f-9a60-43a273848a1f req-407d963a-66cf-4a57-abc3-8cf5c76ed556 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:03:33.089449 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-7294ec51-381b-400f-9a60-43a273848a1f req-407d963a-66cf-4a57-abc3-8cf5c76ed556 service neutron] 10.222.0.32 "GET /v2.0/networks?id=e5be4c6a-143f-474c-a90b-37180778cefe HTTP/1.1" status: 200 len: 917 time: 0.1423042 May 25 17:03:33.107632 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-da38d9fb-7324-42cb-b486-7a5ae10ceda9 req-0f2bbca4-2d88-47c0-bc24-49f0c83a10f3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91830) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:03:33.109121 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-da38d9fb-7324-42cb-b486-7a5ae10ceda9 req-0f2bbca4-2d88-47c0-bc24-49f0c83a10f3 service neutron] 10.222.0.32 "GET /v2.0/ports?device_id=4758207a-3093-4ef3-802c-dc11d895da7a HTTP/1.1" status: 200 len: 1099 time: 0.0842648 May 25 17:03:33.155010 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-da38d9fb-7324-42cb-b486-7a5ae10ceda9 req-bb1b3ca0-3607-4fef-8b46-0060bfdd9f2d service neutron] 10.222.0.32 "GET /v2.0/security-groups?id=7cad7118-dc73-4cab-9cb2-fa41cd4499bd&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0392709 May 25 17:03:33.210743 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-7294ec51-381b-400f-9a60-43a273848a1f req-771dc048-e5d8-4d9a-980d-0b9d7e41ba4a service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=b7d643d2-c7f2-4e49-8125-5c5ec0b9d463 HTTP/1.1" status: 200 len: 1002 time: 0.1131914 May 25 17:03:33.526827 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7294ec51-381b-400f-9a60-43a273848a1f req-bd12f77c-000f-47c7-92b2-0aa2ec8c000b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:03:33.528246 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-7294ec51-381b-400f-9a60-43a273848a1f req-bd12f77c-000f-47c7-92b2-0aa2ec8c000b service neutron] 10.222.0.32 "GET /v2.0/subnets?id=6e6b5897-e23d-4281-96cb-a6fdf9b68134 HTTP/1.1" status: 200 len: 855 time: 0.0643556 May 25 17:03:33.638699 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7294ec51-381b-400f-9a60-43a273848a1f req-e1997541-12f8-4802-aa1f-a22d5d28b7ce service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:03:33.640456 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-7294ec51-381b-400f-9a60-43a273848a1f req-e1997541-12f8-4802-aa1f-a22d5d28b7ce service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=e5be4c6a-143f-474c-a90b-37180778cefe&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0889981 May 25 17:03:33.784872 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-7294ec51-381b-400f-9a60-43a273848a1f req-9acbce12-22b8-44b4-a2a5-ea9593f93156 service neutron] 10.222.0.32 "GET /v2.0/networks/e5be4c6a-143f-474c-a90b-37180778cefe?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1354282 May 25 17:03:34.038937 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-7294ec51-381b-400f-9a60-43a273848a1f req-080c315d-5b6e-4ebb-b01f-414e21a39744 service neutron] 10.222.0.32 "GET /v2.0/networks/e5be4c6a-143f-474c-a90b-37180778cefe?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2465563 May 25 17:03:34.053093 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-11336258-7c16-474d-94be-4a6b843e27da req-30c84a60-ba07-498c-a2c2-60716d57956c tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:03:34.054792 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-11336258-7c16-474d-94be-4a6b843e27da req-30c84a60-ba07-498c-a2c2-60716d57956c tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] 10.222.0.62 "GET /v2.0/ports?device_id=4758207a-3093-4ef3-802c-dc11d895da7a HTTP/1.1" status: 200 len: 946 time: 0.1907177 May 25 17:03:34.062382 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-594a0047-103c-422a-99be-5132472ff430 req-a64d15de-c8de-488f-9b72-04fe4ef35acc tempest-VolumesSnapshotTestJSON-991813121 tempest-VolumesSnapshotTestJSON-991813121-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:03:34.063819 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-594a0047-103c-422a-99be-5132472ff430 req-a64d15de-c8de-488f-9b72-04fe4ef35acc tempest-VolumesSnapshotTestJSON-991813121 tempest-VolumesSnapshotTestJSON-991813121-project] 10.222.0.62 "GET /v2.0/ports?device_id=3ba29874-8ce5-4252-aa6d-7c8f6419aa93 HTTP/1.1" status: 200 len: 945 time: 0.1986890 May 25 17:03:34.131621 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-11336258-7c16-474d-94be-4a6b843e27da req-75f803cc-298a-4144-b6cd-689b342898ec tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] 10.222.0.62 "GET /v2.0/security-groups?id=7cad7118-dc73-4cab-9cb2-fa41cd4499bd&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0667210 May 25 17:03:34.142563 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-594a0047-103c-422a-99be-5132472ff430 req-f5a04452-05d1-4c1f-992a-60da8c7e87ee tempest-VolumesSnapshotTestJSON-991813121 tempest-VolumesSnapshotTestJSON-991813121-project] 10.222.0.62 "GET /v2.0/security-groups?id=b5f47757-8dd4-4226-9a13-ca15ee498213&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0639412 May 25 17:03:34.841224 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '3ba29874-8ce5-4252-aa6d-7c8f6419aa93', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '4653ac1b-8d11-4595-8487-58704e147494'}] {{(pid=91831) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 25 17:03:34.887464 dv-cinder-790492-4-iscsi neutron-server[91831]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '3ba29874-8ce5-4252-aa6d-7c8f6419aa93', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '4653ac1b-8d11-4595-8487-58704e147494', 'code': 200} May 25 17:03:35.137226 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d77a611c-e7cb-46c1-9dd6-2d0e82543598 req-31b332e3-6157-4569-ba34-6839f0616bb2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:03:35.138710 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-d77a611c-e7cb-46c1-9dd6-2d0e82543598 req-31b332e3-6157-4569-ba34-6839f0616bb2 service neutron] 10.222.0.32 "GET /v2.0/ports?device_id=3ba29874-8ce5-4252-aa6d-7c8f6419aa93 HTTP/1.1" status: 200 len: 1098 time: 0.0704288 May 25 17:03:35.168782 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:03:35.191566 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-d77a611c-e7cb-46c1-9dd6-2d0e82543598 req-12b2f9d6-7963-4422-b101-f1de5ebe00ff service neutron] 10.222.0.32 "GET /v2.0/security-groups?id=b5f47757-8dd4-4226-9a13-ca15ee498213&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0456071 May 25 17:03:35.398195 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2aa7748d-4d07-4e68-9e4d-bbbcae70dadd req-3d84bb01-ede4-4dc3-8429-c74c2be64a3d tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:03:35.399744 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-2aa7748d-4d07-4e68-9e4d-bbbcae70dadd req-3d84bb01-ede4-4dc3-8429-c74c2be64a3d tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] 10.222.0.62 "GET /v2.0/ports?device_id=4758207a-3093-4ef3-802c-dc11d895da7a HTTP/1.1" status: 200 len: 946 time: 0.1412387 May 25 17:03:35.408325 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-149004d2-ceb6-4e48-8ba0-d11ce0dccd03 req-5cdf2d41-886b-40e9-a4eb-c0d35d7e5b42 tempest-VolumesSnapshotTestJSON-991813121 tempest-VolumesSnapshotTestJSON-991813121-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:03:35.409707 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-149004d2-ceb6-4e48-8ba0-d11ce0dccd03 req-5cdf2d41-886b-40e9-a4eb-c0d35d7e5b42 tempest-VolumesSnapshotTestJSON-991813121 tempest-VolumesSnapshotTestJSON-991813121-project] 10.222.0.62 "GET /v2.0/ports?device_id=3ba29874-8ce5-4252-aa6d-7c8f6419aa93 HTTP/1.1" status: 200 len: 945 time: 0.1165600 May 25 17:03:35.479072 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-2aa7748d-4d07-4e68-9e4d-bbbcae70dadd req-10a9b4c4-651c-4ba8-887e-7699379e731a tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] 10.222.0.62 "GET /v2.0/security-groups?id=7cad7118-dc73-4cab-9cb2-fa41cd4499bd&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0683796 May 25 17:03:35.486263 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-149004d2-ceb6-4e48-8ba0-d11ce0dccd03 req-8002795b-88a1-40fa-9b60-263fc6579b34 tempest-VolumesSnapshotTestJSON-991813121 tempest-VolumesSnapshotTestJSON-991813121-project] 10.222.0.62 "GET /v2.0/security-groups?id=b5f47757-8dd4-4226-9a13-ca15ee498213&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0625451 May 25 17:03:35.752636 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d8fd28f2-a4ed-4b5b-b1f4-2d61f9f405ff req-df32c50d-cda3-49a2-a944-9b47a44d2c9b tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:03:35.754119 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-d8fd28f2-a4ed-4b5b-b1f4-2d61f9f405ff req-df32c50d-cda3-49a2-a944-9b47a44d2c9b tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] 10.222.0.62 "GET /v2.0/ports?device_id=4758207a-3093-4ef3-802c-dc11d895da7a HTTP/1.1" status: 200 len: 946 time: 0.1735966 May 25 17:03:35.762717 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.wsgi [-] (91829) accepted ('10.222.0.62', 34076) {{(pid=91829) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:03:35.768049 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.v2.base [None req-e7762bd7-5a96-4137-8297-18c9827aa4af tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Request body: {'floatingip': {'port_id': '13752a02-2ccb-4f85-b36f-38ca98958db9'}} {{(pid=91829) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 17:03:35.850901 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-e7762bd7-5a96-4137-8297-18c9827aa4af tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Notify callbacks [] for floatingip, before_update {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:03:36.456267 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-e7762bd7-5a96-4137-8297-18c9827aa4af tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Notify callbacks [] for floatingip, precommit_update {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:03:36.460693 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-e7762bd7-5a96-4137-8297-18c9827aa4af tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-683033'] for floatingip, after_update {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:03:36.688757 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.db.l3_db [None req-e7762bd7-5a96-4137-8297-18c9827aa4af tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Floating IP 2a4488c9-1454-49a3-8879-33de4dc6f828 associated. External IP: 172.27.2.221, port: 13752a02-2ccb-4f85-b36f-38ca98958db9. May 25 17:03:36.788899 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ba535286-0a40-4682-aabd-34dd2f13f4db req-e5f270de-c14f-4edd-ab73-c582394ee742 tempest-VolumesSnapshotTestJSON-991813121 tempest-VolumesSnapshotTestJSON-991813121-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:03:36.790358 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-ba535286-0a40-4682-aabd-34dd2f13f4db req-e5f270de-c14f-4edd-ab73-c582394ee742 tempest-VolumesSnapshotTestJSON-991813121 tempest-VolumesSnapshotTestJSON-991813121-project] 10.222.0.62 "GET /v2.0/ports?device_id=3ba29874-8ce5-4252-aa6d-7c8f6419aa93 HTTP/1.1" status: 200 len: 945 time: 0.1951385 May 25 17:03:36.910549 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-ba535286-0a40-4682-aabd-34dd2f13f4db req-c10e2014-0022-4409-9a51-98321d8d109b tempest-VolumesSnapshotTestJSON-991813121 tempest-VolumesSnapshotTestJSON-991813121-project] 10.222.0.62 "GET /v2.0/security-groups?id=b5f47757-8dd4-4226-9a13-ca15ee498213&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0663517 May 25 17:03:37.196309 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-e7762bd7-5a96-4137-8297-18c9827aa4af tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Router f1e3cf65-0e20-4226-8986-652055868473 has already been hosted by L3 agent a2d427c1-2d07-43e8-afbe-218c9f7d0445 {{(pid=91829) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 25 17:03:37.377272 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-e7762bd7-5a96-4137-8297-18c9827aa4af tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Notify agent at l3_agent.dv-cinder-790492-4-iscsi the message routers_updated {{(pid=91829) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 25 17:03:37.386486 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b795f19d-dfcb-476b-ab0e-fd5488606709 None None] Sync routers for ids ['f1e3cf65-0e20-4226-8986-652055868473'] in dv-cinder-790492-4-iscsi {{(pid=91831) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 25 17:03:37.391718 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-e7762bd7-5a96-4137-8297-18c9827aa4af tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-178712'] for floatingip, before_response {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:03:37.396640 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b795f19d-dfcb-476b-ab0e-fd5488606709 None None] Routers {'f1e3cf65-0e20-4226-8986-652055868473'} bound to L3 agent in host dv-cinder-790492-4-iscsi {{(pid=91831) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 17:03:37.397251 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.l3_hamode_db [None req-b795f19d-dfcb-476b-ab0e-fd5488606709 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-790492-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-05-25T16:50:28Z,description=,heartbeat_timestamp=2021-05-25T17:03:28Z,host='dv-cinder-790492-4-iscsi',id=a2d427c1-2d07-43e8-afbe-218c9f7d0445,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T16:50:28Z,topic='l3_agent')) {'router_ids': ['f1e3cf65-0e20-4226-8986-652055868473'], 'active': True} {{(pid=91831) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 17:03:37.447353 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [None req-e7762bd7-5a96-4137-8297-18c9827aa4af tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] 10.222.0.62 "PUT /v2.0/floatingips/2a4488c9-1454-49a3-8879-33de4dc6f828 HTTP/1.1" status: 200 len: 992 time: 1.6833270 May 25 17:03:37.447978 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '4758207a-3093-4ef3-802c-dc11d895da7a', 'tag': '13752a02-2ccb-4f85-b36f-38ca98958db9'}] {{(pid=91829) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 25 17:03:37.503423 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '4758207a-3093-4ef3-802c-dc11d895da7a', 'tag': '13752a02-2ccb-4f85-b36f-38ca98958db9', 'status': 'completed', 'code': 200} May 25 17:03:37.577771 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.l3_dvr_db [None req-b795f19d-dfcb-476b-ab0e-fd5488606709 None None] Set router f1e3cf65-0e20-4226-8986-652055868473 gateway port host: dv-cinder-790492-4-iscsi {{(pid=91831) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 17:03:37.603439 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0419a987-9961-41c7-84f9-a40a7aa9124b req-297fb9ad-793f-45fa-a946-b350bb0de06d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:03:37.604903 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-0419a987-9961-41c7-84f9-a40a7aa9124b req-297fb9ad-793f-45fa-a946-b350bb0de06d service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=70dac097fff04aed99a4976fa955579b&device_id=4758207a-3093-4ef3-802c-dc11d895da7a HTTP/1.1" status: 200 len: 1099 time: 0.0696089 May 25 17:03:37.744329 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0419a987-9961-41c7-84f9-a40a7aa9124b req-9151ec1b-f0bc-4eab-8ff3-72c241523115 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:03:37.745734 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-0419a987-9961-41c7-84f9-a40a7aa9124b req-9151ec1b-f0bc-4eab-8ff3-72c241523115 service neutron] 10.222.0.32 "GET /v2.0/networks?id=b351598a-3f6f-4a37-8095-8d9371896ccc HTTP/1.1" status: 200 len: 911 time: 0.1304543 May 25 17:03:37.866892 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-0419a987-9961-41c7-84f9-a40a7aa9124b req-0ab55d52-0813-4c8a-9706-357afe154ede service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=13752a02-2ccb-4f85-b36f-38ca98958db9 HTTP/1.1" status: 200 len: 1000 time: 0.1097820 May 25 17:03:37.941570 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0419a987-9961-41c7-84f9-a40a7aa9124b req-6cc0f47a-9f75-4e16-9aac-e4fd8f839749 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:03:37.943565 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-0419a987-9961-41c7-84f9-a40a7aa9124b req-6cc0f47a-9f75-4e16-9aac-e4fd8f839749 service neutron] 10.222.0.32 "GET /v2.0/subnets?id=4bbae145-74ed-4fda-b7c0-ae77a3202a83 HTTP/1.1" status: 200 len: 849 time: 0.0632954 May 25 17:03:37.960534 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.l3_hamode_db [None req-b795f19d-dfcb-476b-ab0e-fd5488606709 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'f1e3cf65-0e20-4226-8986-652055868473', 'name': 'tempest-AttachVolumeTestJSON-312968156-router', 'tenant_id': '70dac097fff04aed99a4976fa955579b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'external_fixed_ips': [{'subnet_id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'ip_address': '172.27.2.63'}], 'enable_snat': True}, 'gw_port_id': 'd0e34ea8-e4eb-48d0-812d-3e5358c5b247', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T17:03:07Z', 'updated_at': '2021-05-25T17:03:12Z', 'revision_number': 4, 'project_id': '70dac097fff04aed99a4976fa955579b', 'gw_port': {'id': 'd0e34ea8-e4eb-48d0-812d-3e5358c5b247', 'name': '', 'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'tenant_id': '', 'mac_address': 'fa:16:3e:be:2a:11', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f1e3cf65-0e20-4226-8986-652055868473', 'device_owner': 'network:router_gateway', 'standard_attr_id': 477, 'fixed_ips': [{'subnet_id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'ip_address': '172.27.2.63', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790492-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:03:08Z', 'updated_at': '2021-05-25T17:03:16Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-790492-4-iscsi', '_floatingips': [{'id': '2a4488c9-1454-49a3-8879-33de4dc6f828', 'tenant_id': '70dac097fff04aed99a4976fa955579b', 'floating_ip_address': '172.27.2.221', 'floating_network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'router_id': 'f1e3cf65-0e20-4226-8986-652055868473', 'port_id': '13752a02-2ccb-4f85-b36f-38ca98958db9', 'fixed_ip_address': '172.20.0.10', 'status': 'DOWN', 'standard_attr_id': 485, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'b351598a-3f6f-4a37-8095-8d9371896ccc', 'mac_address': 'fa:16:3e:d3:e8:22', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4758207a-3093-4ef3-802c-dc11d895da7a', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-25T17:03:15Z', 'updated_at': '2021-05-25T17:03:36Z', 'revision_number': 1, 'project_id': '70dac097fff04aed99a4976fa955579b', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '6561ca57-f5fa-4bba-803c-ac716f98a0fb', 'name': '', 'network_id': 'b351598a-3f6f-4a37-8095-8d9371896ccc', 'tenant_id': '70dac097fff04aed99a4976fa955579b', 'mac_address': 'fa:16:3e:2f:70:71', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f1e3cf65-0e20-4226-8986-652055868473', 'device_owner': 'network:router_interface', 'standard_attr_id': 478, 'fixed_ips': [{'subnet_id': '4bbae145-74ed-4fda-b7c0-ae77a3202a83', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790492-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:03:12Z', 'updated_at': '2021-05-25T17:03:18Z', 'revision_number': 5, 'project_id': '70dac097fff04aed99a4976fa955579b', 'subnets': [{'id': '4bbae145-74ed-4fda-b7c0-ae77a3202a83', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-790492-4-iscsi', False) {} {{(pid=91831) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 17:03:37.964567 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b795f19d-dfcb-476b-ab0e-fd5488606709 None None] Checking router: f1e3cf65-0e20-4226-8986-652055868473 for host: dv-cinder-790492-4-iscsi {{(pid=91831) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 25 17:03:37.973462 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b795f19d-dfcb-476b-ab0e-fd5488606709 None None] Routers {'f1e3cf65-0e20-4226-8986-652055868473'} bound to L3 agent in host dv-cinder-790492-4-iscsi {{(pid=91831) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 17:03:37.974115 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.l3_hamode_db [None req-b795f19d-dfcb-476b-ab0e-fd5488606709 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-790492-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-05-25T16:50:28Z,description=,heartbeat_timestamp=2021-05-25T17:03:28Z,host='dv-cinder-790492-4-iscsi',id=a2d427c1-2d07-43e8-afbe-218c9f7d0445,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T16:50:28Z,topic='l3_agent')) {'router_ids': ['f1e3cf65-0e20-4226-8986-652055868473'], 'active': True} {{(pid=91831) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 17:03:38.091053 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0419a987-9961-41c7-84f9-a40a7aa9124b req-44eca33e-6c90-4f65-9419-e869ee9b27ba service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:03:38.093946 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-0419a987-9961-41c7-84f9-a40a7aa9124b req-44eca33e-6c90-4f65-9419-e869ee9b27ba service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=b351598a-3f6f-4a37-8095-8d9371896ccc&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.1373138 May 25 17:03:38.139086 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3f87592f-e548-470b-b657-65ddb6394883 req-cb848868-562e-4ea0-97b1-75dda323502f tempest-VolumesSnapshotTestJSON-991813121 tempest-VolumesSnapshotTestJSON-991813121-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:03:38.142184 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-3f87592f-e548-470b-b657-65ddb6394883 req-cb848868-562e-4ea0-97b1-75dda323502f tempest-VolumesSnapshotTestJSON-991813121 tempest-VolumesSnapshotTestJSON-991813121-project] 10.222.0.62 "GET /v2.0/ports?device_id=3ba29874-8ce5-4252-aa6d-7c8f6419aa93 HTTP/1.1" status: 200 len: 945 time: 0.1040044 May 25 17:03:38.161139 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.l3_dvr_db [None req-b795f19d-dfcb-476b-ab0e-fd5488606709 None None] Set router f1e3cf65-0e20-4226-8986-652055868473 gateway port host: dv-cinder-790492-4-iscsi {{(pid=91831) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 17:03:38.188181 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-3f87592f-e548-470b-b657-65ddb6394883 req-be9fe9e5-5f79-4d78-b7d2-68ba655d1b14 tempest-VolumesSnapshotTestJSON-991813121 tempest-VolumesSnapshotTestJSON-991813121-project] 10.222.0.62 "GET /v2.0/security-groups?id=b5f47757-8dd4-4226-9a13-ca15ee498213&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0413270 May 25 17:03:38.346861 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-0419a987-9961-41c7-84f9-a40a7aa9124b req-679001ba-e923-4248-8c76-626745ac7f07 service neutron] 10.222.0.32 "GET /v2.0/networks/b351598a-3f6f-4a37-8095-8d9371896ccc?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2432609 May 25 17:03:38.501609 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-0419a987-9961-41c7-84f9-a40a7aa9124b req-ddffd06e-372d-4606-a40e-3986cc5b9767 service neutron] 10.222.0.32 "GET /v2.0/networks/b351598a-3f6f-4a37-8095-8d9371896ccc?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1412032 May 25 17:03:38.524151 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.l3_hamode_db [None req-b795f19d-dfcb-476b-ab0e-fd5488606709 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'f1e3cf65-0e20-4226-8986-652055868473', 'name': 'tempest-AttachVolumeTestJSON-312968156-router', 'tenant_id': '70dac097fff04aed99a4976fa955579b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'external_fixed_ips': [{'subnet_id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'ip_address': '172.27.2.63'}], 'enable_snat': True}, 'gw_port_id': 'd0e34ea8-e4eb-48d0-812d-3e5358c5b247', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T17:03:07Z', 'updated_at': '2021-05-25T17:03:12Z', 'revision_number': 4, 'project_id': '70dac097fff04aed99a4976fa955579b', 'gw_port': {'id': 'd0e34ea8-e4eb-48d0-812d-3e5358c5b247', 'name': '', 'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'tenant_id': '', 'mac_address': 'fa:16:3e:be:2a:11', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f1e3cf65-0e20-4226-8986-652055868473', 'device_owner': 'network:router_gateway', 'standard_attr_id': 477, 'fixed_ips': [{'subnet_id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'ip_address': '172.27.2.63', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790492-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:03:08Z', 'updated_at': '2021-05-25T17:03:16Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-790492-4-iscsi', '_floatingips': [{'id': '2a4488c9-1454-49a3-8879-33de4dc6f828', 'tenant_id': '70dac097fff04aed99a4976fa955579b', 'floating_ip_address': '172.27.2.221', 'floating_network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'router_id': 'f1e3cf65-0e20-4226-8986-652055868473', 'port_id': '13752a02-2ccb-4f85-b36f-38ca98958db9', 'fixed_ip_address': '172.20.0.10', 'status': 'DOWN', 'standard_attr_id': 485, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'b351598a-3f6f-4a37-8095-8d9371896ccc', 'mac_address': 'fa:16:3e:d3:e8:22', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4758207a-3093-4ef3-802c-dc11d895da7a', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-25T17:03:15Z', 'updated_at': '2021-05-25T17:03:36Z', 'revision_number': 1, 'project_id': '70dac097fff04aed99a4976fa955579b', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '6561ca57-f5fa-4bba-803c-ac716f98a0fb', 'name': '', 'network_id': 'b351598a-3f6f-4a37-8095-8d9371896ccc', 'tenant_id': '70dac097fff04aed99a4976fa955579b', 'mac_address': 'fa:16:3e:2f:70:71', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f1e3cf65-0e20-4226-8986-652055868473', 'device_owner': 'network:router_interface', 'standard_attr_id': 478, 'fixed_ips': [{'subnet_id': '4bbae145-74ed-4fda-b7c0-ae77a3202a83', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790492-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:03:12Z', 'updated_at': '2021-05-25T17:03:18Z', 'revision_number': 5, 'project_id': '70dac097fff04aed99a4976fa955579b', 'subnets': [{'id': '4bbae145-74ed-4fda-b7c0-ae77a3202a83', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-790492-4-iscsi', False) {} {{(pid=91831) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 17:03:38.529385 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b795f19d-dfcb-476b-ab0e-fd5488606709 None None] The sync data for ids ['f1e3cf65-0e20-4226-8986-652055868473'] in dv-cinder-790492-4-iscsi is: [{'id': 'f1e3cf65-0e20-4226-8986-652055868473', 'name': 'tempest-AttachVolumeTestJSON-312968156-router', 'tenant_id': '70dac097fff04aed99a4976fa955579b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'external_fixed_ips': [{'subnet_id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'ip_address': '172.27.2.63'}], 'enable_snat': True}, 'gw_port_id': 'd0e34ea8-e4eb-48d0-812d-3e5358c5b247', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T17:03:07Z', 'updated_at': '2021-05-25T17:03:12Z', 'revision_number': 4, 'project_id': '70dac097fff04aed99a4976fa955579b', 'gw_port': {'id': 'd0e34ea8-e4eb-48d0-812d-3e5358c5b247', 'name': '', 'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'tenant_id': '', 'mac_address': 'fa:16:3e:be:2a:11', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f1e3cf65-0e20-4226-8986-652055868473', 'device_owner': 'network:router_gateway', 'standard_attr_id': 477, 'fixed_ips': [{'subnet_id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'ip_address': '172.27.2.63', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790492-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:03:08Z', 'updated_at': '2021-05-25T17:03:16Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-790492-4-iscsi', '_floatingips': [{'id': '2a4488c9-1454-49a3-8879-33de4dc6f828', 'tenant_id': '70dac097fff04aed99a4976fa955579b', 'floating_ip_address': '172.27.2.221', 'floating_network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'router_id': 'f1e3cf65-0e20-4226-8986-652055868473', 'port_id': '13752a02-2ccb-4f85-b36f-38ca98958db9', 'fixed_ip_address': '172.20.0.10', 'status': 'DOWN', 'standard_attr_id': 485, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'b351598a-3f6f-4a37-8095-8d9371896ccc', 'mac_address': 'fa:16:3e:d3:e8:22', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4758207a-3093-4ef3-802c-dc11d895da7a', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-25T17:03:15Z', 'updated_at': '2021-05-25T17:03:36Z', 'revision_number': 1, 'project_id': '70dac097fff04aed99a4976fa955579b', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '6561ca57-f5fa-4bba-803c-ac716f98a0fb', 'name': '', 'network_id': 'b351598a-3f6f-4a37-8095-8d9371896ccc', 'tenant_id': '70dac097fff04aed99a4976fa955579b', 'mac_address': 'fa:16:3e:2f:70:71', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f1e3cf65-0e20-4226-8986-652055868473', 'device_owner': 'network:router_interface', 'standard_attr_id': 478, 'fixed_ips': [{'subnet_id': '4bbae145-74ed-4fda-b7c0-ae77a3202a83', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790492-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:03:12Z', 'updated_at': '2021-05-25T17:03:18Z', 'revision_number': 5, 'project_id': '70dac097fff04aed99a4976fa955579b', 'subnets': [{'id': '4bbae145-74ed-4fda-b7c0-ae77a3202a83', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=91831) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 25 17:03:38.728456 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0f979212-279a-422f-b337-a1f700999af4 None None] New status for floating IP 2a4488c9-1454-49a3-8879-33de4dc6f828: ACTIVE {{(pid=91832) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} May 25 17:03:40.153694 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.db.agents_db [None req-504cb04f-4543-46c1-8db7-349e21db7634 None None] Agent healthcheck: found 6 active agents {{(pid=91832) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} May 25 17:03:55.288743 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-48ef499f-8064-473d-a38f-e88f0d19224e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:03:57.681992 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-45a3d59a-c48f-4663-891f-8f1bc808063b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:03:57.865974 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:03:58.617962 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-0a55eb4a-8b57-4233-84d6-6b423b4ed6db None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:04:00.228736 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-57f11b47-1f51-4191-b7c9-af248a48372c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:04:05.183941 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:04:08.828212 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0adf7b5c-be5e-4178-9a59-c93fc63a4cac req-c41f87a8-d616-4e95-bd2c-989f770397e6 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:04:08.829556 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-0adf7b5c-be5e-4178-9a59-c93fc63a4cac req-c41f87a8-d616-4e95-bd2c-989f770397e6 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/ports?device_id=3ead96ee-e427-4e87-9879-a1cdf303f894 HTTP/1.1" status: 200 len: 946 time: 0.0815427 May 25 17:04:08.873742 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-0adf7b5c-be5e-4178-9a59-c93fc63a4cac req-33871c8d-e282-412b-ba5f-ceb033828202 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/security-groups?id=fdd3b3f1-a2cb-4432-9874-c1d04f64207b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0383446 May 25 17:04:10.069092 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3ce65b5d-bb0b-4c28-ac75-6957e87faa7c req-ffaab649-b7d2-449f-a5af-881b2fdb7487 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:04:10.070470 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-3ce65b5d-bb0b-4c28-ac75-6957e87faa7c req-ffaab649-b7d2-449f-a5af-881b2fdb7487 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/ports?device_id=3ead96ee-e427-4e87-9879-a1cdf303f894 HTTP/1.1" status: 200 len: 946 time: 0.0838885 May 25 17:04:10.113544 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-3ce65b5d-bb0b-4c28-ac75-6957e87faa7c req-0dfe73fa-5b46-4c1a-817c-930a5c413552 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/security-groups?id=fdd3b3f1-a2cb-4432-9874-c1d04f64207b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0373096 May 25 17:04:11.298399 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-08db1c43-17ea-4856-bdae-405ba7d7c741 req-81bc7f64-eee9-4581-8ae8-b04a59dc1647 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:04:11.299732 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-08db1c43-17ea-4856-bdae-405ba7d7c741 req-81bc7f64-eee9-4581-8ae8-b04a59dc1647 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/ports?device_id=3ead96ee-e427-4e87-9879-a1cdf303f894 HTTP/1.1" status: 200 len: 946 time: 0.0780079 May 25 17:04:11.444328 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-08db1c43-17ea-4856-bdae-405ba7d7c741 req-d57c2ff9-0035-46bd-9ec2-fd9364214f01 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/security-groups?id=fdd3b3f1-a2cb-4432-9874-c1d04f64207b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1388419 May 25 17:04:12.273642 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-68963845-f7c1-4e41-ae89-c1fb04ba6bbb req-af86fcb7-b10e-4c46-b1df-6bab6432b460 tempest-VolumesSnapshotTestJSON-991813121 tempest-VolumesSnapshotTestJSON-991813121-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:04:12.274993 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-68963845-f7c1-4e41-ae89-c1fb04ba6bbb req-af86fcb7-b10e-4c46-b1df-6bab6432b460 tempest-VolumesSnapshotTestJSON-991813121 tempest-VolumesSnapshotTestJSON-991813121-project] 10.222.0.62 "GET /v2.0/ports?device_id=3ba29874-8ce5-4252-aa6d-7c8f6419aa93 HTTP/1.1" status: 200 len: 945 time: 0.0788779 May 25 17:04:12.318299 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-68963845-f7c1-4e41-ae89-c1fb04ba6bbb req-a1af1f84-aad4-4e27-a4c3-0827d9803728 tempest-VolumesSnapshotTestJSON-991813121 tempest-VolumesSnapshotTestJSON-991813121-project] 10.222.0.62 "GET /v2.0/security-groups?id=b5f47757-8dd4-4226-9a13-ca15ee498213&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0375717 May 25 17:04:12.639542 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-147d4f62-93e5-4c99-82ab-8f2a9bba7593 req-763e33a3-4529-4027-86db-ea181ab51e7b tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:04:12.641850 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-147d4f62-93e5-4c99-82ab-8f2a9bba7593 req-763e33a3-4529-4027-86db-ea181ab51e7b tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/ports?device_id=3ead96ee-e427-4e87-9879-a1cdf303f894 HTTP/1.1" status: 200 len: 946 time: 0.0849166 May 25 17:04:12.685385 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-147d4f62-93e5-4c99-82ab-8f2a9bba7593 req-5d2a4a50-7af8-49b9-a089-d251c4e76bf8 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/security-groups?id=fdd3b3f1-a2cb-4432-9874-c1d04f64207b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0379999 May 25 17:04:13.503633 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fbf630f1-1d49-462b-a63a-2f28ae826c3a req-d6096c52-31e3-459f-b77a-2f23ffc623c2 tempest-VolumesSnapshotTestJSON-991813121 tempest-VolumesSnapshotTestJSON-991813121-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:04:13.505051 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-fbf630f1-1d49-462b-a63a-2f28ae826c3a req-d6096c52-31e3-459f-b77a-2f23ffc623c2 tempest-VolumesSnapshotTestJSON-991813121 tempest-VolumesSnapshotTestJSON-991813121-project] 10.222.0.62 "GET /v2.0/ports?device_id=3ba29874-8ce5-4252-aa6d-7c8f6419aa93 HTTP/1.1" status: 200 len: 945 time: 0.0791354 May 25 17:04:13.549030 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-fbf630f1-1d49-462b-a63a-2f28ae826c3a req-ad7c2216-ba31-46b9-a842-5e9a19602c77 tempest-VolumesSnapshotTestJSON-991813121 tempest-VolumesSnapshotTestJSON-991813121-project] 10.222.0.62 "GET /v2.0/security-groups?id=b5f47757-8dd4-4226-9a13-ca15ee498213&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0384257 May 25 17:04:13.876364 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dac8862a-f6fa-4f54-abdb-1cc5255c98de req-f9b6fce1-056e-42fa-90a6-eafec1ca1679 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:04:13.877792 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-dac8862a-f6fa-4f54-abdb-1cc5255c98de req-f9b6fce1-056e-42fa-90a6-eafec1ca1679 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/ports?device_id=3ead96ee-e427-4e87-9879-a1cdf303f894 HTTP/1.1" status: 200 len: 946 time: 0.0820339 May 25 17:04:13.921887 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-dac8862a-f6fa-4f54-abdb-1cc5255c98de req-8d486db0-2eef-41da-8d8f-5bd726199334 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/security-groups?id=fdd3b3f1-a2cb-4432-9874-c1d04f64207b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0383790 May 25 17:04:14.730120 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-27eee9ef-afb1-492f-9d24-8a5d2da1ae05 req-62370ecd-8ce6-472d-a46a-b18d2c8c895d tempest-VolumesSnapshotTestJSON-991813121 tempest-VolumesSnapshotTestJSON-991813121-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:04:14.731822 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-27eee9ef-afb1-492f-9d24-8a5d2da1ae05 req-62370ecd-8ce6-472d-a46a-b18d2c8c895d tempest-VolumesSnapshotTestJSON-991813121 tempest-VolumesSnapshotTestJSON-991813121-project] 10.222.0.62 "GET /v2.0/ports?device_id=3ba29874-8ce5-4252-aa6d-7c8f6419aa93 HTTP/1.1" status: 200 len: 945 time: 0.0788057 May 25 17:04:14.779039 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-27eee9ef-afb1-492f-9d24-8a5d2da1ae05 req-45d042b3-0f6d-47c6-97ef-a85d32603291 tempest-VolumesSnapshotTestJSON-991813121 tempest-VolumesSnapshotTestJSON-991813121-project] 10.222.0.62 "GET /v2.0/security-groups?id=b5f47757-8dd4-4226-9a13-ca15ee498213&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0408854 May 25 17:04:14.956975 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-65804d4e-7071-4265-83c6-55c46549a821 req-c760c8a6-4850-405f-8d4a-da2462bc4946 tempest-VolumesSnapshotTestJSON-991813121 tempest-VolumesSnapshotTestJSON-991813121-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:04:14.958428 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-65804d4e-7071-4265-83c6-55c46549a821 req-c760c8a6-4850-405f-8d4a-da2462bc4946 tempest-VolumesSnapshotTestJSON-991813121 tempest-VolumesSnapshotTestJSON-991813121-project] 10.222.0.32 "GET /v2.0/ports?device_id=3ba29874-8ce5-4252-aa6d-7c8f6419aa93 HTTP/1.1" status: 200 len: 945 time: 0.0799539 May 25 17:04:15.158174 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.plugins.ml2.plugin [req-65804d4e-7071-4265-83c6-55c46549a821 req-3e64f1ec-f6ab-4fc8-8b2a-bb7956bf3d6a tempest-VolumesSnapshotTestJSON-991813121 tempest-VolumesSnapshotTestJSON-991813121-project] Deleting port 4653ac1b-8d11-4595-8487-58704e147494 {{(pid=91829) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 25 17:04:15.158520 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [req-65804d4e-7071-4265-83c6-55c46549a821 req-3e64f1ec-f6ab-4fc8-8b2a-bb7956bf3d6a tempest-VolumesSnapshotTestJSON-991813121 tempest-VolumesSnapshotTestJSON-991813121-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8757892952899'] for port, before_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:04:15.180835 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e693e5d2-1ee1-4c11-b789-8b2982b3a886 req-20a751a1-3764-44ab-8b43-d8fd9382faea tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:04:15.182226 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-e693e5d2-1ee1-4c11-b789-8b2982b3a886 req-20a751a1-3764-44ab-8b43-d8fd9382faea tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/ports?device_id=3ead96ee-e427-4e87-9879-a1cdf303f894 HTTP/1.1" status: 200 len: 946 time: 0.1265602 May 25 17:04:15.308376 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-e693e5d2-1ee1-4c11-b789-8b2982b3a886 req-55304c66-601a-4b5d-976f-97c54daea18b tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/security-groups?id=fdd3b3f1-a2cb-4432-9874-c1d04f64207b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0733092 May 25 17:04:15.332535 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.plugins.ml2.db [req-65804d4e-7071-4265-83c6-55c46549a821 req-3e64f1ec-f6ab-4fc8-8b2a-bb7956bf3d6a tempest-VolumesSnapshotTestJSON-991813121 tempest-VolumesSnapshotTestJSON-991813121-project] For port 4653ac1b-8d11-4595-8487-58704e147494, host hv-cinder-79049, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79049',level=0,port_id=4653ac1b-8d11-4595-8487-58704e147494,segment=NetworkSegment(bba065e2-1e75-4ab9-bc0e-e3037ef57277),segment_id=bba065e2-1e75-4ab9-bc0e-e3037ef57277)] {{(pid=91829) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 17:04:15.332883 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [req-65804d4e-7071-4265-83c6-55c46549a821 req-3e64f1ec-f6ab-4fc8-8b2a-bb7956bf3d6a tempest-VolumesSnapshotTestJSON-991813121 tempest-VolumesSnapshotTestJSON-991813121-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-683770'] for port, precommit_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:04:15.454103 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.plugins.ml2.plugin [req-65804d4e-7071-4265-83c6-55c46549a821 req-3e64f1ec-f6ab-4fc8-8b2a-bb7956bf3d6a tempest-VolumesSnapshotTestJSON-991813121 tempest-VolumesSnapshotTestJSON-991813121-project] Calling delete_port for 4653ac1b-8d11-4595-8487-58704e147494 owned by compute:nova {{(pid=91829) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 25 17:04:15.560142 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [req-65804d4e-7071-4265-83c6-55c46549a821 req-3e64f1ec-f6ab-4fc8-8b2a-bb7956bf3d6a tempest-VolumesSnapshotTestJSON-991813121 tempest-VolumesSnapshotTestJSON-991813121-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8757892955046', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8757892520924', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28230808'] for port, after_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:04:15.565990 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:04:15.571908 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.db [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] get_ports_and_sgs() called for port_ids ['4653ac1b-8d11-4595-8487-58704e147494'] {{(pid=91831) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 25 17:04:15.613585 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3e64f1ec-f6ab-4fc8-8b2a-bb7956bf3d6a tempest-VolumesSnapshotTestJSON-991813121 tempest-VolumesSnapshotTestJSON-991813121-project] Pushing event deleted for resources: {'Port': ['ID=4653ac1b-8d11-4595-8487-58704e147494,revision_number=None']} {{(pid=91829) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:04:15.646725 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3e64f1ec-f6ab-4fc8-8b2a-bb7956bf3d6a tempest-VolumesSnapshotTestJSON-991813121 tempest-VolumesSnapshotTestJSON-991813121-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91829) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:04:15.647094 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3e64f1ec-f6ab-4fc8-8b2a-bb7956bf3d6a tempest-VolumesSnapshotTestJSON-991813121 tempest-VolumesSnapshotTestJSON-991813121-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91829) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:04:15.647453 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3e64f1ec-f6ab-4fc8-8b2a-bb7956bf3d6a tempest-VolumesSnapshotTestJSON-991813121 tempest-VolumesSnapshotTestJSON-991813121-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91829) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:04:15.647811 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3e64f1ec-f6ab-4fc8-8b2a-bb7956bf3d6a tempest-VolumesSnapshotTestJSON-991813121 tempest-VolumesSnapshotTestJSON-991813121-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91829) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:04:15.648159 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3e64f1ec-f6ab-4fc8-8b2a-bb7956bf3d6a tempest-VolumesSnapshotTestJSON-991813121 tempest-VolumesSnapshotTestJSON-991813121-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91829) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:04:15.648511 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3e64f1ec-f6ab-4fc8-8b2a-bb7956bf3d6a tempest-VolumesSnapshotTestJSON-991813121 tempest-VolumesSnapshotTestJSON-991813121-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91829) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:04:15.648856 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3e64f1ec-f6ab-4fc8-8b2a-bb7956bf3d6a tempest-VolumesSnapshotTestJSON-991813121 tempest-VolumesSnapshotTestJSON-991813121-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91829) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:04:15.649201 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3e64f1ec-f6ab-4fc8-8b2a-bb7956bf3d6a tempest-VolumesSnapshotTestJSON-991813121 tempest-VolumesSnapshotTestJSON-991813121-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91829) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:04:15.649544 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3e64f1ec-f6ab-4fc8-8b2a-bb7956bf3d6a tempest-VolumesSnapshotTestJSON-991813121 tempest-VolumesSnapshotTestJSON-991813121-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91829) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:04:15.649882 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3e64f1ec-f6ab-4fc8-8b2a-bb7956bf3d6a tempest-VolumesSnapshotTestJSON-991813121 tempest-VolumesSnapshotTestJSON-991813121-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91829) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:04:15.650250 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3e64f1ec-f6ab-4fc8-8b2a-bb7956bf3d6a tempest-VolumesSnapshotTestJSON-991813121 tempest-VolumesSnapshotTestJSON-991813121-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91829) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:04:15.650590 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3e64f1ec-f6ab-4fc8-8b2a-bb7956bf3d6a tempest-VolumesSnapshotTestJSON-991813121 tempest-VolumesSnapshotTestJSON-991813121-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91829) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:04:15.658101 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-3e64f1ec-f6ab-4fc8-8b2a-bb7956bf3d6a tempest-VolumesSnapshotTestJSON-991813121 tempest-VolumesSnapshotTestJSON-991813121-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.092s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:04:15.697572 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.l3_dvrscheduler_db [req-65804d4e-7071-4265-83c6-55c46549a821 req-3e64f1ec-f6ab-4fc8-8b2a-bb7956bf3d6a tempest-VolumesSnapshotTestJSON-991813121 tempest-VolumesSnapshotTestJSON-991813121-project] No DVR routers for this DVR port 4653ac1b-8d11-4595-8487-58704e147494 on host hv-cinder-79049 {{(pid=91829) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 25 17:04:15.700414 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [req-65804d4e-7071-4265-83c6-55c46549a821 req-3e64f1ec-f6ab-4fc8-8b2a-bb7956bf3d6a tempest-VolumesSnapshotTestJSON-991813121 tempest-VolumesSnapshotTestJSON-991813121-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-178712'] for port, before_response {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:04:15.702800 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '3ba29874-8ce5-4252-aa6d-7c8f6419aa93', 'name': 'network-vif-deleted', 'tag': '4653ac1b-8d11-4595-8487-58704e147494'}] {{(pid=91829) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 25 17:04:15.714124 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-65804d4e-7071-4265-83c6-55c46549a821 req-3e64f1ec-f6ab-4fc8-8b2a-bb7956bf3d6a tempest-VolumesSnapshotTestJSON-991813121 tempest-VolumesSnapshotTestJSON-991813121-project] 10.222.0.32 "DELETE /v2.0/ports/4653ac1b-8d11-4595-8487-58704e147494 HTTP/1.1" status: 204 len: 173 time: 0.7495141 May 25 17:04:15.899364 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '3ba29874-8ce5-4252-aa6d-7c8f6419aa93', 'name': 'network-vif-deleted', 'tag': '4653ac1b-8d11-4595-8487-58704e147494', 'status': 'completed', 'code': 200} May 25 17:04:15.952756 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.quota.resource [req-e342cf32-89df-49e8-8662-880904e2bd0d req-a815133e-70b0-4222-8ca1-d3e1884b43e7 tempest-VolumesSnapshotTestJSON-991813121 tempest-VolumesSnapshotTestJSON-991813121-project] Synchronizing usage tracker for tenant:1314f62bcf90411cadb06fa2d9392828 on resource:port {{(pid=91829) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 25 17:04:15.967596 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.quota.resource [req-e342cf32-89df-49e8-8662-880904e2bd0d req-a815133e-70b0-4222-8ca1-d3e1884b43e7 tempest-VolumesSnapshotTestJSON-991813121 tempest-VolumesSnapshotTestJSON-991813121-project] Unset dirty status for tenant:1314f62bcf90411cadb06fa2d9392828 on resource:port {{(pid=91829) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 25 17:04:15.968662 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-e342cf32-89df-49e8-8662-880904e2bd0d req-a815133e-70b0-4222-8ca1-d3e1884b43e7 tempest-VolumesSnapshotTestJSON-991813121 tempest-VolumesSnapshotTestJSON-991813121-project] 10.222.0.62 "GET /v2.0/ports?device_id=3ba29874-8ce5-4252-aa6d-7c8f6419aa93 HTTP/1.1" status: 200 len: 210 time: 0.0610600 May 25 17:04:16.505564 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dd2c56c6-2397-442c-a96d-50be516d7682 req-9625aa46-da75-423e-9fd2-051eac0a76ac tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:04:16.506946 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-dd2c56c6-2397-442c-a96d-50be516d7682 req-9625aa46-da75-423e-9fd2-051eac0a76ac tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/ports?device_id=3ead96ee-e427-4e87-9879-a1cdf303f894 HTTP/1.1" status: 200 len: 946 time: 0.0809143 May 25 17:04:16.550603 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-dd2c56c6-2397-442c-a96d-50be516d7682 req-1914fbee-b0cf-4819-ae81-62fa50905f2a tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/security-groups?id=fdd3b3f1-a2cb-4432-9874-c1d04f64207b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0380261 May 25 17:04:17.152666 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.db.agents_db [None req-504cb04f-4543-46c1-8db7-349e21db7634 None None] Agent healthcheck: found 6 active agents {{(pid=91832) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} May 25 17:04:17.740830 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3d68689f-aba4-4618-a143-ed08f6ca495c req-176cdfa2-c9f6-47d7-a22b-654550f6d9a5 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:04:17.742331 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-3d68689f-aba4-4618-a143-ed08f6ca495c req-176cdfa2-c9f6-47d7-a22b-654550f6d9a5 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/ports?device_id=3ead96ee-e427-4e87-9879-a1cdf303f894 HTTP/1.1" status: 200 len: 946 time: 0.0836153 May 25 17:04:17.787402 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-3d68689f-aba4-4618-a143-ed08f6ca495c req-bf5b7ddc-b504-40fc-8c70-1461116be116 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/security-groups?id=fdd3b3f1-a2cb-4432-9874-c1d04f64207b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0391021 May 25 17:04:18.529518 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.rpc [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Device 4653ac1b-8d11-4595-8487-58704e147494 no longer exists at agent hyperv_hv-cinder-79049 {{(pid=91831) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 25 17:04:18.566801 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.plugin [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] No Port match for: 4653ac1b-8d11-4595-8487-58704e147494 {{(pid=91831) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}} May 25 17:04:18.567247 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.rpc [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Device 4653ac1b-8d11-4595-8487-58704e147494 not bound to the agent host hv-cinder-79049 {{(pid=91831) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 25 17:04:18.976371 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d9631d8f-60af-499f-82b2-1cb2a369e993 req-34d79c73-69e5-46be-b97e-3656788d1f15 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:04:18.977822 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-d9631d8f-60af-499f-82b2-1cb2a369e993 req-34d79c73-69e5-46be-b97e-3656788d1f15 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/ports?device_id=3ead96ee-e427-4e87-9879-a1cdf303f894 HTTP/1.1" status: 200 len: 946 time: 0.0786147 May 25 17:04:19.025356 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-d9631d8f-60af-499f-82b2-1cb2a369e993 req-13e2662b-381d-4b16-aee1-4218b7d06567 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/security-groups?id=fdd3b3f1-a2cb-4432-9874-c1d04f64207b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0418577 May 25 17:04:19.365204 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.wsgi [-] (91829) accepted ('10.222.0.62', 34474) {{(pid=91829) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:04:19.562264 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-b98b3cad-107c-4989-b5b1-a27c1c5e1145 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:04:19.582561 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.quota.driver [None req-b98b3cad-107c-4989-b5b1-a27c1c5e1145 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91829) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 17:04:19.586802 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.quota.resource [None req-b98b3cad-107c-4989-b5b1-a27c1c5e1145 admin admin] Usage tracker for resource:security_group_rule and tenant:fd07c92722464b59adb0f34f0c046ec8 is out of sync, need to count used quota {{(pid=91829) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 17:04:19.589598 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.quota.resource [None req-b98b3cad-107c-4989-b5b1-a27c1c5e1145 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91829) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 17:04:19.595863 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.quota.driver [None req-b98b3cad-107c-4989-b5b1-a27c1c5e1145 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91829) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 17:04:19.674856 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-b98b3cad-107c-4989-b5b1-a27c1c5e1145 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:04:19.678567 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-b98b3cad-107c-4989-b5b1-a27c1c5e1145 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-640836'] for security_group, after_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:04:19.685152 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:04:19.726519 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [None req-b98b3cad-107c-4989-b5b1-a27c1c5e1145 admin admin] 10.222.0.62 "GET /v2.0/security-groups?tenant_id=fd07c92722464b59adb0f34f0c046ec8&name=default HTTP/1.1" status: 200 len: 2979 time: 0.3602540 May 25 17:04:19.727520 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b98b3cad-107c-4989-b5b1-a27c1c5e1145 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=fbfb9c10-728f-49b0-9cd0-94a4d47538ad,revision_number=1']} {{(pid=91829) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:04:19.729142 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.wsgi [-] (91830) accepted ('10.222.0.62', 34480) {{(pid=91830) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:04:19.730733 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-b98b3cad-107c-4989-b5b1-a27c1c5e1145 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.046s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:04:19.788993 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-3e3f3074-941b-4d2b-8506-78ae54412709 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:04:19.815760 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-3e3f3074-941b-4d2b-8506-78ae54412709 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:04:19.869826 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-3e3f3074-941b-4d2b-8506-78ae54412709 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-640836'] for security_group, after_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:04:19.873583 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-d0a3db3b-9cce-4508-8297-0dd97d748476 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:04:19.885364 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3e3f3074-941b-4d2b-8506-78ae54412709 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=fbfb9c10-728f-49b0-9cd0-94a4d47538ad,revision_number=None']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:04:19.896415 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3e3f3074-941b-4d2b-8506-78ae54412709 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91830) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:04:19.896784 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3e3f3074-941b-4d2b-8506-78ae54412709 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91830) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:04:19.897145 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3e3f3074-941b-4d2b-8506-78ae54412709 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91830) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:04:19.897498 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3e3f3074-941b-4d2b-8506-78ae54412709 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91830) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:04:19.897986 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3e3f3074-941b-4d2b-8506-78ae54412709 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91830) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:04:19.898290 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3e3f3074-941b-4d2b-8506-78ae54412709 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91830) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:04:19.898635 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3e3f3074-941b-4d2b-8506-78ae54412709 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91830) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:04:19.898981 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3e3f3074-941b-4d2b-8506-78ae54412709 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91830) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:04:19.899327 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3e3f3074-941b-4d2b-8506-78ae54412709 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91830) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:04:19.899670 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3e3f3074-941b-4d2b-8506-78ae54412709 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91830) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:04:19.900013 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3e3f3074-941b-4d2b-8506-78ae54412709 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91830) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:04:19.900351 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3e3f3074-941b-4d2b-8506-78ae54412709 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91830) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:04:19.903448 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-3e3f3074-941b-4d2b-8506-78ae54412709 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.030s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:04:19.904243 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-3e3f3074-941b-4d2b-8506-78ae54412709 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:04:19.905334 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [None req-3e3f3074-941b-4d2b-8506-78ae54412709 admin admin] 10.222.0.62 "DELETE /v2.0/security-groups/fbfb9c10-728f-49b0-9cd0-94a4d47538ad HTTP/1.1" status: 204 len: 168 time: 0.1752441 May 25 17:04:20.219890 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-77041ddf-4ab2-4618-a162-f243ce015b44 req-98716e25-f4bd-4055-be9c-609a670db92e tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:04:20.221637 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-77041ddf-4ab2-4618-a162-f243ce015b44 req-98716e25-f4bd-4055-be9c-609a670db92e tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/ports?device_id=3ead96ee-e427-4e87-9879-a1cdf303f894 HTTP/1.1" status: 200 len: 946 time: 0.0856512 May 25 17:04:20.270695 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-77041ddf-4ab2-4618-a162-f243ce015b44 req-a1b62145-182a-40c8-92e0-3d1ef6aeda6e tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/security-groups?id=fdd3b3f1-a2cb-4432-9874-c1d04f64207b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0421889 May 25 17:04:21.462181 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-74f75159-e8a5-4984-8929-57000e8fa1d2 req-c9723e82-f081-4a1a-b4a7-c5c442c6e2e7 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:04:21.463665 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-74f75159-e8a5-4984-8929-57000e8fa1d2 req-c9723e82-f081-4a1a-b4a7-c5c442c6e2e7 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/ports?device_id=3ead96ee-e427-4e87-9879-a1cdf303f894 HTTP/1.1" status: 200 len: 946 time: 0.0791101 May 25 17:04:21.509625 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-74f75159-e8a5-4984-8929-57000e8fa1d2 req-bb0a3df1-df85-472d-a25f-185490b857c6 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/security-groups?id=fdd3b3f1-a2cb-4432-9874-c1d04f64207b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0397735 May 25 17:04:22.702096 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5b9d5830-ff3d-4046-8680-3636283a9f71 req-81b7ff33-6fa2-4c96-a89b-b450160dc6dd tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:04:22.703517 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-5b9d5830-ff3d-4046-8680-3636283a9f71 req-81b7ff33-6fa2-4c96-a89b-b450160dc6dd tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/ports?device_id=3ead96ee-e427-4e87-9879-a1cdf303f894 HTTP/1.1" status: 200 len: 946 time: 0.0817800 May 25 17:04:22.745833 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-5b9d5830-ff3d-4046-8680-3636283a9f71 req-7be662c7-54a1-4921-904c-c6864ee4f2c5 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/security-groups?id=fdd3b3f1-a2cb-4432-9874-c1d04f64207b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0367930 May 25 17:04:23.932717 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fb7bdcbb-b73c-41a7-ab08-eb9756aabb3c req-184f8282-2bb5-4b6e-95f2-eadd1c1056df tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:04:23.934221 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-fb7bdcbb-b73c-41a7-ab08-eb9756aabb3c req-184f8282-2bb5-4b6e-95f2-eadd1c1056df tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/ports?device_id=3ead96ee-e427-4e87-9879-a1cdf303f894 HTTP/1.1" status: 200 len: 946 time: 0.0792489 May 25 17:04:23.983726 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-fb7bdcbb-b73c-41a7-ab08-eb9756aabb3c req-7935779f-bc9d-4548-bc60-5c1c6eb50dcf tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/security-groups?id=fdd3b3f1-a2cb-4432-9874-c1d04f64207b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0431461 May 25 17:04:25.177450 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-12ded864-b88e-44ec-8668-04e7044554e2 req-b88566f3-9186-490a-b1f7-1889a7be7445 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:04:25.179208 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-12ded864-b88e-44ec-8668-04e7044554e2 req-b88566f3-9186-490a-b1f7-1889a7be7445 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/ports?device_id=3ead96ee-e427-4e87-9879-a1cdf303f894 HTTP/1.1" status: 200 len: 946 time: 0.0828812 May 25 17:04:25.224985 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-12ded864-b88e-44ec-8668-04e7044554e2 req-131ba7b7-9eb0-4043-87d7-d001ecce83d3 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/security-groups?id=fdd3b3f1-a2cb-4432-9874-c1d04f64207b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0392246 May 25 17:04:25.289826 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-fb2288eb-9217-469e-b8bb-c80a4df71363 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:04:26.424799 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0ab309d2-c1c5-44f0-8255-c4603baf172f req-e809272e-8fff-40ff-a7b4-c054d2288883 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:04:26.426245 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-0ab309d2-c1c5-44f0-8255-c4603baf172f req-e809272e-8fff-40ff-a7b4-c054d2288883 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/ports?device_id=3ead96ee-e427-4e87-9879-a1cdf303f894 HTTP/1.1" status: 200 len: 946 time: 0.0872982 May 25 17:04:26.469958 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-0ab309d2-c1c5-44f0-8255-c4603baf172f req-21306885-991f-4dc2-931c-8a518a8efdae tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/security-groups?id=fdd3b3f1-a2cb-4432-9874-c1d04f64207b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0376511 May 25 17:04:26.604027 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.wsgi [-] (91830) accepted ('10.222.0.62', 34586) {{(pid=91830) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:04:26.720134 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-78a47479-6228-4ef8-a546-cc4baaed15f9 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:04:26.735822 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.quota.driver [None req-78a47479-6228-4ef8-a546-cc4baaed15f9 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91830) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 17:04:26.739648 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [None req-78a47479-6228-4ef8-a546-cc4baaed15f9 admin admin] Usage tracker for resource:security_group_rule and tenant:66a16bc1ea6e4368bf255ef8d8921a63 is out of sync, need to count used quota {{(pid=91830) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 17:04:26.742470 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [None req-78a47479-6228-4ef8-a546-cc4baaed15f9 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91830) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 17:04:26.748236 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.quota.driver [None req-78a47479-6228-4ef8-a546-cc4baaed15f9 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91830) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 17:04:26.833621 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-78a47479-6228-4ef8-a546-cc4baaed15f9 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:04:26.837013 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-78a47479-6228-4ef8-a546-cc4baaed15f9 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-640836'] for security_group, after_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:04:26.845697 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-71e0aadb-a35e-423b-b404-63f6c1f3552d tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:04:26.885198 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [None req-78a47479-6228-4ef8-a546-cc4baaed15f9 admin admin] 10.222.0.62 "GET /v2.0/security-groups?tenant_id=66a16bc1ea6e4368bf255ef8d8921a63&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2801201 May 25 17:04:26.887110 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-78a47479-6228-4ef8-a546-cc4baaed15f9 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=dfbb8bc3-8c98-4d1b-b0ca-7b76c2bc9b48,revision_number=1']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:04:26.887882 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.wsgi [-] (91829) accepted ('10.222.0.62', 34594) {{(pid=91829) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:04:26.890807 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-78a47479-6228-4ef8-a546-cc4baaed15f9 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.045s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:04:26.945229 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-d0c105f6-e595-4c5c-a1e6-37cacb67507b admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:04:26.971110 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-d0c105f6-e595-4c5c-a1e6-37cacb67507b admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:04:27.023681 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-d0c105f6-e595-4c5c-a1e6-37cacb67507b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-640836'] for security_group, after_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:04:27.028615 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-3193bc9c-c6e6-4e3b-83fd-44c4279eff8f admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:04:27.041117 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d0c105f6-e595-4c5c-a1e6-37cacb67507b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=dfbb8bc3-8c98-4d1b-b0ca-7b76c2bc9b48,revision_number=None']} {{(pid=91829) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:04:27.051723 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-d0c105f6-e595-4c5c-a1e6-37cacb67507b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.023s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:04:27.056108 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-d0c105f6-e595-4c5c-a1e6-37cacb67507b admin admin] Notify callbacks [] for security_group, before_response {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:04:27.059915 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [None req-d0c105f6-e595-4c5c-a1e6-37cacb67507b admin admin] 10.222.0.62 "DELETE /v2.0/security-groups/dfbb8bc3-8c98-4d1b-b0ca-7b76c2bc9b48 HTTP/1.1" status: 204 len: 168 time: 0.1683841 May 25 17:04:27.357277 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.wsgi [-] (91829) accepted ('10.222.0.62', 34610) {{(pid=91829) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:04:27.375667 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-0134ceee-449f-4518-be91-29097295a9b9 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:04:27.394605 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.quota.driver [None req-0134ceee-449f-4518-be91-29097295a9b9 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91829) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 17:04:27.399412 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.quota.resource [None req-0134ceee-449f-4518-be91-29097295a9b9 admin admin] Usage tracker for resource:security_group_rule and tenant:c53db0daf3e240f2ae9da94b5a78fae1 is out of sync, need to count used quota {{(pid=91829) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 17:04:27.403463 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.quota.resource [None req-0134ceee-449f-4518-be91-29097295a9b9 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91829) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 17:04:27.411336 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.quota.driver [None req-0134ceee-449f-4518-be91-29097295a9b9 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91829) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 17:04:27.494130 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-0134ceee-449f-4518-be91-29097295a9b9 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:04:27.497440 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-0134ceee-449f-4518-be91-29097295a9b9 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-640836'] for security_group, after_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:04:27.506072 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-8b168949-d4c7-42c6-ab59-0549e6c63c4c admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:04:27.545513 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [None req-0134ceee-449f-4518-be91-29097295a9b9 admin admin] 10.222.0.62 "GET /v2.0/security-groups?tenant_id=c53db0daf3e240f2ae9da94b5a78fae1&name=default HTTP/1.1" status: 200 len: 2979 time: 0.1869733 May 25 17:04:27.547214 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0134ceee-449f-4518-be91-29097295a9b9 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=93f899d3-ff13-4776-b2c3-5414d547d3e6,revision_number=1']} {{(pid=91829) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:04:27.548206 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.wsgi [-] (91830) accepted ('10.222.0.62', 34616) {{(pid=91830) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:04:27.550375 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-0134ceee-449f-4518-be91-29097295a9b9 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.044s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:04:27.607500 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-f9a7ca17-9e08-4d4d-9191-afc293892f56 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:04:27.633506 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-f9a7ca17-9e08-4d4d-9191-afc293892f56 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:04:27.663343 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2c3a2fbc-f382-44c6-b0f0-2d5398cc4b0a req-460d5892-0b2f-4747-9850-29b671d46b35 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:04:27.664808 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-2c3a2fbc-f382-44c6-b0f0-2d5398cc4b0a req-460d5892-0b2f-4747-9850-29b671d46b35 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/ports?device_id=3ead96ee-e427-4e87-9879-a1cdf303f894 HTTP/1.1" status: 200 len: 946 time: 0.0798755 May 25 17:04:27.696385 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-7c8be8ca-fd57-47a6-84f5-58024c1b6fda None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:04:27.697889 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-f9a7ca17-9e08-4d4d-9191-afc293892f56 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-640836'] for security_group, after_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:04:27.702870 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-78a47479-6228-4ef8-a546-cc4baaed15f9 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:04:27.714981 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f9a7ca17-9e08-4d4d-9191-afc293892f56 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=93f899d3-ff13-4776-b2c3-5414d547d3e6,revision_number=None']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:04:27.718194 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-2c3a2fbc-f382-44c6-b0f0-2d5398cc4b0a req-368c6788-69fd-4180-a0e9-d9dfa17eb04e tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/security-groups?id=fdd3b3f1-a2cb-4432-9874-c1d04f64207b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0474060 May 25 17:04:27.720014 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-f9a7ca17-9e08-4d4d-9191-afc293892f56 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.017s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:04:27.724256 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-f9a7ca17-9e08-4d4d-9191-afc293892f56 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:04:27.725357 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [None req-f9a7ca17-9e08-4d4d-9191-afc293892f56 admin admin] 10.222.0.62 "DELETE /v2.0/security-groups/93f899d3-ff13-4776-b2c3-5414d547d3e6 HTTP/1.1" status: 204 len: 168 time: 0.1761799 May 25 17:04:27.878665 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:04:28.618811 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-0a55eb4a-8b57-4233-84d6-6b423b4ed6db None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:04:28.922460 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f8dedbba-5d93-473e-8f86-783a1dc372e1 req-4df281d6-ea86-4321-ad5b-56ba2cc26f11 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:04:28.923931 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-f8dedbba-5d93-473e-8f86-783a1dc372e1 req-4df281d6-ea86-4321-ad5b-56ba2cc26f11 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/ports?device_id=3ead96ee-e427-4e87-9879-a1cdf303f894 HTTP/1.1" status: 200 len: 946 time: 0.0813465 May 25 17:04:28.969440 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-f8dedbba-5d93-473e-8f86-783a1dc372e1 req-c87e72ab-29b0-4928-b410-f19e3b6d2ec2 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/security-groups?id=fdd3b3f1-a2cb-4432-9874-c1d04f64207b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0395570 May 25 17:04:30.163986 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0de363c4-2739-4953-925b-f0c4f82153d4 req-5d2d3b67-1358-4909-96df-b0b7b8f027a5 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:04:30.165438 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-0de363c4-2739-4953-925b-f0c4f82153d4 req-5d2d3b67-1358-4909-96df-b0b7b8f027a5 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/ports?device_id=3ead96ee-e427-4e87-9879-a1cdf303f894 HTTP/1.1" status: 200 len: 946 time: 0.0832167 May 25 17:04:30.215138 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-0de363c4-2739-4953-925b-f0c4f82153d4 req-2cd426ac-763a-4b14-b4ae-011253044e57 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/security-groups?id=fdd3b3f1-a2cb-4432-9874-c1d04f64207b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0439730 May 25 17:04:30.224258 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-57f11b47-1f51-4191-b7c9-af248a48372c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:04:31.405166 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dae126c6-1f3c-4ccb-a5e7-79b42bf65944 req-9752acae-7596-414e-8be3-b86b1e951c56 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:04:31.406667 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-dae126c6-1f3c-4ccb-a5e7-79b42bf65944 req-9752acae-7596-414e-8be3-b86b1e951c56 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/ports?device_id=3ead96ee-e427-4e87-9879-a1cdf303f894 HTTP/1.1" status: 200 len: 946 time: 0.0836029 May 25 17:04:31.453490 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-dae126c6-1f3c-4ccb-a5e7-79b42bf65944 req-62ecbb46-d220-4eeb-9cdb-5cfdc506f49f tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/security-groups?id=fdd3b3f1-a2cb-4432-9874-c1d04f64207b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0409162 May 25 17:04:32.643456 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2ce2f8dd-9011-49e9-8761-bd24d54cb946 req-3fafdfb6-f481-4e5b-b8d4-f8b2538411a9 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:04:32.644888 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-2ce2f8dd-9011-49e9-8761-bd24d54cb946 req-3fafdfb6-f481-4e5b-b8d4-f8b2538411a9 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/ports?device_id=3ead96ee-e427-4e87-9879-a1cdf303f894 HTTP/1.1" status: 200 len: 946 time: 0.0842817 May 25 17:04:32.688707 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-2ce2f8dd-9011-49e9-8761-bd24d54cb946 req-b487e9f4-e818-4051-a9b4-c9d33f1218a6 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/security-groups?id=fdd3b3f1-a2cb-4432-9874-c1d04f64207b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0381021 May 25 17:04:34.021825 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b2131e1c-983e-441d-83e3-214bc3cbe4a4 req-44763d49-fa1d-4a77-9123-02512ebaee43 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:04:34.023448 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-b2131e1c-983e-441d-83e3-214bc3cbe4a4 req-44763d49-fa1d-4a77-9123-02512ebaee43 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/ports?device_id=3ead96ee-e427-4e87-9879-a1cdf303f894 HTTP/1.1" status: 200 len: 946 time: 0.0776081 May 25 17:04:34.068622 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-b2131e1c-983e-441d-83e3-214bc3cbe4a4 req-3536d9a7-ce48-43e7-bda4-201e603d7c8d tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/security-groups?id=fdd3b3f1-a2cb-4432-9874-c1d04f64207b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0394115 May 25 17:04:35.187098 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:04:35.269077 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8dbc13e0-6f9d-4731-98e3-4c001421a1fd req-1f4d8e3c-4411-43a9-a97b-65055cab657d tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:04:35.270747 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-8dbc13e0-6f9d-4731-98e3-4c001421a1fd req-1f4d8e3c-4411-43a9-a97b-65055cab657d tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/ports?device_id=3ead96ee-e427-4e87-9879-a1cdf303f894 HTTP/1.1" status: 200 len: 946 time: 0.0893190 May 25 17:04:35.318337 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-8dbc13e0-6f9d-4731-98e3-4c001421a1fd req-d8e0de0e-1d22-4c9c-b7aa-dd47dc3e8494 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/security-groups?id=fdd3b3f1-a2cb-4432-9874-c1d04f64207b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0415874 May 25 17:04:36.218684 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-676cffe7-9d6f-4aef-91d7-4598313e6ec8 req-0ce2f0f5-11a6-48ba-a6b4-15ab88d3c549 service neutron] 10.222.0.32 "GET /v2.0/ports?device_id=482f4d0c-0df9-4de7-9c75-b28c728be580&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0726845 May 25 17:04:36.326755 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-676cffe7-9d6f-4aef-91d7-4598313e6ec8 req-eafc6bfd-c01b-4580-a189-442ff795f9d9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:04:36.328411 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-676cffe7-9d6f-4aef-91d7-4598313e6ec8 req-eafc6bfd-c01b-4580-a189-442ff795f9d9 service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=a736cc60cc2143c4b6dea99321051da5&device_id=482f4d0c-0df9-4de7-9c75-b28c728be580 HTTP/1.1" status: 200 len: 1099 time: 0.0804811 May 25 17:04:36.621751 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-676cffe7-9d6f-4aef-91d7-4598313e6ec8 req-11f598f6-f526-475b-89f3-44ab90d3d6da service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:04:36.622902 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.rpc [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Device b7d643d2-c7f2-4e49-8125-5c5ec0b9d463 details requested by agent hyperv_hv-cinder-79049 with host hv-cinder-79049 {{(pid=91831) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 25 17:04:36.623659 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-676cffe7-9d6f-4aef-91d7-4598313e6ec8 req-11f598f6-f526-475b-89f3-44ab90d3d6da service neutron] 10.222.0.32 "GET /v2.0/networks?id=613457eb-6f6d-4604-8f6c-f2d318ff9bc5 HTTP/1.1" status: 200 len: 910 time: 0.2740774 May 25 17:04:36.638522 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4b5d68ac-1514-4e34-ac1e-09036757ad4d req-44a1a735-e631-488e-bf70-8ec18250e091 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:04:36.639927 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-4b5d68ac-1514-4e34-ac1e-09036757ad4d req-44a1a735-e631-488e-bf70-8ec18250e091 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/ports?device_id=3ead96ee-e427-4e87-9879-a1cdf303f894 HTTP/1.1" status: 200 len: 946 time: 0.1327860 May 25 17:04:36.770285 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-4b5d68ac-1514-4e34-ac1e-09036757ad4d req-04df4b65-7617-4d49-9141-4076179cf5e8 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/security-groups?id=fdd3b3f1-a2cb-4432-9874-c1d04f64207b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0605438 May 25 17:04:36.770497 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.db [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] For port b7d643d2-c7f2-4e49-8125-5c5ec0b9d463, host hv-cinder-79049, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79049',level=0,port_id=b7d643d2-c7f2-4e49-8125-5c5ec0b9d463,segment=NetworkSegment(a8fb0313-938a-4f5e-8ff4-96df8acd943b),segment_id=a8fb0313-938a-4f5e-8ff4-96df8acd943b)] {{(pid=91831) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 17:04:36.774844 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-676cffe7-9d6f-4aef-91d7-4598313e6ec8 req-a6185221-c390-4dc6-8f2d-11e2a32eddab service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=646693a2-80a9-425d-bb26-ffda8fa453a7 HTTP/1.1" status: 200 len: 1002 time: 0.1339390 May 25 17:04:36.785380 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.rpc [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Returning: {'device': 'b7d643d2-c7f2-4e49-8125-5c5ec0b9d463', 'network_id': 'e5be4c6a-143f-474c-a90b-37180778cefe', 'port_id': 'b7d643d2-c7f2-4e49-8125-5c5ec0b9d463', 'mac_address': 'fa:16:3e:a8:69:d8', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 695, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '6e6b5897-e23d-4281-96cb-a6fdf9b68134', 'ip_address': '172.20.0.13'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=91831) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 25 17:04:36.849140 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3832070'] for port, before_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:04:36.857108 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-676cffe7-9d6f-4aef-91d7-4598313e6ec8 req-35f4ac3a-d8f4-45d3-ab5d-c0aa84575311 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:04:36.858978 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-676cffe7-9d6f-4aef-91d7-4598313e6ec8 req-35f4ac3a-d8f4-45d3-ab5d-c0aa84575311 service neutron] 10.222.0.32 "GET /v2.0/subnets?id=3fc60650-484d-4574-bb67-0e4931bc9854 HTTP/1.1" status: 200 len: 848 time: 0.0765748 May 25 17:04:36.869380 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.notifiers.nova [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Ignoring state change previous_port_status: ACTIVE current_port_status: BUILD port_id b7d643d2-c7f2-4e49-8125-5c5ec0b9d463 {{(pid=91831) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} May 25 17:04:36.888222 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.db [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] For port b7d643d2-c7f2-4e49-8125-5c5ec0b9d463, host hv-cinder-79049, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79049',level=0,port_id=b7d643d2-c7f2-4e49-8125-5c5ec0b9d463,segment=NetworkSegment(a8fb0313-938a-4f5e-8ff4-96df8acd943b),segment_id=a8fb0313-938a-4f5e-8ff4-96df8acd943b)] {{(pid=91831) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 17:04:36.893584 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8757892955028', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8757892520933', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8757892521750'] for port, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:04:36.895475 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:04:36.961494 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-676cffe7-9d6f-4aef-91d7-4598313e6ec8 req-62ff7c3e-bc4b-4565-b284-475824e3589f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:04:36.964224 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-676cffe7-9d6f-4aef-91d7-4598313e6ec8 req-62ff7c3e-bc4b-4565-b284-475824e3589f service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=613457eb-6f6d-4604-8f6c-f2d318ff9bc5&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0925450 May 25 17:04:36.975126 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Pushing event updated for resources: {'Port': ['ID=b7d643d2-c7f2-4e49-8125-5c5ec0b9d463,revision_number=6']} {{(pid=91831) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:04:36.983005 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91831) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:04:36.983342 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91831) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:04:36.983672 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91831) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:04:36.983998 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91831) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:04:36.984317 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91831) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:04:36.984637 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91831) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:04:36.984952 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91831) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:04:36.985267 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91831) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:04:36.985586 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91831) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:04:36.985899 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91831) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:04:36.986246 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91831) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:04:36.986556 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91831) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:04:36.996702 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.096s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:04:37.042019 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.db [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] get_ports_and_sgs() called for port_ids ['b7d643d2-c7f2-4e49-8125-5c5ec0b9d463'] {{(pid=91831) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 25 17:04:37.106655 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-676cffe7-9d6f-4aef-91d7-4598313e6ec8 req-36e64434-5fca-4720-a7be-d72454c60ef2 service neutron] 10.222.0.32 "GET /v2.0/networks/613457eb-6f6d-4604-8f6c-f2d318ff9bc5?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1310818 May 25 17:04:37.246112 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-676cffe7-9d6f-4aef-91d7-4598313e6ec8 req-d00731dc-9d96-4d87-8e26-be585a47c4dd service neutron] 10.222.0.32 "GET /v2.0/networks/613457eb-6f6d-4604-8f6c-f2d318ff9bc5?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1318896 May 25 17:04:37.976146 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d6b37d1a-4955-4f2b-b552-2a8740fc8f3f req-b54a47ea-4253-426b-972c-61d0143e64e4 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:04:37.977710 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-d6b37d1a-4955-4f2b-b552-2a8740fc8f3f req-b54a47ea-4253-426b-972c-61d0143e64e4 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/ports?device_id=3ead96ee-e427-4e87-9879-a1cdf303f894 HTTP/1.1" status: 200 len: 945 time: 0.0869405 May 25 17:04:38.025019 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-d6b37d1a-4955-4f2b-b552-2a8740fc8f3f req-de481b7a-982a-40ab-94ba-8cfe7e233a3c tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/security-groups?id=fdd3b3f1-a2cb-4432-9874-c1d04f64207b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0411611 May 25 17:04:38.668953 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.rpc [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Device b7d643d2-c7f2-4e49-8125-5c5ec0b9d463 up at agent hyperv_hv-cinder-79049 {{(pid=91831) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 25 17:04:38.740290 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.provisioning_blocks [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Provisioning complete for port b7d643d2-c7f2-4e49-8125-5c5ec0b9d463 triggered by entity L2. {{(pid=91831) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 17:04:38.740667 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3854128'] for port, provisioning_complete {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:04:38.860383 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3832070'] for port, before_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:04:38.894672 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '3ead96ee-e427-4e87-9879-a1cdf303f894', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'b7d643d2-c7f2-4e49-8125-5c5ec0b9d463'}] {{(pid=91831) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 25 17:04:38.905963 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.db [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] For port b7d643d2-c7f2-4e49-8125-5c5ec0b9d463, host hv-cinder-79049, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79049',level=0,port_id=b7d643d2-c7f2-4e49-8125-5c5ec0b9d463,segment=NetworkSegment(a8fb0313-938a-4f5e-8ff4-96df8acd943b),segment_id=a8fb0313-938a-4f5e-8ff4-96df8acd943b)] {{(pid=91831) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 17:04:38.912192 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8757892955028', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8757892520933', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8757892521750'] for port, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:04:38.914522 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [None req-12a18a89-5b44-4402-8d0e-0f0a132bc88f None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:04:38.990775 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Pushing event updated for resources: {'Port': ['ID=b7d643d2-c7f2-4e49-8125-5c5ec0b9d463,revision_number=7']} {{(pid=91831) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:04:38.993943 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.079s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:04:39.071978 dv-cinder-790492-4-iscsi neutron-server[91831]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '3ead96ee-e427-4e87-9879-a1cdf303f894', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'b7d643d2-c7f2-4e49-8125-5c5ec0b9d463', 'code': 200} May 25 17:04:39.214195 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4f1bf35a-0973-4821-8779-0d6903488fd0 req-5968fb41-78ee-4572-bd92-c6379ad1b53a tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:04:39.215556 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-4f1bf35a-0973-4821-8779-0d6903488fd0 req-5968fb41-78ee-4572-bd92-c6379ad1b53a tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/ports?device_id=3ead96ee-e427-4e87-9879-a1cdf303f894 HTTP/1.1" status: 200 len: 946 time: 0.0801985 May 25 17:04:39.270488 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-4f1bf35a-0973-4821-8779-0d6903488fd0 req-b6094a24-99dd-4bfb-9d70-7e018014eccb tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/security-groups?id=fdd3b3f1-a2cb-4432-9874-c1d04f64207b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0487483 May 25 17:04:40.466811 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-33a6ea03-0c3b-4442-8a34-cff578ff0205 req-08b2a733-4bd0-4bcd-8903-e2a6f8ff05ed tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:04:40.468254 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-33a6ea03-0c3b-4442-8a34-cff578ff0205 req-08b2a733-4bd0-4bcd-8903-e2a6f8ff05ed tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/ports?device_id=3ead96ee-e427-4e87-9879-a1cdf303f894 HTTP/1.1" status: 200 len: 946 time: 0.0824668 May 25 17:04:40.513829 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-33a6ea03-0c3b-4442-8a34-cff578ff0205 req-26ae7d84-fa8d-4cc5-940f-428d8c3cf27a tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/security-groups?id=fdd3b3f1-a2cb-4432-9874-c1d04f64207b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0399930 May 25 17:04:41.722254 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e66aab66-0164-40c0-a72b-ab7f98bf3f11 req-3d8968bf-e61d-4a19-8af8-a20226ce4749 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:04:41.723779 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-e66aab66-0164-40c0-a72b-ab7f98bf3f11 req-3d8968bf-e61d-4a19-8af8-a20226ce4749 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/ports?device_id=3ead96ee-e427-4e87-9879-a1cdf303f894 HTTP/1.1" status: 200 len: 946 time: 0.0851676 May 25 17:04:41.771256 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-e66aab66-0164-40c0-a72b-ab7f98bf3f11 req-bc6224eb-30bc-4fa9-a48c-001c34e6a11e tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/security-groups?id=fdd3b3f1-a2cb-4432-9874-c1d04f64207b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0410564 May 25 17:04:42.963368 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0bd4410a-60e6-4f66-b60c-0c6c09024526 req-ac266e8e-a78e-4f93-ab34-7d9ff27035dd tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:04:42.964872 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-0bd4410a-60e6-4f66-b60c-0c6c09024526 req-ac266e8e-a78e-4f93-ab34-7d9ff27035dd tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/ports?device_id=3ead96ee-e427-4e87-9879-a1cdf303f894 HTTP/1.1" status: 200 len: 946 time: 0.0819550 May 25 17:04:43.009018 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-0bd4410a-60e6-4f66-b60c-0c6c09024526 req-8df36ec6-e47f-4ac0-8512-a1bb1ecac20c tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/security-groups?id=fdd3b3f1-a2cb-4432-9874-c1d04f64207b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0385249 May 25 17:04:44.210340 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-482837fa-5588-4495-82e2-1d7fdac92a8f req-99edcf30-41d2-40cb-80ff-2d456ababab3 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:04:44.211796 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-482837fa-5588-4495-82e2-1d7fdac92a8f req-99edcf30-41d2-40cb-80ff-2d456ababab3 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/ports?device_id=3ead96ee-e427-4e87-9879-a1cdf303f894 HTTP/1.1" status: 200 len: 946 time: 0.0867770 May 25 17:04:44.258599 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-482837fa-5588-4495-82e2-1d7fdac92a8f req-4ed850e7-9ed9-4f1c-b125-3bc6baadfff1 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/security-groups?id=fdd3b3f1-a2cb-4432-9874-c1d04f64207b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0406892 May 25 17:04:45.476954 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-23304efa-7b4c-4eb6-9e6d-c45cd6c9ce21 req-3143b532-9b43-434b-8df8-3846d48958ab tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:04:45.478479 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-23304efa-7b4c-4eb6-9e6d-c45cd6c9ce21 req-3143b532-9b43-434b-8df8-3846d48958ab tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/ports?device_id=3ead96ee-e427-4e87-9879-a1cdf303f894 HTTP/1.1" status: 200 len: 946 time: 0.0926926 May 25 17:04:45.537679 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-23304efa-7b4c-4eb6-9e6d-c45cd6c9ce21 req-4cdae7de-30dc-4403-8289-21bffcea3f94 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/security-groups?id=fdd3b3f1-a2cb-4432-9874-c1d04f64207b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0533547 May 25 17:04:45.698164 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.wsgi [-] (91830) accepted ('10.222.0.62', 34906) {{(pid=91830) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:04:45.761352 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.db_base_plugin_v2 [None req-841026a1-b61e-4456-82a2-cd45bfd682ce admin admin] Deleting subnet e21793ea-1820-4ec5-b3fc-a7d9b7129124 {{(pid=91830) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}} May 25 17:04:45.764590 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-841026a1-b61e-4456-82a2-cd45bfd682ce admin admin] Notify callbacks [] for subnet, before_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:04:45.816602 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-841026a1-b61e-4456-82a2-cd45bfd682ce admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-28085025'] for subnet, precommit_delete_associations {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:04:45.880477 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-841026a1-b61e-4456-82a2-cd45bfd682ce admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3856586'] for subnet, precommit_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:04:46.162841 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-841026a1-b61e-4456-82a2-cd45bfd682ce admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3857535', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55886', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-28085112', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1152740'] for subnet, after_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:04:46.167035 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-1afd865b-682f-465c-a85f-61637a8516fb admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:04:46.206964 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-841026a1-b61e-4456-82a2-cd45bfd682ce admin admin] Pushing event deleted for resources: {'Subnet': ['ID=e21793ea-1820-4ec5-b3fc-a7d9b7129124,revision_number=None']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:04:46.210602 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-841026a1-b61e-4456-82a2-cd45bfd682ce admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-551373'] for subnet, before_response {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:04:46.213127 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-841026a1-b61e-4456-82a2-cd45bfd682ce admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.046s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:04:46.217225 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [None req-841026a1-b61e-4456-82a2-cd45bfd682ce admin admin] 10.222.0.62 "DELETE /v2.0/subnets/e21793ea-1820-4ec5-b3fc-a7d9b7129124 HTTP/1.1" status: 204 len: 168 time: 0.5180609 May 25 17:04:46.219648 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.wsgi [-] (91830) accepted ('10.222.0.62', 34912) {{(pid=91830) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:04:46.344461 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-0bcea275-cc19-4ee7-ad46-d0e2f064687a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3867326'] for network, before_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:04:46.544746 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-0bcea275-cc19-4ee7-ad46-d0e2f064687a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3858245', 'neutron.services.segments.db._delete_segments_for_network-8757892982492'] for network, precommit_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:04:46.559056 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.services.segments.db [None req-0bcea275-cc19-4ee7-ad46-d0e2f064687a admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['c8b64023-a7f5-4c0f-847b-8a8aef981caa']}} {{(pid=91830) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 17:04:46.573951 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.services.segments.db [None req-0bcea275-cc19-4ee7-ad46-d0e2f064687a admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'bba065e2-1e75-4ab9-bc0e-e3037ef57277') {'for_net_delete': True} {{(pid=91830) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 17:04:46.574267 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.services.segments.db [None req-0bcea275-cc19-4ee7-ad46-d0e2f064687a admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'bba065e2-1e75-4ab9-bc0e-e3037ef57277') {} {{(pid=91830) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 17:04:46.592127 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-0bcea275-cc19-4ee7-ad46-d0e2f064687a admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8757892991389', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-28085034'] for segment, before_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:04:46.615463 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-0bcea275-cc19-4ee7-ad46-d0e2f064687a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3809789'] for segment, precommit_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:04:46.627175 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-0bcea275-cc19-4ee7-ad46-d0e2f064687a admin admin] Releasing vlan 654 on physical network physnet1 to pool {{(pid=91830) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 25 17:04:46.627575 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-0bcea275-cc19-4ee7-ad46-d0e2f064687a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3809789', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-27483102'] for segment, after_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:04:46.642207 dv-cinder-790492-4-iscsi neutron-server[91830]: Traceback (most recent call last): May 25 17:04:46.642207 dv-cinder-790492-4-iscsi neutron-server[91830]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 25 17:04:46.642207 dv-cinder-790492-4-iscsi neutron-server[91830]: timer() May 25 17:04:46.642207 dv-cinder-790492-4-iscsi neutron-server[91830]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 25 17:04:46.642207 dv-cinder-790492-4-iscsi neutron-server[91830]: cb(*args, **kw) May 25 17:04:46.642207 dv-cinder-790492-4-iscsi neutron-server[91830]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper May 25 17:04:46.642207 dv-cinder-790492-4-iscsi neutron-server[91830]: return func(*args, **kwargs) May 25 17:04:46.642207 dv-cinder-790492-4-iscsi neutron-server[91830]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 25 17:04:46.642207 dv-cinder-790492-4-iscsi neutron-server[91830]: self._notify() May 25 17:04:46.642207 dv-cinder-790492-4-iscsi neutron-server[91830]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 25 17:04:46.642207 dv-cinder-790492-4-iscsi neutron-server[91830]: self.callback(batched_events) May 25 17:04:46.642207 dv-cinder-790492-4-iscsi neutron-server[91830]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 25 17:04:46.642207 dv-cinder-790492-4-iscsi neutron-server[91830]: event.method(event) May 25 17:04:46.642207 dv-cinder-790492-4-iscsi neutron-server[91830]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 25 17:04:46.642207 dv-cinder-790492-4-iscsi neutron-server[91830]: aggregate_id = self._get_aggregate_id(event.segment_id) May 25 17:04:46.642207 dv-cinder-790492-4-iscsi neutron-server[91830]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 25 17:04:46.642207 dv-cinder-790492-4-iscsi neutron-server[91830]: aggregate_uuid = self.p_client.list_aggregates( May 25 17:04:46.642207 dv-cinder-790492-4-iscsi neutron-server[91830]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 25 17:04:46.642207 dv-cinder-790492-4-iscsi neutron-server[91830]: return f(self, *a, **k) May 25 17:04:46.642207 dv-cinder-790492-4-iscsi neutron-server[91830]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 25 17:04:46.642207 dv-cinder-790492-4-iscsi neutron-server[91830]: return self._get(url).json() May 25 17:04:46.642207 dv-cinder-790492-4-iscsi neutron-server[91830]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 25 17:04:46.642207 dv-cinder-790492-4-iscsi neutron-server[91830]: return self._client.get(url, endpoint_filter=self._ks_filter, May 25 17:04:46.642207 dv-cinder-790492-4-iscsi neutron-server[91830]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 25 17:04:46.642207 dv-cinder-790492-4-iscsi neutron-server[91830]: return self.request(url, 'GET', **kwargs) May 25 17:04:46.642207 dv-cinder-790492-4-iscsi neutron-server[91830]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 25 17:04:46.642207 dv-cinder-790492-4-iscsi neutron-server[91830]: base_url = self.get_endpoint(auth, allow=allow, May 25 17:04:46.642207 dv-cinder-790492-4-iscsi neutron-server[91830]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 25 17:04:46.642207 dv-cinder-790492-4-iscsi neutron-server[91830]: auth = self._auth_required(auth, 'determine endpoint URL') May 25 17:04:46.642207 dv-cinder-790492-4-iscsi neutron-server[91830]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 25 17:04:46.642207 dv-cinder-790492-4-iscsi neutron-server[91830]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 25 17:04:46.642207 dv-cinder-790492-4-iscsi neutron-server[91830]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 25 17:04:46.766710 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-0bcea275-cc19-4ee7-ad46-d0e2f064687a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3858252', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-640806', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-551400', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-683051'] for network, after_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:04:46.779192 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-deb58874-c29a-42e4-a2ef-29435e4a2ec2 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:04:46.795435 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-0bcea275-cc19-4ee7-ad46-d0e2f064687a admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-551373'] for network, before_response {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:04:46.804685 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0bcea275-cc19-4ee7-ad46-d0e2f064687a admin admin] Pushing event deleted for resources: {'Network': ['ID=c8b64023-a7f5-4c0f-847b-8a8aef981caa,revision_number=None']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:04:46.810138 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8b956d65-3ed0-4e0a-9a16-851e490fc0dd req-f221aeae-fd48-492e-bc6e-1ce25ff7cc44 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:04:46.810138 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-8b956d65-3ed0-4e0a-9a16-851e490fc0dd req-f221aeae-fd48-492e-bc6e-1ce25ff7cc44 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/ports?device_id=3ead96ee-e427-4e87-9879-a1cdf303f894 HTTP/1.1" status: 200 len: 946 time: 0.1157095 May 25 17:04:46.820560 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-0bcea275-cc19-4ee7-ad46-d0e2f064687a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.041s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:04:46.822436 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [None req-0bcea275-cc19-4ee7-ad46-d0e2f064687a admin admin] 10.222.0.62 "DELETE /v2.0/networks/c8b64023-a7f5-4c0f-847b-8a8aef981caa HTTP/1.1" status: 204 len: 168 time: 0.6014547 May 25 17:04:46.864434 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-8b956d65-3ed0-4e0a-9a16-851e490fc0dd req-f915b611-4415-42e8-8217-24cb45fec943 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/security-groups?id=fdd3b3f1-a2cb-4432-9874-c1d04f64207b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0468481 May 25 17:04:47.023960 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.wsgi [-] (91830) accepted ('10.222.0.62', 34924) {{(pid=91830) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:04:47.074893 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [None req-1411ef77-ffe1-4cd1-a52b-d4471b40c37d admin admin] 10.222.0.62 "GET /v2.0/security-groups?tenant_id=1314f62bcf90411cadb06fa2d9392828&name=default HTTP/1.1" status: 200 len: 2979 time: 0.0482714 May 25 17:04:47.076726 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.wsgi [-] (91829) accepted ('10.222.0.62', 34928) {{(pid=91829) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:04:47.138075 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-a838fcf9-2316-4be4-967c-585f9de2e5a0 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:04:47.163635 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-a838fcf9-2316-4be4-967c-585f9de2e5a0 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:04:47.232406 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-a838fcf9-2316-4be4-967c-585f9de2e5a0 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-640836'] for security_group, after_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:04:47.236208 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-b98b3cad-107c-4989-b5b1-a27c1c5e1145 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:04:47.250492 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a838fcf9-2316-4be4-967c-585f9de2e5a0 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b5f47757-8dd4-4226-9a13-ca15ee498213,revision_number=None']} {{(pid=91829) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:04:47.257740 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-a838fcf9-2316-4be4-967c-585f9de2e5a0 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.022s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:04:47.259763 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-a838fcf9-2316-4be4-967c-585f9de2e5a0 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:04:47.260856 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [None req-a838fcf9-2316-4be4-967c-585f9de2e5a0 admin admin] 10.222.0.62 "DELETE /v2.0/security-groups/b5f47757-8dd4-4226-9a13-ca15ee498213 HTTP/1.1" status: 204 len: 168 time: 0.1830688 May 25 17:04:48.069306 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-64b80d73-dc9a-408a-ace9-00ced19589bf req-bf02074b-24b7-4b01-beff-8dfa577d475b tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:04:48.071540 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-64b80d73-dc9a-408a-ace9-00ced19589bf req-bf02074b-24b7-4b01-beff-8dfa577d475b tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/ports?device_id=3ead96ee-e427-4e87-9879-a1cdf303f894 HTTP/1.1" status: 200 len: 946 time: 0.0841651 May 25 17:04:48.118902 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-64b80d73-dc9a-408a-ace9-00ced19589bf req-19a44246-b808-4c5e-be69-f9b610a1c507 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/security-groups?id=fdd3b3f1-a2cb-4432-9874-c1d04f64207b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0410819 May 25 17:04:49.472646 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1fd97574-a67b-4cb0-8a02-9ceafd2dc9a3 req-25d95934-fa7e-4b66-b439-ee49a352e950 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:04:49.475308 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-1fd97574-a67b-4cb0-8a02-9ceafd2dc9a3 req-25d95934-fa7e-4b66-b439-ee49a352e950 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/ports?device_id=3ead96ee-e427-4e87-9879-a1cdf303f894 HTTP/1.1" status: 200 len: 946 time: 0.2158995 May 25 17:04:49.524034 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-1fd97574-a67b-4cb0-8a02-9ceafd2dc9a3 req-a7eb48a6-1b8e-4a45-b2bc-fb96268cb817 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/security-groups?id=fdd3b3f1-a2cb-4432-9874-c1d04f64207b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0418649 May 25 17:04:50.728903 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-35c4fcf6-0c34-41be-91c0-10d68a29f5f3 req-c77af0a3-4964-43fa-a909-d90ad2ce427d tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:04:50.730385 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-35c4fcf6-0c34-41be-91c0-10d68a29f5f3 req-c77af0a3-4964-43fa-a909-d90ad2ce427d tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/ports?device_id=3ead96ee-e427-4e87-9879-a1cdf303f894 HTTP/1.1" status: 200 len: 946 time: 0.0897114 May 25 17:04:50.776705 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-35c4fcf6-0c34-41be-91c0-10d68a29f5f3 req-789afd79-b16b-4de2-b34d-b1d13e56cb04 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/security-groups?id=fdd3b3f1-a2cb-4432-9874-c1d04f64207b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0400741 May 25 17:04:51.983253 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-85abc085-3c3a-4865-9f75-217003a627fa req-a8d2d435-c10f-44ac-b607-7951b2144a6a tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:04:51.984776 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-85abc085-3c3a-4865-9f75-217003a627fa req-a8d2d435-c10f-44ac-b607-7951b2144a6a tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/ports?device_id=3ead96ee-e427-4e87-9879-a1cdf303f894 HTTP/1.1" status: 200 len: 946 time: 0.0853500 May 25 17:04:52.031577 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-85abc085-3c3a-4865-9f75-217003a627fa req-c6169722-7e58-4361-a4b7-cd4176868824 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/security-groups?id=fdd3b3f1-a2cb-4432-9874-c1d04f64207b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0409110 May 25 17:04:53.218106 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a7820e44-4a69-4f93-85f4-76f5f33ed3fc req-e046a2fd-9d5e-4a2b-a984-b60e6c755603 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:04:53.219554 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-a7820e44-4a69-4f93-85f4-76f5f33ed3fc req-e046a2fd-9d5e-4a2b-a984-b60e6c755603 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/ports?device_id=3ead96ee-e427-4e87-9879-a1cdf303f894 HTTP/1.1" status: 200 len: 946 time: 0.0804880 May 25 17:04:53.266384 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-a7820e44-4a69-4f93-85f4-76f5f33ed3fc req-2b726c06-9c1d-4048-96ce-9e021d27814d tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/security-groups?id=fdd3b3f1-a2cb-4432-9874-c1d04f64207b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0406661 May 25 17:04:54.152002 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.db.agents_db [None req-504cb04f-4543-46c1-8db7-349e21db7634 None None] Agent healthcheck: found 6 active agents {{(pid=91832) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} May 25 17:04:54.465115 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6ee94a5d-6435-46eb-8bc6-a1552238ad0b req-a633060c-1ea5-44ba-bf77-8d40283184e3 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:04:54.466590 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-6ee94a5d-6435-46eb-8bc6-a1552238ad0b req-a633060c-1ea5-44ba-bf77-8d40283184e3 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/ports?device_id=3ead96ee-e427-4e87-9879-a1cdf303f894 HTTP/1.1" status: 200 len: 946 time: 0.0903404 May 25 17:04:54.513093 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-6ee94a5d-6435-46eb-8bc6-a1552238ad0b req-bcc684bd-1f63-45a8-b4a7-3d4f89a3964b tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/security-groups?id=fdd3b3f1-a2cb-4432-9874-c1d04f64207b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0408416 May 25 17:04:55.292878 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-6359b910-ad20-462a-a149-d137aef72e8a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:04:55.731045 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-56090c52-6496-41d9-beaf-ddcfb0d76d2e req-8cec27af-4469-4f21-9ad5-16b743ee1945 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:04:55.732535 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-56090c52-6496-41d9-beaf-ddcfb0d76d2e req-8cec27af-4469-4f21-9ad5-16b743ee1945 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/ports?device_id=3ead96ee-e427-4e87-9879-a1cdf303f894 HTTP/1.1" status: 200 len: 946 time: 0.0874634 May 25 17:04:55.790004 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-56090c52-6496-41d9-beaf-ddcfb0d76d2e req-db37bb58-ff67-4c61-9849-60be08c6c68b tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/security-groups?id=fdd3b3f1-a2cb-4432-9874-c1d04f64207b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0516999 May 25 17:04:56.978627 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6ec16a1d-fee8-4b57-a050-17fc129e094a req-77315ac3-0c4a-4fb2-9972-f527bc83e80e tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:04:56.982391 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-6ec16a1d-fee8-4b57-a050-17fc129e094a req-77315ac3-0c4a-4fb2-9972-f527bc83e80e tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/ports?device_id=3ead96ee-e427-4e87-9879-a1cdf303f894 HTTP/1.1" status: 200 len: 946 time: 0.0884562 May 25 17:04:57.026141 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-6ec16a1d-fee8-4b57-a050-17fc129e094a req-b7766079-ffaf-403e-90cc-6c3969d246e1 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/security-groups?id=fdd3b3f1-a2cb-4432-9874-c1d04f64207b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0399184 May 25 17:04:57.690050 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-ed19dde5-213e-4c74-ab8c-7c92b7d6c950 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:04:57.875615 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:04:58.221806 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-131db893-9a39-4416-b928-45c9559f8ed1 req-6604f72a-8e31-4be2-b00d-3e9de815c66e tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:04:58.223280 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-131db893-9a39-4416-b928-45c9559f8ed1 req-6604f72a-8e31-4be2-b00d-3e9de815c66e tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/ports?device_id=3ead96ee-e427-4e87-9879-a1cdf303f894 HTTP/1.1" status: 200 len: 946 time: 0.0834558 May 25 17:04:58.271560 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-131db893-9a39-4416-b928-45c9559f8ed1 req-b8df7762-1998-4575-b40c-72a90ef8e04d tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/security-groups?id=fdd3b3f1-a2cb-4432-9874-c1d04f64207b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0411520 May 25 17:04:58.621544 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-0a55eb4a-8b57-4233-84d6-6b423b4ed6db None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:04:59.487278 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f0b08d31-1d5a-48ce-a5b2-69b3fb1cbe0e req-d5b4a303-7190-40c0-a099-5ae20af77f9f tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:04:59.488752 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-f0b08d31-1d5a-48ce-a5b2-69b3fb1cbe0e req-d5b4a303-7190-40c0-a099-5ae20af77f9f tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/ports?device_id=3ead96ee-e427-4e87-9879-a1cdf303f894 HTTP/1.1" status: 200 len: 946 time: 0.0940645 May 25 17:04:59.541250 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-f0b08d31-1d5a-48ce-a5b2-69b3fb1cbe0e req-d9eaf014-43fc-449f-abc9-62284438a265 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/security-groups?id=fdd3b3f1-a2cb-4432-9874-c1d04f64207b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0462754 May 25 17:05:00.234969 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-57f11b47-1f51-4191-b7c9-af248a48372c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:05:00.778544 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f4285c88-9547-4ce2-b797-664c46be2515 req-6e769880-6f26-4d75-8f8a-ca10ef9c16b2 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:05:00.780125 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-f4285c88-9547-4ce2-b797-664c46be2515 req-6e769880-6f26-4d75-8f8a-ca10ef9c16b2 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/ports?device_id=3ead96ee-e427-4e87-9879-a1cdf303f894 HTTP/1.1" status: 200 len: 946 time: 0.0801692 May 25 17:05:00.832845 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-f4285c88-9547-4ce2-b797-664c46be2515 req-a8795b08-ea4d-4d16-b0aa-017034403447 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/security-groups?id=fdd3b3f1-a2cb-4432-9874-c1d04f64207b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0471101 May 25 17:05:02.024792 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-19842e08-42b0-4258-9e90-853f04bbb772 req-b3362035-3f56-4aea-9f17-ebd47582e676 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:05:02.026273 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-19842e08-42b0-4258-9e90-853f04bbb772 req-b3362035-3f56-4aea-9f17-ebd47582e676 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/ports?device_id=3ead96ee-e427-4e87-9879-a1cdf303f894 HTTP/1.1" status: 200 len: 946 time: 0.0830848 May 25 17:05:02.069096 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-19842e08-42b0-4258-9e90-853f04bbb772 req-fb29ddcb-6bbe-44e5-a24b-1a34991d2b2d tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/security-groups?id=fdd3b3f1-a2cb-4432-9874-c1d04f64207b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0372214 May 25 17:05:03.257765 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9767b776-58d1-487d-a231-9b445807dc74 req-d5a4a32a-c24c-4f03-912a-aa9caf8fa78c tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:05:03.259227 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-9767b776-58d1-487d-a231-9b445807dc74 req-d5a4a32a-c24c-4f03-912a-aa9caf8fa78c tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/ports?device_id=3ead96ee-e427-4e87-9879-a1cdf303f894 HTTP/1.1" status: 200 len: 946 time: 0.0785820 May 25 17:05:03.302631 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-9767b776-58d1-487d-a231-9b445807dc74 req-25e15ed9-7103-4186-bf84-fd09383fd3b6 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/security-groups?id=fdd3b3f1-a2cb-4432-9874-c1d04f64207b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0378473 May 25 17:05:04.489857 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-926732ae-f2a5-4dd9-a351-9d6412478a90 req-61a20e0b-50a4-40b4-957c-b479f101e01f tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:05:04.491872 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-926732ae-f2a5-4dd9-a351-9d6412478a90 req-61a20e0b-50a4-40b4-957c-b479f101e01f tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/ports?device_id=3ead96ee-e427-4e87-9879-a1cdf303f894 HTTP/1.1" status: 200 len: 946 time: 0.0814610 May 25 17:05:04.536294 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-926732ae-f2a5-4dd9-a351-9d6412478a90 req-9e041134-9ccc-4ba2-88a7-9d1ab42160ed tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/security-groups?id=fdd3b3f1-a2cb-4432-9874-c1d04f64207b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0388050 May 25 17:05:04.915569 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.rpc [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Device b7d643d2-c7f2-4e49-8125-5c5ec0b9d463 no longer exists at agent hyperv_hv-cinder-79049 {{(pid=91831) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 25 17:05:05.028518 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3832070'] for port, before_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:05:05.055576 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '3ead96ee-e427-4e87-9879-a1cdf303f894', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': 'b7d643d2-c7f2-4e49-8125-5c5ec0b9d463'}] {{(pid=91831) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 25 17:05:05.065109 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.db [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] For port b7d643d2-c7f2-4e49-8125-5c5ec0b9d463, host hv-cinder-79049, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79049',level=0,port_id=b7d643d2-c7f2-4e49-8125-5c5ec0b9d463,segment=NetworkSegment(a8fb0313-938a-4f5e-8ff4-96df8acd943b),segment_id=a8fb0313-938a-4f5e-8ff4-96df8acd943b)] {{(pid=91831) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 17:05:05.070195 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8757892955028', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8757892520933', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8757892521750'] for port, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:05:05.072091 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [None req-0c176240-54ab-4c4f-9583-59c938361492 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:05:05.107328 dv-cinder-790492-4-iscsi neutron-server[91831]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '3ead96ee-e427-4e87-9879-a1cdf303f894', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': 'b7d643d2-c7f2-4e49-8125-5c5ec0b9d463', 'code': 200} May 25 17:05:05.137102 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Pushing event updated for resources: {'Port': ['ID=b7d643d2-c7f2-4e49-8125-5c5ec0b9d463,revision_number=8']} {{(pid=91831) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:05:05.140077 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.068s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:05:05.723392 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dc0a6069-4272-4261-8a1f-14ceed3725ea req-460e21fa-3697-4427-a71b-fcddb7af8c7e tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:05:05.724835 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-dc0a6069-4272-4261-8a1f-14ceed3725ea req-460e21fa-3697-4427-a71b-fcddb7af8c7e tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/ports?device_id=3ead96ee-e427-4e87-9879-a1cdf303f894 HTTP/1.1" status: 200 len: 944 time: 0.0778086 May 25 17:05:05.768837 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-dc0a6069-4272-4261-8a1f-14ceed3725ea req-e043ea77-7531-49a6-99c2-b84b240c24ce tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/security-groups?id=fdd3b3f1-a2cb-4432-9874-c1d04f64207b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0377367 May 25 17:05:06.468212 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:05:07.019472 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c5757028-238d-45ba-97e4-c26908775307 req-bbe04ed5-6091-439c-b79d-e56ece05423e tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:05:07.020919 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-c5757028-238d-45ba-97e4-c26908775307 req-bbe04ed5-6091-439c-b79d-e56ece05423e tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/ports?device_id=3ead96ee-e427-4e87-9879-a1cdf303f894 HTTP/1.1" status: 200 len: 944 time: 0.1292884 May 25 17:05:07.066876 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-16c06516-5f25-47b5-b228-a27989e42a7a req-f411f93f-4170-4088-8488-fa54d306cc54 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:05:07.068337 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-16c06516-5f25-47b5-b228-a27989e42a7a req-f411f93f-4170-4088-8488-fa54d306cc54 service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=bbb9e99759bc47d08005f3b1e036a6cf&device_id=3ead96ee-e427-4e87-9879-a1cdf303f894 HTTP/1.1" status: 200 len: 1097 time: 0.1182194 May 25 17:05:07.079026 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-c5757028-238d-45ba-97e4-c26908775307 req-18dfef17-0ebf-40ea-b320-7a016eead896 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/security-groups?id=fdd3b3f1-a2cb-4432-9874-c1d04f64207b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0517313 May 25 17:05:07.201341 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-16c06516-5f25-47b5-b228-a27989e42a7a req-9cb14699-fb7a-42a8-aa99-46e47c7c8472 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:05:07.202815 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-16c06516-5f25-47b5-b228-a27989e42a7a req-9cb14699-fb7a-42a8-aa99-46e47c7c8472 service neutron] 10.222.0.32 "GET /v2.0/networks?id=e5be4c6a-143f-474c-a90b-37180778cefe HTTP/1.1" status: 200 len: 917 time: 0.1268377 May 25 17:05:07.302480 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-16c06516-5f25-47b5-b228-a27989e42a7a req-2a414670-7573-4717-bf17-653c5e3e03b5 service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=b7d643d2-c7f2-4e49-8125-5c5ec0b9d463 HTTP/1.1" status: 200 len: 1000 time: 0.0917754 May 25 17:05:07.369576 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-16c06516-5f25-47b5-b228-a27989e42a7a req-35091a09-92e9-405f-9976-544743437afb service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:05:07.370944 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-16c06516-5f25-47b5-b228-a27989e42a7a req-35091a09-92e9-405f-9976-544743437afb service neutron] 10.222.0.32 "GET /v2.0/subnets?id=6e6b5897-e23d-4281-96cb-a6fdf9b68134 HTTP/1.1" status: 200 len: 855 time: 0.0617330 May 25 17:05:07.448137 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-16c06516-5f25-47b5-b228-a27989e42a7a req-bf8bcfc3-119a-4205-a9b8-ac646712f7cc service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:05:07.450371 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-16c06516-5f25-47b5-b228-a27989e42a7a req-bf8bcfc3-119a-4205-a9b8-ac646712f7cc service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=e5be4c6a-143f-474c-a90b-37180778cefe&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0717392 May 25 17:05:07.669263 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-16c06516-5f25-47b5-b228-a27989e42a7a req-507c8032-dde4-46a8-9500-70584280ffd3 service neutron] 10.222.0.32 "GET /v2.0/networks/e5be4c6a-143f-474c-a90b-37180778cefe?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2107799 May 25 17:05:07.800887 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-16c06516-5f25-47b5-b228-a27989e42a7a req-9805f415-c250-43c4-9ead-00cabbf1d727 service neutron] 10.222.0.32 "GET /v2.0/networks/e5be4c6a-143f-474c-a90b-37180778cefe?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1216786 May 25 17:05:08.269093 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5dca8c7c-4be3-49d8-9c0d-378abbff9e26 req-2fb89f4b-2081-4eae-a90a-9f2715fa550a tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:05:08.270563 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-5dca8c7c-4be3-49d8-9c0d-378abbff9e26 req-2fb89f4b-2081-4eae-a90a-9f2715fa550a tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/ports?device_id=3ead96ee-e427-4e87-9879-a1cdf303f894 HTTP/1.1" status: 200 len: 944 time: 0.0819325 May 25 17:05:08.313666 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-5dca8c7c-4be3-49d8-9c0d-378abbff9e26 req-e53525cd-2782-4aca-b30b-effba2e31e2f tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/security-groups?id=fdd3b3f1-a2cb-4432-9874-c1d04f64207b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0375824 May 25 17:05:09.008260 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d764a8ed-84f3-40f1-867a-789a66fcd93a req-57923714-342f-4975-bac2-0e49fc2d451c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:05:09.009625 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-d764a8ed-84f3-40f1-867a-789a66fcd93a req-57923714-342f-4975-bac2-0e49fc2d451c service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=36c1ffa1d458478bac5893b2ddf98eda&device_id=4413fd77-4f3e-40c8-b7ee-77d416cd7667 HTTP/1.1" status: 200 len: 1138 time: 0.1362019 May 25 17:05:09.017800 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bae344a3-7e00-4eb8-ad58-c671728ba962 req-4a42499c-8f6f-4292-a99d-9d51be1b2b97 tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:05:09.019147 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-bae344a3-7e00-4eb8-ad58-c671728ba962 req-4a42499c-8f6f-4292-a99d-9d51be1b2b97 tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] 10.222.0.62 "GET /v2.0/ports?device_id=4413fd77-4f3e-40c8-b7ee-77d416cd7667 HTTP/1.1" status: 200 len: 985 time: 0.1095746 May 25 17:05:09.140700 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-bae344a3-7e00-4eb8-ad58-c671728ba962 req-60778cc5-07fd-4680-b459-61d63d41bd02 tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] 10.222.0.62 "GET /v2.0/security-groups?id=8af4439c-b905-435b-836a-90c7f9007b51&id=d7d845a2-937c-4f26-ac5a-1b178146b05e&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.1026800 May 25 17:05:09.178968 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d764a8ed-84f3-40f1-867a-789a66fcd93a req-1b1b4fda-3634-42d7-9604-ba75cc5b3e07 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:05:09.180639 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-d764a8ed-84f3-40f1-867a-789a66fcd93a req-1b1b4fda-3634-42d7-9604-ba75cc5b3e07 service neutron] 10.222.0.32 "GET /v2.0/networks?id=f3ddbe01-13f7-4e15-b7da-2bdffc278cb7 HTTP/1.1" status: 200 len: 916 time: 0.1603374 May 25 17:05:09.285192 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-d764a8ed-84f3-40f1-867a-789a66fcd93a req-77f9660d-8a6f-47b8-a72e-c95381126257 service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=d64889c5-b5bd-42be-aa18-7a6149a0a583 HTTP/1.1" status: 200 len: 1002 time: 0.0967438 May 25 17:05:09.355695 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d764a8ed-84f3-40f1-867a-789a66fcd93a req-db4547e2-3b50-4caf-a639-6fc4039681a5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:05:09.357226 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-d764a8ed-84f3-40f1-867a-789a66fcd93a req-db4547e2-3b50-4caf-a639-6fc4039681a5 service neutron] 10.222.0.32 "GET /v2.0/subnets?id=69fba530-cce2-44a2-89bd-18a52f9d454c HTTP/1.1" status: 200 len: 854 time: 0.0632503 May 25 17:05:09.478534 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d764a8ed-84f3-40f1-867a-789a66fcd93a req-04d9c58c-adaf-4a25-9155-f53540c1f2ca service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:05:09.479976 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-d764a8ed-84f3-40f1-867a-789a66fcd93a req-04d9c58c-adaf-4a25-9155-f53540c1f2ca service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=f3ddbe01-13f7-4e15-b7da-2bdffc278cb7&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.1143832 May 25 17:05:09.594528 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f065a37a-7d31-44b2-9e32-bd9bef27364e req-57e53575-8548-465d-8457-0348dd39ee7e tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:05:09.595954 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-f065a37a-7d31-44b2-9e32-bd9bef27364e req-57e53575-8548-465d-8457-0348dd39ee7e tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/ports?device_id=3ead96ee-e427-4e87-9879-a1cdf303f894 HTTP/1.1" status: 200 len: 944 time: 0.1706648 May 25 17:05:09.662452 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-d764a8ed-84f3-40f1-867a-789a66fcd93a req-585e40e1-afb7-46b4-bece-5850d84e4882 service neutron] 10.222.0.32 "GET /v2.0/networks/f3ddbe01-13f7-4e15-b7da-2bdffc278cb7?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1746569 May 25 17:05:09.666889 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-f065a37a-7d31-44b2-9e32-bd9bef27364e req-6f6cbb9a-e2b1-43c4-bdb6-9025d4d184b2 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/security-groups?id=fdd3b3f1-a2cb-4432-9874-c1d04f64207b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0611653 May 25 17:05:09.796204 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-d764a8ed-84f3-40f1-867a-789a66fcd93a req-93ce1ba5-79ef-48a3-9b6e-b9ce7aa123cb service neutron] 10.222.0.32 "GET /v2.0/networks/f3ddbe01-13f7-4e15-b7da-2bdffc278cb7?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1265321 May 25 17:05:10.342758 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d5d2b961-7bc1-4213-8fea-924ee9057d71 req-2ad0c476-f1b5-4ed8-a25b-d66a16c190ce tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:05:10.342758 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-d5d2b961-7bc1-4213-8fea-924ee9057d71 req-2ad0c476-f1b5-4ed8-a25b-d66a16c190ce tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] 10.222.0.62 "GET /v2.0/ports?device_id=4413fd77-4f3e-40c8-b7ee-77d416cd7667 HTTP/1.1" status: 200 len: 985 time: 0.0829265 May 25 17:05:10.383539 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-d5d2b961-7bc1-4213-8fea-924ee9057d71 req-0f2325e2-4eda-473f-a74d-45f1f0f83e4b tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] 10.222.0.62 "GET /v2.0/security-groups?id=8af4439c-b905-435b-836a-90c7f9007b51&id=d7d845a2-937c-4f26-ac5a-1b178146b05e&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0411792 May 25 17:05:10.859007 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3386e5d8-904a-4998-99c2-646164a7a939 req-3ca457da-0380-46b0-af43-90dba9f5d4c1 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:05:10.860701 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-3386e5d8-904a-4998-99c2-646164a7a939 req-3ca457da-0380-46b0-af43-90dba9f5d4c1 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/ports?device_id=3ead96ee-e427-4e87-9879-a1cdf303f894 HTTP/1.1" status: 200 len: 944 time: 0.0826890 May 25 17:05:10.910052 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-3386e5d8-904a-4998-99c2-646164a7a939 req-e5c4d061-d035-4305-a4b1-cc007d2bfd64 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/security-groups?id=fdd3b3f1-a2cb-4432-9874-c1d04f64207b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0432904 May 25 17:05:11.573031 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-41fd1396-8205-4981-b94e-f272545945f3 req-ade653f0-d9e1-4687-ac58-acdfcda153a8 tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:05:11.574510 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-41fd1396-8205-4981-b94e-f272545945f3 req-ade653f0-d9e1-4687-ac58-acdfcda153a8 tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] 10.222.0.62 "GET /v2.0/ports?device_id=4413fd77-4f3e-40c8-b7ee-77d416cd7667 HTTP/1.1" status: 200 len: 985 time: 0.0801902 May 25 17:05:11.620826 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-41fd1396-8205-4981-b94e-f272545945f3 req-ba706262-3cd2-4287-89f2-3b5c01bcbeba tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] 10.222.0.62 "GET /v2.0/security-groups?id=8af4439c-b905-435b-836a-90c7f9007b51&id=d7d845a2-937c-4f26-ac5a-1b178146b05e&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0400596 May 25 17:05:11.911000 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-76a22108-8ba6-4fac-bcb8-e514a2ce5af7 req-17a9c385-2ea4-46d5-ac2c-37fa3f4047ec tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:05:11.912474 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-76a22108-8ba6-4fac-bcb8-e514a2ce5af7 req-17a9c385-2ea4-46d5-ac2c-37fa3f4047ec tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/ports?device_id=3ead96ee-e427-4e87-9879-a1cdf303f894 HTTP/1.1" status: 200 len: 944 time: 0.1767192 May 25 17:05:11.957014 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-76a22108-8ba6-4fac-bcb8-e514a2ce5af7 req-4bc8a679-d899-4b15-a505-47e18347a9dd tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/security-groups?id=fdd3b3f1-a2cb-4432-9874-c1d04f64207b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0380003 May 25 17:05:12.110766 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.wsgi [-] (91829) accepted ('10.222.0.62', 35142) {{(pid=91829) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:05:12.223653 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-ba110ad2-985a-4677-8213-9af3702b6f7a req-a4785856-d691-42fb-9fd8-ca2401849623 service neutron] 10.222.0.62 "GET /v2.0/ports?device_id=3ead96ee-e427-4e87-9879-a1cdf303f894&fields=id&fields=resource_request HTTP/1.1" status: 200 len: 255 time: 0.1117039 May 25 17:05:12.806452 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8cee7e28-352f-40a3-9084-1ee8b36f4a20 req-f4027960-9e33-493a-9e54-9ef2c86e8058 tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:05:12.807886 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-8cee7e28-352f-40a3-9084-1ee8b36f4a20 req-f4027960-9e33-493a-9e54-9ef2c86e8058 tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] 10.222.0.62 "GET /v2.0/ports?device_id=4413fd77-4f3e-40c8-b7ee-77d416cd7667 HTTP/1.1" status: 200 len: 985 time: 0.0819054 May 25 17:05:12.854620 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-8cee7e28-352f-40a3-9084-1ee8b36f4a20 req-a0b16dd7-400a-421a-bfbc-825b878399f5 tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] 10.222.0.62 "GET /v2.0/security-groups?id=8af4439c-b905-435b-836a-90c7f9007b51&id=d7d845a2-937c-4f26-ac5a-1b178146b05e&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0408566 May 25 17:05:12.950438 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.rpc [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Device b7d643d2-c7f2-4e49-8125-5c5ec0b9d463 no longer exists at agent hyperv_hv-cinder-79049 {{(pid=91831) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 25 17:05:13.149378 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-30c391d4-4651-4389-8a38-47c13da05262 req-f75c0000-65da-4990-9c81-04d84093e4fb tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:05:13.150980 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-30c391d4-4651-4389-8a38-47c13da05262 req-f75c0000-65da-4990-9c81-04d84093e4fb tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/ports?device_id=3ead96ee-e427-4e87-9879-a1cdf303f894 HTTP/1.1" status: 200 len: 944 time: 0.0778916 May 25 17:05:13.199061 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-30c391d4-4651-4389-8a38-47c13da05262 req-2d0ab487-961f-4c0e-b6d0-c2a16b06c067 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/security-groups?id=fdd3b3f1-a2cb-4432-9874-c1d04f64207b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0423996 May 25 17:05:14.051831 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c1d86f2f-f7d9-463b-962a-93caf963479b req-661a93ca-c80d-45dd-bdd7-486c12bf88d2 tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:05:14.053288 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-c1d86f2f-f7d9-463b-962a-93caf963479b req-661a93ca-c80d-45dd-bdd7-486c12bf88d2 tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] 10.222.0.62 "GET /v2.0/ports?device_id=4413fd77-4f3e-40c8-b7ee-77d416cd7667 HTTP/1.1" status: 200 len: 985 time: 0.0870862 May 25 17:05:14.099871 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-c1d86f2f-f7d9-463b-962a-93caf963479b req-4584ecf3-9e84-4779-a84f-1e754b27d1b6 tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] 10.222.0.62 "GET /v2.0/security-groups?id=8af4439c-b905-435b-836a-90c7f9007b51&id=d7d845a2-937c-4f26-ac5a-1b178146b05e&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0404146 May 25 17:05:14.393842 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-67a00b94-e571-4622-b7be-03f676da0b1d req-1ec0a8d0-20aa-4a45-8c5e-2539d6d80767 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:05:14.395309 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-67a00b94-e571-4622-b7be-03f676da0b1d req-1ec0a8d0-20aa-4a45-8c5e-2539d6d80767 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/ports?device_id=3ead96ee-e427-4e87-9879-a1cdf303f894 HTTP/1.1" status: 200 len: 944 time: 0.0845423 May 25 17:05:14.439647 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-67a00b94-e571-4622-b7be-03f676da0b1d req-d3a39b6a-788b-4d73-abea-4f5fd00b6241 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/security-groups?id=fdd3b3f1-a2cb-4432-9874-c1d04f64207b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0378628 May 25 17:05:14.664657 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ba110ad2-985a-4677-8213-9af3702b6f7a req-edb425dd-de66-4981-a6cc-717fb5551a35 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:05:14.666072 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-ba110ad2-985a-4677-8213-9af3702b6f7a req-edb425dd-de66-4981-a6cc-717fb5551a35 service neutron] 10.222.0.32 "GET /v2.0/ports?device_id=3ead96ee-e427-4e87-9879-a1cdf303f894&tenant_id=bbb9e99759bc47d08005f3b1e036a6cf HTTP/1.1" status: 200 len: 1097 time: 0.0710695 May 25 17:05:14.762974 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ba110ad2-985a-4677-8213-9af3702b6f7a req-4d809b7a-e302-4295-83ec-2c1d577873ac service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:05:14.764520 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-ba110ad2-985a-4677-8213-9af3702b6f7a req-4d809b7a-e302-4295-83ec-2c1d577873ac service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=bbb9e99759bc47d08005f3b1e036a6cf&device_id=3ead96ee-e427-4e87-9879-a1cdf303f894 HTTP/1.1" status: 200 len: 1097 time: 0.0758760 May 25 17:05:14.898118 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ba110ad2-985a-4677-8213-9af3702b6f7a req-122e544b-587c-478d-979b-3a8ec9bbdf04 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:05:14.899578 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-ba110ad2-985a-4677-8213-9af3702b6f7a req-122e544b-587c-478d-979b-3a8ec9bbdf04 service neutron] 10.222.0.32 "GET /v2.0/networks?id=e5be4c6a-143f-474c-a90b-37180778cefe HTTP/1.1" status: 200 len: 917 time: 0.1287293 May 25 17:05:15.012537 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-ba110ad2-985a-4677-8213-9af3702b6f7a req-5e920cd9-81f1-456f-b363-1272ff0a44e8 service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=b7d643d2-c7f2-4e49-8125-5c5ec0b9d463 HTTP/1.1" status: 200 len: 1000 time: 0.1064689 May 25 17:05:15.076865 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ba110ad2-985a-4677-8213-9af3702b6f7a req-29557b1d-5a60-49c4-98ba-4ad7ec9eee6d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:05:15.078326 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-ba110ad2-985a-4677-8213-9af3702b6f7a req-29557b1d-5a60-49c4-98ba-4ad7ec9eee6d service neutron] 10.222.0.32 "GET /v2.0/subnets?id=6e6b5897-e23d-4281-96cb-a6fdf9b68134 HTTP/1.1" status: 200 len: 855 time: 0.0595160 May 25 17:05:15.168385 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ba110ad2-985a-4677-8213-9af3702b6f7a req-c1968353-73a1-48f5-8b25-4b38d3de97c8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:05:15.170085 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-ba110ad2-985a-4677-8213-9af3702b6f7a req-c1968353-73a1-48f5-8b25-4b38d3de97c8 service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=e5be4c6a-143f-474c-a90b-37180778cefe&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0850003 May 25 17:05:15.376635 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-ba110ad2-985a-4677-8213-9af3702b6f7a req-de680679-60bd-4475-960e-20cbc9bf377c service neutron] 10.222.0.32 "GET /v2.0/networks/e5be4c6a-143f-474c-a90b-37180778cefe?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1970530 May 25 17:05:15.388299 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5a684080-b69f-4b65-ae9a-13cf8e9bfc9b req-5370cbbb-bfd8-46de-b4cb-6d8a7a1b4f10 tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:05:15.389653 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-5a684080-b69f-4b65-ae9a-13cf8e9bfc9b req-5370cbbb-bfd8-46de-b4cb-6d8a7a1b4f10 tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] 10.222.0.62 "GET /v2.0/ports?device_id=4413fd77-4f3e-40c8-b7ee-77d416cd7667 HTTP/1.1" status: 200 len: 985 time: 0.1317127 May 25 17:05:15.522371 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-5a684080-b69f-4b65-ae9a-13cf8e9bfc9b req-e30fdf8d-1abb-4512-9c66-a0e4fda02911 tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] 10.222.0.62 "GET /v2.0/security-groups?id=8af4439c-b905-435b-836a-90c7f9007b51&id=d7d845a2-937c-4f26-ac5a-1b178146b05e&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.1143191 May 25 17:05:15.609510 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-ba110ad2-985a-4677-8213-9af3702b6f7a req-18c70e3a-eb36-4ec9-a014-7c18fb894956 service neutron] 10.222.0.32 "GET /v2.0/networks/e5be4c6a-143f-474c-a90b-37180778cefe?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2187297 May 25 17:05:15.650439 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4ca423ae-46a0-4958-a3e3-645185646bba req-270cc693-d472-44f6-8df3-3e50acc7ff8d tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:05:15.654378 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-4ca423ae-46a0-4958-a3e3-645185646bba req-270cc693-d472-44f6-8df3-3e50acc7ff8d tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/ports?device_id=3ead96ee-e427-4e87-9879-a1cdf303f894 HTTP/1.1" status: 200 len: 944 time: 0.0933390 May 25 17:05:15.697121 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-4ca423ae-46a0-4958-a3e3-645185646bba req-3baeebd2-b2fd-469e-acb9-b7688be07315 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/security-groups?id=fdd3b3f1-a2cb-4432-9874-c1d04f64207b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0391130 May 25 17:05:16.750455 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3c45e679-ffad-43cf-9eb2-4ea977b766d9 req-a4b2624b-3742-4ccc-af38-4565f17e6e02 tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:05:16.752485 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-3c45e679-ffad-43cf-9eb2-4ea977b766d9 req-a4b2624b-3742-4ccc-af38-4565f17e6e02 tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] 10.222.0.62 "GET /v2.0/ports?device_id=4413fd77-4f3e-40c8-b7ee-77d416cd7667 HTTP/1.1" status: 200 len: 985 time: 0.1073308 May 25 17:05:16.801335 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-3c45e679-ffad-43cf-9eb2-4ea977b766d9 req-6a6e5dc4-d8c9-40f5-b61b-68f3e04bdfa8 tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] 10.222.0.62 "GET /v2.0/security-groups?id=8af4439c-b905-435b-836a-90c7f9007b51&id=d7d845a2-937c-4f26-ac5a-1b178146b05e&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0412481 May 25 17:05:17.132863 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4370e498-50fd-4cdf-85ef-67b320253c89 req-fe09463c-06c1-4134-a997-da52a16840d7 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:05:17.134338 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-4370e498-50fd-4cdf-85ef-67b320253c89 req-fe09463c-06c1-4134-a997-da52a16840d7 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/ports?device_id=3ead96ee-e427-4e87-9879-a1cdf303f894 HTTP/1.1" status: 200 len: 944 time: 0.1975584 May 25 17:05:17.185872 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-4370e498-50fd-4cdf-85ef-67b320253c89 req-abd08157-0d76-4a90-bcea-b862af180dd8 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/security-groups?id=fdd3b3f1-a2cb-4432-9874-c1d04f64207b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0458395 May 25 17:05:18.008948 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2e973bd4-1221-45a7-89d9-20b63ab2a1ce req-78b9a7fd-187d-47c9-84fb-251073c1901b tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:05:18.010396 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-2e973bd4-1221-45a7-89d9-20b63ab2a1ce req-78b9a7fd-187d-47c9-84fb-251073c1901b tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] 10.222.0.62 "GET /v2.0/ports?device_id=4413fd77-4f3e-40c8-b7ee-77d416cd7667 HTTP/1.1" status: 200 len: 985 time: 0.0784178 May 25 17:05:18.061049 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-2e973bd4-1221-45a7-89d9-20b63ab2a1ce req-f3dfcf38-c0dc-4cfa-a655-0557dde7ffdb tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] 10.222.0.62 "GET /v2.0/security-groups?id=8af4439c-b905-435b-836a-90c7f9007b51&id=d7d845a2-937c-4f26-ac5a-1b178146b05e&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0447001 May 25 17:05:18.391948 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c031ba12-f68c-4f1c-8414-38138caa2b13 req-99ab040b-0c24-4065-8adc-09a80ab10362 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:05:18.393381 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-c031ba12-f68c-4f1c-8414-38138caa2b13 req-99ab040b-0c24-4065-8adc-09a80ab10362 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/ports?device_id=3ead96ee-e427-4e87-9879-a1cdf303f894 HTTP/1.1" status: 200 len: 944 time: 0.0845900 May 25 17:05:18.439873 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-c031ba12-f68c-4f1c-8414-38138caa2b13 req-fa302883-c750-437d-8665-2c4767442c91 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/security-groups?id=fdd3b3f1-a2cb-4432-9874-c1d04f64207b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0400856 May 25 17:05:19.258937 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-783f2ff2-c37f-499a-aaf3-e98bc0c4606f req-1208c5cd-3830-46b8-8928-20152621b814 tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:05:19.260383 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-783f2ff2-c37f-499a-aaf3-e98bc0c4606f req-1208c5cd-3830-46b8-8928-20152621b814 tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] 10.222.0.62 "GET /v2.0/ports?device_id=4413fd77-4f3e-40c8-b7ee-77d416cd7667 HTTP/1.1" status: 200 len: 985 time: 0.0934441 May 25 17:05:19.306049 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-783f2ff2-c37f-499a-aaf3-e98bc0c4606f req-0ba14aa5-956c-4dca-ad98-0d077724a123 tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] 10.222.0.62 "GET /v2.0/security-groups?id=8af4439c-b905-435b-836a-90c7f9007b51&id=d7d845a2-937c-4f26-ac5a-1b178146b05e&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0399249 May 25 17:05:19.628565 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0cd92d7e-f53b-4669-ac0c-bf02e08f347c req-cb7aa104-5366-45b8-bf6e-d00f3d9c3a07 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:05:19.629901 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-0cd92d7e-f53b-4669-ac0c-bf02e08f347c req-cb7aa104-5366-45b8-bf6e-d00f3d9c3a07 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/ports?device_id=3ead96ee-e427-4e87-9879-a1cdf303f894 HTTP/1.1" status: 200 len: 944 time: 0.0788884 May 25 17:05:19.672728 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-0cd92d7e-f53b-4669-ac0c-bf02e08f347c req-0c28b04a-de58-49a3-8138-d8a63f6447af tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/security-groups?id=fdd3b3f1-a2cb-4432-9874-c1d04f64207b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0372162 May 25 17:05:20.505181 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a7b176bf-7228-4684-b214-35f4c3faf37c req-7ce428bb-b639-42b9-afec-2cd38c0e0efa tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:05:20.507350 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-a7b176bf-7228-4684-b214-35f4c3faf37c req-7ce428bb-b639-42b9-afec-2cd38c0e0efa tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] 10.222.0.62 "GET /v2.0/ports?device_id=4413fd77-4f3e-40c8-b7ee-77d416cd7667 HTTP/1.1" status: 200 len: 985 time: 0.0855417 May 25 17:05:20.560368 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-a7b176bf-7228-4684-b214-35f4c3faf37c req-9d7ef65c-19f8-45a9-8a22-c4ae706c0116 tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] 10.222.0.62 "GET /v2.0/security-groups?id=8af4439c-b905-435b-836a-90c7f9007b51&id=d7d845a2-937c-4f26-ac5a-1b178146b05e&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0456126 May 25 17:05:20.877402 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c34a20fa-7a84-43a6-8365-8cc96f59d53b req-5c1a1e2a-4862-48a0-b7cb-d1ce2e6772f6 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:05:20.879111 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-c34a20fa-7a84-43a6-8365-8cc96f59d53b req-5c1a1e2a-4862-48a0-b7cb-d1ce2e6772f6 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/ports?device_id=3ead96ee-e427-4e87-9879-a1cdf303f894 HTTP/1.1" status: 200 len: 944 time: 0.0906429 May 25 17:05:20.927221 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-c34a20fa-7a84-43a6-8365-8cc96f59d53b req-93d0de85-4f90-4536-b2fa-4405bf8b0ffc tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/security-groups?id=fdd3b3f1-a2cb-4432-9874-c1d04f64207b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0414245 May 25 17:05:21.757138 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f7f4a112-5960-415a-8ecd-c6dc20a827b9 req-a98b54bc-9f3b-436c-97bf-41345a094d51 tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:05:21.758655 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-f7f4a112-5960-415a-8ecd-c6dc20a827b9 req-a98b54bc-9f3b-436c-97bf-41345a094d51 tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] 10.222.0.62 "GET /v2.0/ports?device_id=4413fd77-4f3e-40c8-b7ee-77d416cd7667 HTTP/1.1" status: 200 len: 985 time: 0.0825088 May 25 17:05:21.823439 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-f7f4a112-5960-415a-8ecd-c6dc20a827b9 req-4fd7ecfc-aa54-41f9-bb4c-60007aeaec34 tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] 10.222.0.62 "GET /v2.0/security-groups?id=8af4439c-b905-435b-836a-90c7f9007b51&id=d7d845a2-937c-4f26-ac5a-1b178146b05e&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0489876 May 25 17:05:22.124633 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cf4c0fa9-dcf5-46da-a9b5-9b88a3f2ccc7 req-ee03bbfd-dd00-485c-988f-e0ba04382564 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:05:22.126127 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-cf4c0fa9-dcf5-46da-a9b5-9b88a3f2ccc7 req-ee03bbfd-dd00-485c-988f-e0ba04382564 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/ports?device_id=3ead96ee-e427-4e87-9879-a1cdf303f894 HTTP/1.1" status: 200 len: 944 time: 0.0834661 May 25 17:05:22.190457 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-cf4c0fa9-dcf5-46da-a9b5-9b88a3f2ccc7 req-79dffe43-db64-4641-b62f-a3a746bc23a9 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/security-groups?id=fdd3b3f1-a2cb-4432-9874-c1d04f64207b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0587027 May 25 17:05:23.026704 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-917ecf34-6c2a-483d-9824-3b60e7fcb01b req-c8be497f-d5a9-4988-8fd5-5882d3734d72 tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:05:23.028198 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-917ecf34-6c2a-483d-9824-3b60e7fcb01b req-c8be497f-d5a9-4988-8fd5-5882d3734d72 tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] 10.222.0.62 "GET /v2.0/ports?device_id=4413fd77-4f3e-40c8-b7ee-77d416cd7667 HTTP/1.1" status: 200 len: 985 time: 0.1012208 May 25 17:05:23.074399 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-917ecf34-6c2a-483d-9824-3b60e7fcb01b req-eec21318-3deb-4bbb-b64c-d3dde6fdea10 tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] 10.222.0.62 "GET /v2.0/security-groups?id=8af4439c-b905-435b-836a-90c7f9007b51&id=d7d845a2-937c-4f26-ac5a-1b178146b05e&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0404644 May 25 17:05:23.398995 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6a879447-3150-4bb2-92b3-b50e4a4f190d req-f66d8500-cb7c-4063-9eca-8804992ffe6e tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:05:23.400419 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-6a879447-3150-4bb2-92b3-b50e4a4f190d req-f66d8500-cb7c-4063-9eca-8804992ffe6e tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/ports?device_id=3ead96ee-e427-4e87-9879-a1cdf303f894 HTTP/1.1" status: 200 len: 944 time: 0.0912673 May 25 17:05:23.443147 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-6a879447-3150-4bb2-92b3-b50e4a4f190d req-44360b7b-d102-4b29-967d-5a9d4841f42b tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/security-groups?id=fdd3b3f1-a2cb-4432-9874-c1d04f64207b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0371270 May 25 17:05:24.272387 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ed6ff363-8402-4fcf-b9be-0cd601cb72ff req-d12b1222-4b1e-4c5a-b0ee-e1fe9cf34236 tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:05:24.273810 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-ed6ff363-8402-4fcf-b9be-0cd601cb72ff req-d12b1222-4b1e-4c5a-b0ee-e1fe9cf34236 tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] 10.222.0.62 "GET /v2.0/ports?device_id=4413fd77-4f3e-40c8-b7ee-77d416cd7667 HTTP/1.1" status: 200 len: 985 time: 0.0783765 May 25 17:05:24.322508 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-ed6ff363-8402-4fcf-b9be-0cd601cb72ff req-ea3f2c00-1048-4bea-98ee-d1cf30c4fda9 tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] 10.222.0.62 "GET /v2.0/security-groups?id=8af4439c-b905-435b-836a-90c7f9007b51&id=d7d845a2-937c-4f26-ac5a-1b178146b05e&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0428510 May 25 17:05:24.662820 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2c3d41c1-ff46-4459-bfd6-84c020680e8c req-5354dc9f-583d-4f54-a92d-1aea7244dd39 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:05:24.664837 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-2c3d41c1-ff46-4459-bfd6-84c020680e8c req-5354dc9f-583d-4f54-a92d-1aea7244dd39 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/ports?device_id=3ead96ee-e427-4e87-9879-a1cdf303f894 HTTP/1.1" status: 200 len: 944 time: 0.0946367 May 25 17:05:24.709134 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-2c3d41c1-ff46-4459-bfd6-84c020680e8c req-ea90d9c0-fb59-4505-8956-eb7a9830c745 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/security-groups?id=fdd3b3f1-a2cb-4432-9874-c1d04f64207b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0387032 May 25 17:05:25.295782 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-dc42ff27-4cb1-44f7-96a4-d956a313a8d5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:05:25.511921 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c97d74e3-d1aa-4b9c-b1aa-98b65ae5082a req-06539eb6-dcd2-4251-9ead-24bd2a54db65 tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:05:25.513352 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-c97d74e3-d1aa-4b9c-b1aa-98b65ae5082a req-06539eb6-dcd2-4251-9ead-24bd2a54db65 tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] 10.222.0.62 "GET /v2.0/ports?device_id=4413fd77-4f3e-40c8-b7ee-77d416cd7667 HTTP/1.1" status: 200 len: 985 time: 0.0838866 May 25 17:05:25.562070 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-c97d74e3-d1aa-4b9c-b1aa-98b65ae5082a req-4bc47f51-c13d-4f8c-8782-a60d27d45e54 tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] 10.222.0.62 "GET /v2.0/security-groups?id=8af4439c-b905-435b-836a-90c7f9007b51&id=d7d845a2-937c-4f26-ac5a-1b178146b05e&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0429392 May 25 17:05:25.915803 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-53f757ec-6da6-4f3f-a9dc-cb731a95c33a req-f39d5e5f-4d96-4429-b74e-37f55cfde956 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:05:25.917382 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-53f757ec-6da6-4f3f-a9dc-cb731a95c33a req-f39d5e5f-4d96-4429-b74e-37f55cfde956 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/ports?device_id=3ead96ee-e427-4e87-9879-a1cdf303f894 HTTP/1.1" status: 200 len: 944 time: 0.0913546 May 25 17:05:25.966269 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-53f757ec-6da6-4f3f-a9dc-cb731a95c33a req-1c073e9c-9e82-4324-887d-4902ce2fd3b2 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/security-groups?id=fdd3b3f1-a2cb-4432-9874-c1d04f64207b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0429759 May 25 17:05:26.847049 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1c2a3dc1-290f-4c65-af8d-5086ecb3b92c req-7abd1463-cc4d-432e-b728-46ae59a80b80 tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:05:26.848502 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-1c2a3dc1-290f-4c65-af8d-5086ecb3b92c req-7abd1463-cc4d-432e-b728-46ae59a80b80 tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] 10.222.0.62 "GET /v2.0/ports?device_id=4413fd77-4f3e-40c8-b7ee-77d416cd7667 HTTP/1.1" status: 200 len: 985 time: 0.0859404 May 25 17:05:26.897232 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-1c2a3dc1-290f-4c65-af8d-5086ecb3b92c req-10a38121-e2fd-433c-a371-62db3d98c1e4 tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] 10.222.0.62 "GET /v2.0/security-groups?id=8af4439c-b905-435b-836a-90c7f9007b51&id=d7d845a2-937c-4f26-ac5a-1b178146b05e&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0422018 May 25 17:05:27.072645 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f6eeeae2-2252-467a-81c1-0677e7e83044 req-dacd30ad-3048-4a82-81d2-2897ba45b0b9 tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:05:27.074214 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-f6eeeae2-2252-467a-81c1-0677e7e83044 req-dacd30ad-3048-4a82-81d2-2897ba45b0b9 tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] 10.222.0.62 "GET /v2.0/ports?device_id=482f4d0c-0df9-4de7-9c75-b28c728be580 HTTP/1.1" status: 200 len: 946 time: 0.0796323 May 25 17:05:27.127976 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-f6eeeae2-2252-467a-81c1-0677e7e83044 req-8a29ff40-462b-456d-8bab-b4c85eec5d11 tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] 10.222.0.62 "GET /v2.0/security-groups?id=1468f899-860c-4905-aee3-f13adc83d0a4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0482485 May 25 17:05:27.334015 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b33f4e0e-7dde-4421-ae85-a87f04fcb282 req-f6ff9d2b-b41f-42e6-9d06-23ac0376b10a tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:05:27.339577 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-b33f4e0e-7dde-4421-ae85-a87f04fcb282 req-f6ff9d2b-b41f-42e6-9d06-23ac0376b10a tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/ports?device_id=3ead96ee-e427-4e87-9879-a1cdf303f894 HTTP/1.1" status: 200 len: 944 time: 0.1013539 May 25 17:05:27.395891 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-b33f4e0e-7dde-4421-ae85-a87f04fcb282 req-7e932db3-b7f7-4b8c-a5b6-8abec2588dee tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/security-groups?id=fdd3b3f1-a2cb-4432-9874-c1d04f64207b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0525346 May 25 17:05:27.714177 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-1a361009-4b29-49ff-b3ab-ff5b46995405 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:05:27.892280 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:05:28.087722 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-34c0522b-fd0f-410b-ab91-d3382dc5f5f8 req-5188b29d-6318-4ea6-9096-de62ae8e7f92 tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:05:28.089173 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-34c0522b-fd0f-410b-ab91-d3382dc5f5f8 req-5188b29d-6318-4ea6-9096-de62ae8e7f92 tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] 10.222.0.62 "GET /v2.0/ports?device_id=4413fd77-4f3e-40c8-b7ee-77d416cd7667 HTTP/1.1" status: 200 len: 985 time: 0.0843182 May 25 17:05:28.136329 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-34c0522b-fd0f-410b-ab91-d3382dc5f5f8 req-a22e7012-05f7-4812-9e65-19d2f5066d1a tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] 10.222.0.62 "GET /v2.0/security-groups?id=8af4439c-b905-435b-836a-90c7f9007b51&id=d7d845a2-937c-4f26-ac5a-1b178146b05e&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0413170 May 25 17:05:28.326833 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4677210c-9187-4492-8c53-51f7afadfd8f req-e7118808-7ed2-46ed-91d2-87e7ef79cd8d tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:05:28.328369 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-4677210c-9187-4492-8c53-51f7afadfd8f req-e7118808-7ed2-46ed-91d2-87e7ef79cd8d tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] 10.222.0.62 "GET /v2.0/ports?device_id=482f4d0c-0df9-4de7-9c75-b28c728be580 HTTP/1.1" status: 200 len: 946 time: 0.0898097 May 25 17:05:28.374060 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-4677210c-9187-4492-8c53-51f7afadfd8f req-b074cfa2-7ec3-49e0-aed7-1b798784bb91 tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] 10.222.0.62 "GET /v2.0/security-groups?id=1468f899-860c-4905-aee3-f13adc83d0a4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0399148 May 25 17:05:28.628812 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-0a55eb4a-8b57-4233-84d6-6b423b4ed6db None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:05:28.868351 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-132aac20-1270-4325-a46d-939a21beba81 req-cd692cb2-2bfd-4b8e-9f66-e04878dd8272 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:05:28.869707 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-132aac20-1270-4325-a46d-939a21beba81 req-cd692cb2-2bfd-4b8e-9f66-e04878dd8272 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/ports?device_id=3ead96ee-e427-4e87-9879-a1cdf303f894 HTTP/1.1" status: 200 len: 944 time: 0.1970315 May 25 17:05:29.009728 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-132aac20-1270-4325-a46d-939a21beba81 req-6c48068b-acb0-40d1-8f2c-6b5ecf3f1fc0 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/security-groups?id=fdd3b3f1-a2cb-4432-9874-c1d04f64207b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1343076 May 25 17:05:29.323985 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4a492234-3365-4feb-abc0-c7e8b8b3f251 req-1e62a9c0-2c8a-4a63-99e5-0c7405ddb132 tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:05:29.325478 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-4a492234-3365-4feb-abc0-c7e8b8b3f251 req-1e62a9c0-2c8a-4a63-99e5-0c7405ddb132 tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] 10.222.0.62 "GET /v2.0/ports?device_id=4413fd77-4f3e-40c8-b7ee-77d416cd7667 HTTP/1.1" status: 200 len: 985 time: 0.0809884 May 25 17:05:29.376551 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-4a492234-3365-4feb-abc0-c7e8b8b3f251 req-b3b79d35-d2fe-4d64-809a-3febb668cb30 tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] 10.222.0.62 "GET /v2.0/security-groups?id=8af4439c-b905-435b-836a-90c7f9007b51&id=d7d845a2-937c-4f26-ac5a-1b178146b05e&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0408783 May 25 17:05:29.584243 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e2df9e56-e359-4b21-acf8-d79707818196 req-bbff7d3a-2a47-472a-98b6-8e25df691a5b tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:05:29.586596 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-e2df9e56-e359-4b21-acf8-d79707818196 req-bbff7d3a-2a47-472a-98b6-8e25df691a5b tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] 10.222.0.62 "GET /v2.0/ports?device_id=482f4d0c-0df9-4de7-9c75-b28c728be580 HTTP/1.1" status: 200 len: 946 time: 0.0887921 May 25 17:05:29.631089 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-e2df9e56-e359-4b21-acf8-d79707818196 req-cc589650-7e9e-4992-9e11-68c943908872 tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] 10.222.0.62 "GET /v2.0/security-groups?id=1468f899-860c-4905-aee3-f13adc83d0a4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0387099 May 25 17:05:30.234318 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-57f11b47-1f51-4191-b7c9-af248a48372c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:05:30.247221 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-374a3ed4-f6e8-42c6-b27c-f6cb69c2399a req-8a0c8bf1-6f4d-49ff-82d2-2731db0339cf tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:05:30.248896 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-374a3ed4-f6e8-42c6-b27c-f6cb69c2399a req-8a0c8bf1-6f4d-49ff-82d2-2731db0339cf tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/ports?device_id=3ead96ee-e427-4e87-9879-a1cdf303f894 HTTP/1.1" status: 200 len: 944 time: 0.0911825 May 25 17:05:30.293810 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-374a3ed4-f6e8-42c6-b27c-f6cb69c2399a req-42673315-99b9-4a0b-a3b0-8d255384dea1 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/security-groups?id=fdd3b3f1-a2cb-4432-9874-c1d04f64207b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0391557 May 25 17:05:30.570351 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d7dbfb9b-2684-4256-b85f-6a9b5ce4dd46 req-30ac2074-90b5-4621-bcba-411d5e194de6 tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:05:30.571802 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-d7dbfb9b-2684-4256-b85f-6a9b5ce4dd46 req-30ac2074-90b5-4621-bcba-411d5e194de6 tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] 10.222.0.62 "GET /v2.0/ports?device_id=4413fd77-4f3e-40c8-b7ee-77d416cd7667 HTTP/1.1" status: 200 len: 985 time: 0.0887690 May 25 17:05:30.619125 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-d7dbfb9b-2684-4256-b85f-6a9b5ce4dd46 req-99aba7f7-7eab-4b57-8336-7e36e7f38937 tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] 10.222.0.62 "GET /v2.0/security-groups?id=8af4439c-b905-435b-836a-90c7f9007b51&id=d7d845a2-937c-4f26-ac5a-1b178146b05e&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0413172 May 25 17:05:30.823068 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6a297d2e-0580-41ca-b179-9cd5fe3f4717 req-0dd6ee7a-56b7-4dda-88b7-654aabb09e9d tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:05:30.824509 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-6a297d2e-0580-41ca-b179-9cd5fe3f4717 req-0dd6ee7a-56b7-4dda-88b7-654aabb09e9d tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] 10.222.0.62 "GET /v2.0/ports?device_id=482f4d0c-0df9-4de7-9c75-b28c728be580 HTTP/1.1" status: 200 len: 946 time: 0.0869827 May 25 17:05:30.876918 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-6a297d2e-0580-41ca-b179-9cd5fe3f4717 req-d5ee96ed-6122-4b4f-977e-f8217f7ced92 tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] 10.222.0.62 "GET /v2.0/security-groups?id=1468f899-860c-4905-aee3-f13adc83d0a4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0465989 May 25 17:05:31.153199 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.db.agents_db [None req-504cb04f-4543-46c1-8db7-349e21db7634 None None] Agent healthcheck: found 6 active agents {{(pid=91832) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} May 25 17:05:31.195638 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.wsgi [-] (91829) accepted ('10.222.0.62', 35330) {{(pid=91829) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:05:31.316318 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-fc782629-890d-4dc0-a600-8e972f9b03bd admin admin] Notify callbacks [] for security_group, before_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:05:31.333235 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.quota.driver [None req-fc782629-890d-4dc0-a600-8e972f9b03bd admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91829) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 17:05:31.337183 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.quota.resource [None req-fc782629-890d-4dc0-a600-8e972f9b03bd admin admin] Usage tracker for resource:security_group_rule and tenant:3bd24d316ef94cfcb9a033153b82244b is out of sync, need to count used quota {{(pid=91829) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 17:05:31.340191 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.quota.resource [None req-fc782629-890d-4dc0-a600-8e972f9b03bd admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91829) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 17:05:31.347156 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.quota.driver [None req-fc782629-890d-4dc0-a600-8e972f9b03bd admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91829) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 17:05:31.499341 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-fc782629-890d-4dc0-a600-8e972f9b03bd admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:05:31.505054 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-fc782629-890d-4dc0-a600-8e972f9b03bd admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-640836'] for security_group, after_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:05:31.514501 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-0b42170a-8b4a-4914-90bf-183ba4a7a921 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:05:31.565794 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fc782629-890d-4dc0-a600-8e972f9b03bd admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=f265613b-61c9-42f7-b30c-71857a0f5eff,revision_number=1']} {{(pid=91829) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:05:31.571991 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [None req-fc782629-890d-4dc0-a600-8e972f9b03bd admin admin] 10.222.0.62 "GET /v2.0/security-groups?tenant_id=3bd24d316ef94cfcb9a033153b82244b&name=default HTTP/1.1" status: 200 len: 2979 time: 0.3753583 May 25 17:05:31.574932 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.wsgi [-] (91830) accepted ('10.222.0.62', 35338) {{(pid=91830) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:05:31.579282 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fc782629-890d-4dc0-a600-8e972f9b03bd admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91829) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:05:31.579656 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fc782629-890d-4dc0-a600-8e972f9b03bd admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91829) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:05:31.580019 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fc782629-890d-4dc0-a600-8e972f9b03bd admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91829) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:05:31.580375 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fc782629-890d-4dc0-a600-8e972f9b03bd admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91829) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:05:31.580728 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fc782629-890d-4dc0-a600-8e972f9b03bd admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91829) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:05:31.581082 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fc782629-890d-4dc0-a600-8e972f9b03bd admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91829) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:05:31.581426 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fc782629-890d-4dc0-a600-8e972f9b03bd admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91829) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:05:31.581772 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fc782629-890d-4dc0-a600-8e972f9b03bd admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91829) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:05:31.582145 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fc782629-890d-4dc0-a600-8e972f9b03bd admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91829) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:05:31.582491 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fc782629-890d-4dc0-a600-8e972f9b03bd admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91829) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:05:31.582833 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fc782629-890d-4dc0-a600-8e972f9b03bd admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91829) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:05:31.583173 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fc782629-890d-4dc0-a600-8e972f9b03bd admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91829) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:05:31.588207 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-fc782629-890d-4dc0-a600-8e972f9b03bd admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.075s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:05:31.595925 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9242b9d4-819b-4885-ac75-b19016bcc141 req-4697b288-679b-478d-a331-817495ba1ac4 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:05:31.597375 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-9242b9d4-819b-4885-ac75-b19016bcc141 req-4697b288-679b-478d-a331-817495ba1ac4 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/ports?device_id=3ead96ee-e427-4e87-9879-a1cdf303f894 HTTP/1.1" status: 200 len: 944 time: 0.1835418 May 25 17:05:31.641732 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-78a114a0-2333-413d-a2dc-177cccc3d0f8 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:05:31.645984 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-9242b9d4-819b-4885-ac75-b19016bcc141 req-fbb663a1-342b-4845-a39d-4f19fd7b857c tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/security-groups?id=fdd3b3f1-a2cb-4432-9874-c1d04f64207b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0409639 May 25 17:05:31.669897 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-78a114a0-2333-413d-a2dc-177cccc3d0f8 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:05:31.731525 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-78a114a0-2333-413d-a2dc-177cccc3d0f8 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-640836'] for security_group, after_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:05:31.736441 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-8a2f536a-757e-4002-a420-a17930e3b790 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:05:31.748706 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-78a114a0-2333-413d-a2dc-177cccc3d0f8 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=f265613b-61c9-42f7-b30c-71857a0f5eff,revision_number=None']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:05:31.757737 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-78a114a0-2333-413d-a2dc-177cccc3d0f8 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91830) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:05:31.758142 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-78a114a0-2333-413d-a2dc-177cccc3d0f8 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91830) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:05:31.758506 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-78a114a0-2333-413d-a2dc-177cccc3d0f8 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91830) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:05:31.758867 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-78a114a0-2333-413d-a2dc-177cccc3d0f8 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91830) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:05:31.759222 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-78a114a0-2333-413d-a2dc-177cccc3d0f8 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91830) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:05:31.759572 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-78a114a0-2333-413d-a2dc-177cccc3d0f8 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91830) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:05:31.759920 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-78a114a0-2333-413d-a2dc-177cccc3d0f8 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91830) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:05:31.760268 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-78a114a0-2333-413d-a2dc-177cccc3d0f8 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91830) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:05:31.760613 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-78a114a0-2333-413d-a2dc-177cccc3d0f8 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91830) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:05:31.760957 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-78a114a0-2333-413d-a2dc-177cccc3d0f8 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91830) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:05:31.761302 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-78a114a0-2333-413d-a2dc-177cccc3d0f8 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91830) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:05:31.761641 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-78a114a0-2333-413d-a2dc-177cccc3d0f8 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91830) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:05:31.764551 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-78a114a0-2333-413d-a2dc-177cccc3d0f8 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:05:31.768345 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [None req-78a114a0-2333-413d-a2dc-177cccc3d0f8 admin admin] 10.222.0.62 "DELETE /v2.0/security-groups/f265613b-61c9-42f7-b30c-71857a0f5eff HTTP/1.1" status: 204 len: 168 time: 0.1923504 May 25 17:05:31.769276 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-78a114a0-2333-413d-a2dc-177cccc3d0f8 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.033s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:05:31.830093 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e03fa0ec-858b-4e63-af8e-da792bbda699 req-33a772f9-2141-4b98-8d9a-f83c49743d34 tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:05:31.831552 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-e03fa0ec-858b-4e63-af8e-da792bbda699 req-33a772f9-2141-4b98-8d9a-f83c49743d34 tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] 10.222.0.62 "GET /v2.0/ports?device_id=4413fd77-4f3e-40c8-b7ee-77d416cd7667 HTTP/1.1" status: 200 len: 985 time: 0.0884700 May 25 17:05:31.885221 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-e03fa0ec-858b-4e63-af8e-da792bbda699 req-5840dbe2-919e-49dc-b3b9-66e5f8c2e0e2 tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] 10.222.0.62 "GET /v2.0/security-groups?id=8af4439c-b905-435b-836a-90c7f9007b51&id=d7d845a2-937c-4f26-ac5a-1b178146b05e&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0474479 May 25 17:05:32.070739 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e1ecb988-5e16-4c95-ac52-a95acb486c94 req-b2ef5d55-9fdd-48f7-88fa-f9a0e8ff0d75 tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:05:32.072198 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-e1ecb988-5e16-4c95-ac52-a95acb486c94 req-b2ef5d55-9fdd-48f7-88fa-f9a0e8ff0d75 tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] 10.222.0.62 "GET /v2.0/ports?device_id=482f4d0c-0df9-4de7-9c75-b28c728be580 HTTP/1.1" status: 200 len: 946 time: 0.0825210 May 25 17:05:32.117023 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-e1ecb988-5e16-4c95-ac52-a95acb486c94 req-19aba720-dd58-41f3-aab8-080a5c19914e tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] 10.222.0.62 "GET /v2.0/security-groups?id=1468f899-860c-4905-aee3-f13adc83d0a4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0385458 May 25 17:05:32.838318 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-858e6237-5f9b-4d6b-857c-1eba0624ca4e req-7ef120bc-58ff-4df4-ac11-4b9247848554 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:05:32.839873 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-858e6237-5f9b-4d6b-857c-1eba0624ca4e req-7ef120bc-58ff-4df4-ac11-4b9247848554 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/ports?device_id=3ead96ee-e427-4e87-9879-a1cdf303f894 HTTP/1.1" status: 200 len: 944 time: 0.0835965 May 25 17:05:32.886052 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-858e6237-5f9b-4d6b-857c-1eba0624ca4e req-660bcd7f-549b-4bd9-bfd1-dcda2c75a26f tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/security-groups?id=fdd3b3f1-a2cb-4432-9874-c1d04f64207b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0395138 May 25 17:05:33.066527 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9ac04dda-66c4-4b17-ad02-aefbf0ebf1ef req-cdf80489-1034-42c9-b60c-e1f79886bb27 tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:05:33.067949 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-9ac04dda-66c4-4b17-ad02-aefbf0ebf1ef req-cdf80489-1034-42c9-b60c-e1f79886bb27 tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] 10.222.0.62 "GET /v2.0/ports?device_id=4413fd77-4f3e-40c8-b7ee-77d416cd7667 HTTP/1.1" status: 200 len: 985 time: 0.0792828 May 25 17:05:33.113215 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-9ac04dda-66c4-4b17-ad02-aefbf0ebf1ef req-eb27c569-24ce-499e-ac19-d46d4dd5786e tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] 10.222.0.62 "GET /v2.0/security-groups?id=8af4439c-b905-435b-836a-90c7f9007b51&id=d7d845a2-937c-4f26-ac5a-1b178146b05e&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0391655 May 25 17:05:33.301901 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c7d354ce-2bcb-45a8-8dd1-d21ae7e0a7fa req-274532d3-1254-4b43-a43e-4d0ec1af5197 tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:05:33.303342 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-c7d354ce-2bcb-45a8-8dd1-d21ae7e0a7fa req-274532d3-1254-4b43-a43e-4d0ec1af5197 tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] 10.222.0.62 "GET /v2.0/ports?device_id=482f4d0c-0df9-4de7-9c75-b28c728be580 HTTP/1.1" status: 200 len: 946 time: 0.0813277 May 25 17:05:33.346755 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-c7d354ce-2bcb-45a8-8dd1-d21ae7e0a7fa req-26a3bb91-d655-4af1-ad62-d9964d6eff10 tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] 10.222.0.62 "GET /v2.0/security-groups?id=1468f899-860c-4905-aee3-f13adc83d0a4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0367727 May 25 17:05:34.074272 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b765ab7c-ba0b-4ec3-b1b2-7d87fd38b7ff req-6e4cda68-9ea2-43c0-bfb2-30ecc6792df1 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:05:34.075623 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-b765ab7c-ba0b-4ec3-b1b2-7d87fd38b7ff req-6e4cda68-9ea2-43c0-bfb2-30ecc6792df1 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/ports?device_id=3ead96ee-e427-4e87-9879-a1cdf303f894 HTTP/1.1" status: 200 len: 944 time: 0.0780478 May 25 17:05:34.123168 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-b765ab7c-ba0b-4ec3-b1b2-7d87fd38b7ff req-8a6be576-8362-4bb6-964c-fdb8e1ab1ff6 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/security-groups?id=fdd3b3f1-a2cb-4432-9874-c1d04f64207b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0415661 May 25 17:05:34.296903 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-78e38130-cfce-4507-b358-2d9b9f2b4141 req-0a1531ba-c844-4d84-a369-9ef7228af45d tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:05:34.298315 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-78e38130-cfce-4507-b358-2d9b9f2b4141 req-0a1531ba-c844-4d84-a369-9ef7228af45d tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] 10.222.0.62 "GET /v2.0/ports?device_id=4413fd77-4f3e-40c8-b7ee-77d416cd7667 HTTP/1.1" status: 200 len: 985 time: 0.0790339 May 25 17:05:34.343384 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-78e38130-cfce-4507-b358-2d9b9f2b4141 req-7d562a99-c548-4da7-a17f-d8cce6b75c7c tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] 10.222.0.62 "GET /v2.0/security-groups?id=8af4439c-b905-435b-836a-90c7f9007b51&id=d7d845a2-937c-4f26-ac5a-1b178146b05e&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0392933 May 25 17:05:34.537470 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e5b2f788-e8a3-4ea5-9aca-c195706df746 req-defd6f28-a5f2-4cf2-bcbb-0490dd759ecc tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:05:34.539629 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-e5b2f788-e8a3-4ea5-9aca-c195706df746 req-defd6f28-a5f2-4cf2-bcbb-0490dd759ecc tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] 10.222.0.62 "GET /v2.0/ports?device_id=482f4d0c-0df9-4de7-9c75-b28c728be580 HTTP/1.1" status: 200 len: 946 time: 0.0905285 May 25 17:05:34.585772 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-e5b2f788-e8a3-4ea5-9aca-c195706df746 req-0000e529-f9a1-4c50-8e32-91fb6cd526f9 tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] 10.222.0.62 "GET /v2.0/security-groups?id=1468f899-860c-4905-aee3-f13adc83d0a4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0397482 May 25 17:05:35.322554 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-396828ee-1fa8-4f1c-8a08-448d3efd3479 req-df59a32c-19ca-423d-932c-f010a07f8ac2 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:05:35.323976 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-396828ee-1fa8-4f1c-8a08-448d3efd3479 req-df59a32c-19ca-423d-932c-f010a07f8ac2 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/ports?device_id=3ead96ee-e427-4e87-9879-a1cdf303f894 HTTP/1.1" status: 200 len: 944 time: 0.0788772 May 25 17:05:35.367860 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-396828ee-1fa8-4f1c-8a08-448d3efd3479 req-c36e1cef-1cd5-46e0-b9bb-14e4466f09b2 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/security-groups?id=fdd3b3f1-a2cb-4432-9874-c1d04f64207b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0380151 May 25 17:05:35.530806 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2e7951e2-9bd5-4955-a827-c5e9f07cfb1e req-54fa03df-3260-4f1c-a5ee-de62fd7cb555 tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:05:35.532253 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-2e7951e2-9bd5-4955-a827-c5e9f07cfb1e req-54fa03df-3260-4f1c-a5ee-de62fd7cb555 tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] 10.222.0.62 "GET /v2.0/ports?device_id=4413fd77-4f3e-40c8-b7ee-77d416cd7667 HTTP/1.1" status: 200 len: 985 time: 0.0819485 May 25 17:05:35.580568 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-2e7951e2-9bd5-4955-a827-c5e9f07cfb1e req-9fe24230-53a0-43ab-bf5d-33cd017f9687 tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] 10.222.0.62 "GET /v2.0/security-groups?id=8af4439c-b905-435b-836a-90c7f9007b51&id=d7d845a2-937c-4f26-ac5a-1b178146b05e&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0410402 May 25 17:05:36.013476 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7bbe03e5-4eb4-426b-8693-48762e4a31ee req-e9fa6ab3-8058-463e-b7ef-2933603ea69f tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:05:36.014918 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-7bbe03e5-4eb4-426b-8693-48762e4a31ee req-e9fa6ab3-8058-463e-b7ef-2933603ea69f tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] 10.222.0.62 "GET /v2.0/ports?device_id=482f4d0c-0df9-4de7-9c75-b28c728be580 HTTP/1.1" status: 200 len: 946 time: 0.0771565 May 25 17:05:36.058454 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-7bbe03e5-4eb4-426b-8693-48762e4a31ee req-3548ff2a-fc83-4709-9376-aa46c5b257cf tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] 10.222.0.62 "GET /v2.0/security-groups?id=1468f899-860c-4905-aee3-f13adc83d0a4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0379417 May 25 17:05:36.489568 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:05:36.638703 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-45a203c1-9140-463e-8d5a-a2d7dd10b0c3 req-1a556505-36e6-45fd-bc70-baed3ccee0ad tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:05:36.640142 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-45a203c1-9140-463e-8d5a-a2d7dd10b0c3 req-1a556505-36e6-45fd-bc70-baed3ccee0ad tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/ports?device_id=3ead96ee-e427-4e87-9879-a1cdf303f894 HTTP/1.1" status: 200 len: 944 time: 0.1612804 May 25 17:05:36.684945 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-45a203c1-9140-463e-8d5a-a2d7dd10b0c3 req-2f4319db-2ba9-4b5a-9a58-068ac3d4639d tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/security-groups?id=fdd3b3f1-a2cb-4432-9874-c1d04f64207b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0390038 May 25 17:05:36.764923 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-43efdb9c-1449-44d4-a5cb-a440bcb37aee req-e945aabe-ccde-473d-b021-a280b6a01e78 tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:05:36.766387 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-43efdb9c-1449-44d4-a5cb-a440bcb37aee req-e945aabe-ccde-473d-b021-a280b6a01e78 tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] 10.222.0.62 "GET /v2.0/ports?device_id=4413fd77-4f3e-40c8-b7ee-77d416cd7667 HTTP/1.1" status: 200 len: 985 time: 0.0803168 May 25 17:05:36.812043 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-43efdb9c-1449-44d4-a5cb-a440bcb37aee req-934b3755-7cf1-42ef-84f7-2087648f71f5 tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] 10.222.0.62 "GET /v2.0/security-groups?id=8af4439c-b905-435b-836a-90c7f9007b51&id=d7d845a2-937c-4f26-ac5a-1b178146b05e&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0398593 May 25 17:05:37.242835 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-87a104b0-6fa6-4fde-b52d-e868bb86974c req-481a6802-18bd-4841-b6a7-5b079e52ccfe tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:05:37.244262 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-87a104b0-6fa6-4fde-b52d-e868bb86974c req-481a6802-18bd-4841-b6a7-5b079e52ccfe tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] 10.222.0.62 "GET /v2.0/ports?device_id=482f4d0c-0df9-4de7-9c75-b28c728be580 HTTP/1.1" status: 200 len: 946 time: 0.0793567 May 25 17:05:37.288675 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-87a104b0-6fa6-4fde-b52d-e868bb86974c req-fdaef3c2-4ecc-43d1-859a-8139b9cb3c5f tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] 10.222.0.62 "GET /v2.0/security-groups?id=1468f899-860c-4905-aee3-f13adc83d0a4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0386462 May 25 17:05:37.880577 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dcff5d52-68f0-4b19-bc22-04cb7d7b063d req-3899423e-32c2-4623-a738-4e0a1443dd41 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:05:37.882128 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-dcff5d52-68f0-4b19-bc22-04cb7d7b063d req-3899423e-32c2-4623-a738-4e0a1443dd41 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/ports?device_id=3ead96ee-e427-4e87-9879-a1cdf303f894 HTTP/1.1" status: 200 len: 944 time: 0.0856297 May 25 17:05:37.927034 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-dcff5d52-68f0-4b19-bc22-04cb7d7b063d req-1833617a-4076-46c5-9773-b406a5989d5c tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/security-groups?id=fdd3b3f1-a2cb-4432-9874-c1d04f64207b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0392392 May 25 17:05:38.474023 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0100dab7-e263-4694-ad62-85e4d00a5f7e req-cbd84a0e-13cd-4c07-afb1-8ecbcb50fe8f tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:05:38.475979 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-0100dab7-e263-4694-ad62-85e4d00a5f7e req-cbd84a0e-13cd-4c07-afb1-8ecbcb50fe8f tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] 10.222.0.62 "GET /v2.0/ports?device_id=482f4d0c-0df9-4de7-9c75-b28c728be580 HTTP/1.1" status: 200 len: 946 time: 0.0783644 May 25 17:05:38.522540 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-0100dab7-e263-4694-ad62-85e4d00a5f7e req-b81ec986-edb1-4d39-b9a7-72f778011c15 tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] 10.222.0.62 "GET /v2.0/security-groups?id=1468f899-860c-4905-aee3-f13adc83d0a4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0408497 May 25 17:05:39.121519 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-328fd24e-3fed-4e31-b434-923d69d5db57 req-b6850684-a7eb-4542-b030-4af55027dc2e tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:05:39.122980 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-328fd24e-3fed-4e31-b434-923d69d5db57 req-b6850684-a7eb-4542-b030-4af55027dc2e tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/ports?device_id=3ead96ee-e427-4e87-9879-a1cdf303f894 HTTP/1.1" status: 200 len: 944 time: 0.0822563 May 25 17:05:39.166293 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-328fd24e-3fed-4e31-b434-923d69d5db57 req-8f8ab704-d291-4410-95f0-d999405ff3ba tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/security-groups?id=fdd3b3f1-a2cb-4432-9874-c1d04f64207b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0373650 May 25 17:05:39.709033 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d7c9a758-fa94-4f68-a641-75eedab42f46 req-8c191e27-ed14-4092-9183-55c03ec18cba tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:05:39.711010 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-d7c9a758-fa94-4f68-a641-75eedab42f46 req-8c191e27-ed14-4092-9183-55c03ec18cba tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] 10.222.0.62 "GET /v2.0/ports?device_id=482f4d0c-0df9-4de7-9c75-b28c728be580 HTTP/1.1" status: 200 len: 946 time: 0.0820763 May 25 17:05:39.754549 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-d7c9a758-fa94-4f68-a641-75eedab42f46 req-50f4c050-b06e-436f-85dd-f096de6f0ac1 tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] 10.222.0.62 "GET /v2.0/security-groups?id=1468f899-860c-4905-aee3-f13adc83d0a4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0379002 May 25 17:05:40.357659 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b09642e8-9e71-47be-bf28-e0f8f58909ff req-b62262c8-3d7a-44a2-bc28-9a9f30529c28 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:05:40.359057 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-b09642e8-9e71-47be-bf28-e0f8f58909ff req-b62262c8-3d7a-44a2-bc28-9a9f30529c28 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/ports?device_id=3ead96ee-e427-4e87-9879-a1cdf303f894 HTTP/1.1" status: 200 len: 944 time: 0.0784080 May 25 17:05:40.403654 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-b09642e8-9e71-47be-bf28-e0f8f58909ff req-bc31dc69-1cc2-43b4-93f5-5f86ea533b67 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/security-groups?id=fdd3b3f1-a2cb-4432-9874-c1d04f64207b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0388830 May 25 17:05:40.944705 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4beb859f-d759-469a-85ce-506af96918f2 req-88abfa8b-4872-4b08-b92c-d466209cfd36 tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:05:40.946159 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-4beb859f-d759-469a-85ce-506af96918f2 req-88abfa8b-4872-4b08-b92c-d466209cfd36 tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] 10.222.0.62 "GET /v2.0/ports?device_id=482f4d0c-0df9-4de7-9c75-b28c728be580 HTTP/1.1" status: 200 len: 946 time: 0.0833948 May 25 17:05:40.989217 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-4beb859f-d759-469a-85ce-506af96918f2 req-845f6338-359b-484e-a8ba-19283b8c5be5 tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] 10.222.0.62 "GET /v2.0/security-groups?id=1468f899-860c-4905-aee3-f13adc83d0a4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0374868 May 25 17:05:41.588023 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6fee56b8-7c45-4c74-adac-7c88bcc4bc78 req-4ae91c3a-460f-4061-bda0-fe4e293df747 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:05:41.589421 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-6fee56b8-7c45-4c74-adac-7c88bcc4bc78 req-4ae91c3a-460f-4061-bda0-fe4e293df747 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/ports?device_id=3ead96ee-e427-4e87-9879-a1cdf303f894 HTTP/1.1" status: 200 len: 944 time: 0.0770037 May 25 17:05:41.632239 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-6fee56b8-7c45-4c74-adac-7c88bcc4bc78 req-c54f98b4-c32d-47e9-809e-6d492d997ade tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/security-groups?id=fdd3b3f1-a2cb-4432-9874-c1d04f64207b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0373387 May 25 17:05:42.183468 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fc592579-439b-4fb7-acfa-b9619cd4ebf3 req-38c16742-e353-41fe-a36d-d88141f29d5c tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:05:42.184906 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-fc592579-439b-4fb7-acfa-b9619cd4ebf3 req-38c16742-e353-41fe-a36d-d88141f29d5c tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] 10.222.0.62 "GET /v2.0/ports?device_id=482f4d0c-0df9-4de7-9c75-b28c728be580 HTTP/1.1" status: 200 len: 946 time: 0.0816398 May 25 17:05:42.228249 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-fc592579-439b-4fb7-acfa-b9619cd4ebf3 req-0522492c-262c-472f-a4eb-74e8002a4f80 tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] 10.222.0.62 "GET /v2.0/security-groups?id=1468f899-860c-4905-aee3-f13adc83d0a4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0377440 May 25 17:05:42.818910 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dffdcef1-1388-4858-8980-e1ebe6cbef51 req-45bc5ab7-929a-4e15-997f-b7886ee9b37f tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:05:42.820959 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-dffdcef1-1388-4858-8980-e1ebe6cbef51 req-45bc5ab7-929a-4e15-997f-b7886ee9b37f tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/ports?device_id=3ead96ee-e427-4e87-9879-a1cdf303f894 HTTP/1.1" status: 200 len: 944 time: 0.0787401 May 25 17:05:42.868174 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-dffdcef1-1388-4858-8980-e1ebe6cbef51 req-bbb8f6c4-0211-4111-9232-37ed13c28091 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/security-groups?id=fdd3b3f1-a2cb-4432-9874-c1d04f64207b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0415330 May 25 17:05:43.165685 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.rpc [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Device b7d643d2-c7f2-4e49-8125-5c5ec0b9d463 details requested by agent hyperv_hv-cinder-79049 with host hv-cinder-79049 {{(pid=91831) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 25 17:05:43.295137 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.db [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] For port b7d643d2-c7f2-4e49-8125-5c5ec0b9d463, host hv-cinder-79049, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79049',level=0,port_id=b7d643d2-c7f2-4e49-8125-5c5ec0b9d463,segment=NetworkSegment(a8fb0313-938a-4f5e-8ff4-96df8acd943b),segment_id=a8fb0313-938a-4f5e-8ff4-96df8acd943b)] {{(pid=91831) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 17:05:43.311153 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.rpc [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Returning: {'device': 'b7d643d2-c7f2-4e49-8125-5c5ec0b9d463', 'network_id': 'e5be4c6a-143f-474c-a90b-37180778cefe', 'port_id': 'b7d643d2-c7f2-4e49-8125-5c5ec0b9d463', 'mac_address': 'fa:16:3e:a8:69:d8', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 695, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '6e6b5897-e23d-4281-96cb-a6fdf9b68134', 'ip_address': '172.20.0.13'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=91831) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 25 17:05:43.396827 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3832070'] for port, before_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:05:43.413454 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.notifiers.nova [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id b7d643d2-c7f2-4e49-8125-5c5ec0b9d463 {{(pid=91831) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} May 25 17:05:43.417722 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5e0379d5-f1c2-42ba-bd3e-980c154df3fc req-b73032bf-13ad-4805-82ff-79f8841544eb tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:05:43.419500 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-5e0379d5-f1c2-42ba-bd3e-980c154df3fc req-b73032bf-13ad-4805-82ff-79f8841544eb tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] 10.222.0.62 "GET /v2.0/ports?device_id=482f4d0c-0df9-4de7-9c75-b28c728be580 HTTP/1.1" status: 200 len: 946 time: 0.0798118 May 25 17:05:43.429418 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.db [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] For port b7d643d2-c7f2-4e49-8125-5c5ec0b9d463, host hv-cinder-79049, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79049',level=0,port_id=b7d643d2-c7f2-4e49-8125-5c5ec0b9d463,segment=NetworkSegment(a8fb0313-938a-4f5e-8ff4-96df8acd943b),segment_id=a8fb0313-938a-4f5e-8ff4-96df8acd943b)] {{(pid=91831) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 17:05:43.433794 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8757892955028', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8757892520933', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8757892521750'] for port, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:05:43.436534 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:05:43.465086 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-5e0379d5-f1c2-42ba-bd3e-980c154df3fc req-be6c79eb-203b-48cd-82dc-76ba6f2b45d8 tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] 10.222.0.62 "GET /v2.0/security-groups?id=1468f899-860c-4905-aee3-f13adc83d0a4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0401840 May 25 17:05:43.502675 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Pushing event updated for resources: {'Port': ['ID=b7d643d2-c7f2-4e49-8125-5c5ec0b9d463,revision_number=9']} {{(pid=91831) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:05:43.510736 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91831) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:05:43.511087 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91831) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:05:43.511421 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91831) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:05:43.511846 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91831) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:05:43.512178 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91831) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:05:43.512509 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91831) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:05:43.512830 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91831) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:05:43.513151 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91831) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:05:43.513472 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91831) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:05:43.513791 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91831) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:05:43.514136 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91831) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:05:43.514453 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91831) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:05:43.518317 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.082s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:05:43.869563 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.db [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] get_ports_and_sgs() called for port_ids ['b7d643d2-c7f2-4e49-8125-5c5ec0b9d463'] {{(pid=91831) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 25 17:05:44.061143 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ca18e557-dd39-4f1f-b0c9-77b7d56133da req-3962384e-0270-45f6-aa08-248357b87601 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:05:44.062642 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-ca18e557-dd39-4f1f-b0c9-77b7d56133da req-3962384e-0270-45f6-aa08-248357b87601 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/ports?device_id=3ead96ee-e427-4e87-9879-a1cdf303f894 HTTP/1.1" status: 200 len: 945 time: 0.0840442 May 25 17:05:44.105785 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-ca18e557-dd39-4f1f-b0c9-77b7d56133da req-445a1b24-a887-4a20-be13-2d93afa71ad1 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/security-groups?id=fdd3b3f1-a2cb-4432-9874-c1d04f64207b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0376554 May 25 17:05:44.659285 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e42b9bc1-cea5-4450-8fc5-833d36cc1540 req-bcce1ada-a93a-4218-a547-206a4e8967a8 tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:05:44.660746 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-e42b9bc1-cea5-4450-8fc5-833d36cc1540 req-bcce1ada-a93a-4218-a547-206a4e8967a8 tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] 10.222.0.62 "GET /v2.0/ports?device_id=482f4d0c-0df9-4de7-9c75-b28c728be580 HTTP/1.1" status: 200 len: 946 time: 0.0817373 May 25 17:05:44.704960 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-e42b9bc1-cea5-4450-8fc5-833d36cc1540 req-303bf2e2-ab47-4c12-9e27-b39c55b00d22 tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] 10.222.0.62 "GET /v2.0/security-groups?id=1468f899-860c-4905-aee3-f13adc83d0a4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0386271 May 25 17:05:45.179251 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.rpc [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Device b7d643d2-c7f2-4e49-8125-5c5ec0b9d463 up at agent hyperv_hv-cinder-79049 {{(pid=91831) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 25 17:05:45.246146 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.provisioning_blocks [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Provisioning complete for port b7d643d2-c7f2-4e49-8125-5c5ec0b9d463 triggered by entity L2. {{(pid=91831) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 17:05:45.246522 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3854128'] for port, provisioning_complete {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:05:45.304150 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-15555116-4f12-4428-a355-5c6a4374d3a8 req-f3f3df51-d5c9-4763-b234-cfaea1e39c3d tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:05:45.305924 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-15555116-4f12-4428-a355-5c6a4374d3a8 req-f3f3df51-d5c9-4763-b234-cfaea1e39c3d tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/ports?device_id=3ead96ee-e427-4e87-9879-a1cdf303f894 HTTP/1.1" status: 200 len: 945 time: 0.0853186 May 25 17:05:45.352382 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-15555116-4f12-4428-a355-5c6a4374d3a8 req-04652b48-106e-4428-86da-921c7f1570e2 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/security-groups?id=fdd3b3f1-a2cb-4432-9874-c1d04f64207b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0407395 May 25 17:05:45.362377 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3832070'] for port, before_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:05:45.389584 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '3ead96ee-e427-4e87-9879-a1cdf303f894', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'b7d643d2-c7f2-4e49-8125-5c5ec0b9d463'}] {{(pid=91831) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 25 17:05:45.398960 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.db [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] For port b7d643d2-c7f2-4e49-8125-5c5ec0b9d463, host hv-cinder-79049, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79049',level=0,port_id=b7d643d2-c7f2-4e49-8125-5c5ec0b9d463,segment=NetworkSegment(a8fb0313-938a-4f5e-8ff4-96df8acd943b),segment_id=a8fb0313-938a-4f5e-8ff4-96df8acd943b)] {{(pid=91831) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 17:05:45.403439 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8757892955028', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8757892520933', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8757892521750'] for port, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:05:45.405343 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:05:45.443685 dv-cinder-790492-4-iscsi neutron-server[91831]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '3ead96ee-e427-4e87-9879-a1cdf303f894', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'b7d643d2-c7f2-4e49-8125-5c5ec0b9d463', 'code': 200} May 25 17:05:45.480736 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Pushing event updated for resources: {'Port': ['ID=b7d643d2-c7f2-4e49-8125-5c5ec0b9d463,revision_number=10']} {{(pid=91831) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:05:45.483669 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.078s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:05:45.906385 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ef6b3031-b972-439e-b124-c383182cf995 req-5ab22a15-bdb1-4b33-9225-e0dd907e5bfc tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:05:45.907882 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-ef6b3031-b972-439e-b124-c383182cf995 req-5ab22a15-bdb1-4b33-9225-e0dd907e5bfc tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] 10.222.0.62 "GET /v2.0/ports?device_id=482f4d0c-0df9-4de7-9c75-b28c728be580 HTTP/1.1" status: 200 len: 946 time: 0.0874383 May 25 17:05:45.956354 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-ef6b3031-b972-439e-b124-c383182cf995 req-79f93678-ca28-4437-b66f-47f45ac3121e tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] 10.222.0.62 "GET /v2.0/security-groups?id=1468f899-860c-4905-aee3-f13adc83d0a4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0426013 May 25 17:05:46.034356 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2bb8f7da-9910-40fa-8481-3242366db6f4 req-e33a6163-526b-49db-9a86-2dcfb055c853 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:05:46.035816 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-2bb8f7da-9910-40fa-8481-3242366db6f4 req-e33a6163-526b-49db-9a86-2dcfb055c853 service neutron] 10.222.0.32 "GET /v2.0/ports?device_id=3ead96ee-e427-4e87-9879-a1cdf303f894 HTTP/1.1" status: 200 len: 1100 time: 0.0689080 May 25 17:05:46.077127 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-2bb8f7da-9910-40fa-8481-3242366db6f4 req-6ac07bc2-aa6c-4dc5-8055-7e6400ec732f service neutron] 10.222.0.32 "GET /v2.0/security-groups?id=fdd3b3f1-a2cb-4432-9874-c1d04f64207b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0338154 May 25 17:05:46.544744 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ebaf189d-a0f7-4421-bf4f-fb0197d6d52a req-1946b508-fc7e-43e9-a2fd-e01e83d74feb tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:05:46.546228 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-ebaf189d-a0f7-4421-bf4f-fb0197d6d52a req-1946b508-fc7e-43e9-a2fd-e01e83d74feb tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/ports?device_id=3ead96ee-e427-4e87-9879-a1cdf303f894 HTTP/1.1" status: 200 len: 947 time: 0.0818279 May 25 17:05:46.669450 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-ebaf189d-a0f7-4421-bf4f-fb0197d6d52a req-4172ed8c-c103-43d5-afee-a28c6cdc3124 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/security-groups?id=fdd3b3f1-a2cb-4432-9874-c1d04f64207b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1175511 May 25 17:05:47.140830 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0fd4630a-f673-4246-a1c5-c06ea1f7553f req-8cae02c6-d00e-476e-ad80-27f30a1e8089 tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:05:47.142277 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-0fd4630a-f673-4246-a1c5-c06ea1f7553f req-8cae02c6-d00e-476e-ad80-27f30a1e8089 tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] 10.222.0.62 "GET /v2.0/ports?device_id=482f4d0c-0df9-4de7-9c75-b28c728be580 HTTP/1.1" status: 200 len: 946 time: 0.0777185 May 25 17:05:47.188853 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-0fd4630a-f673-4246-a1c5-c06ea1f7553f req-1ca04b8a-7f50-4d18-8997-d5a1b7f5078f tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] 10.222.0.62 "GET /v2.0/security-groups?id=1468f899-860c-4905-aee3-f13adc83d0a4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0404296 May 25 17:05:47.862122 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-91070d43-4a10-459d-a88c-62df90f2e7c7 req-bc55de83-43e0-4289-b686-4bffdc679994 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:05:47.863600 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-91070d43-4a10-459d-a88c-62df90f2e7c7 req-bc55de83-43e0-4289-b686-4bffdc679994 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/ports?device_id=3ead96ee-e427-4e87-9879-a1cdf303f894 HTTP/1.1" status: 200 len: 947 time: 0.0807197 May 25 17:05:47.910931 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-91070d43-4a10-459d-a88c-62df90f2e7c7 req-3c1def83-7544-4d0f-a1ec-f1014c0be58f tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/security-groups?id=fdd3b3f1-a2cb-4432-9874-c1d04f64207b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0406890 May 25 17:05:48.375695 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0925083b-245b-41e9-a278-eb53e73918fa req-dae6e168-6fb6-4227-8316-ab4a22518ecb tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:05:48.377040 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-0925083b-245b-41e9-a278-eb53e73918fa req-dae6e168-6fb6-4227-8316-ab4a22518ecb tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] 10.222.0.62 "GET /v2.0/ports?device_id=482f4d0c-0df9-4de7-9c75-b28c728be580 HTTP/1.1" status: 200 len: 946 time: 0.0825522 May 25 17:05:48.421412 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-0925083b-245b-41e9-a278-eb53e73918fa req-726d139e-e0ab-4df7-b3a5-579e58b2159a tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] 10.222.0.62 "GET /v2.0/security-groups?id=1468f899-860c-4905-aee3-f13adc83d0a4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0386674 May 25 17:05:49.101612 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dff8660d-57a3-4196-a217-85f209c632ed req-478a1489-be1d-4912-9d0f-bfa7a757bb6e tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:05:49.103343 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-dff8660d-57a3-4196-a217-85f209c632ed req-478a1489-be1d-4912-9d0f-bfa7a757bb6e tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/ports?device_id=3ead96ee-e427-4e87-9879-a1cdf303f894 HTTP/1.1" status: 200 len: 947 time: 0.0808444 May 25 17:05:49.151589 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-dff8660d-57a3-4196-a217-85f209c632ed req-899dd63b-0ff8-415f-8988-b81cac7a0526 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/security-groups?id=fdd3b3f1-a2cb-4432-9874-c1d04f64207b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0420005 May 25 17:05:49.608554 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b74d3a4b-6e4c-48f0-b948-953815c10f7d req-bef00c36-751e-4c9c-9681-e3752846467f tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:05:49.609992 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-b74d3a4b-6e4c-48f0-b948-953815c10f7d req-bef00c36-751e-4c9c-9681-e3752846467f tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] 10.222.0.62 "GET /v2.0/ports?device_id=482f4d0c-0df9-4de7-9c75-b28c728be580 HTTP/1.1" status: 200 len: 946 time: 0.0822732 May 25 17:05:49.653579 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-b74d3a4b-6e4c-48f0-b948-953815c10f7d req-a85158b0-3235-4b85-9c9d-f90a6a1ac9c2 tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] 10.222.0.62 "GET /v2.0/security-groups?id=1468f899-860c-4905-aee3-f13adc83d0a4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0380654 May 25 17:05:49.848207 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-13a2e27d-dcad-45ad-b833-a0edda58cda0 req-f4875d3b-b4fa-4885-857b-7082255e036f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:05:49.849650 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-13a2e27d-dcad-45ad-b833-a0edda58cda0 req-f4875d3b-b4fa-4885-857b-7082255e036f service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=a736cc60cc2143c4b6dea99321051da5&device_id=482f4d0c-0df9-4de7-9c75-b28c728be580 HTTP/1.1" status: 200 len: 1099 time: 0.0698211 May 25 17:05:49.982546 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-13a2e27d-dcad-45ad-b833-a0edda58cda0 req-9b6a2b57-6263-4eb9-a891-6b8b858a15e0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:05:49.984411 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-13a2e27d-dcad-45ad-b833-a0edda58cda0 req-9b6a2b57-6263-4eb9-a891-6b8b858a15e0 service neutron] 10.222.0.32 "GET /v2.0/networks?id=613457eb-6f6d-4604-8f6c-f2d318ff9bc5 HTTP/1.1" status: 200 len: 910 time: 0.1271572 May 25 17:05:50.093017 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-13a2e27d-dcad-45ad-b833-a0edda58cda0 req-278ceba9-3819-4187-87ec-0401398f2918 service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=646693a2-80a9-425d-bb26-ffda8fa453a7 HTTP/1.1" status: 200 len: 1002 time: 0.0966425 May 25 17:05:50.158121 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-13a2e27d-dcad-45ad-b833-a0edda58cda0 req-0c93a32f-2855-4ec8-8976-276255db1750 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:05:50.159506 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-13a2e27d-dcad-45ad-b833-a0edda58cda0 req-0c93a32f-2855-4ec8-8976-276255db1750 service neutron] 10.222.0.32 "GET /v2.0/subnets?id=3fc60650-484d-4574-bb67-0e4931bc9854 HTTP/1.1" status: 200 len: 848 time: 0.0594597 May 25 17:05:50.235609 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-13a2e27d-dcad-45ad-b833-a0edda58cda0 req-ef4a9f31-e8cb-42ea-b54c-3bf155a5f4ce service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:05:50.237071 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-13a2e27d-dcad-45ad-b833-a0edda58cda0 req-ef4a9f31-e8cb-42ea-b54c-3bf155a5f4ce service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=613457eb-6f6d-4604-8f6c-f2d318ff9bc5&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0692868 May 25 17:05:50.375396 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-13a2e27d-dcad-45ad-b833-a0edda58cda0 req-32ccbe62-8cd8-49c7-a044-53043d680bf7 service neutron] 10.222.0.32 "GET /v2.0/networks/613457eb-6f6d-4604-8f6c-f2d318ff9bc5?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1294930 May 25 17:05:50.511441 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-13a2e27d-dcad-45ad-b833-a0edda58cda0 req-207d727c-8533-49cc-8981-32b5436bef2e service neutron] 10.222.0.32 "GET /v2.0/networks/613457eb-6f6d-4604-8f6c-f2d318ff9bc5?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1266012 May 25 17:05:50.833406 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0bda513d-a932-4c6b-b54f-d131467491ea req-bd391d83-38eb-4116-b2ce-80c2df451aa2 tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:05:50.835360 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-0bda513d-a932-4c6b-b54f-d131467491ea req-bd391d83-38eb-4116-b2ce-80c2df451aa2 tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] 10.222.0.62 "GET /v2.0/ports?device_id=482f4d0c-0df9-4de7-9c75-b28c728be580 HTTP/1.1" status: 200 len: 946 time: 0.0769351 May 25 17:05:50.882124 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-0bda513d-a932-4c6b-b54f-d131467491ea req-eab614e3-6bdf-4973-a60e-52124511080e tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] 10.222.0.62 "GET /v2.0/security-groups?id=1468f899-860c-4905-aee3-f13adc83d0a4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0410459 May 25 17:05:52.063558 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9ec8de89-2da9-4186-a1cc-a55d8d6b0466 req-26db226a-fdfd-4aba-9cd6-a1e77048a454 tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:05:52.064913 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-9ec8de89-2da9-4186-a1cc-a55d8d6b0466 req-26db226a-fdfd-4aba-9cd6-a1e77048a454 tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] 10.222.0.62 "GET /v2.0/ports?device_id=482f4d0c-0df9-4de7-9c75-b28c728be580 HTTP/1.1" status: 200 len: 946 time: 0.0796850 May 25 17:05:52.108240 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-9ec8de89-2da9-4186-a1cc-a55d8d6b0466 req-fafc97f3-97d3-483d-b8dc-4a9b56725122 tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] 10.222.0.62 "GET /v2.0/security-groups?id=1468f899-860c-4905-aee3-f13adc83d0a4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0372739 May 25 17:05:53.297982 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-86f82636-e1dd-4f28-ae2f-c1b05d5143fd req-cbd13dd3-8991-478e-8bac-f2aff894f221 tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:05:53.299307 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-86f82636-e1dd-4f28-ae2f-c1b05d5143fd req-cbd13dd3-8991-478e-8bac-f2aff894f221 tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] 10.222.0.62 "GET /v2.0/ports?device_id=482f4d0c-0df9-4de7-9c75-b28c728be580 HTTP/1.1" status: 200 len: 946 time: 0.0842485 May 25 17:05:53.342860 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-86f82636-e1dd-4f28-ae2f-c1b05d5143fd req-8da98ae1-c681-470d-ae80-5f2ff2a0303a tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] 10.222.0.62 "GET /v2.0/security-groups?id=1468f899-860c-4905-aee3-f13adc83d0a4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0374544 May 25 17:05:53.766983 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-c9aa40dd-814a-4557-a88c-37843470372b req-09afc2cd-bbac-47cd-b938-7e5999b96461 service neutron] 10.222.0.62 "GET /v2.0/ports?device_id=482f4d0c-0df9-4de7-9c75-b28c728be580&fields=id&fields=resource_request HTTP/1.1" status: 200 len: 255 time: 0.2123194 May 25 17:05:53.794197 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-70416f31-d070-4816-a126-839c47457c40 req-08f2b31c-3480-4a62-b526-024c521e83a2 tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:05:53.795631 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-70416f31-d070-4816-a126-839c47457c40 req-08f2b31c-3480-4a62-b526-024c521e83a2 tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] 10.222.0.62 "GET /v2.0/ports?device_id=482f4d0c-0df9-4de7-9c75-b28c728be580 HTTP/1.1" status: 200 len: 946 time: 0.1838865 May 25 17:05:53.840160 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-70416f31-d070-4816-a126-839c47457c40 req-34f2f55f-1d4b-42cf-a08f-0cec9dd2f6f6 tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] 10.222.0.62 "GET /v2.0/security-groups?id=1468f899-860c-4905-aee3-f13adc83d0a4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0387821 May 25 17:05:55.030039 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8b4573fb-e375-4ba9-8a00-84fac077cac8 req-78316c38-16ff-468f-8222-1b366668fc0e tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:05:55.031500 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-8b4573fb-e375-4ba9-8a00-84fac077cac8 req-78316c38-16ff-468f-8222-1b366668fc0e tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] 10.222.0.62 "GET /v2.0/ports?device_id=482f4d0c-0df9-4de7-9c75-b28c728be580 HTTP/1.1" status: 200 len: 946 time: 0.0814948 May 25 17:05:55.080776 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-8b4573fb-e375-4ba9-8a00-84fac077cac8 req-2164747c-5c52-497c-8b6f-ea4a23b64a8b tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] 10.222.0.62 "GET /v2.0/security-groups?id=1468f899-860c-4905-aee3-f13adc83d0a4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0433099 May 25 17:05:55.243588 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.rpc [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Device 646693a2-80a9-425d-bb26-ffda8fa453a7 no longer exists at agent hyperv_hv-cinder-79049 {{(pid=91831) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 25 17:05:55.306876 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-d52ff735-84ce-4661-90fd-7d90bd15ffd8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:05:55.369876 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3832070'] for port, before_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:05:55.396238 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '482f4d0c-0df9-4de7-9c75-b28c728be580', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '646693a2-80a9-425d-bb26-ffda8fa453a7'}] {{(pid=91831) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 25 17:05:55.405500 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.db [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] For port 646693a2-80a9-425d-bb26-ffda8fa453a7, host hv-cinder-79049, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79049',level=0,port_id=646693a2-80a9-425d-bb26-ffda8fa453a7,segment=NetworkSegment(55bc70ae-213c-42ca-b035-b4a902044007),segment_id=55bc70ae-213c-42ca-b035-b4a902044007)] {{(pid=91831) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 17:05:55.409299 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8757892955028', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8757892520933', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8757892521750'] for port, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:05:55.412006 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:05:55.447976 dv-cinder-790492-4-iscsi neutron-server[91831]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '482f4d0c-0df9-4de7-9c75-b28c728be580', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '646693a2-80a9-425d-bb26-ffda8fa453a7', 'code': 200} May 25 17:05:55.479870 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Pushing event updated for resources: {'Port': ['ID=646693a2-80a9-425d-bb26-ffda8fa453a7,revision_number=6']} {{(pid=91831) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:05:55.482989 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.071s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:05:55.525880 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c9aa40dd-814a-4557-a88c-37843470372b req-03589479-2b8a-4871-99de-f29f3c09b7fd service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:05:55.527353 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-c9aa40dd-814a-4557-a88c-37843470372b req-03589479-2b8a-4871-99de-f29f3c09b7fd service neutron] 10.222.0.32 "GET /v2.0/ports?device_id=482f4d0c-0df9-4de7-9c75-b28c728be580&tenant_id=a736cc60cc2143c4b6dea99321051da5 HTTP/1.1" status: 200 len: 1097 time: 0.0695605 May 25 17:05:55.616605 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c9aa40dd-814a-4557-a88c-37843470372b req-e5843baa-d697-4a6e-93ba-90d57f15c4b1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:05:55.618152 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-c9aa40dd-814a-4557-a88c-37843470372b req-e5843baa-d697-4a6e-93ba-90d57f15c4b1 service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=a736cc60cc2143c4b6dea99321051da5&device_id=482f4d0c-0df9-4de7-9c75-b28c728be580 HTTP/1.1" status: 200 len: 1097 time: 0.0694323 May 25 17:05:55.750868 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c9aa40dd-814a-4557-a88c-37843470372b req-2d41628e-1220-492b-829a-c6db9b964050 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:05:55.752279 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-c9aa40dd-814a-4557-a88c-37843470372b req-2d41628e-1220-492b-829a-c6db9b964050 service neutron] 10.222.0.32 "GET /v2.0/networks?id=613457eb-6f6d-4604-8f6c-f2d318ff9bc5 HTTP/1.1" status: 200 len: 910 time: 0.1244752 May 25 17:05:55.856698 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-c9aa40dd-814a-4557-a88c-37843470372b req-13093e03-7ac2-45f1-b94b-a1e5ce8b8708 service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=646693a2-80a9-425d-bb26-ffda8fa453a7 HTTP/1.1" status: 200 len: 1000 time: 0.0969465 May 25 17:05:55.924781 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c9aa40dd-814a-4557-a88c-37843470372b req-112c67f3-9571-433a-94e9-a656689091a2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:05:55.926228 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-c9aa40dd-814a-4557-a88c-37843470372b req-112c67f3-9571-433a-94e9-a656689091a2 service neutron] 10.222.0.32 "GET /v2.0/subnets?id=3fc60650-484d-4574-bb67-0e4931bc9854 HTTP/1.1" status: 200 len: 848 time: 0.0599041 May 25 17:05:56.014798 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c9aa40dd-814a-4557-a88c-37843470372b req-dc66c627-80fc-42c7-ab3a-73f96134852f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:05:56.016232 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-c9aa40dd-814a-4557-a88c-37843470372b req-dc66c627-80fc-42c7-ab3a-73f96134852f service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=613457eb-6f6d-4604-8f6c-f2d318ff9bc5&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0714772 May 25 17:05:56.169022 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-c9aa40dd-814a-4557-a88c-37843470372b req-79277d5a-f3d3-4580-8d4d-eba2393d1cad service neutron] 10.222.0.32 "GET /v2.0/networks/613457eb-6f6d-4604-8f6c-f2d318ff9bc5?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1248031 May 25 17:05:56.362509 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-c9aa40dd-814a-4557-a88c-37843470372b req-8431d8e5-21a6-45ab-8dbf-4c34ded2cdf1 service neutron] 10.222.0.32 "GET /v2.0/networks/613457eb-6f6d-4604-8f6c-f2d318ff9bc5?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1831145 May 25 17:05:56.373209 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-72fc3547-33c4-4457-bc25-1acdce84b8e3 req-7f815e5c-498d-4956-a682-251608a5b81f tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:05:56.374611 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-72fc3547-33c4-4457-bc25-1acdce84b8e3 req-7f815e5c-498d-4956-a682-251608a5b81f tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] 10.222.0.62 "GET /v2.0/ports?device_id=482f4d0c-0df9-4de7-9c75-b28c728be580 HTTP/1.1" status: 200 len: 944 time: 0.1773877 May 25 17:05:56.419607 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-72fc3547-33c4-4457-bc25-1acdce84b8e3 req-ed0fe2bb-03c4-449d-a288-6c89c635212c tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] 10.222.0.62 "GET /v2.0/security-groups?id=1468f899-860c-4905-aee3-f13adc83d0a4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0391099 May 25 17:05:57.604067 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0612646f-e644-422e-89a7-a072dd03694b req-a6d7f70a-9a1e-4db2-98e6-9d425bcf7811 tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:05:57.605518 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-0612646f-e644-422e-89a7-a072dd03694b req-a6d7f70a-9a1e-4db2-98e6-9d425bcf7811 tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] 10.222.0.62 "GET /v2.0/ports?device_id=482f4d0c-0df9-4de7-9c75-b28c728be580 HTTP/1.1" status: 200 len: 944 time: 0.0786514 May 25 17:05:57.648861 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-0612646f-e644-422e-89a7-a072dd03694b req-6181b9a7-9d71-4d64-90df-b81263dcf0ed tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] 10.222.0.62 "GET /v2.0/security-groups?id=1468f899-860c-4905-aee3-f13adc83d0a4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0376644 May 25 17:05:57.695924 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-a6f2a6c2-7ea6-4b4b-9391-f8457809e7ff None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:05:57.874425 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:05:58.621529 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-0a55eb4a-8b57-4233-84d6-6b423b4ed6db None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:05:58.832841 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0d4bd17f-a2da-4163-924a-e14fa016cdda req-736fb21c-72b6-40fe-8b09-fcc66cb6523d tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:05:58.834286 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-0d4bd17f-a2da-4163-924a-e14fa016cdda req-736fb21c-72b6-40fe-8b09-fcc66cb6523d tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] 10.222.0.62 "GET /v2.0/ports?device_id=482f4d0c-0df9-4de7-9c75-b28c728be580 HTTP/1.1" status: 200 len: 944 time: 0.0822387 May 25 17:05:58.877831 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-0d4bd17f-a2da-4163-924a-e14fa016cdda req-eda70a10-fba6-479b-b215-8ee8ee0f4e38 tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] 10.222.0.62 "GET /v2.0/security-groups?id=1468f899-860c-4905-aee3-f13adc83d0a4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0378501 May 25 17:06:00.060507 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f16271e7-2df7-46f2-80c8-17525c6ef52f req-9f4aa9a8-6685-4c4d-bbf0-9bbda5717df8 tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:06:00.061806 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-f16271e7-2df7-46f2-80c8-17525c6ef52f req-9f4aa9a8-6685-4c4d-bbf0-9bbda5717df8 tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] 10.222.0.62 "GET /v2.0/ports?device_id=482f4d0c-0df9-4de7-9c75-b28c728be580 HTTP/1.1" status: 200 len: 944 time: 0.0772312 May 25 17:06:00.108953 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-f16271e7-2df7-46f2-80c8-17525c6ef52f req-7855c380-d4f5-4068-91b9-cb0ea266d825 tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] 10.222.0.62 "GET /v2.0/security-groups?id=1468f899-860c-4905-aee3-f13adc83d0a4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0413630 May 25 17:06:00.232023 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-57f11b47-1f51-4191-b7c9-af248a48372c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:06:01.289373 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2c2f0133-eff1-4be3-b1c3-df62159b40f7 req-0488ae71-e482-4c34-8650-f54d2d8927b0 tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:06:01.290746 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-2c2f0133-eff1-4be3-b1c3-df62159b40f7 req-0488ae71-e482-4c34-8650-f54d2d8927b0 tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] 10.222.0.62 "GET /v2.0/ports?device_id=482f4d0c-0df9-4de7-9c75-b28c728be580 HTTP/1.1" status: 200 len: 944 time: 0.0780642 May 25 17:06:01.334897 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-2c2f0133-eff1-4be3-b1c3-df62159b40f7 req-6239a318-a1dd-4d7c-b535-4a288f8ac09e tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] 10.222.0.62 "GET /v2.0/security-groups?id=1468f899-860c-4905-aee3-f13adc83d0a4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0385456 May 25 17:06:02.518454 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e9d55c48-d5a5-4cb1-b6c5-1f4ccbe7a7ce req-73692a6a-c350-4056-ab18-c490c59dd1d4 tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:06:02.519895 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-e9d55c48-d5a5-4cb1-b6c5-1f4ccbe7a7ce req-73692a6a-c350-4056-ab18-c490c59dd1d4 tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] 10.222.0.62 "GET /v2.0/ports?device_id=482f4d0c-0df9-4de7-9c75-b28c728be580 HTTP/1.1" status: 200 len: 944 time: 0.0819991 May 25 17:06:02.563414 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-e9d55c48-d5a5-4cb1-b6c5-1f4ccbe7a7ce req-7001bdf6-30fa-4f8d-b533-3e98df119857 tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] 10.222.0.62 "GET /v2.0/security-groups?id=1468f899-860c-4905-aee3-f13adc83d0a4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0371616 May 25 17:06:03.752971 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d436d77e-13ea-49ec-b302-76080f3a22a8 req-5bf478fb-c09b-4df3-9156-bd8b22c51e36 tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:06:03.754577 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-d436d77e-13ea-49ec-b302-76080f3a22a8 req-5bf478fb-c09b-4df3-9156-bd8b22c51e36 tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] 10.222.0.62 "GET /v2.0/ports?device_id=482f4d0c-0df9-4de7-9c75-b28c728be580 HTTP/1.1" status: 200 len: 944 time: 0.0833950 May 25 17:06:03.800061 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-d436d77e-13ea-49ec-b302-76080f3a22a8 req-c992c6b0-14f5-4b41-b6bb-28fb56518ba6 tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] 10.222.0.62 "GET /v2.0/security-groups?id=1468f899-860c-4905-aee3-f13adc83d0a4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0392027 May 25 17:06:05.075484 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-07ca738c-e52e-402a-982d-394e09f99f42 req-fb236bbf-52ff-4cf4-944a-bcf97c52a04e tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:06:05.076927 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-07ca738c-e52e-402a-982d-394e09f99f42 req-fb236bbf-52ff-4cf4-944a-bcf97c52a04e tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] 10.222.0.62 "GET /v2.0/ports?device_id=482f4d0c-0df9-4de7-9c75-b28c728be580 HTTP/1.1" status: 200 len: 944 time: 0.1698442 May 25 17:06:05.121892 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-07ca738c-e52e-402a-982d-394e09f99f42 req-0fba13f2-24b7-46c7-bfdc-4127217ab755 tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] 10.222.0.62 "GET /v2.0/security-groups?id=1468f899-860c-4905-aee3-f13adc83d0a4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0387425 May 25 17:06:05.300881 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.rpc [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Device 646693a2-80a9-425d-bb26-ffda8fa453a7 details requested by agent hyperv_hv-cinder-79049 with host hv-cinder-79049 {{(pid=91831) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 25 17:06:05.434098 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.db [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] For port 646693a2-80a9-425d-bb26-ffda8fa453a7, host hv-cinder-79049, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79049',level=0,port_id=646693a2-80a9-425d-bb26-ffda8fa453a7,segment=NetworkSegment(55bc70ae-213c-42ca-b035-b4a902044007),segment_id=55bc70ae-213c-42ca-b035-b4a902044007)] {{(pid=91831) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 17:06:05.446667 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.rpc [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Returning: {'device': '646693a2-80a9-425d-bb26-ffda8fa453a7', 'network_id': '613457eb-6f6d-4604-8f6c-f2d318ff9bc5', 'port_id': '646693a2-80a9-425d-bb26-ffda8fa453a7', 'mac_address': 'fa:16:3e:2c:b8:5f', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 659, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '3fc60650-484d-4574-bb67-0e4931bc9854', 'ip_address': '172.20.0.11'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=91831) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 25 17:06:05.503776 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3832070'] for port, before_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:06:05.519958 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.notifiers.nova [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 646693a2-80a9-425d-bb26-ffda8fa453a7 {{(pid=91831) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} May 25 17:06:05.534865 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.db [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] For port 646693a2-80a9-425d-bb26-ffda8fa453a7, host hv-cinder-79049, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79049',level=0,port_id=646693a2-80a9-425d-bb26-ffda8fa453a7,segment=NetworkSegment(55bc70ae-213c-42ca-b035-b4a902044007),segment_id=55bc70ae-213c-42ca-b035-b4a902044007)] {{(pid=91831) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 17:06:05.539217 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8757892955028', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8757892520933', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8757892521750'] for port, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:06:05.541427 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:06:05.606764 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Pushing event updated for resources: {'Port': ['ID=646693a2-80a9-425d-bb26-ffda8fa453a7,revision_number=7']} {{(pid=91831) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:06:05.610018 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.069s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:06:06.020202 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.db [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] get_ports_and_sgs() called for port_ids ['646693a2-80a9-425d-bb26-ffda8fa453a7'] {{(pid=91831) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 25 17:06:06.303309 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ef375630-7d76-4812-9a78-8669c104f72a req-38ca8442-a432-47e3-99d7-a7d9f6aea478 tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:06:06.304750 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-ef375630-7d76-4812-9a78-8669c104f72a req-38ca8442-a432-47e3-99d7-a7d9f6aea478 tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] 10.222.0.62 "GET /v2.0/ports?device_id=482f4d0c-0df9-4de7-9c75-b28c728be580 HTTP/1.1" status: 200 len: 945 time: 0.0784042 May 25 17:06:06.352484 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-ef375630-7d76-4812-9a78-8669c104f72a req-f9bc77c0-42ea-4718-954e-8b3d8f942139 tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] 10.222.0.62 "GET /v2.0/security-groups?id=1468f899-860c-4905-aee3-f13adc83d0a4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0418177 May 25 17:06:06.507799 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:06:07.318934 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.rpc [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Device 646693a2-80a9-425d-bb26-ffda8fa453a7 up at agent hyperv_hv-cinder-79049 {{(pid=91831) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 25 17:06:07.385831 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.provisioning_blocks [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Provisioning complete for port 646693a2-80a9-425d-bb26-ffda8fa453a7 triggered by entity L2. {{(pid=91831) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 17:06:07.386246 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3854128'] for port, provisioning_complete {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:06:07.530250 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3832070'] for port, before_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:06:07.540404 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-49a0989e-e3bf-4f03-b7ae-8c0dfe8e3b0a req-1e9bb732-ec88-4a69-a81f-b17fb34582d4 tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:06:07.541895 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-49a0989e-e3bf-4f03-b7ae-8c0dfe8e3b0a req-1e9bb732-ec88-4a69-a81f-b17fb34582d4 tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] 10.222.0.62 "GET /v2.0/ports?device_id=482f4d0c-0df9-4de7-9c75-b28c728be580 HTTP/1.1" status: 200 len: 945 time: 0.0858209 May 25 17:06:07.570177 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.db [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] For port 646693a2-80a9-425d-bb26-ffda8fa453a7, host hv-cinder-79049, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79049',level=0,port_id=646693a2-80a9-425d-bb26-ffda8fa453a7,segment=NetworkSegment(55bc70ae-213c-42ca-b035-b4a902044007),segment_id=55bc70ae-213c-42ca-b035-b4a902044007)] {{(pid=91831) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 17:06:07.570915 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '482f4d0c-0df9-4de7-9c75-b28c728be580', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '646693a2-80a9-425d-bb26-ffda8fa453a7'}] {{(pid=91831) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 25 17:06:07.576538 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8757892955028', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8757892520933', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8757892521750'] for port, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:06:07.578600 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [None req-838925ed-adbb-430b-876f-1b3a0f72d481 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:06:07.591729 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-49a0989e-e3bf-4f03-b7ae-8c0dfe8e3b0a req-8ace3fcc-cece-4d07-bb0b-4f0d4eb75365 tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] 10.222.0.62 "GET /v2.0/security-groups?id=1468f899-860c-4905-aee3-f13adc83d0a4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0408044 May 25 17:06:07.650292 dv-cinder-790492-4-iscsi neutron-server[91831]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '482f4d0c-0df9-4de7-9c75-b28c728be580', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '646693a2-80a9-425d-bb26-ffda8fa453a7', 'code': 200} May 25 17:06:07.658759 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Pushing event updated for resources: {'Port': ['ID=646693a2-80a9-425d-bb26-ffda8fa453a7,revision_number=8']} {{(pid=91831) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:06:07.668564 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.090s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:06:07.955713 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f3835910-a050-479b-99f0-781378ee78b2 req-de677b5c-5bdb-40f3-9100-20805406872c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:06:07.957138 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-f3835910-a050-479b-99f0-781378ee78b2 req-de677b5c-5bdb-40f3-9100-20805406872c service neutron] 10.222.0.32 "GET /v2.0/ports?device_id=482f4d0c-0df9-4de7-9c75-b28c728be580 HTTP/1.1" status: 200 len: 1099 time: 0.0732532 May 25 17:06:08.001557 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-f3835910-a050-479b-99f0-781378ee78b2 req-890394ff-8de9-464e-9d67-7f7401605f7e service neutron] 10.222.0.32 "GET /v2.0/security-groups?id=1468f899-860c-4905-aee3-f13adc83d0a4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0337567 May 25 17:06:08.151885 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.db.agents_db [None req-504cb04f-4543-46c1-8db7-349e21db7634 None None] Agent healthcheck: found 6 active agents {{(pid=91832) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} May 25 17:06:08.790064 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1b7c191e-5403-4f63-b7d2-2c12f2741b3f req-cfe1f5ba-0308-41a5-900b-4bf0c1469b78 tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:06:08.791521 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-1b7c191e-5403-4f63-b7d2-2c12f2741b3f req-cfe1f5ba-0308-41a5-900b-4bf0c1469b78 tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] 10.222.0.62 "GET /v2.0/ports?device_id=482f4d0c-0df9-4de7-9c75-b28c728be580 HTTP/1.1" status: 200 len: 946 time: 0.0801709 May 25 17:06:08.836613 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-1b7c191e-5403-4f63-b7d2-2c12f2741b3f req-4151602a-c144-48f6-bb7c-fc44a9f78b63 tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] 10.222.0.62 "GET /v2.0/security-groups?id=1468f899-860c-4905-aee3-f13adc83d0a4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0392311 May 25 17:06:10.022936 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f869c97b-eae2-40e4-95d7-df5702abe2f3 req-8ffb8435-eb03-4bcd-9ae2-915eca7490df tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:06:10.024394 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-f869c97b-eae2-40e4-95d7-df5702abe2f3 req-8ffb8435-eb03-4bcd-9ae2-915eca7490df tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] 10.222.0.62 "GET /v2.0/ports?device_id=482f4d0c-0df9-4de7-9c75-b28c728be580 HTTP/1.1" status: 200 len: 946 time: 0.0826874 May 25 17:06:10.068451 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-f869c97b-eae2-40e4-95d7-df5702abe2f3 req-15ca6f58-c738-4987-9465-99e837f60c57 tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] 10.222.0.62 "GET /v2.0/security-groups?id=1468f899-860c-4905-aee3-f13adc83d0a4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0385001 May 25 17:06:11.765797 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-37f02f92-fd05-448c-9d59-f3edd3a76430 req-72bf011f-1c8f-4d54-8f18-f412b0cf7382 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:06:11.767247 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-37f02f92-fd05-448c-9d59-f3edd3a76430 req-72bf011f-1c8f-4d54-8f18-f412b0cf7382 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] 10.222.0.62 "GET /v2.0/ports?device_id=4758207a-3093-4ef3-802c-dc11d895da7a HTTP/1.1" status: 200 len: 946 time: 0.0781000 May 25 17:06:11.809933 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-37f02f92-fd05-448c-9d59-f3edd3a76430 req-d118aa49-f6e4-4085-848d-2dea7bc73b51 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] 10.222.0.62 "GET /v2.0/security-groups?id=7cad7118-dc73-4cab-9cb2-fa41cd4499bd&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0370097 May 25 17:06:12.999469 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7f6c57f9-2c8b-486f-a7fc-38f275dce92b req-d3aedb3e-6134-4374-8ede-d335766fe79f tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:06:13.000907 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-7f6c57f9-2c8b-486f-a7fc-38f275dce92b req-d3aedb3e-6134-4374-8ede-d335766fe79f tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] 10.222.0.62 "GET /v2.0/ports?device_id=4758207a-3093-4ef3-802c-dc11d895da7a HTTP/1.1" status: 200 len: 946 time: 0.0853829 May 25 17:06:13.045552 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-7f6c57f9-2c8b-486f-a7fc-38f275dce92b req-4aed600b-d17c-46eb-b1d0-075ff3f79826 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] 10.222.0.62 "GET /v2.0/security-groups?id=7cad7118-dc73-4cab-9cb2-fa41cd4499bd&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0389695 May 25 17:06:14.227784 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b1146a28-c46d-4dcc-826e-2a6e551bd881 req-247e47b3-2b33-4acc-b646-05e705bf1bd2 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:06:14.229258 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-b1146a28-c46d-4dcc-826e-2a6e551bd881 req-247e47b3-2b33-4acc-b646-05e705bf1bd2 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] 10.222.0.62 "GET /v2.0/ports?device_id=4758207a-3093-4ef3-802c-dc11d895da7a HTTP/1.1" status: 200 len: 946 time: 0.0795946 May 25 17:06:14.276913 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-b1146a28-c46d-4dcc-826e-2a6e551bd881 req-dfca60c3-f6e7-487e-8f9a-07a216adb9ea tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] 10.222.0.62 "GET /v2.0/security-groups?id=7cad7118-dc73-4cab-9cb2-fa41cd4499bd&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0419028 May 25 17:06:15.463583 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-168eb773-e406-443b-9c66-f172b6d56e8a req-6fe63837-957a-4a6c-afea-1f0337463505 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:06:15.465013 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-168eb773-e406-443b-9c66-f172b6d56e8a req-6fe63837-957a-4a6c-afea-1f0337463505 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] 10.222.0.62 "GET /v2.0/ports?device_id=4758207a-3093-4ef3-802c-dc11d895da7a HTTP/1.1" status: 200 len: 946 time: 0.0809340 May 25 17:06:15.507925 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-168eb773-e406-443b-9c66-f172b6d56e8a req-ca13756e-5f49-48c4-84ba-433e38a35acb tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] 10.222.0.62 "GET /v2.0/security-groups?id=7cad7118-dc73-4cab-9cb2-fa41cd4499bd&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0372970 May 25 17:06:16.692644 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-998990e5-0d7d-4fe0-8161-e5fc59b1128a req-cbdbb6d6-342b-4c81-a99c-60bbcae90c92 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:06:16.694030 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-998990e5-0d7d-4fe0-8161-e5fc59b1128a req-cbdbb6d6-342b-4c81-a99c-60bbcae90c92 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] 10.222.0.62 "GET /v2.0/ports?device_id=4758207a-3093-4ef3-802c-dc11d895da7a HTTP/1.1" status: 200 len: 946 time: 0.0825007 May 25 17:06:16.737065 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-998990e5-0d7d-4fe0-8161-e5fc59b1128a req-62838f77-f387-4238-af92-cf84dfea45c7 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] 10.222.0.62 "GET /v2.0/security-groups?id=7cad7118-dc73-4cab-9cb2-fa41cd4499bd&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0375233 May 25 17:06:17.923806 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-37ec2fd8-3771-4a75-9844-a1d1121c989d req-fa39f999-b304-4c89-87c5-dd77a938a354 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:06:17.925253 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-37ec2fd8-3771-4a75-9844-a1d1121c989d req-fa39f999-b304-4c89-87c5-dd77a938a354 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] 10.222.0.62 "GET /v2.0/ports?device_id=4758207a-3093-4ef3-802c-dc11d895da7a HTTP/1.1" status: 200 len: 946 time: 0.0796535 May 25 17:06:17.969557 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-37ec2fd8-3771-4a75-9844-a1d1121c989d req-23b9a300-f12a-43dc-8244-e44b8e6f0e04 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] 10.222.0.62 "GET /v2.0/security-groups?id=7cad7118-dc73-4cab-9cb2-fa41cd4499bd&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0385902 May 25 17:06:19.156979 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5b5b5482-23de-4625-836b-022a57715fbe req-566f8651-db9a-420f-911f-bba6c916e8e2 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:06:19.158492 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-5b5b5482-23de-4625-836b-022a57715fbe req-566f8651-db9a-420f-911f-bba6c916e8e2 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] 10.222.0.62 "GET /v2.0/ports?device_id=4758207a-3093-4ef3-802c-dc11d895da7a HTTP/1.1" status: 200 len: 946 time: 0.0831592 May 25 17:06:19.202448 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-5b5b5482-23de-4625-836b-022a57715fbe req-059160f6-96ae-4fe8-96c7-40c2762e502e tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] 10.222.0.62 "GET /v2.0/security-groups?id=7cad7118-dc73-4cab-9cb2-fa41cd4499bd&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0383408 May 25 17:06:20.387306 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a0e2f42e-97d8-4c74-9c2a-2888ec23ac32 req-4665a613-619c-4dbf-9036-8503795054a3 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:06:20.388737 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-a0e2f42e-97d8-4c74-9c2a-2888ec23ac32 req-4665a613-619c-4dbf-9036-8503795054a3 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] 10.222.0.62 "GET /v2.0/ports?device_id=4758207a-3093-4ef3-802c-dc11d895da7a HTTP/1.1" status: 200 len: 946 time: 0.0799735 May 25 17:06:20.436324 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-a0e2f42e-97d8-4c74-9c2a-2888ec23ac32 req-9135bdca-1a60-4d93-a072-7a6b51e14b5c tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] 10.222.0.62 "GET /v2.0/security-groups?id=7cad7118-dc73-4cab-9cb2-fa41cd4499bd&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0419607 May 25 17:06:21.615730 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-99b00d01-8760-4b0d-8d5f-2b2d1ec7e483 req-be683356-98b7-4096-808c-a8f1e847b953 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:06:21.617125 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-99b00d01-8760-4b0d-8d5f-2b2d1ec7e483 req-be683356-98b7-4096-808c-a8f1e847b953 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] 10.222.0.62 "GET /v2.0/ports?device_id=4758207a-3093-4ef3-802c-dc11d895da7a HTTP/1.1" status: 200 len: 946 time: 0.0775664 May 25 17:06:21.660037 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-99b00d01-8760-4b0d-8d5f-2b2d1ec7e483 req-d6d7a453-60cc-47d8-9fb9-982389c727a3 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] 10.222.0.62 "GET /v2.0/security-groups?id=7cad7118-dc73-4cab-9cb2-fa41cd4499bd&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0373116 May 25 17:06:22.863747 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-02763f18-f143-49fc-9698-b9293e484ee2 req-ad6c8eed-bee8-4a21-8dd9-9619c8394ccd tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:06:22.865201 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-02763f18-f143-49fc-9698-b9293e484ee2 req-ad6c8eed-bee8-4a21-8dd9-9619c8394ccd tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] 10.222.0.62 "GET /v2.0/ports?device_id=4758207a-3093-4ef3-802c-dc11d895da7a HTTP/1.1" status: 200 len: 946 time: 0.0840106 May 25 17:06:22.910503 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-02763f18-f143-49fc-9698-b9293e484ee2 req-31de9b1b-503c-49bc-b28b-92701f061421 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] 10.222.0.62 "GET /v2.0/security-groups?id=7cad7118-dc73-4cab-9cb2-fa41cd4499bd&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0382402 May 25 17:06:23.317956 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7f2e0632-aac0-4443-a527-7d601e26d2ba req-a0569e3f-2445-469d-83f7-b4a693d798d9 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:06:23.319383 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-7f2e0632-aac0-4443-a527-7d601e26d2ba req-a0569e3f-2445-469d-83f7-b4a693d798d9 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] 10.222.0.62 "GET /v2.0/ports?device_id=4758207a-3093-4ef3-802c-dc11d895da7a HTTP/1.1" status: 200 len: 946 time: 0.1472566 May 25 17:06:23.325277 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d742a86b-b331-40d0-89eb-7fbc69712279 req-8743c68f-6143-47b0-9142-45149f905e30 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:06:23.326635 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-d742a86b-b331-40d0-89eb-7fbc69712279 req-8743c68f-6143-47b0-9142-45149f905e30 service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=70dac097fff04aed99a4976fa955579b&device_id=4758207a-3093-4ef3-802c-dc11d895da7a HTTP/1.1" status: 200 len: 1099 time: 0.1017876 May 25 17:06:23.531631 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-7f2e0632-aac0-4443-a527-7d601e26d2ba req-8f671b9c-3fc7-4aa5-97e3-a9b4f8728d7c tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] 10.222.0.62 "GET /v2.0/security-groups?id=7cad7118-dc73-4cab-9cb2-fa41cd4499bd&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.2040663 May 25 17:06:23.569270 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d742a86b-b331-40d0-89eb-7fbc69712279 req-4ac53fe4-92d4-4dd7-aa0a-babe01bb136e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:06:23.570899 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-d742a86b-b331-40d0-89eb-7fbc69712279 req-4ac53fe4-92d4-4dd7-aa0a-babe01bb136e service neutron] 10.222.0.32 "GET /v2.0/networks?id=b351598a-3f6f-4a37-8095-8d9371896ccc HTTP/1.1" status: 200 len: 911 time: 0.2304432 May 25 17:06:23.671077 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-d742a86b-b331-40d0-89eb-7fbc69712279 req-7bb19e64-3653-4ae5-97c0-b9c0602c8a31 service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=13752a02-2ccb-4f85-b36f-38ca98958db9 HTTP/1.1" status: 200 len: 1002 time: 0.0938327 May 25 17:06:23.732594 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d742a86b-b331-40d0-89eb-7fbc69712279 req-c5251f0d-6ae5-458c-8f10-03eb8b59a93d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:06:23.733946 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-d742a86b-b331-40d0-89eb-7fbc69712279 req-c5251f0d-6ae5-458c-8f10-03eb8b59a93d service neutron] 10.222.0.32 "GET /v2.0/subnets?id=4bbae145-74ed-4fda-b7c0-ae77a3202a83 HTTP/1.1" status: 200 len: 849 time: 0.0557253 May 25 17:06:23.813229 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d742a86b-b331-40d0-89eb-7fbc69712279 req-1b2ae163-d0bd-438e-bc9d-5153ae04a226 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:06:23.814693 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-d742a86b-b331-40d0-89eb-7fbc69712279 req-1b2ae163-d0bd-438e-bc9d-5153ae04a226 service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=b351598a-3f6f-4a37-8095-8d9371896ccc&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0739491 May 25 17:06:23.948435 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-d742a86b-b331-40d0-89eb-7fbc69712279 req-e4e04dc9-94ed-4be0-8501-f6486be6fde2 service neutron] 10.222.0.32 "GET /v2.0/networks/b351598a-3f6f-4a37-8095-8d9371896ccc?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1212370 May 25 17:06:24.083102 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-d742a86b-b331-40d0-89eb-7fbc69712279 req-99712baa-8726-416d-bbf5-20fbf195bfd0 service neutron] 10.222.0.32 "GET /v2.0/networks/b351598a-3f6f-4a37-8095-8d9371896ccc?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1276393 May 25 17:06:24.714781 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f5a0aa56-d427-46ca-8bfd-fd67969f0369 req-0c5d6585-29bc-4050-bdd9-68ad4bedcf60 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:06:24.716206 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-f5a0aa56-d427-46ca-8bfd-fd67969f0369 req-0c5d6585-29bc-4050-bdd9-68ad4bedcf60 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] 10.222.0.62 "GET /v2.0/ports?device_id=4758207a-3093-4ef3-802c-dc11d895da7a HTTP/1.1" status: 200 len: 946 time: 0.0775535 May 25 17:06:24.759322 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-f5a0aa56-d427-46ca-8bfd-fd67969f0369 req-eb9adcce-6bee-4f5f-84ee-a5c184066b11 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] 10.222.0.62 "GET /v2.0/security-groups?id=7cad7118-dc73-4cab-9cb2-fa41cd4499bd&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0375314 May 25 17:06:25.287959 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-fb26f904-e682-47c0-90e5-05561e89973b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:06:25.945383 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-317b2f48-11b7-40e7-9f1b-98174513c5cc req-7a4f1ea2-f5a4-47be-bc24-e3f4b19787d7 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:06:25.947385 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-317b2f48-11b7-40e7-9f1b-98174513c5cc req-7a4f1ea2-f5a4-47be-bc24-e3f4b19787d7 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] 10.222.0.62 "GET /v2.0/ports?device_id=4758207a-3093-4ef3-802c-dc11d895da7a HTTP/1.1" status: 200 len: 946 time: 0.0822542 May 25 17:06:25.990954 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-317b2f48-11b7-40e7-9f1b-98174513c5cc req-968a836f-ad20-45c0-9b21-a03ee74b1b29 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] 10.222.0.62 "GET /v2.0/security-groups?id=7cad7118-dc73-4cab-9cb2-fa41cd4499bd&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0377240 May 25 17:06:27.696733 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-3d024dcc-8563-4497-949c-e277056974b9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:06:27.877383 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:06:28.625341 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-0a55eb4a-8b57-4233-84d6-6b423b4ed6db None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:06:30.236663 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-57f11b47-1f51-4191-b7c9-af248a48372c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:06:35.808196 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-1162bff7-5a56-4b2e-bc46-8acf579dc17b req-bb753b8f-242f-4829-9b14-0254ef4c9c7e service neutron] 10.222.0.32 "GET /v2.0/ports?device_id=3ead96ee-e427-4e87-9879-a1cdf303f894&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0681555 May 25 17:06:35.959499 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1162bff7-5a56-4b2e-bc46-8acf579dc17b req-9d12e9c1-5074-4e54-83c8-5d97c2d27a06 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:06:35.960848 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-1162bff7-5a56-4b2e-bc46-8acf579dc17b req-9d12e9c1-5074-4e54-83c8-5d97c2d27a06 service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=bbb9e99759bc47d08005f3b1e036a6cf&device_id=3ead96ee-e427-4e87-9879-a1cdf303f894 HTTP/1.1" status: 200 len: 1100 time: 0.0773683 May 25 17:06:36.103863 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1162bff7-5a56-4b2e-bc46-8acf579dc17b req-ec3ea10d-6de9-45d0-9220-86c466b8db7d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:06:36.105280 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-1162bff7-5a56-4b2e-bc46-8acf579dc17b req-ec3ea10d-6de9-45d0-9220-86c466b8db7d service neutron] 10.222.0.32 "GET /v2.0/networks?id=e5be4c6a-143f-474c-a90b-37180778cefe HTTP/1.1" status: 200 len: 917 time: 0.1249757 May 25 17:06:36.206541 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-1162bff7-5a56-4b2e-bc46-8acf579dc17b req-bb3419b3-f6ae-43f0-9a73-9fc323500825 service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=b7d643d2-c7f2-4e49-8125-5c5ec0b9d463 HTTP/1.1" status: 200 len: 1002 time: 0.0947146 May 25 17:06:36.267445 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1162bff7-5a56-4b2e-bc46-8acf579dc17b req-e62ad615-1c70-4050-9f5a-e5b44db98805 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:06:36.268761 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-1162bff7-5a56-4b2e-bc46-8acf579dc17b req-e62ad615-1c70-4050-9f5a-e5b44db98805 service neutron] 10.222.0.32 "GET /v2.0/subnets?id=6e6b5897-e23d-4281-96cb-a6fdf9b68134 HTTP/1.1" status: 200 len: 855 time: 0.0554049 May 25 17:06:36.344969 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1162bff7-5a56-4b2e-bc46-8acf579dc17b req-59886c48-7603-4fa3-8e50-49ffa0d6f466 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:06:36.346400 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-1162bff7-5a56-4b2e-bc46-8acf579dc17b req-59886c48-7603-4fa3-8e50-49ffa0d6f466 service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=e5be4c6a-143f-474c-a90b-37180778cefe&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0709064 May 25 17:06:36.479396 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-1162bff7-5a56-4b2e-bc46-8acf579dc17b req-75a866a6-0f8b-44e2-a194-db5df240f14b service neutron] 10.222.0.32 "GET /v2.0/networks/e5be4c6a-143f-474c-a90b-37180778cefe?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1260993 May 25 17:06:36.514366 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:06:36.622384 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-1162bff7-5a56-4b2e-bc46-8acf579dc17b req-68d1df79-548e-4b0b-bbc8-72530c8ce708 service neutron] 10.222.0.32 "GET /v2.0/networks/e5be4c6a-143f-474c-a90b-37180778cefe?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1267819 May 25 17:06:44.834457 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-1cc1473a-9028-4897-9787-0cd5fe3b6384 req-38ed7a98-cfbc-47ee-b972-6b9b7b3a6679 tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] 10.222.0.62 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-262025281&fields=id&tenant_id=36c1ffa1d458478bac5893b2ddf98eda HTTP/1.1" status: 200 len: 267 time: 0.1302936 May 25 17:06:44.919477 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1cc1473a-9028-4897-9787-0cd5fe3b6384 req-01c0665a-72e8-48c7-8b36-b96cfe92e6dd tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:06:44.920896 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-1cc1473a-9028-4897-9787-0cd5fe3b6384 req-01c0665a-72e8-48c7-8b36-b96cfe92e6dd tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] 10.222.0.62 "GET /v2.0/ports?device_id=4413fd77-4f3e-40c8-b7ee-77d416cd7667 HTTP/1.1" status: 200 len: 985 time: 0.0806015 May 25 17:06:44.931784 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.v2.base [req-1cc1473a-9028-4897-9787-0cd5fe3b6384 req-e87ae4ba-03db-42f4-bb42-f780ea40e6bf tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Request body: {'port': {'security_groups': ['d7d845a2-937c-4f26-ac5a-1b178146b05e']}} {{(pid=91829) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 17:06:45.050782 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [req-1cc1473a-9028-4897-9787-0cd5fe3b6384 req-e87ae4ba-03db-42f4-bb42-f780ea40e6bf tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3832070'] for port, before_update {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:06:45.150090 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.db.agents_db [None req-504cb04f-4543-46c1-8db7-349e21db7634 None None] Agent healthcheck: found 6 active agents {{(pid=91832) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} May 25 17:06:45.288898 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.plugins.ml2.db [req-1cc1473a-9028-4897-9787-0cd5fe3b6384 req-e87ae4ba-03db-42f4-bb42-f780ea40e6bf tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] For port d64889c5-b5bd-42be-aa18-7a6149a0a583, host hv-cinder-79049, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79049',level=0,port_id=d64889c5-b5bd-42be-aa18-7a6149a0a583,segment=NetworkSegment(5aed6094-89e8-4c7c-ba89-9b30d3e98cd0),segment_id=5aed6094-89e8-4c7c-ba89-9b30d3e98cd0)] {{(pid=91829) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 17:06:45.312189 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [req-1cc1473a-9028-4897-9787-0cd5fe3b6384 req-e87ae4ba-03db-42f4-bb42-f780ea40e6bf tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Notify callbacks [] for port, precommit_update {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:06:45.316510 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [req-1cc1473a-9028-4897-9787-0cd5fe3b6384 req-e87ae4ba-03db-42f4-bb42-f780ea40e6bf tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8757892955028', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8757892520933', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8757892521750', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28230801'] for port, after_update {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:06:45.323393 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:06:45.334845 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.db [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] get_ports_and_sgs() called for port_ids ['d64889c5-b5bd-42be-aa18-7a6149a0a583'] {{(pid=91831) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 25 17:06:45.382180 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1cc1473a-9028-4897-9787-0cd5fe3b6384 req-e87ae4ba-03db-42f4-bb42-f780ea40e6bf tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:06:45.382824 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [req-1cc1473a-9028-4897-9787-0cd5fe3b6384 req-e87ae4ba-03db-42f4-bb42-f780ea40e6bf tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-178712'] for port, before_response {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:06:45.384214 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-1cc1473a-9028-4897-9787-0cd5fe3b6384 req-e87ae4ba-03db-42f4-bb42-f780ea40e6bf tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] 10.222.0.62 "PUT /v2.0/ports/d64889c5-b5bd-42be-aa18-7a6149a0a583 HTTP/1.1" status: 200 len: 943 time: 0.4571316 May 25 17:06:45.388183 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '4413fd77-4f3e-40c8-b7ee-77d416cd7667', 'tag': 'd64889c5-b5bd-42be-aa18-7a6149a0a583'}] {{(pid=91829) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 25 17:06:45.391544 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.wsgi [-] (91830) accepted ('10.222.0.62', 35670) {{(pid=91830) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:06:45.413743 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e87ae4ba-03db-42f4-bb42-f780ea40e6bf tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Pushing event updated for resources: {'Port': ['ID=d64889c5-b5bd-42be-aa18-7a6149a0a583,revision_number=7']} {{(pid=91829) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:06:45.421255 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e87ae4ba-03db-42f4-bb42-f780ea40e6bf tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91829) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:06:45.421620 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e87ae4ba-03db-42f4-bb42-f780ea40e6bf tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91829) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:06:45.421996 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e87ae4ba-03db-42f4-bb42-f780ea40e6bf tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91829) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:06:45.422348 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e87ae4ba-03db-42f4-bb42-f780ea40e6bf tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91829) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:06:45.422723 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e87ae4ba-03db-42f4-bb42-f780ea40e6bf tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91829) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:06:45.423022 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e87ae4ba-03db-42f4-bb42-f780ea40e6bf tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91829) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:06:45.423362 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e87ae4ba-03db-42f4-bb42-f780ea40e6bf tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91829) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:06:45.423706 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e87ae4ba-03db-42f4-bb42-f780ea40e6bf tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91829) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:06:45.424036 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e87ae4ba-03db-42f4-bb42-f780ea40e6bf tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91829) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:06:45.424398 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e87ae4ba-03db-42f4-bb42-f780ea40e6bf tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91829) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:06:45.424707 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e87ae4ba-03db-42f4-bb42-f780ea40e6bf tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91829) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:06:45.425329 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e87ae4ba-03db-42f4-bb42-f780ea40e6bf tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91829) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:06:45.430427 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-e87ae4ba-03db-42f4-bb42-f780ea40e6bf tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.107s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:06:45.463237 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '4413fd77-4f3e-40c8-b7ee-77d416cd7667', 'tag': 'd64889c5-b5bd-42be-aa18-7a6149a0a583', 'status': 'completed', 'code': 200} May 25 17:06:45.500902 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-29cc041a-1ce6-411d-b41f-85e35ccdc2b4 tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Notify callbacks [] for security_group, before_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:06:45.508083 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.db [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] get_ports_and_sgs() called for port_ids ['d64889c5-b5bd-42be-aa18-7a6149a0a583'] {{(pid=91831) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 25 17:06:45.540332 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-29cc041a-1ce6-411d-b41f-85e35ccdc2b4 tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Notify callbacks [] for security_group, precommit_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:06:45.576468 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-af9ab4ca-aa2d-412a-9092-099b8ce522b5 req-e871ba68-043d-418f-ab54-b4855672f8c3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:06:45.578048 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-af9ab4ca-aa2d-412a-9092-099b8ce522b5 req-e871ba68-043d-418f-ab54-b4855672f8c3 service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=36c1ffa1d458478bac5893b2ddf98eda&device_id=4413fd77-4f3e-40c8-b7ee-77d416cd7667 HTTP/1.1" status: 200 len: 1099 time: 0.0860991 May 25 17:06:45.623578 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-29cc041a-1ce6-411d-b41f-85e35ccdc2b4 tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-640836'] for security_group, after_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:06:45.631024 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-53d98817-a235-49a2-aa6b-6846664fab9b admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:06:45.647049 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-29cc041a-1ce6-411d-b41f-85e35ccdc2b4 tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=8af4439c-b905-435b-836a-90c7f9007b51,revision_number=None']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:06:45.659722 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-29cc041a-1ce6-411d-b41f-85e35ccdc2b4 tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91830) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:06:45.660192 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-29cc041a-1ce6-411d-b41f-85e35ccdc2b4 tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91830) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:06:45.660401 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-29cc041a-1ce6-411d-b41f-85e35ccdc2b4 tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91830) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:06:45.660721 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-29cc041a-1ce6-411d-b41f-85e35ccdc2b4 tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91830) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:06:45.661082 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-29cc041a-1ce6-411d-b41f-85e35ccdc2b4 tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91830) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:06:45.661434 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-29cc041a-1ce6-411d-b41f-85e35ccdc2b4 tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91830) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:06:45.661789 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-29cc041a-1ce6-411d-b41f-85e35ccdc2b4 tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91830) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:06:45.662167 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-29cc041a-1ce6-411d-b41f-85e35ccdc2b4 tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91830) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:06:45.662517 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-29cc041a-1ce6-411d-b41f-85e35ccdc2b4 tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91830) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:06:45.663326 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-29cc041a-1ce6-411d-b41f-85e35ccdc2b4 tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91830) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:06:45.663326 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-29cc041a-1ce6-411d-b41f-85e35ccdc2b4 tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91830) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:06:45.663667 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-29cc041a-1ce6-411d-b41f-85e35ccdc2b4 tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91830) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:06:45.666833 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-29cc041a-1ce6-411d-b41f-85e35ccdc2b4 tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Notify callbacks [] for security_group, before_response {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:06:45.670313 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [None req-29cc041a-1ce6-411d-b41f-85e35ccdc2b4 tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] 10.222.0.62 "DELETE /v2.0/security-groups/8af4439c-b905-435b-836a-90c7f9007b51 HTTP/1.1" status: 204 len: 168 time: 0.2736938 May 25 17:06:45.670313 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-29cc041a-1ce6-411d-b41f-85e35ccdc2b4 tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.038s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:06:45.670804 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.wsgi [-] (91830) accepted ('10.222.0.62', 35676) {{(pid=91830) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:06:45.716741 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.provisioning_blocks [None req-43b7f0f6-e1f4-4f03-b64d-adb5b3084eb7 None None] Provisioning complete for port d64889c5-b5bd-42be-aa18-7a6149a0a583 triggered by entity DHCP. {{(pid=91831) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 17:06:45.717126 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-43b7f0f6-e1f4-4f03-b64d-adb5b3084eb7 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3854128'] for port, provisioning_complete {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:06:45.737274 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-af9ab4ca-aa2d-412a-9092-099b8ce522b5 req-30cc4f2f-6663-4a5e-bfaa-cf66174a9b76 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:06:45.738781 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-af9ab4ca-aa2d-412a-9092-099b8ce522b5 req-30cc4f2f-6663-4a5e-bfaa-cf66174a9b76 service neutron] 10.222.0.32 "GET /v2.0/networks?id=f3ddbe01-13f7-4e15-b7da-2bdffc278cb7 HTTP/1.1" status: 200 len: 916 time: 0.1520603 May 25 17:06:45.845119 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-af9ab4ca-aa2d-412a-9092-099b8ce522b5 req-afcff5ac-3a40-4556-99e5-97bc45ab102a service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=d64889c5-b5bd-42be-aa18-7a6149a0a583 HTTP/1.1" status: 200 len: 1002 time: 0.0991249 May 25 17:06:45.910217 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-af9ab4ca-aa2d-412a-9092-099b8ce522b5 req-a9c306eb-b340-4ed4-859b-f82ff339082d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:06:45.911554 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-af9ab4ca-aa2d-412a-9092-099b8ce522b5 req-a9c306eb-b340-4ed4-859b-f82ff339082d service neutron] 10.222.0.32 "GET /v2.0/subnets?id=69fba530-cce2-44a2-89bd-18a52f9d454c HTTP/1.1" status: 200 len: 854 time: 0.0587082 May 25 17:06:45.952024 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.plugins.ml2.plugin [None req-eb75f60b-0348-4f02-86b3-66ab501716d2 tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Deleting port 9eb5148e-299d-412e-a8de-9f6e73bc63f0 {{(pid=91830) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 25 17:06:45.952365 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-eb75f60b-0348-4f02-86b3-66ab501716d2 tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8757892952899'] for port, before_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:06:45.986822 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-af9ab4ca-aa2d-412a-9092-099b8ce522b5 req-6d23bc41-1ff0-4c34-a310-5208b03e2bc6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:06:45.988347 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-af9ab4ca-aa2d-412a-9092-099b8ce522b5 req-6d23bc41-1ff0-4c34-a310-5208b03e2bc6 service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=f3ddbe01-13f7-4e15-b7da-2bdffc278cb7&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0694325 May 25 17:06:46.074421 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-eb75f60b-0348-4f02-86b3-66ab501716d2 tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-683770'] for port, precommit_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:06:46.074782 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-eb75f60b-0348-4f02-86b3-66ab501716d2 tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:06:46.119204 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-af9ab4ca-aa2d-412a-9092-099b8ce522b5 req-c3f09087-9e7d-42e1-8b84-39a4db563b80 service neutron] 10.222.0.32 "GET /v2.0/networks/f3ddbe01-13f7-4e15-b7da-2bdffc278cb7?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1233110 May 25 17:06:46.201047 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.plugins.ml2.plugin [None req-eb75f60b-0348-4f02-86b3-66ab501716d2 tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Calling delete_port for 9eb5148e-299d-412e-a8de-9f6e73bc63f0 owned by network:floatingip {{(pid=91830) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 25 17:06:46.250010 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-af9ab4ca-aa2d-412a-9092-099b8ce522b5 req-7621805b-c4b4-4590-9e91-b8083f922368 service neutron] 10.222.0.32 "GET /v2.0/networks/f3ddbe01-13f7-4e15-b7da-2bdffc278cb7?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1243715 May 25 17:06:46.328147 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-eb75f60b-0348-4f02-86b3-66ab501716d2 tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8757892955046', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8757892520924', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-27483019'] for port, after_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:06:46.332471 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-45c8c85b-2a86-42e8-beb9-2fedb9ea32dc service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:06:46.379240 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eb75f60b-0348-4f02-86b3-66ab501716d2 tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Pushing event deleted for resources: {'Port': ['ID=9eb5148e-299d-412e-a8de-9f6e73bc63f0,revision_number=None']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:06:46.381999 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-eb75f60b-0348-4f02-86b3-66ab501716d2 tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.050s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:06:46.470685 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-eb75f60b-0348-4f02-86b3-66ab501716d2 tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Notify callbacks [] for floatingip, after_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:06:46.471339 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.db.l3_db [None req-eb75f60b-0348-4f02-86b3-66ab501716d2 tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Floating IP 5efceaf8-e80b-4e6e-9280-121545183c1d disassociated (deleted). External IP: 172.27.2.103, port: d64889c5-b5bd-42be-aa18-7a6149a0a583. May 25 17:06:46.890105 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-eb75f60b-0348-4f02-86b3-66ab501716d2 tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Router b37963ac-b2c2-4729-b4f8-6c604a1e5a2b has already been hosted by L3 agent a2d427c1-2d07-43e8-afbe-218c9f7d0445 {{(pid=91830) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 25 17:06:47.067493 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-eb75f60b-0348-4f02-86b3-66ab501716d2 tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Notify agent at l3_agent.dv-cinder-790492-4-iscsi the message routers_updated {{(pid=91830) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 25 17:06:47.076780 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-511b04b3-ac90-451f-a057-2dd0f120349e None None] Sync routers for ids ['b37963ac-b2c2-4729-b4f8-6c604a1e5a2b'] in dv-cinder-790492-4-iscsi {{(pid=91831) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 25 17:06:47.083590 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-eb75f60b-0348-4f02-86b3-66ab501716d2 tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-178712'] for floatingip, before_response {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:06:47.085873 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.l3_dvrscheduler_db [None req-511b04b3-ac90-451f-a057-2dd0f120349e None None] Routers {'b37963ac-b2c2-4729-b4f8-6c604a1e5a2b'} bound to L3 agent in host dv-cinder-790492-4-iscsi {{(pid=91831) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 17:06:47.086654 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.l3_hamode_db [None req-511b04b3-ac90-451f-a057-2dd0f120349e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-790492-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-05-25T16:50:28Z,description=,heartbeat_timestamp=2021-05-25T17:06:28Z,host='dv-cinder-790492-4-iscsi',id=a2d427c1-2d07-43e8-afbe-218c9f7d0445,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T16:50:28Z,topic='l3_agent')) {'router_ids': ['b37963ac-b2c2-4729-b4f8-6c604a1e5a2b'], 'active': True} {{(pid=91831) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 17:06:47.137093 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [None req-eb75f60b-0348-4f02-86b3-66ab501716d2 tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] 10.222.0.62 "DELETE /v2.0/floatingips/5efceaf8-e80b-4e6e-9280-121545183c1d HTTP/1.1" status: 204 len: 168 time: 1.4655788 May 25 17:06:47.137731 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '4413fd77-4f3e-40c8-b7ee-77d416cd7667', 'tag': 'd64889c5-b5bd-42be-aa18-7a6149a0a583'}] {{(pid=91830) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 25 17:06:47.245392 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '4413fd77-4f3e-40c8-b7ee-77d416cd7667', 'tag': 'd64889c5-b5bd-42be-aa18-7a6149a0a583', 'status': 'completed', 'code': 200} May 25 17:06:47.275207 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.l3_dvr_db [None req-511b04b3-ac90-451f-a057-2dd0f120349e None None] Set router b37963ac-b2c2-4729-b4f8-6c604a1e5a2b gateway port host: dv-cinder-790492-4-iscsi {{(pid=91831) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 17:06:47.342631 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-02a1ee60-ee0b-4f61-bd78-4b368c77f9d8 req-639b700e-11b0-4f42-aa4d-0df161b9dbff service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:06:47.344351 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-02a1ee60-ee0b-4f61-bd78-4b368c77f9d8 req-639b700e-11b0-4f42-aa4d-0df161b9dbff service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=36c1ffa1d458478bac5893b2ddf98eda&device_id=4413fd77-4f3e-40c8-b7ee-77d416cd7667 HTTP/1.1" status: 200 len: 1099 time: 0.0765872 May 25 17:06:47.484792 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-02a1ee60-ee0b-4f61-bd78-4b368c77f9d8 req-baf1eb83-24f5-4c29-ab1a-d2ddb20494d6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:06:47.486269 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-02a1ee60-ee0b-4f61-bd78-4b368c77f9d8 req-baf1eb83-24f5-4c29-ab1a-d2ddb20494d6 service neutron] 10.222.0.32 "GET /v2.0/networks?id=f3ddbe01-13f7-4e15-b7da-2bdffc278cb7 HTTP/1.1" status: 200 len: 916 time: 0.1345668 May 25 17:06:47.560406 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-02a1ee60-ee0b-4f61-bd78-4b368c77f9d8 req-874c562e-01ac-4457-a611-7c6754aa6cb9 service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=d64889c5-b5bd-42be-aa18-7a6149a0a583 HTTP/1.1" status: 200 len: 217 time: 0.0664046 May 25 17:06:47.618151 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.l3_hamode_db [None req-511b04b3-ac90-451f-a057-2dd0f120349e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'b37963ac-b2c2-4729-b4f8-6c604a1e5a2b', 'name': 'tempest-TestMinimumBasicScenario-1175520845-router', 'tenant_id': '36c1ffa1d458478bac5893b2ddf98eda', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'external_fixed_ips': [{'subnet_id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'ip_address': '172.27.2.22'}], 'enable_snat': True}, 'gw_port_id': 'abb48be3-09be-464d-887e-584de580da17', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T17:01:12Z', 'updated_at': '2021-05-25T17:01:17Z', 'revision_number': 4, 'project_id': '36c1ffa1d458478bac5893b2ddf98eda', 'gw_port': {'id': 'abb48be3-09be-464d-887e-584de580da17', 'name': '', 'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'tenant_id': '', 'mac_address': 'fa:16:3e:3f:15:26', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b37963ac-b2c2-4729-b4f8-6c604a1e5a2b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 432, 'fixed_ips': [{'subnet_id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'ip_address': '172.27.2.22', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790492-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:01:13Z', 'updated_at': '2021-05-25T17:01:20Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-790492-4-iscsi', '_interfaces': [{'id': 'bcd1bd96-7471-48e7-844a-de3c2de0ab2b', 'name': '', 'network_id': 'f3ddbe01-13f7-4e15-b7da-2bdffc278cb7', 'tenant_id': '36c1ffa1d458478bac5893b2ddf98eda', 'mac_address': 'fa:16:3e:a1:cb:e4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b37963ac-b2c2-4729-b4f8-6c604a1e5a2b', 'device_owner': 'network:router_interface', 'standard_attr_id': 433, 'fixed_ips': [{'subnet_id': '69fba530-cce2-44a2-89bd-18a52f9d454c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790492-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:01:16Z', 'updated_at': '2021-05-25T17:01:24Z', 'revision_number': 5, 'project_id': '36c1ffa1d458478bac5893b2ddf98eda', 'subnets': [{'id': '69fba530-cce2-44a2-89bd-18a52f9d454c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-790492-4-iscsi', False) {} {{(pid=91831) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 17:06:47.622678 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-511b04b3-ac90-451f-a057-2dd0f120349e None None] Checking router: b37963ac-b2c2-4729-b4f8-6c604a1e5a2b for host: dv-cinder-790492-4-iscsi {{(pid=91831) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 25 17:06:47.631986 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.l3_dvrscheduler_db [None req-511b04b3-ac90-451f-a057-2dd0f120349e None None] Routers {'b37963ac-b2c2-4729-b4f8-6c604a1e5a2b'} bound to L3 agent in host dv-cinder-790492-4-iscsi {{(pid=91831) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 17:06:47.632772 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.l3_hamode_db [None req-511b04b3-ac90-451f-a057-2dd0f120349e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-790492-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-05-25T16:50:28Z,description=,heartbeat_timestamp=2021-05-25T17:06:28Z,host='dv-cinder-790492-4-iscsi',id=a2d427c1-2d07-43e8-afbe-218c9f7d0445,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T16:50:28Z,topic='l3_agent')) {'router_ids': ['b37963ac-b2c2-4729-b4f8-6c604a1e5a2b'], 'active': True} {{(pid=91831) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 17:06:47.717883 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-02a1ee60-ee0b-4f61-bd78-4b368c77f9d8 req-741d42e9-c790-49ac-a142-8d281e04dac4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:06:47.719249 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-02a1ee60-ee0b-4f61-bd78-4b368c77f9d8 req-741d42e9-c790-49ac-a142-8d281e04dac4 service neutron] 10.222.0.32 "GET /v2.0/subnets?id=69fba530-cce2-44a2-89bd-18a52f9d454c HTTP/1.1" status: 200 len: 854 time: 0.1526515 May 25 17:06:47.796190 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-02a1ee60-ee0b-4f61-bd78-4b368c77f9d8 req-2ef398fa-1c3a-46bf-bed1-aa466d5f9b9d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:06:47.797651 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-02a1ee60-ee0b-4f61-bd78-4b368c77f9d8 req-2ef398fa-1c3a-46bf-bed1-aa466d5f9b9d service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=f3ddbe01-13f7-4e15-b7da-2bdffc278cb7&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0714238 May 25 17:06:47.809698 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.l3_dvr_db [None req-511b04b3-ac90-451f-a057-2dd0f120349e None None] Set router b37963ac-b2c2-4729-b4f8-6c604a1e5a2b gateway port host: dv-cinder-790492-4-iscsi {{(pid=91831) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 17:06:47.942316 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-02a1ee60-ee0b-4f61-bd78-4b368c77f9d8 req-9281a691-8bb0-49ca-a82e-6435df3b7ab3 service neutron] 10.222.0.32 "GET /v2.0/networks/f3ddbe01-13f7-4e15-b7da-2bdffc278cb7?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1281838 May 25 17:06:48.088761 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-02a1ee60-ee0b-4f61-bd78-4b368c77f9d8 req-1a14d3a4-6ecd-417c-938d-48f57c55d5e6 service neutron] 10.222.0.32 "GET /v2.0/networks/f3ddbe01-13f7-4e15-b7da-2bdffc278cb7?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1371107 May 25 17:06:48.156973 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.l3_hamode_db [None req-511b04b3-ac90-451f-a057-2dd0f120349e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'b37963ac-b2c2-4729-b4f8-6c604a1e5a2b', 'name': 'tempest-TestMinimumBasicScenario-1175520845-router', 'tenant_id': '36c1ffa1d458478bac5893b2ddf98eda', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'external_fixed_ips': [{'subnet_id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'ip_address': '172.27.2.22'}], 'enable_snat': True}, 'gw_port_id': 'abb48be3-09be-464d-887e-584de580da17', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T17:01:12Z', 'updated_at': '2021-05-25T17:01:17Z', 'revision_number': 4, 'project_id': '36c1ffa1d458478bac5893b2ddf98eda', 'gw_port': {'id': 'abb48be3-09be-464d-887e-584de580da17', 'name': '', 'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'tenant_id': '', 'mac_address': 'fa:16:3e:3f:15:26', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b37963ac-b2c2-4729-b4f8-6c604a1e5a2b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 432, 'fixed_ips': [{'subnet_id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'ip_address': '172.27.2.22', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790492-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:01:13Z', 'updated_at': '2021-05-25T17:01:20Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-790492-4-iscsi', '_interfaces': [{'id': 'bcd1bd96-7471-48e7-844a-de3c2de0ab2b', 'name': '', 'network_id': 'f3ddbe01-13f7-4e15-b7da-2bdffc278cb7', 'tenant_id': '36c1ffa1d458478bac5893b2ddf98eda', 'mac_address': 'fa:16:3e:a1:cb:e4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b37963ac-b2c2-4729-b4f8-6c604a1e5a2b', 'device_owner': 'network:router_interface', 'standard_attr_id': 433, 'fixed_ips': [{'subnet_id': '69fba530-cce2-44a2-89bd-18a52f9d454c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790492-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:01:16Z', 'updated_at': '2021-05-25T17:01:24Z', 'revision_number': 5, 'project_id': '36c1ffa1d458478bac5893b2ddf98eda', 'subnets': [{'id': '69fba530-cce2-44a2-89bd-18a52f9d454c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-790492-4-iscsi', False) {} {{(pid=91831) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 17:06:48.160907 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-511b04b3-ac90-451f-a057-2dd0f120349e None None] The sync data for ids ['b37963ac-b2c2-4729-b4f8-6c604a1e5a2b'] in dv-cinder-790492-4-iscsi is: [{'id': 'b37963ac-b2c2-4729-b4f8-6c604a1e5a2b', 'name': 'tempest-TestMinimumBasicScenario-1175520845-router', 'tenant_id': '36c1ffa1d458478bac5893b2ddf98eda', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'external_fixed_ips': [{'subnet_id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'ip_address': '172.27.2.22'}], 'enable_snat': True}, 'gw_port_id': 'abb48be3-09be-464d-887e-584de580da17', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T17:01:12Z', 'updated_at': '2021-05-25T17:01:17Z', 'revision_number': 4, 'project_id': '36c1ffa1d458478bac5893b2ddf98eda', 'gw_port': {'id': 'abb48be3-09be-464d-887e-584de580da17', 'name': '', 'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'tenant_id': '', 'mac_address': 'fa:16:3e:3f:15:26', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b37963ac-b2c2-4729-b4f8-6c604a1e5a2b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 432, 'fixed_ips': [{'subnet_id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'ip_address': '172.27.2.22', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790492-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:01:13Z', 'updated_at': '2021-05-25T17:01:20Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-790492-4-iscsi', '_interfaces': [{'id': 'bcd1bd96-7471-48e7-844a-de3c2de0ab2b', 'name': '', 'network_id': 'f3ddbe01-13f7-4e15-b7da-2bdffc278cb7', 'tenant_id': '36c1ffa1d458478bac5893b2ddf98eda', 'mac_address': 'fa:16:3e:a1:cb:e4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b37963ac-b2c2-4729-b4f8-6c604a1e5a2b', 'device_owner': 'network:router_interface', 'standard_attr_id': 433, 'fixed_ips': [{'subnet_id': '69fba530-cce2-44a2-89bd-18a52f9d454c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790492-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:01:16Z', 'updated_at': '2021-05-25T17:01:24Z', 'revision_number': 5, 'project_id': '36c1ffa1d458478bac5893b2ddf98eda', 'subnets': [{'id': '69fba530-cce2-44a2-89bd-18a52f9d454c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=91831) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 25 17:06:48.390193 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-caf79d2e-dbbe-466c-a3c5-b0b26fb35cf0 None None] New status for floating IP 5efceaf8-e80b-4e6e-9280-121545183c1d: DOWN {{(pid=91832) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} May 25 17:06:50.571529 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-48c65ba8-ab28-43e5-a27e-840b2cf04502 req-a90e278e-76ba-4478-a807-2720cf8436c7 tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:06:50.573000 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-48c65ba8-ab28-43e5-a27e-840b2cf04502 req-a90e278e-76ba-4478-a807-2720cf8436c7 tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] 10.222.0.62 "GET /v2.0/ports?device_id=4413fd77-4f3e-40c8-b7ee-77d416cd7667 HTTP/1.1" status: 200 len: 946 time: 0.0838480 May 25 17:06:50.616401 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-48c65ba8-ab28-43e5-a27e-840b2cf04502 req-b7a629b1-7d5a-4091-ada7-bd3b9ebde9d6 tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] 10.222.0.62 "GET /v2.0/security-groups?id=d7d845a2-937c-4f26-ac5a-1b178146b05e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0377626 May 25 17:06:51.799720 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-87a8d4ee-e199-4c5e-afc0-806893893d7c req-6dddaf0b-df81-4dc5-808e-b90d96b86ba5 tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:06:51.801137 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-87a8d4ee-e199-4c5e-afc0-806893893d7c req-6dddaf0b-df81-4dc5-808e-b90d96b86ba5 tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] 10.222.0.62 "GET /v2.0/ports?device_id=4413fd77-4f3e-40c8-b7ee-77d416cd7667 HTTP/1.1" status: 200 len: 946 time: 0.0792027 May 25 17:06:51.848095 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-87a8d4ee-e199-4c5e-afc0-806893893d7c req-7b4e5131-b4be-4490-af9e-89b8e787141f tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] 10.222.0.62 "GET /v2.0/security-groups?id=d7d845a2-937c-4f26-ac5a-1b178146b05e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0412912 May 25 17:06:52.743068 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e0420ff5-caf2-4b44-856f-40340e52de69 req-ad414131-bc27-4828-a05f-ca4f38758b2c tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:06:52.745101 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-e0420ff5-caf2-4b44-856f-40340e52de69 req-ad414131-bc27-4828-a05f-ca4f38758b2c tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] 10.222.0.32 "GET /v2.0/ports?device_id=4413fd77-4f3e-40c8-b7ee-77d416cd7667 HTTP/1.1" status: 200 len: 946 time: 0.0796595 May 25 17:06:52.881888 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.plugins.ml2.plugin [req-e0420ff5-caf2-4b44-856f-40340e52de69 req-6a05ffe7-47b4-4052-a66d-6a288a2748d7 tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Deleting port d64889c5-b5bd-42be-aa18-7a6149a0a583 {{(pid=91829) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 25 17:06:52.882482 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [req-e0420ff5-caf2-4b44-856f-40340e52de69 req-6a05ffe7-47b4-4052-a66d-6a288a2748d7 tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8757892952899'] for port, before_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:06:53.062162 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.plugins.ml2.db [req-e0420ff5-caf2-4b44-856f-40340e52de69 req-6a05ffe7-47b4-4052-a66d-6a288a2748d7 tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] For port d64889c5-b5bd-42be-aa18-7a6149a0a583, host hv-cinder-79049, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79049',level=0,port_id=d64889c5-b5bd-42be-aa18-7a6149a0a583,segment=NetworkSegment(5aed6094-89e8-4c7c-ba89-9b30d3e98cd0),segment_id=5aed6094-89e8-4c7c-ba89-9b30d3e98cd0)] {{(pid=91829) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 17:06:53.062518 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [req-e0420ff5-caf2-4b44-856f-40340e52de69 req-6a05ffe7-47b4-4052-a66d-6a288a2748d7 tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-683770'] for port, precommit_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:06:53.190248 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.plugins.ml2.plugin [req-e0420ff5-caf2-4b44-856f-40340e52de69 req-6a05ffe7-47b4-4052-a66d-6a288a2748d7 tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Calling delete_port for d64889c5-b5bd-42be-aa18-7a6149a0a583 owned by compute:nova {{(pid=91829) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 25 17:06:53.204305 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cd4ec4bf-50e4-4d4e-b05e-3828395b5ea4 req-4969e82c-4f11-4951-aeb7-47817449e345 tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:06:53.205730 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-cd4ec4bf-50e4-4d4e-b05e-3828395b5ea4 req-4969e82c-4f11-4951-aeb7-47817449e345 tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] 10.222.0.62 "GET /v2.0/ports?device_id=4413fd77-4f3e-40c8-b7ee-77d416cd7667 HTTP/1.1" status: 200 len: 946 time: 0.2513068 May 25 17:06:53.261442 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-cd4ec4bf-50e4-4d4e-b05e-3828395b5ea4 req-be6e7f5e-f8af-4c0d-a0d7-77b60140a7ed tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] 10.222.0.62 "GET /v2.0/security-groups?id=d7d845a2-937c-4f26-ac5a-1b178146b05e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0500290 May 25 17:06:53.341751 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [req-e0420ff5-caf2-4b44-856f-40340e52de69 req-6a05ffe7-47b4-4052-a66d-6a288a2748d7 tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8757892955046', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8757892520924', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28230808'] for port, after_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:06:53.348194 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:06:53.358327 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.db [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] get_ports_and_sgs() called for port_ids ['d64889c5-b5bd-42be-aa18-7a6149a0a583'] {{(pid=91831) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 25 17:06:53.423506 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6a05ffe7-47b4-4052-a66d-6a288a2748d7 tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Pushing event deleted for resources: {'Port': ['ID=d64889c5-b5bd-42be-aa18-7a6149a0a583,revision_number=None']} {{(pid=91829) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:06:53.425719 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-6a05ffe7-47b4-4052-a66d-6a288a2748d7 tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.078s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:06:53.471753 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.l3_dvrscheduler_db [req-e0420ff5-caf2-4b44-856f-40340e52de69 req-6a05ffe7-47b4-4052-a66d-6a288a2748d7 tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] No DVR routers for this DVR port d64889c5-b5bd-42be-aa18-7a6149a0a583 on host hv-cinder-79049 {{(pid=91829) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 25 17:06:53.474257 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [req-e0420ff5-caf2-4b44-856f-40340e52de69 req-6a05ffe7-47b4-4052-a66d-6a288a2748d7 tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-178712'] for port, before_response {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:06:53.476879 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '4413fd77-4f3e-40c8-b7ee-77d416cd7667', 'name': 'network-vif-deleted', 'tag': 'd64889c5-b5bd-42be-aa18-7a6149a0a583'}] {{(pid=91829) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 25 17:06:53.493628 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-e0420ff5-caf2-4b44-856f-40340e52de69 req-6a05ffe7-47b4-4052-a66d-6a288a2748d7 tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] 10.222.0.32 "DELETE /v2.0/ports/d64889c5-b5bd-42be-aa18-7a6149a0a583 HTTP/1.1" status: 204 len: 173 time: 0.7417076 May 25 17:06:53.521773 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '4413fd77-4f3e-40c8-b7ee-77d416cd7667', 'name': 'network-vif-deleted', 'tag': 'd64889c5-b5bd-42be-aa18-7a6149a0a583', 'status': 'completed', 'code': 200} May 25 17:06:55.292042 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-b443c462-eeb1-46eb-bf43-fc08d03e0dda None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:06:55.598905 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.rpc [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Device d64889c5-b5bd-42be-aa18-7a6149a0a583 no longer exists at agent hyperv_hv-cinder-79049 {{(pid=91831) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 25 17:06:55.633528 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.plugin [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] No Port match for: d64889c5-b5bd-42be-aa18-7a6149a0a583 {{(pid=91831) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}} May 25 17:06:55.633947 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.rpc [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Device d64889c5-b5bd-42be-aa18-7a6149a0a583 not bound to the agent host hv-cinder-79049 {{(pid=91831) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 25 17:06:55.898075 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.wsgi [-] (91830) accepted ('10.222.0.62', 35768) {{(pid=91830) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:06:56.595138 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-3a02b9f7-d5e0-4c57-80b4-7dc57e89e759 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-679979'] for router_interface, before_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:06:56.998259 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.plugins.ml2.plugin [None req-3a02b9f7-d5e0-4c57-80b4-7dc57e89e759 admin admin] Deleting port bcd1bd96-7471-48e7-844a-de3c2de0ab2b {{(pid=91830) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 25 17:06:56.998930 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-3a02b9f7-d5e0-4c57-80b4-7dc57e89e759 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8757892952899'] for port, before_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:06:57.205937 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.plugins.ml2.db [None req-3a02b9f7-d5e0-4c57-80b4-7dc57e89e759 admin admin] For port bcd1bd96-7471-48e7-844a-de3c2de0ab2b, host dv-cinder-790492-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-790492-4-iscsi',level=0,port_id=bcd1bd96-7471-48e7-844a-de3c2de0ab2b,segment=NetworkSegment(5aed6094-89e8-4c7c-ba89-9b30d3e98cd0),segment_id=5aed6094-89e8-4c7c-ba89-9b30d3e98cd0)] {{(pid=91830) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 17:06:57.206314 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-3a02b9f7-d5e0-4c57-80b4-7dc57e89e759 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-683770'] for port, precommit_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:06:57.330648 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.plugins.ml2.plugin [None req-3a02b9f7-d5e0-4c57-80b4-7dc57e89e759 admin admin] Calling delete_port for bcd1bd96-7471-48e7-844a-de3c2de0ab2b owned by network:router_interface {{(pid=91830) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 25 17:06:57.608782 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-3a02b9f7-d5e0-4c57-80b4-7dc57e89e759 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8757892955046', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8757892520924', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-27483019'] for port, after_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:06:57.612977 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-7978e2af-825f-409b-ad99-16e1046c3d0b service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:06:57.656389 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3a02b9f7-d5e0-4c57-80b4-7dc57e89e759 admin admin] Pushing event deleted for resources: {'Port': ['ID=bcd1bd96-7471-48e7-844a-de3c2de0ab2b,revision_number=None']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:06:57.658654 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-3a02b9f7-d5e0-4c57-80b4-7dc57e89e759 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.046s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:06:57.698513 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-614c80be-1d54-4b1b-b8b2-aef664cb57b5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:06:57.890546 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:06:57.939012 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-3a02b9f7-d5e0-4c57-80b4-7dc57e89e759 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-551393', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-682171'] for router_interface, after_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:06:58.305089 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-3a02b9f7-d5e0-4c57-80b4-7dc57e89e759 admin admin] Router b37963ac-b2c2-4729-b4f8-6c604a1e5a2b has already been hosted by L3 agent a2d427c1-2d07-43e8-afbe-218c9f7d0445 {{(pid=91830) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 25 17:06:58.576750 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-3a02b9f7-d5e0-4c57-80b4-7dc57e89e759 admin admin] Notify agent at l3_agent.dv-cinder-790492-4-iscsi the message routers_updated {{(pid=91830) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 25 17:06:58.585088 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e5c3a504-f120-4787-87cd-ab49c555b181 None None] Sync routers for ids ['b37963ac-b2c2-4729-b4f8-6c604a1e5a2b'] in dv-cinder-790492-4-iscsi {{(pid=91831) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 25 17:06:58.589290 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [None req-3a02b9f7-d5e0-4c57-80b4-7dc57e89e759 admin admin] 10.222.0.62 "PUT /v2.0/routers/b37963ac-b2c2-4729-b4f8-6c604a1e5a2b/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 2.6895938 May 25 17:06:58.591789 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.wsgi [-] (91830) accepted ('10.222.0.62', 35774) {{(pid=91830) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:06:58.595600 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e5c3a504-f120-4787-87cd-ab49c555b181 None None] Routers {'b37963ac-b2c2-4729-b4f8-6c604a1e5a2b'} bound to L3 agent in host dv-cinder-790492-4-iscsi {{(pid=91831) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 17:06:58.596226 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.l3_hamode_db [None req-e5c3a504-f120-4787-87cd-ab49c555b181 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-790492-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-05-25T16:50:28Z,description=,heartbeat_timestamp=2021-05-25T17:06:58Z,host='dv-cinder-790492-4-iscsi',id=a2d427c1-2d07-43e8-afbe-218c9f7d0445,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T16:50:28Z,topic='l3_agent')) {'router_ids': ['b37963ac-b2c2-4729-b4f8-6c604a1e5a2b'], 'active': True} {{(pid=91831) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 17:06:58.684552 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-0a55eb4a-8b57-4233-84d6-6b423b4ed6db None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:06:58.763106 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-146df38b-64da-4e53-b6c1-a7086a376d50 admin admin] Notify callbacks [] for router, before_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:06:58.781649 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.l3_dvr_db [None req-e5c3a504-f120-4787-87cd-ab49c555b181 None None] Set router b37963ac-b2c2-4729-b4f8-6c604a1e5a2b gateway port host: dv-cinder-790492-4-iscsi {{(pid=91831) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 17:06:58.936352 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-146df38b-64da-4e53-b6c1-a7086a376d50 admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:06:59.009920 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.plugins.ml2.plugin [None req-146df38b-64da-4e53-b6c1-a7086a376d50 admin admin] Deleting port abb48be3-09be-464d-887e-584de580da17 {{(pid=91830) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 25 17:06:59.010283 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-146df38b-64da-4e53-b6c1-a7086a376d50 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8757892952899'] for port, before_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:06:59.066700 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.l3_hamode_db [None req-e5c3a504-f120-4787-87cd-ab49c555b181 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'b37963ac-b2c2-4729-b4f8-6c604a1e5a2b', 'name': 'tempest-TestMinimumBasicScenario-1175520845-router', 'tenant_id': '36c1ffa1d458478bac5893b2ddf98eda', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'external_fixed_ips': [{'subnet_id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'ip_address': '172.27.2.22'}], 'enable_snat': True}, 'gw_port_id': 'abb48be3-09be-464d-887e-584de580da17', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T17:01:12Z', 'updated_at': '2021-05-25T17:06:57Z', 'revision_number': 5, 'project_id': '36c1ffa1d458478bac5893b2ddf98eda', 'gw_port': {'id': 'abb48be3-09be-464d-887e-584de580da17', 'name': '', 'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'tenant_id': '', 'mac_address': 'fa:16:3e:3f:15:26', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b37963ac-b2c2-4729-b4f8-6c604a1e5a2b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 432, 'fixed_ips': [{'subnet_id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'ip_address': '172.27.2.22', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790492-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:01:13Z', 'updated_at': '2021-05-25T17:01:20Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-790492-4-iscsi'}], 'dv-cinder-790492-4-iscsi', False) {} {{(pid=91831) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 17:06:59.070514 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e5c3a504-f120-4787-87cd-ab49c555b181 None None] Checking router: b37963ac-b2c2-4729-b4f8-6c604a1e5a2b for host: dv-cinder-790492-4-iscsi {{(pid=91831) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 25 17:06:59.079123 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e5c3a504-f120-4787-87cd-ab49c555b181 None None] Routers {'b37963ac-b2c2-4729-b4f8-6c604a1e5a2b'} bound to L3 agent in host dv-cinder-790492-4-iscsi {{(pid=91831) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 17:06:59.079760 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.l3_hamode_db [None req-e5c3a504-f120-4787-87cd-ab49c555b181 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-790492-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-05-25T16:50:28Z,description=,heartbeat_timestamp=2021-05-25T17:06:58Z,host='dv-cinder-790492-4-iscsi',id=a2d427c1-2d07-43e8-afbe-218c9f7d0445,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T16:50:28Z,topic='l3_agent')) {'router_ids': ['b37963ac-b2c2-4729-b4f8-6c604a1e5a2b'], 'active': True} {{(pid=91831) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 17:06:59.133021 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.plugins.ml2.db [None req-146df38b-64da-4e53-b6c1-a7086a376d50 admin admin] For port abb48be3-09be-464d-887e-584de580da17, host dv-cinder-790492-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-790492-4-iscsi',level=0,port_id=abb48be3-09be-464d-887e-584de580da17,segment=NetworkSegment(414a8468-1d66-4792-9e81-d8ac5ccf1512),segment_id=414a8468-1d66-4792-9e81-d8ac5ccf1512)] {{(pid=91830) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 17:06:59.133373 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-146df38b-64da-4e53-b6c1-a7086a376d50 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-683770'] for port, precommit_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:06:59.227274 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.l3_dvr_db [None req-e5c3a504-f120-4787-87cd-ab49c555b181 None None] Set router b37963ac-b2c2-4729-b4f8-6c604a1e5a2b gateway port host: None {{(pid=91831) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 17:06:59.255039 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.plugins.ml2.plugin [None req-146df38b-64da-4e53-b6c1-a7086a376d50 admin admin] Calling delete_port for abb48be3-09be-464d-887e-584de580da17 owned by network:router_gateway {{(pid=91830) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 25 17:06:59.332246 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.l3_hamode_db [None req-e5c3a504-f120-4787-87cd-ab49c555b181 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'b37963ac-b2c2-4729-b4f8-6c604a1e5a2b', 'name': 'tempest-TestMinimumBasicScenario-1175520845-router', 'tenant_id': '36c1ffa1d458478bac5893b2ddf98eda', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T17:01:12Z', 'updated_at': '2021-05-25T17:06:58Z', 'revision_number': 6, 'project_id': '36c1ffa1d458478bac5893b2ddf98eda', 'gw_port_host': None}], 'dv-cinder-790492-4-iscsi', False) {} {{(pid=91831) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 17:06:59.336322 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e5c3a504-f120-4787-87cd-ab49c555b181 None None] The sync data for ids ['b37963ac-b2c2-4729-b4f8-6c604a1e5a2b'] in dv-cinder-790492-4-iscsi is: [{'id': 'b37963ac-b2c2-4729-b4f8-6c604a1e5a2b', 'name': 'tempest-TestMinimumBasicScenario-1175520845-router', 'tenant_id': '36c1ffa1d458478bac5893b2ddf98eda', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T17:01:12Z', 'updated_at': '2021-05-25T17:06:58Z', 'revision_number': 6, 'project_id': '36c1ffa1d458478bac5893b2ddf98eda', 'gw_port_host': None}] {{(pid=91831) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 25 17:06:59.399783 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-146df38b-64da-4e53-b6c1-a7086a376d50 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8757892955046', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8757892520924', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-27483019'] for port, after_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:06:59.405835 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-4e460861-9934-411b-ac4d-726f1f5a043b service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:06:59.447477 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-146df38b-64da-4e53-b6c1-a7086a376d50 admin admin] Pushing event deleted for resources: {'Port': ['ID=abb48be3-09be-464d-887e-584de580da17,revision_number=None']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:06:59.451232 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-146df38b-64da-4e53-b6c1-a7086a376d50 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.045s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:06:59.541799 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-146df38b-64da-4e53-b6c1-a7086a376d50 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-683062'] for router_gateway, after_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:06:59.718414 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-146df38b-64da-4e53-b6c1-a7086a376d50 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-684987', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-31024'] for router, precommit_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:06:59.720702 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-146df38b-64da-4e53-b6c1-a7086a376d50 admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:06:59.804267 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-146df38b-64da-4e53-b6c1-a7086a376d50 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-685959'] for router, after_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:06:59.804886 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-146df38b-64da-4e53-b6c1-a7086a376d50 admin admin] Fanout notify agent at l3_agent the message router_deleted on router b37963ac-b2c2-4729-b4f8-6c604a1e5a2b {{(pid=91830) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}} May 25 17:06:59.818083 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-146df38b-64da-4e53-b6c1-a7086a376d50 admin admin] Notify callbacks [] for router, before_response {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:06:59.819175 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [None req-146df38b-64da-4e53-b6c1-a7086a376d50 admin admin] 10.222.0.62 "DELETE /v2.0/routers/b37963ac-b2c2-4729-b4f8-6c604a1e5a2b HTTP/1.1" status: 204 len: 168 time: 1.2264717 May 25 17:06:59.821687 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.wsgi [-] (91830) accepted ('10.222.0.62', 35778) {{(pid=91830) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:06:59.969099 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.db_base_plugin_v2 [None req-f8a3338a-6824-491b-8482-a9c96ad06943 admin admin] Deleting subnet 69fba530-cce2-44a2-89bd-18a52f9d454c {{(pid=91830) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}} May 25 17:06:59.971995 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-f8a3338a-6824-491b-8482-a9c96ad06943 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:00.021078 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-f8a3338a-6824-491b-8482-a9c96ad06943 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-28085025'] for subnet, precommit_delete_associations {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:00.118154 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.rpc [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Device abb48be3-09be-464d-887e-584de580da17 no longer exists at agent ovs-agent-dv-cinder-790492-4-iscsi {{(pid=91831) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 25 17:07:00.147223 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-f8a3338a-6824-491b-8482-a9c96ad06943 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3856586'] for subnet, precommit_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:00.157456 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.plugin [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] No Port match for: abb48be3-09be-464d-887e-584de580da17 {{(pid=91831) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}} May 25 17:07:00.157892 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.rpc [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Device abb48be3-09be-464d-887e-584de580da17 not bound to the agent host dv-cinder-790492-4-iscsi {{(pid=91831) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 25 17:07:00.158407 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.rpc [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Device bcd1bd96-7471-48e7-844a-de3c2de0ab2b no longer exists at agent ovs-agent-dv-cinder-790492-4-iscsi {{(pid=91831) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 25 17:07:00.193457 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.plugin [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] No Port match for: bcd1bd96-7471-48e7-844a-de3c2de0ab2b {{(pid=91831) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}} May 25 17:07:00.193901 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.rpc [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Device bcd1bd96-7471-48e7-844a-de3c2de0ab2b not bound to the agent host dv-cinder-790492-4-iscsi {{(pid=91831) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 25 17:07:00.238903 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-57f11b47-1f51-4191-b7c9-af248a48372c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:00.410887 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-f8a3338a-6824-491b-8482-a9c96ad06943 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3857535', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55886', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-28085112', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1152740'] for subnet, after_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:00.415349 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-54c25aaf-01e5-45d4-9c8b-4e8e4bec5c49 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:07:00.447790 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f8a3338a-6824-491b-8482-a9c96ad06943 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=69fba530-cce2-44a2-89bd-18a52f9d454c,revision_number=None']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:07:00.450728 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-f8a3338a-6824-491b-8482-a9c96ad06943 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.035s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:07:00.451678 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-f8a3338a-6824-491b-8482-a9c96ad06943 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-551373'] for subnet, before_response {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:00.457234 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [None req-f8a3338a-6824-491b-8482-a9c96ad06943 admin admin] 10.222.0.62 "DELETE /v2.0/subnets/69fba530-cce2-44a2-89bd-18a52f9d454c HTTP/1.1" status: 204 len: 168 time: 0.6346004 May 25 17:07:00.457576 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f55ab01c-8b87-47bc-a464-cd7af66775af None None] Network f3ddbe01-13f7-4e15-b7da-2bdffc278cb7 requested from dv-cinder-790492-4-iscsi {{(pid=91831) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} May 25 17:07:00.459657 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.wsgi [-] (91830) accepted ('10.222.0.62', 35784) {{(pid=91830) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:07:00.562860 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-e3c6847d-62e9-4952-9b33-3c2837c5eec8 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3867326'] for network, before_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:00.634823 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.plugins.ml2.plugin [None req-e3c6847d-62e9-4952-9b33-3c2837c5eec8 admin admin] Deleting port 19c8c4df-6d31-4527-8bd6-b674eacf537c {{(pid=91830) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 25 17:07:00.635199 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-e3c6847d-62e9-4952-9b33-3c2837c5eec8 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8757892952899'] for port, before_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:00.702689 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-cb914eaa-ddb9-4396-b361-90af5c1fa3d2 None None] DHCP port deletion for f3ddbe01-13f7-4e15-b7da-2bdffc278cb7 request from dv-cinder-790492-4-iscsi {{(pid=91831) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} May 25 17:07:00.738090 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.plugins.ml2.db [None req-e3c6847d-62e9-4952-9b33-3c2837c5eec8 admin admin] For port 19c8c4df-6d31-4527-8bd6-b674eacf537c, host dv-cinder-790492-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-790492-4-iscsi',level=0,port_id=19c8c4df-6d31-4527-8bd6-b674eacf537c,segment=NetworkSegment(5aed6094-89e8-4c7c-ba89-9b30d3e98cd0),segment_id=5aed6094-89e8-4c7c-ba89-9b30d3e98cd0)] {{(pid=91830) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 17:07:00.738575 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-e3c6847d-62e9-4952-9b33-3c2837c5eec8 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-683770'] for port, precommit_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:00.789934 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.plugin [None req-cb914eaa-ddb9-4396-b361-90af5c1fa3d2 None None] Deleting port 19c8c4df-6d31-4527-8bd6-b674eacf537c {{(pid=91831) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 25 17:07:00.790311 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-cb914eaa-ddb9-4396-b361-90af5c1fa3d2 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8757892952899'] for port, before_delete {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:00.859995 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.plugins.ml2.plugin [None req-e3c6847d-62e9-4952-9b33-3c2837c5eec8 admin admin] Calling delete_port for 19c8c4df-6d31-4527-8bd6-b674eacf537c owned by network:dhcp {{(pid=91830) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 25 17:07:00.887985 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.db [None req-cb914eaa-ddb9-4396-b361-90af5c1fa3d2 None None] For port 19c8c4df-6d31-4527-8bd6-b674eacf537c, host dv-cinder-790492-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-790492-4-iscsi',level=0,port_id=19c8c4df-6d31-4527-8bd6-b674eacf537c,segment=NetworkSegment(5aed6094-89e8-4c7c-ba89-9b30d3e98cd0),segment_id=5aed6094-89e8-4c7c-ba89-9b30d3e98cd0)] {{(pid=91831) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 17:07:00.888429 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-cb914eaa-ddb9-4396-b361-90af5c1fa3d2 None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-683770'] for port, precommit_delete {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:00.908705 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-e3c6847d-62e9-4952-9b33-3c2837c5eec8 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8757892955046', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8757892520924', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-27483019'] for port, after_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:00.913395 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-eb75f60b-0348-4f02-86b3-66ab501716d2 tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:07:00.960748 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e3c6847d-62e9-4952-9b33-3c2837c5eec8 admin admin] Pushing event deleted for resources: {'Port': ['ID=19c8c4df-6d31-4527-8bd6-b674eacf537c,revision_number=None']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:07:00.962953 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-e3c6847d-62e9-4952-9b33-3c2837c5eec8 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.050s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:07:00.965599 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e3c6847d-62e9-4952-9b33-3c2837c5eec8 admin admin] No DVR routers for this DVR port 19c8c4df-6d31-4527-8bd6-b674eacf537c on host dv-cinder-790492-4-iscsi {{(pid=91830) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 25 17:07:01.008957 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.plugin [None req-cb914eaa-ddb9-4396-b361-90af5c1fa3d2 None None] Calling delete_port for 19c8c4df-6d31-4527-8bd6-b674eacf537c owned by network:dhcp {{(pid=91831) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 25 17:07:01.081082 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-e3c6847d-62e9-4952-9b33-3c2837c5eec8 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3858245', 'neutron.services.segments.db._delete_segments_for_network-8757892982492'] for network, precommit_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:01.094859 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.services.segments.db [None req-e3c6847d-62e9-4952-9b33-3c2837c5eec8 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['f3ddbe01-13f7-4e15-b7da-2bdffc278cb7']}} {{(pid=91830) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 17:07:01.106641 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.services.segments.db [None req-e3c6847d-62e9-4952-9b33-3c2837c5eec8 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '5aed6094-89e8-4c7c-ba89-9b30d3e98cd0') {'for_net_delete': True} {{(pid=91830) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 17:07:01.106927 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.services.segments.db [None req-e3c6847d-62e9-4952-9b33-3c2837c5eec8 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '5aed6094-89e8-4c7c-ba89-9b30d3e98cd0') {} {{(pid=91830) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 17:07:01.117858 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-e3c6847d-62e9-4952-9b33-3c2837c5eec8 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8757892991389', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-28085034'] for segment, before_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:01.133333 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-e3c6847d-62e9-4952-9b33-3c2837c5eec8 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3809789'] for segment, precommit_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:01.134097 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-cb914eaa-ddb9-4396-b361-90af5c1fa3d2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8757892955046', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8757892520924'] for port, after_delete {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:01.139259 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:07:01.140172 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-e3c6847d-62e9-4952-9b33-3c2837c5eec8 admin admin] Releasing vlan 692 on physical network physnet1 to pool {{(pid=91830) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 25 17:07:01.140554 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-e3c6847d-62e9-4952-9b33-3c2837c5eec8 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3809789', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-27483102'] for segment, after_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:01.153960 dv-cinder-790492-4-iscsi neutron-server[91830]: Traceback (most recent call last): May 25 17:07:01.153960 dv-cinder-790492-4-iscsi neutron-server[91830]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 25 17:07:01.153960 dv-cinder-790492-4-iscsi neutron-server[91830]: timer() May 25 17:07:01.153960 dv-cinder-790492-4-iscsi neutron-server[91830]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 25 17:07:01.153960 dv-cinder-790492-4-iscsi neutron-server[91830]: cb(*args, **kw) May 25 17:07:01.153960 dv-cinder-790492-4-iscsi neutron-server[91830]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper May 25 17:07:01.153960 dv-cinder-790492-4-iscsi neutron-server[91830]: return func(*args, **kwargs) May 25 17:07:01.153960 dv-cinder-790492-4-iscsi neutron-server[91830]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 25 17:07:01.153960 dv-cinder-790492-4-iscsi neutron-server[91830]: self._notify() May 25 17:07:01.153960 dv-cinder-790492-4-iscsi neutron-server[91830]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 25 17:07:01.153960 dv-cinder-790492-4-iscsi neutron-server[91830]: self.callback(batched_events) May 25 17:07:01.153960 dv-cinder-790492-4-iscsi neutron-server[91830]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 25 17:07:01.153960 dv-cinder-790492-4-iscsi neutron-server[91830]: event.method(event) May 25 17:07:01.153960 dv-cinder-790492-4-iscsi neutron-server[91830]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 25 17:07:01.153960 dv-cinder-790492-4-iscsi neutron-server[91830]: aggregate_id = self._get_aggregate_id(event.segment_id) May 25 17:07:01.153960 dv-cinder-790492-4-iscsi neutron-server[91830]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 25 17:07:01.153960 dv-cinder-790492-4-iscsi neutron-server[91830]: aggregate_uuid = self.p_client.list_aggregates( May 25 17:07:01.153960 dv-cinder-790492-4-iscsi neutron-server[91830]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 25 17:07:01.153960 dv-cinder-790492-4-iscsi neutron-server[91830]: return f(self, *a, **k) May 25 17:07:01.153960 dv-cinder-790492-4-iscsi neutron-server[91830]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 25 17:07:01.153960 dv-cinder-790492-4-iscsi neutron-server[91830]: return self._get(url).json() May 25 17:07:01.153960 dv-cinder-790492-4-iscsi neutron-server[91830]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 25 17:07:01.153960 dv-cinder-790492-4-iscsi neutron-server[91830]: return self._client.get(url, endpoint_filter=self._ks_filter, May 25 17:07:01.153960 dv-cinder-790492-4-iscsi neutron-server[91830]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 25 17:07:01.153960 dv-cinder-790492-4-iscsi neutron-server[91830]: return self.request(url, 'GET', **kwargs) May 25 17:07:01.153960 dv-cinder-790492-4-iscsi neutron-server[91830]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 25 17:07:01.153960 dv-cinder-790492-4-iscsi neutron-server[91830]: base_url = self.get_endpoint(auth, allow=allow, May 25 17:07:01.153960 dv-cinder-790492-4-iscsi neutron-server[91830]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 25 17:07:01.153960 dv-cinder-790492-4-iscsi neutron-server[91830]: auth = self._auth_required(auth, 'determine endpoint URL') May 25 17:07:01.153960 dv-cinder-790492-4-iscsi neutron-server[91830]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 25 17:07:01.153960 dv-cinder-790492-4-iscsi neutron-server[91830]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 25 17:07:01.153960 dv-cinder-790492-4-iscsi neutron-server[91830]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 25 17:07:01.184520 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cb914eaa-ddb9-4396-b361-90af5c1fa3d2 None None] Pushing event deleted for resources: {'Port': ['ID=19c8c4df-6d31-4527-8bd6-b674eacf537c,revision_number=None']} {{(pid=91831) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:07:01.189951 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cb914eaa-ddb9-4396-b361-90af5c1fa3d2 None None] No DVR routers for this DVR port 19c8c4df-6d31-4527-8bd6-b674eacf537c on host dv-cinder-790492-4-iscsi {{(pid=91831) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 25 17:07:01.196366 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cb914eaa-ddb9-4396-b361-90af5c1fa3d2 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91831) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:07:01.196713 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cb914eaa-ddb9-4396-b361-90af5c1fa3d2 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91831) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:07:01.197433 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cb914eaa-ddb9-4396-b361-90af5c1fa3d2 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91831) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:07:01.198322 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cb914eaa-ddb9-4396-b361-90af5c1fa3d2 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91831) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:07:01.198677 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cb914eaa-ddb9-4396-b361-90af5c1fa3d2 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91831) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:07:01.198968 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cb914eaa-ddb9-4396-b361-90af5c1fa3d2 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91831) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:07:01.199296 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cb914eaa-ddb9-4396-b361-90af5c1fa3d2 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91831) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:07:01.199596 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cb914eaa-ddb9-4396-b361-90af5c1fa3d2 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91831) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:07:01.199913 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cb914eaa-ddb9-4396-b361-90af5c1fa3d2 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91831) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:07:01.200601 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cb914eaa-ddb9-4396-b361-90af5c1fa3d2 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91831) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:07:01.200601 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cb914eaa-ddb9-4396-b361-90af5c1fa3d2 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91831) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:07:01.200860 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cb914eaa-ddb9-4396-b361-90af5c1fa3d2 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91831) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:07:01.204354 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [None req-cb914eaa-ddb9-4396-b361-90af5c1fa3d2 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.065s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:07:01.233937 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-e3c6847d-62e9-4952-9b33-3c2837c5eec8 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3858252', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-640806', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-551400', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-683051'] for network, after_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:01.237666 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-e49171c6-de5e-48a8-b5f8-c92d36e6f56b admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:07:01.251115 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-e3c6847d-62e9-4952-9b33-3c2837c5eec8 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-551373'] for network, before_response {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:01.262719 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e3c6847d-62e9-4952-9b33-3c2837c5eec8 admin admin] Pushing event deleted for resources: {'Network': ['ID=f3ddbe01-13f7-4e15-b7da-2bdffc278cb7,revision_number=None']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:07:01.266744 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-e3c6847d-62e9-4952-9b33-3c2837c5eec8 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.029s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:07:01.274161 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [None req-e3c6847d-62e9-4952-9b33-3c2837c5eec8 admin admin] 10.222.0.62 "DELETE /v2.0/networks/f3ddbe01-13f7-4e15-b7da-2bdffc278cb7 HTTP/1.1" status: 204 len: 168 time: 0.8135774 May 25 17:07:01.277024 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.wsgi [-] (91830) accepted ('10.222.0.62', 35788) {{(pid=91830) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:07:01.890483 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-9b02b2d9-912a-48a3-8db5-d56339cd92ae admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-679979'] for router_interface, before_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:01.913246 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.rpc [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Device 19c8c4df-6d31-4527-8bd6-b674eacf537c no longer exists at agent ovs-agent-dv-cinder-790492-4-iscsi {{(pid=91831) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 25 17:07:01.947352 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.plugin [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] No Port match for: 19c8c4df-6d31-4527-8bd6-b674eacf537c {{(pid=91831) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}} May 25 17:07:01.947728 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.rpc [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Device 19c8c4df-6d31-4527-8bd6-b674eacf537c not bound to the agent host dv-cinder-790492-4-iscsi {{(pid=91831) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 25 17:07:02.302910 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.plugins.ml2.plugin [None req-9b02b2d9-912a-48a3-8db5-d56339cd92ae admin admin] Deleting port 57de629d-5918-4034-ad5a-0176cb475228 {{(pid=91830) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 25 17:07:02.303248 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-9b02b2d9-912a-48a3-8db5-d56339cd92ae admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8757892952899'] for port, before_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:02.421548 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.plugins.ml2.db [None req-9b02b2d9-912a-48a3-8db5-d56339cd92ae admin admin] For port 57de629d-5918-4034-ad5a-0176cb475228, host dv-cinder-790492-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-790492-4-iscsi',level=0,port_id=57de629d-5918-4034-ad5a-0176cb475228,segment=NetworkSegment(ed45d58b-5f76-41a7-95d9-322227308621),segment_id=ed45d58b-5f76-41a7-95d9-322227308621)] {{(pid=91830) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 17:07:02.421895 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-9b02b2d9-912a-48a3-8db5-d56339cd92ae admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-683770'] for port, precommit_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:02.541515 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.plugins.ml2.plugin [None req-9b02b2d9-912a-48a3-8db5-d56339cd92ae admin admin] Calling delete_port for 57de629d-5918-4034-ad5a-0176cb475228 owned by network:router_interface {{(pid=91830) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 25 17:07:02.686628 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-9b02b2d9-912a-48a3-8db5-d56339cd92ae admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8757892955046', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8757892520924', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-27483019'] for port, after_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:02.690854 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-91b43151-d64d-47f8-8e6e-86c6c40ce00c service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:07:02.733474 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9b02b2d9-912a-48a3-8db5-d56339cd92ae admin admin] Pushing event deleted for resources: {'Port': ['ID=57de629d-5918-4034-ad5a-0176cb475228,revision_number=None']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:07:02.763062 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-9b02b2d9-912a-48a3-8db5-d56339cd92ae admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.072s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:07:03.092833 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-9b02b2d9-912a-48a3-8db5-d56339cd92ae admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-551393', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-682171'] for router_interface, after_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:03.445159 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-9b02b2d9-912a-48a3-8db5-d56339cd92ae admin admin] Router a00240d8-05fd-40cc-9536-9762357ba6d6 has already been hosted by L3 agent a2d427c1-2d07-43e8-afbe-218c9f7d0445 {{(pid=91830) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 25 17:07:03.618844 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-9b02b2d9-912a-48a3-8db5-d56339cd92ae admin admin] Notify agent at l3_agent.dv-cinder-790492-4-iscsi the message routers_updated {{(pid=91830) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 25 17:07:03.627162 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d3454390-6254-40c7-ad6c-58ae1bcf0822 None None] Sync routers for ids ['a00240d8-05fd-40cc-9536-9762357ba6d6'] in dv-cinder-790492-4-iscsi {{(pid=91832) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 25 17:07:03.634969 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [None req-9b02b2d9-912a-48a3-8db5-d56339cd92ae admin admin] 10.222.0.62 "PUT /v2.0/routers/a00240d8-05fd-40cc-9536-9762357ba6d6/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 2.3569708 May 25 17:07:03.636791 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d3454390-6254-40c7-ad6c-58ae1bcf0822 None None] Routers {'a00240d8-05fd-40cc-9536-9762357ba6d6'} bound to L3 agent in host dv-cinder-790492-4-iscsi {{(pid=91832) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 17:07:03.637407 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.db.l3_hamode_db [None req-d3454390-6254-40c7-ad6c-58ae1bcf0822 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-790492-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-05-25T16:50:28Z,description=,heartbeat_timestamp=2021-05-25T17:06:58Z,host='dv-cinder-790492-4-iscsi',id=a2d427c1-2d07-43e8-afbe-218c9f7d0445,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T16:50:28Z,topic='l3_agent')) {'router_ids': ['a00240d8-05fd-40cc-9536-9762357ba6d6'], 'active': True} {{(pid=91832) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 17:07:03.637556 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.wsgi [-] (91830) accepted ('10.222.0.62', 35794) {{(pid=91830) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:07:03.813834 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-ce51d90b-5f33-4c35-9e54-8ee391fb227b admin admin] Notify callbacks [] for router, before_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:03.815097 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.db.l3_dvr_db [None req-d3454390-6254-40c7-ad6c-58ae1bcf0822 None None] Set router a00240d8-05fd-40cc-9536-9762357ba6d6 gateway port host: dv-cinder-790492-4-iscsi {{(pid=91832) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 17:07:03.997374 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-ce51d90b-5f33-4c35-9e54-8ee391fb227b admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:04.067395 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.plugins.ml2.plugin [None req-ce51d90b-5f33-4c35-9e54-8ee391fb227b admin admin] Deleting port 1cd0b8ab-beec-4909-80a4-6c7ac80ecd5c {{(pid=91830) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 25 17:07:04.067682 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-ce51d90b-5f33-4c35-9e54-8ee391fb227b admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8757892952899'] for port, before_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:04.094928 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.db.l3_hamode_db [None req-d3454390-6254-40c7-ad6c-58ae1bcf0822 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'a00240d8-05fd-40cc-9536-9762357ba6d6', 'name': 'tempest-TestMinimumBasicScenario-1151073527-router', 'tenant_id': 'a60ff90c536747ff984cf0591f1a098b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'external_fixed_ips': [{'subnet_id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'ip_address': '172.27.2.228'}], 'enable_snat': True}, 'gw_port_id': '1cd0b8ab-beec-4909-80a4-6c7ac80ecd5c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T17:01:21Z', 'updated_at': '2021-05-25T17:07:02Z', 'revision_number': 5, 'project_id': 'a60ff90c536747ff984cf0591f1a098b', 'gw_port': {'id': '1cd0b8ab-beec-4909-80a4-6c7ac80ecd5c', 'name': '', 'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'tenant_id': '', 'mac_address': 'fa:16:3e:f6:e5:02', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a00240d8-05fd-40cc-9536-9762357ba6d6', 'device_owner': 'network:router_gateway', 'standard_attr_id': 444, 'fixed_ips': [{'subnet_id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'ip_address': '172.27.2.228', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790492-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:01:22Z', 'updated_at': '2021-05-25T17:01:30Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-790492-4-iscsi'}], 'dv-cinder-790492-4-iscsi', False) {} {{(pid=91832) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 17:07:04.098609 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d3454390-6254-40c7-ad6c-58ae1bcf0822 None None] Checking router: a00240d8-05fd-40cc-9536-9762357ba6d6 for host: dv-cinder-790492-4-iscsi {{(pid=91832) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 25 17:07:04.107508 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d3454390-6254-40c7-ad6c-58ae1bcf0822 None None] Routers {'a00240d8-05fd-40cc-9536-9762357ba6d6'} bound to L3 agent in host dv-cinder-790492-4-iscsi {{(pid=91832) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 17:07:04.108112 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.db.l3_hamode_db [None req-d3454390-6254-40c7-ad6c-58ae1bcf0822 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-790492-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-05-25T16:50:28Z,description=,heartbeat_timestamp=2021-05-25T17:06:58Z,host='dv-cinder-790492-4-iscsi',id=a2d427c1-2d07-43e8-afbe-218c9f7d0445,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T16:50:28Z,topic='l3_agent')) {'router_ids': ['a00240d8-05fd-40cc-9536-9762357ba6d6'], 'active': True} {{(pid=91832) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 17:07:04.189598 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.plugins.ml2.db [None req-ce51d90b-5f33-4c35-9e54-8ee391fb227b admin admin] For port 1cd0b8ab-beec-4909-80a4-6c7ac80ecd5c, host dv-cinder-790492-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-790492-4-iscsi',level=0,port_id=1cd0b8ab-beec-4909-80a4-6c7ac80ecd5c,segment=NetworkSegment(414a8468-1d66-4792-9e81-d8ac5ccf1512),segment_id=414a8468-1d66-4792-9e81-d8ac5ccf1512)] {{(pid=91830) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 17:07:04.190244 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-ce51d90b-5f33-4c35-9e54-8ee391fb227b admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-683770'] for port, precommit_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:04.263173 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.db.l3_dvr_db [None req-d3454390-6254-40c7-ad6c-58ae1bcf0822 None None] Set router a00240d8-05fd-40cc-9536-9762357ba6d6 gateway port host: None {{(pid=91832) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 17:07:04.377266 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.db.l3_hamode_db [None req-d3454390-6254-40c7-ad6c-58ae1bcf0822 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'a00240d8-05fd-40cc-9536-9762357ba6d6', 'name': 'tempest-TestMinimumBasicScenario-1151073527-router', 'tenant_id': 'a60ff90c536747ff984cf0591f1a098b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T17:01:21Z', 'updated_at': '2021-05-25T17:07:03Z', 'revision_number': 6, 'project_id': 'a60ff90c536747ff984cf0591f1a098b', 'gw_port_host': None}], 'dv-cinder-790492-4-iscsi', False) {} {{(pid=91832) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 17:07:04.381264 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d3454390-6254-40c7-ad6c-58ae1bcf0822 None None] The sync data for ids ['a00240d8-05fd-40cc-9536-9762357ba6d6'] in dv-cinder-790492-4-iscsi is: [{'id': 'a00240d8-05fd-40cc-9536-9762357ba6d6', 'name': 'tempest-TestMinimumBasicScenario-1151073527-router', 'tenant_id': 'a60ff90c536747ff984cf0591f1a098b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T17:01:21Z', 'updated_at': '2021-05-25T17:07:03Z', 'revision_number': 6, 'project_id': 'a60ff90c536747ff984cf0591f1a098b', 'gw_port_host': None}] {{(pid=91832) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 25 17:07:04.420475 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.plugins.ml2.plugin [None req-ce51d90b-5f33-4c35-9e54-8ee391fb227b admin admin] Calling delete_port for 1cd0b8ab-beec-4909-80a4-6c7ac80ecd5c owned by network:router_gateway {{(pid=91830) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 25 17:07:04.556836 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-ce51d90b-5f33-4c35-9e54-8ee391fb227b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8757892955046', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8757892520924', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-27483019'] for port, after_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:04.560731 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-f7dca670-83e9-478a-aa86-bc414af0b2c1 tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:07:04.606720 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ce51d90b-5f33-4c35-9e54-8ee391fb227b admin admin] Pushing event deleted for resources: {'Port': ['ID=1cd0b8ab-beec-4909-80a4-6c7ac80ecd5c,revision_number=None']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:07:04.609123 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-ce51d90b-5f33-4c35-9e54-8ee391fb227b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.048s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:07:04.698863 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-ce51d90b-5f33-4c35-9e54-8ee391fb227b admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-683062'] for router_gateway, after_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:04.872786 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-ce51d90b-5f33-4c35-9e54-8ee391fb227b admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-684987', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-31024'] for router, precommit_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:04.874958 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-ce51d90b-5f33-4c35-9e54-8ee391fb227b admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:04.898042 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-ce51d90b-5f33-4c35-9e54-8ee391fb227b admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-685959'] for router, after_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:04.898544 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-ce51d90b-5f33-4c35-9e54-8ee391fb227b admin admin] Fanout notify agent at l3_agent the message router_deleted on router a00240d8-05fd-40cc-9536-9762357ba6d6 {{(pid=91830) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}} May 25 17:07:04.912338 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-ce51d90b-5f33-4c35-9e54-8ee391fb227b admin admin] Notify callbacks [] for router, before_response {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:04.913452 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [None req-ce51d90b-5f33-4c35-9e54-8ee391fb227b admin admin] 10.222.0.62 "DELETE /v2.0/routers/a00240d8-05fd-40cc-9536-9762357ba6d6 HTTP/1.1" status: 204 len: 168 time: 1.2749355 May 25 17:07:04.915937 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.wsgi [-] (91830) accepted ('10.222.0.62', 35798) {{(pid=91830) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:07:04.975423 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.db_base_plugin_v2 [None req-b073e810-41a0-4dac-87ee-37fac75de922 admin admin] Deleting subnet ccf0e45f-5342-4190-89c1-d04cd1f8e468 {{(pid=91830) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}} May 25 17:07:04.978246 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-b073e810-41a0-4dac-87ee-37fac75de922 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:05.029875 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-b073e810-41a0-4dac-87ee-37fac75de922 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-28085025'] for subnet, precommit_delete_associations {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:05.113502 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-b073e810-41a0-4dac-87ee-37fac75de922 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3856586'] for subnet, precommit_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:05.367837 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-b073e810-41a0-4dac-87ee-37fac75de922 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3857535', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55886', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-28085112', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1152740'] for subnet, after_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:05.371601 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:07:05.406069 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b073e810-41a0-4dac-87ee-37fac75de922 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=ccf0e45f-5342-4190-89c1-d04cd1f8e468,revision_number=None']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:07:05.409042 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-b073e810-41a0-4dac-87ee-37fac75de922 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.037s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:07:05.410028 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-b073e810-41a0-4dac-87ee-37fac75de922 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-551373'] for subnet, before_response {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:05.415772 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-22e6de08-4ca3-4cf1-a5b7-c996a9eb5aec None None] Network faa2de89-15e9-41fa-ad3d-fb87f039acb9 requested from dv-cinder-790492-4-iscsi {{(pid=91831) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} May 25 17:07:05.416442 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [None req-b073e810-41a0-4dac-87ee-37fac75de922 admin admin] 10.222.0.62 "DELETE /v2.0/subnets/ccf0e45f-5342-4190-89c1-d04cd1f8e468 HTTP/1.1" status: 204 len: 168 time: 0.4987919 May 25 17:07:05.419054 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.wsgi [-] (91830) accepted ('10.222.0.62', 35804) {{(pid=91830) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:07:05.524866 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-e26bfffe-33de-4b8c-a7fd-70b6fef486d2 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3867326'] for network, before_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:05.600160 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.plugins.ml2.plugin [None req-e26bfffe-33de-4b8c-a7fd-70b6fef486d2 admin admin] Deleting port e6815fb7-1b18-4cc6-b357-42279bfb7877 {{(pid=91830) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 25 17:07:05.600427 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-e26bfffe-33de-4b8c-a7fd-70b6fef486d2 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8757892952899'] for port, before_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:05.674493 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0fc2775e-b5b4-4cc1-8594-88543756e6ab None None] DHCP port deletion for faa2de89-15e9-41fa-ad3d-fb87f039acb9 request from dv-cinder-790492-4-iscsi {{(pid=91831) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} May 25 17:07:05.697103 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.plugins.ml2.db [None req-e26bfffe-33de-4b8c-a7fd-70b6fef486d2 admin admin] For port e6815fb7-1b18-4cc6-b357-42279bfb7877, host dv-cinder-790492-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-790492-4-iscsi',level=0,port_id=e6815fb7-1b18-4cc6-b357-42279bfb7877,segment=NetworkSegment(ed45d58b-5f76-41a7-95d9-322227308621),segment_id=ed45d58b-5f76-41a7-95d9-322227308621)] {{(pid=91830) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 17:07:05.697471 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-e26bfffe-33de-4b8c-a7fd-70b6fef486d2 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-683770'] for port, precommit_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:05.738332 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.plugin [None req-0fc2775e-b5b4-4cc1-8594-88543756e6ab None None] Deleting port e6815fb7-1b18-4cc6-b357-42279bfb7877 {{(pid=91831) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 25 17:07:05.738715 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-0fc2775e-b5b4-4cc1-8594-88543756e6ab None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8757892952899'] for port, before_delete {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:05.837879 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.db [None req-0fc2775e-b5b4-4cc1-8594-88543756e6ab None None] For port e6815fb7-1b18-4cc6-b357-42279bfb7877, host dv-cinder-790492-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-790492-4-iscsi',level=0,port_id=e6815fb7-1b18-4cc6-b357-42279bfb7877,segment=NetworkSegment(ed45d58b-5f76-41a7-95d9-322227308621),segment_id=ed45d58b-5f76-41a7-95d9-322227308621)] {{(pid=91831) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 17:07:05.838330 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-0fc2775e-b5b4-4cc1-8594-88543756e6ab None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-683770'] for port, precommit_delete {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:05.911296 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.plugins.ml2.plugin [None req-e26bfffe-33de-4b8c-a7fd-70b6fef486d2 admin admin] Calling delete_port for e6815fb7-1b18-4cc6-b357-42279bfb7877 owned by network:dhcp {{(pid=91830) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 25 17:07:05.958698 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-e26bfffe-33de-4b8c-a7fd-70b6fef486d2 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8757892955046', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8757892520924', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-27483019'] for port, after_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:05.961011 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.rpc [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Device 1cd0b8ab-beec-4909-80a4-6c7ac80ecd5c no longer exists at agent ovs-agent-dv-cinder-790492-4-iscsi {{(pid=91831) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 25 17:07:05.963890 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-b497bade-28f9-4a02-be35-5fb97f089477 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:07:05.993499 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.plugin [None req-0fc2775e-b5b4-4cc1-8594-88543756e6ab None None] Calling delete_port for e6815fb7-1b18-4cc6-b357-42279bfb7877 owned by network:dhcp {{(pid=91831) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 25 17:07:06.007406 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e26bfffe-33de-4b8c-a7fd-70b6fef486d2 admin admin] Pushing event deleted for resources: {'Port': ['ID=e6815fb7-1b18-4cc6-b357-42279bfb7877,revision_number=None']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:07:06.008852 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.plugin [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] No Port match for: 1cd0b8ab-beec-4909-80a4-6c7ac80ecd5c {{(pid=91831) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}} May 25 17:07:06.009236 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.rpc [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Device 1cd0b8ab-beec-4909-80a4-6c7ac80ecd5c not bound to the agent host dv-cinder-790492-4-iscsi {{(pid=91831) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 25 17:07:06.009404 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e26bfffe-33de-4b8c-a7fd-70b6fef486d2 admin admin] No DVR routers for this DVR port e6815fb7-1b18-4cc6-b357-42279bfb7877 on host dv-cinder-790492-4-iscsi {{(pid=91830) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 25 17:07:06.009665 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.rpc [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Device 57de629d-5918-4034-ad5a-0176cb475228 no longer exists at agent ovs-agent-dv-cinder-790492-4-iscsi {{(pid=91831) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 25 17:07:06.011381 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-e26bfffe-33de-4b8c-a7fd-70b6fef486d2 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.048s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:07:06.046270 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.plugin [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] No Port match for: 57de629d-5918-4034-ad5a-0176cb475228 {{(pid=91831) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}} May 25 17:07:06.046632 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.rpc [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Device 57de629d-5918-4034-ad5a-0176cb475228 not bound to the agent host dv-cinder-790492-4-iscsi {{(pid=91831) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 25 17:07:06.047045 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.rpc [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Device e6815fb7-1b18-4cc6-b357-42279bfb7877 no longer exists at agent ovs-agent-dv-cinder-790492-4-iscsi {{(pid=91831) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 25 17:07:06.088007 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.plugin [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] No Port match for: e6815fb7-1b18-4cc6-b357-42279bfb7877 {{(pid=91831) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}} May 25 17:07:06.089004 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.rpc [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Device e6815fb7-1b18-4cc6-b357-42279bfb7877 not bound to the agent host dv-cinder-790492-4-iscsi {{(pid=91831) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 25 17:07:06.118224 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-0fc2775e-b5b4-4cc1-8594-88543756e6ab None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8757892955046', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8757892520924'] for port, after_delete {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:06.123023 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:07:06.124741 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-e26bfffe-33de-4b8c-a7fd-70b6fef486d2 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3858245', 'neutron.services.segments.db._delete_segments_for_network-8757892982492'] for network, precommit_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:06.138324 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.services.segments.db [None req-e26bfffe-33de-4b8c-a7fd-70b6fef486d2 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['faa2de89-15e9-41fa-ad3d-fb87f039acb9']}} {{(pid=91830) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 17:07:06.157023 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.services.segments.db [None req-e26bfffe-33de-4b8c-a7fd-70b6fef486d2 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'ed45d58b-5f76-41a7-95d9-322227308621') {'for_net_delete': True} {{(pid=91830) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 17:07:06.157498 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.services.segments.db [None req-e26bfffe-33de-4b8c-a7fd-70b6fef486d2 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'ed45d58b-5f76-41a7-95d9-322227308621') {} {{(pid=91830) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 17:07:06.168249 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0fc2775e-b5b4-4cc1-8594-88543756e6ab None None] Pushing event deleted for resources: {'Port': ['ID=e6815fb7-1b18-4cc6-b357-42279bfb7877,revision_number=None']} {{(pid=91831) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:07:06.170344 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-e26bfffe-33de-4b8c-a7fd-70b6fef486d2 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8757892991389', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-28085034'] for segment, before_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:06.175322 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [None req-0fc2775e-b5b4-4cc1-8594-88543756e6ab None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.052s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:07:06.176141 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0fc2775e-b5b4-4cc1-8594-88543756e6ab None None] No DVR routers for this DVR port e6815fb7-1b18-4cc6-b357-42279bfb7877 on host dv-cinder-790492-4-iscsi {{(pid=91831) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 25 17:07:06.193340 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-e26bfffe-33de-4b8c-a7fd-70b6fef486d2 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3809789'] for segment, precommit_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:06.200018 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-e26bfffe-33de-4b8c-a7fd-70b6fef486d2 admin admin] Releasing vlan 682 on physical network physnet1 to pool {{(pid=91830) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 25 17:07:06.200433 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-e26bfffe-33de-4b8c-a7fd-70b6fef486d2 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3809789', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-27483102'] for segment, after_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:06.214096 dv-cinder-790492-4-iscsi neutron-server[91830]: Traceback (most recent call last): May 25 17:07:06.214096 dv-cinder-790492-4-iscsi neutron-server[91830]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 25 17:07:06.214096 dv-cinder-790492-4-iscsi neutron-server[91830]: timer() May 25 17:07:06.214096 dv-cinder-790492-4-iscsi neutron-server[91830]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 25 17:07:06.214096 dv-cinder-790492-4-iscsi neutron-server[91830]: cb(*args, **kw) May 25 17:07:06.214096 dv-cinder-790492-4-iscsi neutron-server[91830]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper May 25 17:07:06.214096 dv-cinder-790492-4-iscsi neutron-server[91830]: return func(*args, **kwargs) May 25 17:07:06.214096 dv-cinder-790492-4-iscsi neutron-server[91830]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 25 17:07:06.214096 dv-cinder-790492-4-iscsi neutron-server[91830]: self._notify() May 25 17:07:06.214096 dv-cinder-790492-4-iscsi neutron-server[91830]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 25 17:07:06.214096 dv-cinder-790492-4-iscsi neutron-server[91830]: self.callback(batched_events) May 25 17:07:06.214096 dv-cinder-790492-4-iscsi neutron-server[91830]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 25 17:07:06.214096 dv-cinder-790492-4-iscsi neutron-server[91830]: event.method(event) May 25 17:07:06.214096 dv-cinder-790492-4-iscsi neutron-server[91830]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 25 17:07:06.214096 dv-cinder-790492-4-iscsi neutron-server[91830]: aggregate_id = self._get_aggregate_id(event.segment_id) May 25 17:07:06.214096 dv-cinder-790492-4-iscsi neutron-server[91830]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 25 17:07:06.214096 dv-cinder-790492-4-iscsi neutron-server[91830]: aggregate_uuid = self.p_client.list_aggregates( May 25 17:07:06.214096 dv-cinder-790492-4-iscsi neutron-server[91830]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 25 17:07:06.214096 dv-cinder-790492-4-iscsi neutron-server[91830]: return f(self, *a, **k) May 25 17:07:06.214096 dv-cinder-790492-4-iscsi neutron-server[91830]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 25 17:07:06.214096 dv-cinder-790492-4-iscsi neutron-server[91830]: return self._get(url).json() May 25 17:07:06.214096 dv-cinder-790492-4-iscsi neutron-server[91830]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 25 17:07:06.214096 dv-cinder-790492-4-iscsi neutron-server[91830]: return self._client.get(url, endpoint_filter=self._ks_filter, May 25 17:07:06.214096 dv-cinder-790492-4-iscsi neutron-server[91830]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 25 17:07:06.214096 dv-cinder-790492-4-iscsi neutron-server[91830]: return self.request(url, 'GET', **kwargs) May 25 17:07:06.214096 dv-cinder-790492-4-iscsi neutron-server[91830]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 25 17:07:06.214096 dv-cinder-790492-4-iscsi neutron-server[91830]: base_url = self.get_endpoint(auth, allow=allow, May 25 17:07:06.214096 dv-cinder-790492-4-iscsi neutron-server[91830]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 25 17:07:06.214096 dv-cinder-790492-4-iscsi neutron-server[91830]: auth = self._auth_required(auth, 'determine endpoint URL') May 25 17:07:06.214096 dv-cinder-790492-4-iscsi neutron-server[91830]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 25 17:07:06.214096 dv-cinder-790492-4-iscsi neutron-server[91830]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 25 17:07:06.214096 dv-cinder-790492-4-iscsi neutron-server[91830]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 25 17:07:06.286682 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-e26bfffe-33de-4b8c-a7fd-70b6fef486d2 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3858252', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-640806', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-551400', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-683051'] for network, after_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:06.290529 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:07:06.306418 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-e26bfffe-33de-4b8c-a7fd-70b6fef486d2 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-551373'] for network, before_response {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:06.317074 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e26bfffe-33de-4b8c-a7fd-70b6fef486d2 admin admin] Pushing event deleted for resources: {'Network': ['ID=faa2de89-15e9-41fa-ad3d-fb87f039acb9,revision_number=None']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:07:06.321232 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-e26bfffe-33de-4b8c-a7fd-70b6fef486d2 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.031s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:07:06.325323 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [None req-e26bfffe-33de-4b8c-a7fd-70b6fef486d2 admin admin] 10.222.0.62 "DELETE /v2.0/networks/faa2de89-15e9-41fa-ad3d-fb87f039acb9 HTTP/1.1" status: 204 len: 168 time: 0.9052758 May 25 17:07:06.444153 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.wsgi [-] (91830) accepted ('10.222.0.62', 35818) {{(pid=91830) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:07:06.496855 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [None req-89f07d63-4ad3-48d3-b008-3c5b4d747631 admin admin] 10.222.0.62 "GET /v2.0/security-groups?tenant_id=36c1ffa1d458478bac5893b2ddf98eda&name=default HTTP/1.1" status: 200 len: 2979 time: 0.0514910 May 25 17:07:06.499314 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.wsgi [-] (91830) accepted ('10.222.0.62', 35824) {{(pid=91830) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:07:06.519955 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:06.562719 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-bbd78dfd-6772-4d2e-9534-2ecc1ec6d31d admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:06.591426 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-bbd78dfd-6772-4d2e-9534-2ecc1ec6d31d admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:06.650556 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-bbd78dfd-6772-4d2e-9534-2ecc1ec6d31d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-640836'] for security_group, after_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:06.655739 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-2154e6a4-a75a-42c8-8b69-3091867c75f4 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:07:06.670576 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bbd78dfd-6772-4d2e-9534-2ecc1ec6d31d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d7d845a2-937c-4f26-ac5a-1b178146b05e,revision_number=None']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:07:06.682673 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-bbd78dfd-6772-4d2e-9534-2ecc1ec6d31d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.025s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:07:06.686922 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-bbd78dfd-6772-4d2e-9534-2ecc1ec6d31d admin admin] Notify callbacks [] for security_group, before_response {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:06.689943 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [None req-bbd78dfd-6772-4d2e-9534-2ecc1ec6d31d admin admin] 10.222.0.62 "DELETE /v2.0/security-groups/d7d845a2-937c-4f26-ac5a-1b178146b05e HTTP/1.1" status: 204 len: 168 time: 0.1875529 May 25 17:07:07.024242 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.wsgi [-] (91829) accepted ('10.222.0.62', 35834) {{(pid=91829) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:07:07.075364 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [None req-d7604d6a-40e5-422e-8469-d310199e24df admin admin] 10.222.0.62 "GET /v2.0/security-groups?tenant_id=a60ff90c536747ff984cf0591f1a098b&name=default HTTP/1.1" status: 200 len: 2979 time: 0.0498786 May 25 17:07:07.077557 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.wsgi [-] (91829) accepted ('10.222.0.62', 35838) {{(pid=91829) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:07:07.135184 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-cc85d2eb-73b6-49b4-a694-9bd774f59904 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:07.162483 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-cc85d2eb-73b6-49b4-a694-9bd774f59904 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:07.215986 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-cc85d2eb-73b6-49b4-a694-9bd774f59904 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-640836'] for security_group, after_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:07.219924 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:07:07.232169 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cc85d2eb-73b6-49b4-a694-9bd774f59904 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=5f670629-5849-44ab-878d-8949864207a2,revision_number=None']} {{(pid=91829) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:07:07.235546 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-cc85d2eb-73b6-49b4-a694-9bd774f59904 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.016s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:07:07.240945 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-cc85d2eb-73b6-49b4-a694-9bd774f59904 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:07.244753 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [None req-cc85d2eb-73b6-49b4-a694-9bd774f59904 admin admin] 10.222.0.62 "DELETE /v2.0/security-groups/5f670629-5849-44ab-878d-8949864207a2 HTTP/1.1" status: 204 len: 168 time: 0.1662025 May 25 17:07:08.001803 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.wsgi [-] (91830) accepted ('10.222.0.62', 35868) {{(pid=91830) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:07:08.112364 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.v2.base [None req-aac7a8a3-a79b-4fc5-aa33-65b6e9872b0b admin admin] Request body: {'network': {'name': 'tempest-TestVolumeBootPattern-219116984-network', 'tenant_id': '5397bf60956945c3a2bf43c6b1aa614b'}} {{(pid=91830) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 17:07:08.117049 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.quota.driver [None req-aac7a8a3-a79b-4fc5-aa33-65b6e9872b0b admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91830) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 17:07:08.121612 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [None req-aac7a8a3-a79b-4fc5-aa33-65b6e9872b0b admin admin] Usage tracker for resource:network and tenant:5397bf60956945c3a2bf43c6b1aa614b is out of sync, need to count used quota {{(pid=91830) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 17:07:08.124597 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [None req-aac7a8a3-a79b-4fc5-aa33-65b6e9872b0b admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=91830) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 17:07:08.131088 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.quota.driver [None req-aac7a8a3-a79b-4fc5-aa33-65b6e9872b0b admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91830) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 17:07:08.141144 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-aac7a8a3-a79b-4fc5-aa33-65b6e9872b0b admin admin] Made reservation on behalf of 5397bf60956945c3a2bf43c6b1aa614b for: {'network': 1} {{(pid=91830) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 25 17:07:08.143564 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-aac7a8a3-a79b-4fc5-aa33-65b6e9872b0b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-3832077'] for network, before_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:08.155830 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-aac7a8a3-a79b-4fc5-aa33-65b6e9872b0b admin admin] Notify callbacks [] for security_group, before_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:08.171502 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.quota.driver [None req-aac7a8a3-a79b-4fc5-aa33-65b6e9872b0b admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91830) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 17:07:08.175550 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [None req-aac7a8a3-a79b-4fc5-aa33-65b6e9872b0b admin admin] Usage tracker for resource:security_group_rule and tenant:5397bf60956945c3a2bf43c6b1aa614b is out of sync, need to count used quota {{(pid=91830) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 17:07:08.178564 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [None req-aac7a8a3-a79b-4fc5-aa33-65b6e9872b0b admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91830) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 17:07:08.185503 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.quota.driver [None req-aac7a8a3-a79b-4fc5-aa33-65b6e9872b0b admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91830) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 17:07:08.280394 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-aac7a8a3-a79b-4fc5-aa33-65b6e9872b0b admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:08.280903 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-11bc45d9-db83-498c-93f7-cfa35e53e418 req-68279346-eb74-44e2-8c37-4b7d5f1b5bd1 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:07:08.282673 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-11bc45d9-db83-498c-93f7-cfa35e53e418 req-68279346-eb74-44e2-8c37-4b7d5f1b5bd1 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/ports?device_id=3ead96ee-e427-4e87-9879-a1cdf303f894 HTTP/1.1" status: 200 len: 947 time: 0.1764896 May 25 17:07:08.284537 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-aac7a8a3-a79b-4fc5-aa33-65b6e9872b0b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-640836'] for security_group, after_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:08.287648 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-b5c0e513-9be5-4a14-9b8e-5e61fcb52b36 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:07:08.317479 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-aac7a8a3-a79b-4fc5-aa33-65b6e9872b0b admin admin] vlan segment allocate from pool success with {'vlan_id': 657, 'physical_network': 'physnet1'} {{(pid=91830) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 25 17:07:08.326346 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aac7a8a3-a79b-4fc5-aa33-65b6e9872b0b admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=714f2890-bd30-467f-967a-8a9670a5bdb0,revision_number=1']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:07:08.329593 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-aac7a8a3-a79b-4fc5-aa33-65b6e9872b0b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.042s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:07:08.330520 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-11bc45d9-db83-498c-93f7-cfa35e53e418 req-177314b0-6ba1-40a0-8d07-54e70c9d5997 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/security-groups?id=fdd3b3f1-a2cb-4432-9874-c1d04f64207b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0420074 May 25 17:07:08.334221 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-aac7a8a3-a79b-4fc5-aa33-65b6e9872b0b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3809789'] for segment, precommit_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:08.334457 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.db.segments_db [None req-aac7a8a3-a79b-4fc5-aa33-65b6e9872b0b admin admin] Added segment 50ed67e9-f8d3-4927-b257-bd17654cce34 of type vlan for network 17a0e39e-1e1f-4550-b28b-d5ae3bdca362 May 25 17:07:08.361303 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-aac7a8a3-a79b-4fc5-aa33-65b6e9872b0b admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8757892541013'] for network, precommit_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:08.389754 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-aac7a8a3-a79b-4fc5-aa33-65b6e9872b0b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-640806', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-551400'] for network, after_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:08.391072 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-aac7a8a3-a79b-4fc5-aa33-65b6e9872b0b admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91830) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:07:08.391651 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-aac7a8a3-a79b-4fc5-aa33-65b6e9872b0b admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-551373'] for network, before_response {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:08.394969 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-f2816692-bd2c-42ac-8443-cfc33d95cafc admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:07:08.492344 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [None req-aac7a8a3-a79b-4fc5-aa33-65b6e9872b0b admin admin] 10.222.0.62 "POST /v2.0/networks HTTP/1.1" status: 201 len: 884 time: 0.4894075 May 25 17:07:08.495698 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aac7a8a3-a79b-4fc5-aa33-65b6e9872b0b admin admin] Pushing event updated for resources: {'Network': ['ID=17a0e39e-1e1f-4550-b28b-d5ae3bdca362,revision_number=1']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:07:08.496085 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.wsgi [-] (91829) accepted ('10.222.0.62', 35876) {{(pid=91829) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:07:08.498220 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-aac7a8a3-a79b-4fc5-aa33-65b6e9872b0b admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.103s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:07:08.502116 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.v2.base [None req-6257659e-f7f3-45c1-8bf9-e5d5aa59b4db admin admin] Request body: {'subnet': {'network_id': '17a0e39e-1e1f-4550-b28b-d5ae3bdca362', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestVolumeBootPattern-219116984-subnet', 'tenant_id': '5397bf60956945c3a2bf43c6b1aa614b', 'ip_version': 4}} {{(pid=91829) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 17:07:08.505464 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.rpc [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Network 17a0e39e-1e1f-4550-b28b-d5ae3bdca362 details requested by agent ovs-agent-dv-cinder-790492-4-iscsi with host dv-cinder-790492-4-iscsi {{(pid=91831) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 25 17:07:08.506949 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.quota.driver [None req-6257659e-f7f3-45c1-8bf9-e5d5aa59b4db admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91829) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 17:07:08.510737 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.quota.resource [None req-6257659e-f7f3-45c1-8bf9-e5d5aa59b4db admin admin] Usage tracker for resource:subnet and tenant:5397bf60956945c3a2bf43c6b1aa614b is out of sync, need to count used quota {{(pid=91829) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 17:07:08.513500 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.quota.resource [None req-6257659e-f7f3-45c1-8bf9-e5d5aa59b4db admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=91829) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 17:07:08.519758 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.quota.driver [None req-6257659e-f7f3-45c1-8bf9-e5d5aa59b4db admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91829) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 17:07:08.529725 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-6257659e-f7f3-45c1-8bf9-e5d5aa59b4db admin admin] Made reservation on behalf of 5397bf60956945c3a2bf43c6b1aa614b for: {'subnet': 1} {{(pid=91829) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 25 17:07:08.532109 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-6257659e-f7f3-45c1-8bf9-e5d5aa59b4db admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-28266129'] for subnet, before_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:08.914163 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-6257659e-f7f3-45c1-8bf9-e5d5aa59b4db admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55886', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-27333672', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-28266119'] for subnet, after_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:08.919241 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-30c959cc-25a1-42fa-b7ef-9af2ffbf61b4 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:07:08.987002 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6257659e-f7f3-45c1-8bf9-e5d5aa59b4db admin admin] Pushing event updated for resources: {'Subnet': ['ID=f5599a2e-9942-4423-a1ac-67e9b2650770,revision_number=0']} {{(pid=91829) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:07:08.989537 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-6257659e-f7f3-45c1-8bf9-e5d5aa59b4db admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.070s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:07:08.996368 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6257659e-f7f3-45c1-8bf9-e5d5aa59b4db admin admin] Checking segment: {'id': '50ed67e9-f8d3-4927-b257-bd17654cce34', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 657, 'network_id': '17a0e39e-1e1f-4550-b28b-d5ae3bdca362'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91829) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 25 17:07:08.996720 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6257659e-f7f3-45c1-8bf9-e5d5aa59b4db admin admin] Network hostable DHCP agents. Network: 17a0e39e-1e1f-4550-b28b-d5ae3bdca362, hostable agents: ['8d7401c6-8951-4f2b-ace4-208761782bfc'], hosted agents: [] {{(pid=91829) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 25 17:07:09.013747 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6257659e-f7f3-45c1-8bf9-e5d5aa59b4db admin admin] Network 17a0e39e-1e1f-4550-b28b-d5ae3bdca362 is scheduled to be hosted by DHCP agent 8d7401c6-8951-4f2b-ace4-208761782bfc with binding_index 1 {{(pid=91829) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 25 17:07:09.023190 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.scheduler.base_scheduler [None req-6257659e-f7f3-45c1-8bf9-e5d5aa59b4db admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-790492-4-iscsi, 17a0e39e-1e1f-4550-b28b-d5ae3bdca362) {{(pid=91829) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 17:07:09.032046 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6257659e-f7f3-45c1-8bf9-e5d5aa59b4db admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:07:09.032618 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-6257659e-f7f3-45c1-8bf9-e5d5aa59b4db admin admin] Notify callbacks [] for subnet, before_response {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:09.033690 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-94d941e1-866a-4990-b0b5-15598188c0dc None None] Network 17a0e39e-1e1f-4550-b28b-d5ae3bdca362 requested from dv-cinder-790492-4-iscsi {{(pid=91831) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} May 25 17:07:09.052348 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [None req-6257659e-f7f3-45c1-8bf9-e5d5aa59b4db admin admin] 10.222.0.62 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 847 time: 0.5552099 May 25 17:07:09.055126 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.wsgi [-] (91830) accepted ('10.222.0.62', 35880) {{(pid=91830) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:07:09.060530 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.v2.base [None req-dd6e8004-21bb-45eb-8eb3-38145b043107 admin admin] Request body: {'router': {'name': 'tempest-TestVolumeBootPattern-219116984-router', 'tenant_id': '5397bf60956945c3a2bf43c6b1aa614b', 'external_gateway_info': {'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74'}}} {{(pid=91830) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 17:07:09.065229 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.quota.driver [None req-dd6e8004-21bb-45eb-8eb3-38145b043107 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91830) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 17:07:09.068956 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [None req-dd6e8004-21bb-45eb-8eb3-38145b043107 admin admin] Usage tracker for resource:router and tenant:5397bf60956945c3a2bf43c6b1aa614b is out of sync, need to count used quota {{(pid=91830) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 17:07:09.071757 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [None req-dd6e8004-21bb-45eb-8eb3-38145b043107 admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=91830) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 17:07:09.077927 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.quota.driver [None req-dd6e8004-21bb-45eb-8eb3-38145b043107 admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91830) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 17:07:09.088075 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-dd6e8004-21bb-45eb-8eb3-38145b043107 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-684888', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-31042'] for router, before_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:09.089107 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-dd6e8004-21bb-45eb-8eb3-38145b043107 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-684376', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-683143', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-647018', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-31049'] for router, precommit_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:09.103711 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-dd6e8004-21bb-45eb-8eb3-38145b043107 admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:09.246256 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2233b088-d8cd-45b3-9faf-a8cc6ef4490c None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp6d7ebc81-b6b5-52ec-b8f5-10a9de34bf46-17a0e39e-1e1f-4550-b28b-d5ae3bdca362', 'network_id': '17a0e39e-1e1f-4550-b28b-d5ae3bdca362', 'tenant_id': '5397bf60956945c3a2bf43c6b1aa614b', 'fixed_ips': [{'subnet_id': 'f5599a2e-9942-4423-a1ac-67e9b2650770'}]}} from dv-cinder-790492-4-iscsi. {{(pid=91831) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} May 25 17:07:09.247093 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-2233b088-d8cd-45b3-9faf-a8cc6ef4490c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3832070'] for port, before_create {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:09.374226 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-dd6e8004-21bb-45eb-8eb3-38145b043107 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-683170', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-684906', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-31039'] for router, precommit_update {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:09.404145 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.db_base_plugin_common [None req-2233b088-d8cd-45b3-9faf-a8cc6ef4490c None None] Allocated IP 172.20.0.2 (17a0e39e-1e1f-4550-b28b-d5ae3bdca362/f5599a2e-9942-4423-a1ac-67e9b2650770/3b3711a7-5c0c-4ba2-9c64-ab0275cc49da) {{(pid=91831) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 25 17:07:09.530897 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-42ffa665-3848-4959-b4ab-c1f48daece4c req-cebfc331-1696-4831-8009-e5cfa3576ad9 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:07:09.532425 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-42ffa665-3848-4959-b4ab-c1f48daece4c req-cebfc331-1696-4831-8009-e5cfa3576ad9 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/ports?device_id=3ead96ee-e427-4e87-9879-a1cdf303f894 HTTP/1.1" status: 200 len: 947 time: 0.0858548 May 25 17:07:09.579490 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-42ffa665-3848-4959-b4ab-c1f48daece4c req-b604e649-fb02-4251-a165-8fafb8e6ee3f tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/security-groups?id=fdd3b3f1-a2cb-4432-9874-c1d04f64207b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0407481 May 25 17:07:09.610935 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-2233b088-d8cd-45b3-9faf-a8cc6ef4490c None None] Notify callbacks [] for port, precommit_create {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:09.620853 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.provisioning_blocks [None req-2233b088-d8cd-45b3-9faf-a8cc6ef4490c None None] Transition to ACTIVE for port object 3b3711a7-5c0c-4ba2-9c64-ab0275cc49da will not be triggered until provisioned by entity L2. {{(pid=91831) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 25 17:07:09.638945 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.provisioning_blocks [None req-2233b088-d8cd-45b3-9faf-a8cc6ef4490c None None] Transition to ACTIVE for port object 3b3711a7-5c0c-4ba2-9c64-ab0275cc49da will not be triggered until provisioned by entity DHCP. {{(pid=91831) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 25 17:07:09.645210 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-2233b088-d8cd-45b3-9faf-a8cc6ef4490c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8757892520915'] for port, after_create {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:09.648761 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:07:09.700562 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-dd6e8004-21bb-45eb-8eb3-38145b043107 admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:09.715082 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2233b088-d8cd-45b3-9faf-a8cc6ef4490c None None] Network 17a0e39e-1e1f-4550-b28b-d5ae3bdca362 is already hosted by enough agents. {{(pid=91831) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 25 17:07:09.717731 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.scheduler.base_scheduler [None req-2233b088-d8cd-45b3-9faf-a8cc6ef4490c None None] Resources bound (agent type, host, resource id): {{(pid=91831) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 17:07:09.721376 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2233b088-d8cd-45b3-9faf-a8cc6ef4490c None None] Received port after_create {{(pid=91831) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 25 17:07:09.727480 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2233b088-d8cd-45b3-9faf-a8cc6ef4490c None None] Pushing event updated for resources: {'Port': ['ID=3b3711a7-5c0c-4ba2-9c64-ab0275cc49da,revision_number=1']} {{(pid=91831) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:07:09.732115 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [None req-2233b088-d8cd-45b3-9faf-a8cc6ef4490c None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.083s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:07:09.824433 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.managers [None req-2233b088-d8cd-45b3-9faf-a8cc6ef4490c None None] Attempting to bind port 3b3711a7-5c0c-4ba2-9c64-ab0275cc49da on host dv-cinder-790492-4-iscsi for vnic_type normal with profile {{(pid=91831) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 25 17:07:09.824800 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.managers [None req-2233b088-d8cd-45b3-9faf-a8cc6ef4490c None None] Attempting to bind port 3b3711a7-5c0c-4ba2-9c64-ab0275cc49da by drivers openvswitch,hyperv on host dv-cinder-790492-4-iscsi at level 0 using segments [{'id': '50ed67e9-f8d3-4927-b257-bd17654cce34', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 657, 'network_id': '17a0e39e-1e1f-4550-b28b-d5ae3bdca362'}] {{(pid=91831) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 25 17:07:09.825164 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2233b088-d8cd-45b3-9faf-a8cc6ef4490c None None] Attempting to bind port 3b3711a7-5c0c-4ba2-9c64-ab0275cc49da on network 17a0e39e-1e1f-4550-b28b-d5ae3bdca362 {{(pid=91831) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 25 17:07:09.830480 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2233b088-d8cd-45b3-9faf-a8cc6ef4490c None None] Checking agent: {'id': 'fc8251e1-071c-49f7-bc10-1337f1d37d1b', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-790492-4-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 25, 16, 50, 28), 'started_at': datetime.datetime(2021, 5, 25, 16, 50, 58), 'heartbeat_timestamp': datetime.datetime(2021, 5, 25, 17, 6, 58), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-790492-4-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=91831) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 25 17:07:09.830849 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2233b088-d8cd-45b3-9faf-a8cc6ef4490c None None] Checking segment: {'id': '50ed67e9-f8d3-4927-b257-bd17654cce34', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 657, 'network_id': '17a0e39e-1e1f-4550-b28b-d5ae3bdca362'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91831) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 25 17:07:09.831252 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-2233b088-d8cd-45b3-9faf-a8cc6ef4490c None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:09.831702 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2233b088-d8cd-45b3-9faf-a8cc6ef4490c None None] Bound using segment: {'id': '50ed67e9-f8d3-4927-b257-bd17654cce34', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 657, 'network_id': '17a0e39e-1e1f-4550-b28b-d5ae3bdca362'} {{(pid=91831) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 25 17:07:09.832160 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.managers [None req-2233b088-d8cd-45b3-9faf-a8cc6ef4490c None None] Bound port: 3b3711a7-5c0c-4ba2-9c64-ab0275cc49da, host: dv-cinder-790492-4-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '50ed67e9-f8d3-4927-b257-bd17654cce34', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 657, 'network_id': '17a0e39e-1e1f-4550-b28b-d5ae3bdca362'}}] {{(pid=91831) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 25 17:07:09.832538 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-2233b088-d8cd-45b3-9faf-a8cc6ef4490c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3832070'] for port, before_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:09.836684 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-dd6e8004-21bb-45eb-8eb3-38145b043107 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3832070'] for port, before_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:09.920926 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.db [None req-2233b088-d8cd-45b3-9faf-a8cc6ef4490c None None] For port 3b3711a7-5c0c-4ba2-9c64-ab0275cc49da, host dv-cinder-790492-4-iscsi, cleared binding levels {{(pid=91831) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 25 17:07:09.924001 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.db [None req-2233b088-d8cd-45b3-9faf-a8cc6ef4490c None None] For port 3b3711a7-5c0c-4ba2-9c64-ab0275cc49da, host dv-cinder-790492-4-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-790492-4-iscsi',level=0,port_id=3b3711a7-5c0c-4ba2-9c64-ab0275cc49da,segment=NetworkSegment(50ed67e9-f8d3-4927-b257-bd17654cce34),segment_id=50ed67e9-f8d3-4927-b257-bd17654cce34)] {{(pid=91831) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 25 17:07:09.927949 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-2233b088-d8cd-45b3-9faf-a8cc6ef4490c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8757892955028', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8757892520933', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8757892521750'] for port, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:09.931660 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:07:09.979271 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.db_base_plugin_common [None req-dd6e8004-21bb-45eb-8eb3-38145b043107 admin admin] Allocated IP 172.27.2.227 (4364b6ab-4117-4a92-baeb-f5ee2f45bf74/b947e790-d731-4b63-afc4-4aa112afe0f6/2fef7852-acf7-462f-beee-5679d3df0ad2) {{(pid=91830) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 25 17:07:10.022784 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2233b088-d8cd-45b3-9faf-a8cc6ef4490c None None] Pushing event updated for resources: {'Port': ['ID=3b3711a7-5c0c-4ba2-9c64-ab0275cc49da,revision_number=2']} {{(pid=91831) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:07:10.025459 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [None req-2233b088-d8cd-45b3-9faf-a8cc6ef4490c None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.094s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:07:10.130631 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-dd6e8004-21bb-45eb-8eb3-38145b043107 admin admin] Notify callbacks [] for port, precommit_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:10.156946 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b152a7c5-55a9-48ee-9616-d493be12b732 req-2aecdd32-1673-4b05-ab1c-2955e6a59e0e tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:07:10.158523 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-b152a7c5-55a9-48ee-9616-d493be12b732 req-2aecdd32-1673-4b05-ab1c-2955e6a59e0e tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.32 "GET /v2.0/ports?device_id=3ead96ee-e427-4e87-9879-a1cdf303f894 HTTP/1.1" status: 200 len: 947 time: 0.0860436 May 25 17:07:10.161806 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-dd6e8004-21bb-45eb-8eb3-38145b043107 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8757892520915', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-27483019'] for port, after_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:10.165563 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-3a02b9f7-d5e0-4c57-80b4-7dc57e89e759 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:07:10.237472 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-dd6e8004-21bb-45eb-8eb3-38145b043107 admin admin] Network 4364b6ab-4117-4a92-baeb-f5ee2f45bf74 is already hosted by enough agents. {{(pid=91830) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 25 17:07:10.242205 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.scheduler.base_scheduler [None req-dd6e8004-21bb-45eb-8eb3-38145b043107 admin admin] Resources bound (agent type, host, resource id): {{(pid=91830) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 17:07:10.245432 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.l3_dvrscheduler_db [None req-dd6e8004-21bb-45eb-8eb3-38145b043107 admin admin] Received port after_create {{(pid=91830) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 25 17:07:10.295216 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dd6e8004-21bb-45eb-8eb3-38145b043107 admin admin] Pushing event updated for resources: {'Port': ['ID=2fef7852-acf7-462f-beee-5679d3df0ad2,revision_number=1']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:07:10.299998 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-dd6e8004-21bb-45eb-8eb3-38145b043107 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.134s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:07:10.356556 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.plugins.ml2.plugin [req-b152a7c5-55a9-48ee-9616-d493be12b732 req-e1a9164b-b5cd-4005-97e7-5c9727957c07 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Deleting port b7d643d2-c7f2-4e49-8125-5c5ec0b9d463 {{(pid=91829) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 25 17:07:10.356870 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [req-b152a7c5-55a9-48ee-9616-d493be12b732 req-e1a9164b-b5cd-4005-97e7-5c9727957c07 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8757892952899'] for port, before_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:10.502742 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.plugins.ml2.db [req-b152a7c5-55a9-48ee-9616-d493be12b732 req-e1a9164b-b5cd-4005-97e7-5c9727957c07 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] For port b7d643d2-c7f2-4e49-8125-5c5ec0b9d463, host hv-cinder-79049, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79049',level=0,port_id=b7d643d2-c7f2-4e49-8125-5c5ec0b9d463,segment=NetworkSegment(a8fb0313-938a-4f5e-8ff4-96df8acd943b),segment_id=a8fb0313-938a-4f5e-8ff4-96df8acd943b)] {{(pid=91829) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 17:07:10.503132 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [req-b152a7c5-55a9-48ee-9616-d493be12b732 req-e1a9164b-b5cd-4005-97e7-5c9727957c07 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-683770'] for port, precommit_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:10.690488 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-dd6e8004-21bb-45eb-8eb3-38145b043107 admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:10.873012 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [req-b152a7c5-55a9-48ee-9616-d493be12b732 req-e1a9164b-b5cd-4005-97e7-5c9727957c07 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Notify callbacks [] for floatingip, precommit_update {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:10.873614 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [req-b152a7c5-55a9-48ee-9616-d493be12b732 req-e1a9164b-b5cd-4005-97e7-5c9727957c07 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-683033'] for floatingip, after_update {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:10.873614 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.db.l3_db [req-b152a7c5-55a9-48ee-9616-d493be12b732 req-e1a9164b-b5cd-4005-97e7-5c9727957c07 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Floating IP efd05916-23a4-4ee0-a108-18fa80681716 disassociated. External IP: 172.27.2.190, port: b7d643d2-c7f2-4e49-8125-5c5ec0b9d463. May 25 17:07:10.874082 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.plugins.ml2.plugin [req-b152a7c5-55a9-48ee-9616-d493be12b732 req-e1a9164b-b5cd-4005-97e7-5c9727957c07 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Calling delete_port for b7d643d2-c7f2-4e49-8125-5c5ec0b9d463 owned by compute:nova {{(pid=91829) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 25 17:07:10.907280 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f1368fc2-f5f1-4c61-b847-ae056181712e req-d3f37306-0f8c-45fe-8224-42a8de496026 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:07:10.908769 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-f1368fc2-f5f1-4c61-b847-ae056181712e req-d3f37306-0f8c-45fe-8224-42a8de496026 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/ports?device_id=3ead96ee-e427-4e87-9879-a1cdf303f894 HTTP/1.1" status: 200 len: 947 time: 0.2121499 May 25 17:07:10.972476 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-f1368fc2-f5f1-4c61-b847-ae056181712e req-c5c3b9b3-fb1e-4d04-825e-5e778872ea19 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/security-groups?id=fdd3b3f1-a2cb-4432-9874-c1d04f64207b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0568969 May 25 17:07:11.050272 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [req-b152a7c5-55a9-48ee-9616-d493be12b732 req-e1a9164b-b5cd-4005-97e7-5c9727957c07 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8757892955046', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8757892520924', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28230808'] for port, after_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:11.058126 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ed35517a-4057-4b96-9f1e-f986d687ca96 None None] Network 17a0e39e-1e1f-4550-b28b-d5ae3bdca362 requested from dv-cinder-790492-4-iscsi {{(pid=91831) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} May 25 17:07:11.059510 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:07:11.065408 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-dd6e8004-21bb-45eb-8eb3-38145b043107 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-684881', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-683233'] for router, after_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:11.104677 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e1a9164b-b5cd-4005-97e7-5c9727957c07 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Pushing event deleted for resources: {'Port': ['ID=b7d643d2-c7f2-4e49-8125-5c5ec0b9d463,revision_number=None']} {{(pid=91829) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:07:11.108825 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-e1a9164b-b5cd-4005-97e7-5c9727957c07 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.049s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:07:11.168826 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.provisioning_blocks [None req-3b03882e-bc11-4c34-ad86-3f7cd25c890f None None] Provisioning for port 3b3711a7-5c0c-4ba2-9c64-ab0275cc49da completed by entity DHCP. {{(pid=91831) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 25 17:07:11.393969 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-dd6e8004-21bb-45eb-8eb3-38145b043107 admin admin] Router 269c6b7b-91cc-4880-9e6d-b8889bac29f6 is scheduled to L3 agent a2d427c1-2d07-43e8-afbe-218c9f7d0445 with binding_index 1 {{(pid=91830) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}} May 25 17:07:11.418532 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.scheduler.l3_agent_scheduler [req-b152a7c5-55a9-48ee-9616-d493be12b732 req-e1a9164b-b5cd-4005-97e7-5c9727957c07 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Router d2ed6ef9-f77a-4b7a-b152-3e1b9c85e1ad has already been hosted by L3 agent a2d427c1-2d07-43e8-afbe-218c9f7d0445 {{(pid=91829) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 25 17:07:11.590578 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-dd6e8004-21bb-45eb-8eb3-38145b043107 admin admin] Notify agent at l3_agent.dv-cinder-790492-4-iscsi the message routers_updated {{(pid=91830) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 25 17:07:11.601584 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0c6c3e82-a5f1-463b-8014-320ea8fd376c None None] Sync routers for ids ['269c6b7b-91cc-4880-9e6d-b8889bac29f6'] in dv-cinder-790492-4-iscsi {{(pid=91831) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 25 17:07:11.618160 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-dd6e8004-21bb-45eb-8eb3-38145b043107 admin admin] Notify callbacks [] for router, before_response {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:11.618647 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-b152a7c5-55a9-48ee-9616-d493be12b732 req-e1a9164b-b5cd-4005-97e7-5c9727957c07 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Notify agent at l3_agent.dv-cinder-790492-4-iscsi the message routers_updated {{(pid=91829) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 25 17:07:11.619645 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0c6c3e82-a5f1-463b-8014-320ea8fd376c None None] Routers {'269c6b7b-91cc-4880-9e6d-b8889bac29f6'} bound to L3 agent in host dv-cinder-790492-4-iscsi {{(pid=91831) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 17:07:11.620299 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.l3_hamode_db [None req-0c6c3e82-a5f1-463b-8014-320ea8fd376c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-790492-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-05-25T16:50:28Z,description=,heartbeat_timestamp=2021-05-25T17:06:58Z,host='dv-cinder-790492-4-iscsi',id=a2d427c1-2d07-43e8-afbe-218c9f7d0445,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T16:50:28Z,topic='l3_agent')) {'router_ids': ['269c6b7b-91cc-4880-9e6d-b8889bac29f6'], 'active': True} {{(pid=91831) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 17:07:11.620648 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [None req-dd6e8004-21bb-45eb-8eb3-38145b043107 admin admin] 10.222.0.62 "POST /v2.0/routers HTTP/1.1" status: 201 len: 923 time: 2.5642653 May 25 17:07:11.622988 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.wsgi [-] (91830) accepted ('10.222.0.62', 35890) {{(pid=91830) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:07:11.632120 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-64305508-5438-430e-9f11-3755f47c2ef4 None None] Sync routers for ids ['d2ed6ef9-f77a-4b7a-b152-3e1b9c85e1ad'] in dv-cinder-790492-4-iscsi {{(pid=91832) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 25 17:07:11.646227 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.db.l3_dvrscheduler_db [None req-64305508-5438-430e-9f11-3755f47c2ef4 None None] Routers {'d2ed6ef9-f77a-4b7a-b152-3e1b9c85e1ad'} bound to L3 agent in host dv-cinder-790492-4-iscsi {{(pid=91832) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 17:07:11.647233 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.db.l3_hamode_db [None req-64305508-5438-430e-9f11-3755f47c2ef4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-790492-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-05-25T16:50:28Z,description=,heartbeat_timestamp=2021-05-25T17:06:58Z,host='dv-cinder-790492-4-iscsi',id=a2d427c1-2d07-43e8-afbe-218c9f7d0445,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T16:50:28Z,topic='l3_agent')) {'router_ids': ['d2ed6ef9-f77a-4b7a-b152-3e1b9c85e1ad'], 'active': True} {{(pid=91832) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 17:07:11.711788 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.l3_dvrscheduler_db [req-b152a7c5-55a9-48ee-9616-d493be12b732 req-e1a9164b-b5cd-4005-97e7-5c9727957c07 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] No DVR routers for this DVR port b7d643d2-c7f2-4e49-8125-5c5ec0b9d463 on host hv-cinder-79049 {{(pid=91829) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 25 17:07:11.715299 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [req-b152a7c5-55a9-48ee-9616-d493be12b732 req-e1a9164b-b5cd-4005-97e7-5c9727957c07 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-178712'] for port, before_response {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:11.718201 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '3ead96ee-e427-4e87-9879-a1cdf303f894', 'name': 'network-vif-deleted', 'tag': 'b7d643d2-c7f2-4e49-8125-5c5ec0b9d463'}] {{(pid=91829) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 25 17:07:11.752849 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-b152a7c5-55a9-48ee-9616-d493be12b732 req-e1a9164b-b5cd-4005-97e7-5c9727957c07 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.32 "DELETE /v2.0/ports/b7d643d2-c7f2-4e49-8125-5c5ec0b9d463 HTTP/1.1" status: 204 len: 173 time: 1.5884068 May 25 17:07:11.779579 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '3ead96ee-e427-4e87-9879-a1cdf303f894', 'name': 'network-vif-deleted', 'tag': 'b7d643d2-c7f2-4e49-8125-5c5ec0b9d463', 'status': 'completed', 'code': 200} May 25 17:07:11.847075 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.l3_dvr_db [None req-0c6c3e82-a5f1-463b-8014-320ea8fd376c None None] Set router 269c6b7b-91cc-4880-9e6d-b8889bac29f6 gateway port host: dv-cinder-790492-4-iscsi {{(pid=91831) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 17:07:11.962511 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.db.l3_dvr_db [None req-64305508-5438-430e-9f11-3755f47c2ef4 None None] Set router d2ed6ef9-f77a-4b7a-b152-3e1b9c85e1ad gateway port host: dv-cinder-790492-4-iscsi {{(pid=91832) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 17:07:12.180517 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.quota.resource [req-3daafd6f-5888-4a9b-bf25-1daf19047512 req-abc7254b-cce6-4f77-813f-de09fe68f44b tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Synchronizing usage tracker for tenant:bbb9e99759bc47d08005f3b1e036a6cf on resource:port {{(pid=91829) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 25 17:07:12.198528 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.rpc [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Device 3b3711a7-5c0c-4ba2-9c64-ab0275cc49da up at agent ovs-agent-dv-cinder-790492-4-iscsi {{(pid=91831) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 25 17:07:12.200158 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.quota.resource [req-3daafd6f-5888-4a9b-bf25-1daf19047512 req-abc7254b-cce6-4f77-813f-de09fe68f44b tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Unset dirty status for tenant:bbb9e99759bc47d08005f3b1e036a6cf on resource:port {{(pid=91829) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 25 17:07:12.212410 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-3daafd6f-5888-4a9b-bf25-1daf19047512 req-abc7254b-cce6-4f77-813f-de09fe68f44b tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/ports?device_id=3ead96ee-e427-4e87-9879-a1cdf303f894 HTTP/1.1" status: 200 len: 210 time: 0.0823960 May 25 17:07:12.331720 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.provisioning_blocks [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Provisioning for port 3b3711a7-5c0c-4ba2-9c64-ab0275cc49da completed by entity L2. {{(pid=91831) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 25 17:07:12.345036 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.provisioning_blocks [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Provisioning complete for port 3b3711a7-5c0c-4ba2-9c64-ab0275cc49da triggered by entity L2. {{(pid=91831) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 17:07:12.345685 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3854128'] for port, provisioning_complete {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:12.359466 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.db.l3_hamode_db [None req-64305508-5438-430e-9f11-3755f47c2ef4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd2ed6ef9-f77a-4b7a-b152-3e1b9c85e1ad', 'name': 'tempest-AttachVolumeShelveTestJSON-437778030-router', 'tenant_id': 'bbb9e99759bc47d08005f3b1e036a6cf', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'external_fixed_ips': [{'subnet_id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'ip_address': '172.27.2.253'}], 'enable_snat': True}, 'gw_port_id': '3bc942c3-5854-4018-b3fb-5071bf6c70c6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T17:00:14Z', 'updated_at': '2021-05-25T17:00:25Z', 'revision_number': 4, 'project_id': 'bbb9e99759bc47d08005f3b1e036a6cf', 'gw_port': {'id': '3bc942c3-5854-4018-b3fb-5071bf6c70c6', 'name': '', 'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'tenant_id': '', 'mac_address': 'fa:16:3e:da:a2:c4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd2ed6ef9-f77a-4b7a-b152-3e1b9c85e1ad', 'device_owner': 'network:router_gateway', 'standard_attr_id': 294, 'fixed_ips': [{'subnet_id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'ip_address': '172.27.2.253', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790492-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:00:16Z', 'updated_at': '2021-05-25T17:00:27Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-790492-4-iscsi', '_interfaces': [{'id': '735e7c1b-31b2-48e2-b2b7-538c31dbffb6', 'name': '', 'network_id': 'e5be4c6a-143f-474c-a90b-37180778cefe', 'tenant_id': 'bbb9e99759bc47d08005f3b1e036a6cf', 'mac_address': 'fa:16:3e:9a:dc:e1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd2ed6ef9-f77a-4b7a-b152-3e1b9c85e1ad', 'device_owner': 'network:router_interface', 'standard_attr_id': 319, 'fixed_ips': [{'subnet_id': '6e6b5897-e23d-4281-96cb-a6fdf9b68134', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790492-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:00:21Z', 'updated_at': '2021-05-25T17:00:33Z', 'revision_number': 5, 'project_id': 'bbb9e99759bc47d08005f3b1e036a6cf', 'subnets': [{'id': '6e6b5897-e23d-4281-96cb-a6fdf9b68134', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-790492-4-iscsi', False) {} {{(pid=91832) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 17:07:12.364717 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-64305508-5438-430e-9f11-3755f47c2ef4 None None] Checking router: d2ed6ef9-f77a-4b7a-b152-3e1b9c85e1ad for host: dv-cinder-790492-4-iscsi {{(pid=91832) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 25 17:07:12.377020 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.db.l3_dvrscheduler_db [None req-64305508-5438-430e-9f11-3755f47c2ef4 None None] Routers {'d2ed6ef9-f77a-4b7a-b152-3e1b9c85e1ad'} bound to L3 agent in host dv-cinder-790492-4-iscsi {{(pid=91832) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 17:07:12.377848 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.db.l3_hamode_db [None req-64305508-5438-430e-9f11-3755f47c2ef4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-790492-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-05-25T16:50:28Z,description=,heartbeat_timestamp=2021-05-25T17:06:58Z,host='dv-cinder-790492-4-iscsi',id=a2d427c1-2d07-43e8-afbe-218c9f7d0445,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T16:50:28Z,topic='l3_agent')) {'router_ids': ['d2ed6ef9-f77a-4b7a-b152-3e1b9c85e1ad'], 'active': True} {{(pid=91832) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 17:07:12.401700 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.l3_hamode_db [None req-0c6c3e82-a5f1-463b-8014-320ea8fd376c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '269c6b7b-91cc-4880-9e6d-b8889bac29f6', 'name': 'tempest-TestVolumeBootPattern-219116984-router', 'tenant_id': '5397bf60956945c3a2bf43c6b1aa614b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'external_fixed_ips': [{'subnet_id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'ip_address': '172.27.2.227'}], 'enable_snat': True}, 'gw_port_id': '2fef7852-acf7-462f-beee-5679d3df0ad2', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T17:07:09Z', 'updated_at': '2021-05-25T17:07:10Z', 'revision_number': 3, 'project_id': '5397bf60956945c3a2bf43c6b1aa614b', 'gw_port': {'id': '2fef7852-acf7-462f-beee-5679d3df0ad2', 'name': '', 'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'tenant_id': '', 'mac_address': 'fa:16:3e:35:b9:d0', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '269c6b7b-91cc-4880-9e6d-b8889bac29f6', 'device_owner': 'network:router_gateway', 'standard_attr_id': 533, 'fixed_ips': [{'subnet_id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'ip_address': '172.27.2.227', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:07:09Z', 'updated_at': '2021-05-25T17:07:09Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-790492-4-iscsi'}], 'dv-cinder-790492-4-iscsi', False) {} {{(pid=91831) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 17:07:12.409180 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0c6c3e82-a5f1-463b-8014-320ea8fd376c None None] Checking router: 269c6b7b-91cc-4880-9e6d-b8889bac29f6 for host: dv-cinder-790492-4-iscsi {{(pid=91831) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 25 17:07:12.409720 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0c6c3e82-a5f1-463b-8014-320ea8fd376c None None] Updating router 269c6b7b-91cc-4880-9e6d-b8889bac29f6 port 2fef7852-acf7-462f-beee-5679d3df0ad2 binding host dv-cinder-790492-4-iscsi {{(pid=91831) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} May 25 17:07:12.439666 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-028ded24-f221-4014-a310-834e174107ce admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3832070'] for port, before_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:12.480594 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-0c6c3e82-a5f1-463b-8014-320ea8fd376c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3832070'] for port, before_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:12.573879 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.db.l3_dvr_db [None req-64305508-5438-430e-9f11-3755f47c2ef4 None None] Set router d2ed6ef9-f77a-4b7a-b152-3e1b9c85e1ad gateway port host: dv-cinder-790492-4-iscsi {{(pid=91832) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 17:07:12.651739 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.db_base_plugin_common [None req-028ded24-f221-4014-a310-834e174107ce admin admin] Allocated IP 172.20.0.1 (17a0e39e-1e1f-4550-b28b-d5ae3bdca362/f5599a2e-9942-4423-a1ac-67e9b2650770/4972e3a9-91eb-48ce-8b7b-b0906822cebf) {{(pid=91830) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 25 17:07:12.655552 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3832070'] for port, before_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:12.771315 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.db [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] For port 3b3711a7-5c0c-4ba2-9c64-ab0275cc49da, host dv-cinder-790492-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-790492-4-iscsi',level=0,port_id=3b3711a7-5c0c-4ba2-9c64-ab0275cc49da,segment=NetworkSegment(50ed67e9-f8d3-4927-b257-bd17654cce34),segment_id=50ed67e9-f8d3-4927-b257-bd17654cce34)] {{(pid=91831) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 17:07:12.779326 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8757892955028', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8757892520933', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8757892521750'] for port, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:12.782870 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:07:12.817356 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-028ded24-f221-4014-a310-834e174107ce admin admin] Notify callbacks [] for port, precommit_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:12.836883 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.provisioning_blocks [None req-028ded24-f221-4014-a310-834e174107ce admin admin] Transition to ACTIVE for port object 4972e3a9-91eb-48ce-8b7b-b0906822cebf will not be triggered until provisioned by entity DHCP. {{(pid=91830) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 25 17:07:12.866219 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-028ded24-f221-4014-a310-834e174107ce admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8757892520915', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-27483019'] for port, after_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:12.872650 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-39832d44-63ae-4e83-b8ae-4fa49fd193a6 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:07:12.887338 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Pushing event updated for resources: {'Port': ['ID=3b3711a7-5c0c-4ba2-9c64-ab0275cc49da,revision_number=3']} {{(pid=91831) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:07:12.891106 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.108s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:07:12.904264 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.db.l3_hamode_db [None req-64305508-5438-430e-9f11-3755f47c2ef4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd2ed6ef9-f77a-4b7a-b152-3e1b9c85e1ad', 'name': 'tempest-AttachVolumeShelveTestJSON-437778030-router', 'tenant_id': 'bbb9e99759bc47d08005f3b1e036a6cf', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'external_fixed_ips': [{'subnet_id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'ip_address': '172.27.2.253'}], 'enable_snat': True}, 'gw_port_id': '3bc942c3-5854-4018-b3fb-5071bf6c70c6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T17:00:14Z', 'updated_at': '2021-05-25T17:00:25Z', 'revision_number': 4, 'project_id': 'bbb9e99759bc47d08005f3b1e036a6cf', 'gw_port': {'id': '3bc942c3-5854-4018-b3fb-5071bf6c70c6', 'name': '', 'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'tenant_id': '', 'mac_address': 'fa:16:3e:da:a2:c4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd2ed6ef9-f77a-4b7a-b152-3e1b9c85e1ad', 'device_owner': 'network:router_gateway', 'standard_attr_id': 294, 'fixed_ips': [{'subnet_id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'ip_address': '172.27.2.253', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790492-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:00:16Z', 'updated_at': '2021-05-25T17:00:27Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-790492-4-iscsi', '_interfaces': [{'id': '735e7c1b-31b2-48e2-b2b7-538c31dbffb6', 'name': '', 'network_id': 'e5be4c6a-143f-474c-a90b-37180778cefe', 'tenant_id': 'bbb9e99759bc47d08005f3b1e036a6cf', 'mac_address': 'fa:16:3e:9a:dc:e1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd2ed6ef9-f77a-4b7a-b152-3e1b9c85e1ad', 'device_owner': 'network:router_interface', 'standard_attr_id': 319, 'fixed_ips': [{'subnet_id': '6e6b5897-e23d-4281-96cb-a6fdf9b68134', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790492-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:00:21Z', 'updated_at': '2021-05-25T17:00:33Z', 'revision_number': 5, 'project_id': 'bbb9e99759bc47d08005f3b1e036a6cf', 'subnets': [{'id': '6e6b5897-e23d-4281-96cb-a6fdf9b68134', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-790492-4-iscsi', False) {} {{(pid=91832) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 17:07:12.908686 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-64305508-5438-430e-9f11-3755f47c2ef4 None None] The sync data for ids ['d2ed6ef9-f77a-4b7a-b152-3e1b9c85e1ad'] in dv-cinder-790492-4-iscsi is: [{'id': 'd2ed6ef9-f77a-4b7a-b152-3e1b9c85e1ad', 'name': 'tempest-AttachVolumeShelveTestJSON-437778030-router', 'tenant_id': 'bbb9e99759bc47d08005f3b1e036a6cf', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'external_fixed_ips': [{'subnet_id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'ip_address': '172.27.2.253'}], 'enable_snat': True}, 'gw_port_id': '3bc942c3-5854-4018-b3fb-5071bf6c70c6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T17:00:14Z', 'updated_at': '2021-05-25T17:00:25Z', 'revision_number': 4, 'project_id': 'bbb9e99759bc47d08005f3b1e036a6cf', 'gw_port': {'id': '3bc942c3-5854-4018-b3fb-5071bf6c70c6', 'name': '', 'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'tenant_id': '', 'mac_address': 'fa:16:3e:da:a2:c4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd2ed6ef9-f77a-4b7a-b152-3e1b9c85e1ad', 'device_owner': 'network:router_gateway', 'standard_attr_id': 294, 'fixed_ips': [{'subnet_id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'ip_address': '172.27.2.253', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790492-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:00:16Z', 'updated_at': '2021-05-25T17:00:27Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-790492-4-iscsi', '_interfaces': [{'id': '735e7c1b-31b2-48e2-b2b7-538c31dbffb6', 'name': '', 'network_id': 'e5be4c6a-143f-474c-a90b-37180778cefe', 'tenant_id': 'bbb9e99759bc47d08005f3b1e036a6cf', 'mac_address': 'fa:16:3e:9a:dc:e1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd2ed6ef9-f77a-4b7a-b152-3e1b9c85e1ad', 'device_owner': 'network:router_interface', 'standard_attr_id': 319, 'fixed_ips': [{'subnet_id': '6e6b5897-e23d-4281-96cb-a6fdf9b68134', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790492-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:00:21Z', 'updated_at': '2021-05-25T17:00:33Z', 'revision_number': 5, 'project_id': 'bbb9e99759bc47d08005f3b1e036a6cf', 'subnets': [{'id': '6e6b5897-e23d-4281-96cb-a6fdf9b68134', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=91832) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 25 17:07:12.946234 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-028ded24-f221-4014-a310-834e174107ce admin admin] Network 17a0e39e-1e1f-4550-b28b-d5ae3bdca362 is already hosted by enough agents. {{(pid=91830) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 25 17:07:12.949000 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.scheduler.base_scheduler [None req-028ded24-f221-4014-a310-834e174107ce admin admin] Resources bound (agent type, host, resource id): {{(pid=91830) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 17:07:12.952298 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.l3_dvrscheduler_db [None req-028ded24-f221-4014-a310-834e174107ce admin admin] Received port after_create {{(pid=91830) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 25 17:07:12.971850 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-0c6c3e82-a5f1-463b-8014-320ea8fd376c None None] Notify callbacks [] for port, precommit_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:12.991145 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.provisioning_blocks [None req-0c6c3e82-a5f1-463b-8014-320ea8fd376c None None] Transition to ACTIVE for port object 2fef7852-acf7-462f-beee-5679d3df0ad2 will not be triggered until provisioned by entity L2. {{(pid=91831) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 25 17:07:12.991517 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-028ded24-f221-4014-a310-834e174107ce admin admin] Pushing event updated for resources: {'Port': ['ID=4972e3a9-91eb-48ce-8b7b-b0906822cebf,revision_number=1']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:07:12.995079 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-028ded24-f221-4014-a310-834e174107ce admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.122s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:07:12.999229 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-0c6c3e82-a5f1-463b-8014-320ea8fd376c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8757892955028', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8757892520933', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8757892521750'] for port, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:13.004609 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:07:13.023690 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-028ded24-f221-4014-a310-834e174107ce admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-680080'] for router_interface, before_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:13.085463 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.managers [None req-0c6c3e82-a5f1-463b-8014-320ea8fd376c None None] Attempting to bind port 2fef7852-acf7-462f-beee-5679d3df0ad2 on host dv-cinder-790492-4-iscsi for vnic_type normal with profile {{(pid=91831) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 25 17:07:13.086086 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.managers [None req-0c6c3e82-a5f1-463b-8014-320ea8fd376c None None] Attempting to bind port 2fef7852-acf7-462f-beee-5679d3df0ad2 by drivers openvswitch,hyperv on host dv-cinder-790492-4-iscsi at level 0 using segments [{'id': '414a8468-1d66-4792-9e81-d8ac5ccf1512', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74'}] {{(pid=91831) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 25 17:07:13.086557 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0c6c3e82-a5f1-463b-8014-320ea8fd376c None None] Attempting to bind port 2fef7852-acf7-462f-beee-5679d3df0ad2 on network 4364b6ab-4117-4a92-baeb-f5ee2f45bf74 {{(pid=91831) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 25 17:07:13.093239 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-11bc4dd5-ae61-44ef-93dc-2365d150821b None None] Pushing event updated for resources: {'Port': ['ID=2fef7852-acf7-462f-beee-5679d3df0ad2,revision_number=2']} {{(pid=91831) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:07:13.098199 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [None req-11bc4dd5-ae61-44ef-93dc-2365d150821b None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.094s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:07:13.099545 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0c6c3e82-a5f1-463b-8014-320ea8fd376c None None] Checking agent: {'id': 'fc8251e1-071c-49f7-bc10-1337f1d37d1b', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-790492-4-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 25, 16, 50, 28), 'started_at': datetime.datetime(2021, 5, 25, 16, 50, 58), 'heartbeat_timestamp': datetime.datetime(2021, 5, 25, 17, 6, 58), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-790492-4-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=91831) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 25 17:07:13.100187 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0c6c3e82-a5f1-463b-8014-320ea8fd376c None None] Checking segment: {'id': '414a8468-1d66-4792-9e81-d8ac5ccf1512', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91831) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 25 17:07:13.100836 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-0c6c3e82-a5f1-463b-8014-320ea8fd376c None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:13.101819 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0c6c3e82-a5f1-463b-8014-320ea8fd376c None None] Bound using segment: {'id': '414a8468-1d66-4792-9e81-d8ac5ccf1512', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74'} {{(pid=91831) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 25 17:07:13.102619 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.managers [None req-0c6c3e82-a5f1-463b-8014-320ea8fd376c None None] Bound port: 2fef7852-acf7-462f-beee-5679d3df0ad2, host: dv-cinder-790492-4-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '414a8468-1d66-4792-9e81-d8ac5ccf1512', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74'}}] {{(pid=91831) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 25 17:07:13.103224 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-0c6c3e82-a5f1-463b-8014-320ea8fd376c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3832070'] for port, before_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:13.195703 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.db [None req-0c6c3e82-a5f1-463b-8014-320ea8fd376c None None] For port 2fef7852-acf7-462f-beee-5679d3df0ad2, host dv-cinder-790492-4-iscsi, cleared binding levels {{(pid=91831) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 25 17:07:13.200304 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.db [None req-0c6c3e82-a5f1-463b-8014-320ea8fd376c None None] For port 2fef7852-acf7-462f-beee-5679d3df0ad2, host dv-cinder-790492-4-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-790492-4-iscsi',level=0,port_id=2fef7852-acf7-462f-beee-5679d3df0ad2,segment=NetworkSegment(414a8468-1d66-4792-9e81-d8ac5ccf1512),segment_id=414a8468-1d66-4792-9e81-d8ac5ccf1512)] {{(pid=91831) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 25 17:07:13.204601 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b225affd-90b6-426c-920a-7be43be6336e None None] New status for floating IP efd05916-23a4-4ee0-a108-18fa80681716: DOWN {{(pid=91831) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} May 25 17:07:13.278829 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-0c6c3e82-a5f1-463b-8014-320ea8fd376c None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8757892955028', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8757892520933', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8757892521750'] for port, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:13.290036 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:07:13.336645 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.wsgi [-] (91829) accepted ('10.222.0.62', 35902) {{(pid=91829) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:07:13.403860 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-097be494-e01f-41b4-83f1-8d2162c5d575 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Notify callbacks [] for security_group, before_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:13.420005 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-028ded24-f221-4014-a310-834e174107ce admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3832070'] for port, before_update {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:13.424282 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.provisioning_blocks [None req-75f8e4b1-5829-4095-ad13-139d2dffc257 None None] Provisioning for port 4972e3a9-91eb-48ce-8b7b-b0906822cebf completed by entity DHCP. {{(pid=91831) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 25 17:07:13.440704 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-097be494-e01f-41b4-83f1-8d2162c5d575 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Notify callbacks [] for security_group, precommit_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:13.493647 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.provisioning_blocks [None req-75f8e4b1-5829-4095-ad13-139d2dffc257 None None] Provisioning complete for port 4972e3a9-91eb-48ce-8b7b-b0906822cebf triggered by entity DHCP. {{(pid=91831) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 17:07:13.494040 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-75f8e4b1-5829-4095-ad13-139d2dffc257 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3854128'] for port, provisioning_complete {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:13.498779 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-097be494-e01f-41b4-83f1-8d2162c5d575 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-640836'] for security_group, after_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:13.503785 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-a2df9107-e961-4d1e-9b4a-3e7e133b2c0d admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:07:13.518585 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-097be494-e01f-41b4-83f1-8d2162c5d575 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=fdd3b3f1-a2cb-4432-9874-c1d04f64207b,revision_number=None']} {{(pid=91829) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:07:13.521382 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-097be494-e01f-41b4-83f1-8d2162c5d575 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.018s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:07:13.522635 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-097be494-e01f-41b4-83f1-8d2162c5d575 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Notify callbacks [] for security_group, before_response {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:13.523919 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [None req-097be494-e01f-41b4-83f1-8d2162c5d575 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "DELETE /v2.0/security-groups/fdd3b3f1-a2cb-4432-9874-c1d04f64207b HTTP/1.1" status: 204 len: 168 time: 0.1862676 May 25 17:07:13.526719 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.wsgi [-] (91829) accepted ('10.222.0.62', 35906) {{(pid=91829) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:07:13.547024 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.api.v2.resource [None req-4c5a6ff8-2767-47ac-9e72-bb62b1137103 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] show failed (client error): The resource could not be found. May 25 17:07:13.549432 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [None req-4c5a6ff8-2767-47ac-9e72-bb62b1137103 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/security-groups/fdd3b3f1-a2cb-4432-9874-c1d04f64207b HTTP/1.1" status: 404 len: 347 time: 0.0213954 May 25 17:07:13.551889 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.wsgi [-] (91829) accepted ('10.222.0.62', 35910) {{(pid=91829) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:07:13.581336 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0c6c3e82-a5f1-463b-8014-320ea8fd376c None None] Routers {'269c6b7b-91cc-4880-9e6d-b8889bac29f6'} bound to L3 agent in host dv-cinder-790492-4-iscsi {{(pid=91831) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 17:07:13.581996 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.l3_hamode_db [None req-0c6c3e82-a5f1-463b-8014-320ea8fd376c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-790492-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-05-25T16:50:28Z,description=,heartbeat_timestamp=2021-05-25T17:06:58Z,host='dv-cinder-790492-4-iscsi',id=a2d427c1-2d07-43e8-afbe-218c9f7d0445,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T16:50:28Z,topic='l3_agent')) {'router_ids': ['269c6b7b-91cc-4880-9e6d-b8889bac29f6'], 'active': True} {{(pid=91831) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 17:07:13.640517 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-11bc4dd5-ae61-44ef-93dc-2365d150821b None None] Pushing event updated for resources: {'Port': ['ID=2fef7852-acf7-462f-beee-5679d3df0ad2,revision_number=3']} {{(pid=91831) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:07:13.652191 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [None req-11bc4dd5-ae61-44ef-93dc-2365d150821b None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.362s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:07:13.668264 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-028ded24-f221-4014-a310-834e174107ce admin admin] Notify callbacks [] for port, precommit_update {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:13.671659 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.plugin [None req-75f8e4b1-5829-4095-ad13-139d2dffc257 None None] Port 4972e3a9-91eb-48ce-8b7b-b0906822cebf cannot update to ACTIVE because it is not bound. {{(pid=91831) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 25 17:07:13.674411 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-028ded24-f221-4014-a310-834e174107ce admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8757892955028', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8757892520933', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8757892521750', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-27483010'] for port, after_update {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:13.700851 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-5d4e4bae-db38-4911-8f71-2592abdbdfc1 tempest-VolumesSnapshotTestJSON-991813121 tempest-VolumesSnapshotTestJSON-991813121-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:07:13.729670 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.rpc [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Device b7d643d2-c7f2-4e49-8125-5c5ec0b9d463 no longer exists at agent hyperv_hv-cinder-79049 {{(pid=91831) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 25 17:07:13.797201 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-028ded24-f221-4014-a310-834e174107ce admin admin] Pushing event updated for resources: {'Port': ['ID=4972e3a9-91eb-48ce-8b7b-b0906822cebf,revision_number=2']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:07:13.800652 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-028ded24-f221-4014-a310-834e174107ce admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.100s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:07:13.800808 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.plugins.ml2.plugin [None req-35ab179e-7e88-49ca-b3e2-7f321ea42e38 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Deleting port 79c058e5-5666-4bcc-810c-a46796e283b0 {{(pid=91829) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 25 17:07:13.801124 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-35ab179e-7e88-49ca-b3e2-7f321ea42e38 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8757892952899'] for port, before_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:13.806155 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-028ded24-f221-4014-a310-834e174107ce admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-549138', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-679997'] for router_interface, after_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:13.827104 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.plugin [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] No Port match for: b7d643d2-c7f2-4e49-8125-5c5ec0b9d463 {{(pid=91831) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}} May 25 17:07:13.827400 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.rpc [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Device b7d643d2-c7f2-4e49-8125-5c5ec0b9d463 not bound to the agent host hv-cinder-79049 {{(pid=91831) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 25 17:07:13.852200 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.l3_dvr_db [None req-0c6c3e82-a5f1-463b-8014-320ea8fd376c None None] Set router 269c6b7b-91cc-4880-9e6d-b8889bac29f6 gateway port host: dv-cinder-790492-4-iscsi {{(pid=91831) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 17:07:13.925889 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-35ab179e-7e88-49ca-b3e2-7f321ea42e38 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-683770'] for port, precommit_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:13.926343 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-35ab179e-7e88-49ca-b3e2-7f321ea42e38 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:13.956687 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-028ded24-f221-4014-a310-834e174107ce admin admin] Network 17a0e39e-1e1f-4550-b28b-d5ae3bdca362 is already hosted by enough agents. {{(pid=91830) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 25 17:07:13.957848 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.scheduler.base_scheduler [None req-028ded24-f221-4014-a310-834e174107ce admin admin] Resources bound (agent type, host, resource id): {{(pid=91830) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 17:07:13.987421 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.rpc [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Device 3b3711a7-5c0c-4ba2-9c64-ab0275cc49da up at agent ovs-agent-dv-cinder-790492-4-iscsi {{(pid=91831) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 25 17:07:14.060782 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.plugins.ml2.plugin [None req-35ab179e-7e88-49ca-b3e2-7f321ea42e38 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Calling delete_port for 79c058e5-5666-4bcc-810c-a46796e283b0 owned by network:floatingip {{(pid=91829) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 25 17:07:14.141546 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.provisioning_blocks [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Provisioning complete for port 3b3711a7-5c0c-4ba2-9c64-ab0275cc49da triggered by entity L2. {{(pid=91831) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 17:07:14.142268 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3854128'] for port, provisioning_complete {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:14.198297 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-35ab179e-7e88-49ca-b3e2-7f321ea42e38 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8757892955046', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8757892520924', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28230808'] for port, after_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:14.207831 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-11322510-0860-4b24-bea0-e87b70011e99 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:07:14.210258 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-028ded24-f221-4014-a310-834e174107ce admin admin] Router 269c6b7b-91cc-4880-9e6d-b8889bac29f6 has already been hosted by L3 agent a2d427c1-2d07-43e8-afbe-218c9f7d0445 {{(pid=91830) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 25 17:07:14.229520 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.provisioning_blocks [None req-1f421cd7-7dcb-426c-b7ba-7a65c5a22a65 None None] Provisioning complete for port 4972e3a9-91eb-48ce-8b7b-b0906822cebf triggered by entity DHCP. {{(pid=91831) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 17:07:14.230167 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-1f421cd7-7dcb-426c-b7ba-7a65c5a22a65 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3854128'] for port, provisioning_complete {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:14.250723 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-35ab179e-7e88-49ca-b3e2-7f321ea42e38 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Pushing event deleted for resources: {'Port': ['ID=79c058e5-5666-4bcc-810c-a46796e283b0,revision_number=None']} {{(pid=91829) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:07:14.255116 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-35ab179e-7e88-49ca-b3e2-7f321ea42e38 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.047s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:07:14.318347 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.plugin [None req-1f421cd7-7dcb-426c-b7ba-7a65c5a22a65 None None] Port 4972e3a9-91eb-48ce-8b7b-b0906822cebf cannot update to ACTIVE because it is not bound. {{(pid=91831) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 25 17:07:14.350522 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-35ab179e-7e88-49ca-b3e2-7f321ea42e38 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Notify callbacks [] for floatingip, after_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:14.368920 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-35ab179e-7e88-49ca-b3e2-7f321ea42e38 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-178712'] for floatingip, before_response {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:14.377644 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [None req-35ab179e-7e88-49ca-b3e2-7f321ea42e38 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "DELETE /v2.0/floatingips/efd05916-23a4-4ee0-a108-18fa80681716 HTTP/1.1" status: 204 len: 168 time: 0.8224163 May 25 17:07:14.408667 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-028ded24-f221-4014-a310-834e174107ce admin admin] Notify agent at l3_agent.dv-cinder-790492-4-iscsi the message routers_updated {{(pid=91830) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 25 17:07:14.420016 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [None req-028ded24-f221-4014-a310-834e174107ce admin admin] 10.222.0.62 "PUT /v2.0/routers/269c6b7b-91cc-4880-9e6d-b8889bac29f6/add_router_interface HTTP/1.1" status: 200 len: 503 time: 2.7955787 May 25 17:07:14.451167 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.l3_hamode_db [None req-0c6c3e82-a5f1-463b-8014-320ea8fd376c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '269c6b7b-91cc-4880-9e6d-b8889bac29f6', 'name': 'tempest-TestVolumeBootPattern-219116984-router', 'tenant_id': '5397bf60956945c3a2bf43c6b1aa614b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'external_fixed_ips': [{'subnet_id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'ip_address': '172.27.2.227'}], 'enable_snat': True}, 'gw_port_id': '2fef7852-acf7-462f-beee-5679d3df0ad2', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T17:07:09Z', 'updated_at': '2021-05-25T17:07:13Z', 'revision_number': 4, 'project_id': '5397bf60956945c3a2bf43c6b1aa614b', 'gw_port': {'id': '2fef7852-acf7-462f-beee-5679d3df0ad2', 'name': '', 'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'tenant_id': '', 'mac_address': 'fa:16:3e:35:b9:d0', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '269c6b7b-91cc-4880-9e6d-b8889bac29f6', 'device_owner': 'network:router_gateway', 'standard_attr_id': 533, 'fixed_ips': [{'subnet_id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'ip_address': '172.27.2.227', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790492-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:07:09Z', 'updated_at': '2021-05-25T17:07:13Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-790492-4-iscsi', '_interfaces': [{'id': '4972e3a9-91eb-48ce-8b7b-b0906822cebf', 'name': '', 'network_id': '17a0e39e-1e1f-4550-b28b-d5ae3bdca362', 'tenant_id': '5397bf60956945c3a2bf43c6b1aa614b', 'mac_address': 'fa:16:3e:ce:fe:1a', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '269c6b7b-91cc-4880-9e6d-b8889bac29f6', 'device_owner': 'network:router_interface', 'standard_attr_id': 534, 'fixed_ips': [{'subnet_id': 'f5599a2e-9942-4423-a1ac-67e9b2650770', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:07:12Z', 'updated_at': '2021-05-25T17:07:12Z', 'revision_number': 1, 'project_id': '5397bf60956945c3a2bf43c6b1aa614b', 'subnets': [{'id': 'f5599a2e-9942-4423-a1ac-67e9b2650770', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-790492-4-iscsi', False) {} {{(pid=91831) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 17:07:14.458813 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0c6c3e82-a5f1-463b-8014-320ea8fd376c None None] The sync data for ids ['269c6b7b-91cc-4880-9e6d-b8889bac29f6'] in dv-cinder-790492-4-iscsi is: [{'id': '269c6b7b-91cc-4880-9e6d-b8889bac29f6', 'name': 'tempest-TestVolumeBootPattern-219116984-router', 'tenant_id': '5397bf60956945c3a2bf43c6b1aa614b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'external_fixed_ips': [{'subnet_id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'ip_address': '172.27.2.227'}], 'enable_snat': True}, 'gw_port_id': '2fef7852-acf7-462f-beee-5679d3df0ad2', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T17:07:09Z', 'updated_at': '2021-05-25T17:07:13Z', 'revision_number': 4, 'project_id': '5397bf60956945c3a2bf43c6b1aa614b', 'gw_port': {'id': '2fef7852-acf7-462f-beee-5679d3df0ad2', 'name': '', 'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'tenant_id': '', 'mac_address': 'fa:16:3e:35:b9:d0', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '269c6b7b-91cc-4880-9e6d-b8889bac29f6', 'device_owner': 'network:router_gateway', 'standard_attr_id': 533, 'fixed_ips': [{'subnet_id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'ip_address': '172.27.2.227', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790492-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:07:09Z', 'updated_at': '2021-05-25T17:07:13Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-790492-4-iscsi', '_interfaces': [{'id': '4972e3a9-91eb-48ce-8b7b-b0906822cebf', 'name': '', 'network_id': '17a0e39e-1e1f-4550-b28b-d5ae3bdca362', 'tenant_id': '5397bf60956945c3a2bf43c6b1aa614b', 'mac_address': 'fa:16:3e:ce:fe:1a', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '269c6b7b-91cc-4880-9e6d-b8889bac29f6', 'device_owner': 'network:router_interface', 'standard_attr_id': 534, 'fixed_ips': [{'subnet_id': 'f5599a2e-9942-4423-a1ac-67e9b2650770', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:07:12Z', 'updated_at': '2021-05-25T17:07:12Z', 'revision_number': 1, 'project_id': '5397bf60956945c3a2bf43c6b1aa614b', 'subnets': [{'id': 'f5599a2e-9942-4423-a1ac-67e9b2650770', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=91831) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 25 17:07:14.739695 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.wsgi [-] (91829) accepted ('10.222.0.62', 35924) {{(pid=91829) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:07:14.746569 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.v2.base [None req-e5e9c981-b9f9-4d94-8858-c94b44ab6b03 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Request body: {'security_group': {'name': 'tempest-securitygroup--734774', 'description': 'tempest-description--1914766566'}} {{(pid=91829) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 17:07:14.752574 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.quota.driver [None req-e5e9c981-b9f9-4d94-8858-c94b44ab6b03 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91829) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 17:07:14.757262 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.quota.resource [None req-e5e9c981-b9f9-4d94-8858-c94b44ab6b03 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Usage tracker for resource:security_group and tenant:bbb9e99759bc47d08005f3b1e036a6cf is out of sync, need to count used quota {{(pid=91829) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 17:07:14.761442 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.quota.resource [None req-e5e9c981-b9f9-4d94-8858-c94b44ab6b03 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Quota usage for security_group was recalculated. Used quota:1. {{(pid=91829) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 17:07:14.768087 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.quota.driver [None req-e5e9c981-b9f9-4d94-8858-c94b44ab6b03 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=91829) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 17:07:14.784513 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-e5e9c981-b9f9-4d94-8858-c94b44ab6b03 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Notify callbacks [] for security_group, before_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:14.810245 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.quota.driver [None req-e5e9c981-b9f9-4d94-8858-c94b44ab6b03 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91829) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 17:07:14.817159 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.quota.resource [None req-e5e9c981-b9f9-4d94-8858-c94b44ab6b03 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Usage tracker for resource:security_group_rule and tenant:bbb9e99759bc47d08005f3b1e036a6cf is out of sync, need to count used quota {{(pid=91829) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 17:07:14.821140 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.quota.resource [None req-e5e9c981-b9f9-4d94-8858-c94b44ab6b03 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=91829) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 17:07:14.830481 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.quota.driver [None req-e5e9c981-b9f9-4d94-8858-c94b44ab6b03 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=91829) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 17:07:14.907822 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-e5e9c981-b9f9-4d94-8858-c94b44ab6b03 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Notify callbacks [] for security_group, precommit_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:14.912665 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-e5e9c981-b9f9-4d94-8858-c94b44ab6b03 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-640836'] for security_group, after_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:14.917487 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-6b71dc7b-6a7b-474d-88a8-1f34eddd581a admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.001s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:07:14.959222 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e5e9c981-b9f9-4d94-8858-c94b44ab6b03 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Pushing event updated for resources: {'SecurityGroup': ['ID=4e6b7b77-0833-47dc-be2e-ec9c7c960bb9,revision_number=1']} {{(pid=91829) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:07:14.962599 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-e5e9c981-b9f9-4d94-8858-c94b44ab6b03 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Notify callbacks [] for security_group, before_response {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:14.967500 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [None req-e5e9c981-b9f9-4d94-8858-c94b44ab6b03 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1776 time: 0.2239258 May 25 17:07:14.967500 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-e5e9c981-b9f9-4d94-8858-c94b44ab6b03 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.048s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:07:14.968428 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.wsgi [-] (91829) accepted ('10.222.0.62', 35934) {{(pid=91829) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:07:14.972730 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.v2.base [None req-c78cb6e9-00cc-40ff-b874-e0ab4f350170 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Request body: {'security_group_rule': {'security_group_id': '4e6b7b77-0833-47dc-be2e-ec9c7c960bb9', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=91829) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 17:07:14.978758 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.quota.driver [None req-c78cb6e9-00cc-40ff-b874-e0ab4f350170 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91829) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 17:07:14.984210 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.quota.resource [None req-c78cb6e9-00cc-40ff-b874-e0ab4f350170 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Usage tracker for resource:security_group_rule and tenant:bbb9e99759bc47d08005f3b1e036a6cf is out of sync, need to count used quota {{(pid=91829) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 17:07:14.987384 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.quota.resource [None req-c78cb6e9-00cc-40ff-b874-e0ab4f350170 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=91829) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 17:07:14.994099 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.quota.driver [None req-c78cb6e9-00cc-40ff-b874-e0ab4f350170 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=91829) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 17:07:15.020442 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-c78cb6e9-00cc-40ff-b874-e0ab4f350170 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Notify callbacks [] for security_group_rule, before_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:15.046458 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.wsgi [-] (91830) accepted ('10.222.0.62', 35940) {{(pid=91830) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:07:15.052731 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.v2.base [None req-035a371f-9d66-47a8-9b06-9feef1fbd693 admin admin] Request body: {'network': {'name': 'tempest-TestVolumeBootPattern-2097476481-network', 'tenant_id': 'ebceaa13caaa4258abf32e19141de493'}} {{(pid=91830) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 17:07:15.058023 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.quota.driver [None req-035a371f-9d66-47a8-9b06-9feef1fbd693 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91830) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 17:07:15.062446 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [None req-035a371f-9d66-47a8-9b06-9feef1fbd693 admin admin] Usage tracker for resource:network and tenant:ebceaa13caaa4258abf32e19141de493 is out of sync, need to count used quota {{(pid=91830) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 17:07:15.065537 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [None req-035a371f-9d66-47a8-9b06-9feef1fbd693 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=91830) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 17:07:15.073185 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.quota.driver [None req-035a371f-9d66-47a8-9b06-9feef1fbd693 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91830) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 17:07:15.085018 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-035a371f-9d66-47a8-9b06-9feef1fbd693 admin admin] Made reservation on behalf of ebceaa13caaa4258abf32e19141de493 for: {'network': 1} {{(pid=91830) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 25 17:07:15.087848 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-035a371f-9d66-47a8-9b06-9feef1fbd693 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-3832077'] for network, before_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:15.107183 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-035a371f-9d66-47a8-9b06-9feef1fbd693 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:15.125739 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.quota.driver [None req-035a371f-9d66-47a8-9b06-9feef1fbd693 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91830) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 17:07:15.131839 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [None req-035a371f-9d66-47a8-9b06-9feef1fbd693 admin admin] Usage tracker for resource:security_group_rule and tenant:ebceaa13caaa4258abf32e19141de493 is out of sync, need to count used quota {{(pid=91830) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 17:07:15.134975 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [None req-035a371f-9d66-47a8-9b06-9feef1fbd693 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91830) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 17:07:15.141108 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.quota.driver [None req-035a371f-9d66-47a8-9b06-9feef1fbd693 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91830) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 17:07:15.199947 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-c78cb6e9-00cc-40ff-b874-e0ab4f350170 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:15.203823 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-c78cb6e9-00cc-40ff-b874-e0ab4f350170 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-640874'] for security_group_rule, after_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:15.213854 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:07:15.234921 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c78cb6e9-00cc-40ff-b874-e0ab4f350170 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=99e6dcd5-27e2-4ba0-a8e8-95c3bc7ff17d,revision_number=0']} {{(pid=91829) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:07:15.237808 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-c78cb6e9-00cc-40ff-b874-e0ab4f350170 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.024s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:07:15.247171 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-c78cb6e9-00cc-40ff-b874-e0ab4f350170 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Notify callbacks [] for security_group_rule, before_response {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:15.249965 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [None req-c78cb6e9-00cc-40ff-b874-e0ab4f350170 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.2798569 May 25 17:07:15.251279 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.wsgi [-] (91829) accepted ('10.222.0.62', 35944) {{(pid=91829) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:07:15.256985 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.v2.base [None req-5dbfa5e8-ecf6-443c-89d1-89430574d1d9 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Request body: {'security_group_rule': {'security_group_id': '4e6b7b77-0833-47dc-be2e-ec9c7c960bb9', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=91829) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 17:07:15.263994 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.quota.driver [None req-5dbfa5e8-ecf6-443c-89d1-89430574d1d9 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91829) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 17:07:15.267724 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-035a371f-9d66-47a8-9b06-9feef1fbd693 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:15.268151 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.quota.resource [None req-5dbfa5e8-ecf6-443c-89d1-89430574d1d9 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Usage tracker for resource:security_group_rule and tenant:bbb9e99759bc47d08005f3b1e036a6cf is out of sync, need to count used quota {{(pid=91829) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 17:07:15.271662 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.quota.resource [None req-5dbfa5e8-ecf6-443c-89d1-89430574d1d9 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Quota usage for security_group_rule was recalculated. Used quota:7. {{(pid=91829) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 17:07:15.273088 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-035a371f-9d66-47a8-9b06-9feef1fbd693 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-640836'] for security_group, after_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:15.278404 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.quota.driver [None req-5dbfa5e8-ecf6-443c-89d1-89430574d1d9 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 7; quota limit: 100; headroom:93 {{(pid=91829) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 17:07:15.281413 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-3e3f3074-941b-4d2b-8506-78ae54412709 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:07:15.296639 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-5dbfa5e8-ecf6-443c-89d1-89430574d1d9 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Notify callbacks [] for security_group_rule, before_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:15.312376 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-035a371f-9d66-47a8-9b06-9feef1fbd693 admin admin] vlan segment allocate from pool success with {'vlan_id': 687, 'physical_network': 'physnet1'} {{(pid=91830) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 25 17:07:15.320982 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-035a371f-9d66-47a8-9b06-9feef1fbd693 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=a56427ce-fa79-41d7-bed3-5f8568d1a417,revision_number=1']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:07:15.325631 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-035a371f-9d66-47a8-9b06-9feef1fbd693 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.044s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:07:15.328392 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-035a371f-9d66-47a8-9b06-9feef1fbd693 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3809789'] for segment, precommit_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:15.328744 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.db.segments_db [None req-035a371f-9d66-47a8-9b06-9feef1fbd693 admin admin] Added segment f72d7b23-e2ca-41dd-83c7-c64087195ce8 of type vlan for network 3fa72d6e-1a8d-4d69-93de-30a32f8d5423 May 25 17:07:15.359957 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-035a371f-9d66-47a8-9b06-9feef1fbd693 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8757892541013'] for network, precommit_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:15.370412 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-5dbfa5e8-ecf6-443c-89d1-89430574d1d9 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:15.374263 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-5dbfa5e8-ecf6-443c-89d1-89430574d1d9 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-640874'] for security_group_rule, after_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:15.376413 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:07:15.398927 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-035a371f-9d66-47a8-9b06-9feef1fbd693 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-640806', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-551400'] for network, after_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:15.401672 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5dbfa5e8-ecf6-443c-89d1-89430574d1d9 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=799367c8-0947-44cb-b349-e52f6e30da17,revision_number=0']} {{(pid=91829) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:07:15.402462 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-035a371f-9d66-47a8-9b06-9feef1fbd693 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91830) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:07:15.403162 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-035a371f-9d66-47a8-9b06-9feef1fbd693 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-551373'] for network, before_response {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:15.404489 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-5dbfa5e8-ecf6-443c-89d1-89430574d1d9 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.028s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:07:15.412204 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-dea2f965-5743-4fd9-9f3e-e50867f6b6ba admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:07:15.412398 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-5dbfa5e8-ecf6-443c-89d1-89430574d1d9 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Notify callbacks [] for security_group_rule, before_response {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:15.413606 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [None req-5dbfa5e8-ecf6-443c-89d1-89430574d1d9 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.1612310 May 25 17:07:15.416648 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.wsgi [-] (91829) accepted ('10.222.0.62', 35948) {{(pid=91829) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:07:15.421879 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.v2.base [None req-a01cbb65-e7a7-41b8-95ec-ab292e2a3a9b tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Request body: {'floatingip': {'floating_network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74'}} {{(pid=91829) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 17:07:15.428337 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.quota.driver [None req-a01cbb65-e7a7-41b8-95ec-ab292e2a3a9b tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91829) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 17:07:15.433401 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.quota.resource [None req-a01cbb65-e7a7-41b8-95ec-ab292e2a3a9b tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Usage tracker for resource:floatingip and tenant:bbb9e99759bc47d08005f3b1e036a6cf is out of sync, need to count used quota {{(pid=91829) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 17:07:15.436739 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.quota.resource [None req-a01cbb65-e7a7-41b8-95ec-ab292e2a3a9b tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Quota usage for floatingip was recalculated. Used quota:0. {{(pid=91829) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 17:07:15.443223 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.quota.driver [None req-a01cbb65-e7a7-41b8-95ec-ab292e2a3a9b tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Attempting to reserve 1 items for resource floatingip. Total usage: 0; quota limit: 50; headroom:50 {{(pid=91829) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 17:07:15.454794 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-a01cbb65-e7a7-41b8-95ec-ab292e2a3a9b tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Notify callbacks [] for floatingip, before_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:15.513084 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-035a371f-9d66-47a8-9b06-9feef1fbd693 admin admin] Pushing event updated for resources: {'Network': ['ID=3fa72d6e-1a8d-4d69-93de-30a32f8d5423,revision_number=1']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:07:15.516326 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [None req-035a371f-9d66-47a8-9b06-9feef1fbd693 admin admin] 10.222.0.62 "POST /v2.0/networks HTTP/1.1" status: 201 len: 885 time: 0.4687064 May 25 17:07:15.517423 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-035a371f-9d66-47a8-9b06-9feef1fbd693 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.105s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:07:15.519127 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.wsgi [-] (91830) accepted ('10.222.0.62', 35952) {{(pid=91830) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:07:15.525171 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.v2.base [None req-ff6e1081-fc32-45e5-9ee6-43775065da52 admin admin] Request body: {'subnet': {'network_id': '3fa72d6e-1a8d-4d69-93de-30a32f8d5423', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestVolumeBootPattern-2097476481-subnet', 'tenant_id': 'ebceaa13caaa4258abf32e19141de493', 'ip_version': 4}} {{(pid=91830) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 17:07:15.529995 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.quota.driver [None req-ff6e1081-fc32-45e5-9ee6-43775065da52 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91830) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 17:07:15.536165 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.rpc [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Network 3fa72d6e-1a8d-4d69-93de-30a32f8d5423 details requested by agent ovs-agent-dv-cinder-790492-4-iscsi with host dv-cinder-790492-4-iscsi {{(pid=91831) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 25 17:07:15.542057 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [None req-ff6e1081-fc32-45e5-9ee6-43775065da52 admin admin] Usage tracker for resource:subnet and tenant:ebceaa13caaa4258abf32e19141de493 is out of sync, need to count used quota {{(pid=91830) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 17:07:15.546285 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [None req-ff6e1081-fc32-45e5-9ee6-43775065da52 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=91830) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 17:07:15.553293 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.quota.driver [None req-ff6e1081-fc32-45e5-9ee6-43775065da52 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91830) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 17:07:15.566716 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-ff6e1081-fc32-45e5-9ee6-43775065da52 admin admin] Made reservation on behalf of ebceaa13caaa4258abf32e19141de493 for: {'subnet': 1} {{(pid=91830) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 25 17:07:15.569558 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-ff6e1081-fc32-45e5-9ee6-43775065da52 admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1152763'] for subnet, before_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:15.604970 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-a01cbb65-e7a7-41b8-95ec-ab292e2a3a9b tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3832070'] for port, before_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:15.771170 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.db_base_plugin_common [None req-a01cbb65-e7a7-41b8-95ec-ab292e2a3a9b tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Allocated IP 172.27.2.15 (4364b6ab-4117-4a92-baeb-f5ee2f45bf74/b947e790-d731-4b63-afc4-4aa112afe0f6/f18a74f7-36aa-484b-b8c1-4df0ed9b9127) {{(pid=91829) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 25 17:07:15.965548 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-a01cbb65-e7a7-41b8-95ec-ab292e2a3a9b tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Notify callbacks [] for port, precommit_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:15.971774 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.rpc [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Device 2fef7852-acf7-462f-beee-5679d3df0ad2 up at agent ovs-agent-dv-cinder-790492-4-iscsi {{(pid=91831) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 25 17:07:15.998158 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-a01cbb65-e7a7-41b8-95ec-ab292e2a3a9b tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8757892520915', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28230808'] for port, after_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:16.005121 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-4f1857dc-3e6c-4225-a247-ce9bfcee644b tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:07:16.052878 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.provisioning_blocks [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Provisioning for port 2fef7852-acf7-462f-beee-5679d3df0ad2 completed by entity L2. {{(pid=91831) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 25 17:07:16.059244 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.provisioning_blocks [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Provisioning complete for port 2fef7852-acf7-462f-beee-5679d3df0ad2 triggered by entity L2. {{(pid=91831) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 17:07:16.059801 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3854128'] for port, provisioning_complete {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:16.077063 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a01cbb65-e7a7-41b8-95ec-ab292e2a3a9b tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Pushing event updated for resources: {'Port': ['ID=f18a74f7-36aa-484b-b8c1-4df0ed9b9127,revision_number=1']} {{(pid=91829) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:07:16.087114 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-a01cbb65-e7a7-41b8-95ec-ab292e2a3a9b tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.082s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:07:16.088847 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a01cbb65-e7a7-41b8-95ec-ab292e2a3a9b tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Network 4364b6ab-4117-4a92-baeb-f5ee2f45bf74 is already hosted by enough agents. {{(pid=91829) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 25 17:07:16.090130 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.scheduler.base_scheduler [None req-a01cbb65-e7a7-41b8-95ec-ab292e2a3a9b tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Resources bound (agent type, host, resource id): {{(pid=91829) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 17:07:16.093392 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a01cbb65-e7a7-41b8-95ec-ab292e2a3a9b tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Received port after_create {{(pid=91829) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 25 17:07:16.123643 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-ff6e1081-fc32-45e5-9ee6-43775065da52 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55886', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-28085051', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-1152749'] for subnet, after_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:16.131136 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:07:16.177527 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-a01cbb65-e7a7-41b8-95ec-ab292e2a3a9b tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Notify callbacks [] for floatingip, precommit_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:16.183699 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3832070'] for port, before_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:16.201452 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.db [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] For port 2fef7852-acf7-462f-beee-5679d3df0ad2, host dv-cinder-790492-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-790492-4-iscsi',level=0,port_id=2fef7852-acf7-462f-beee-5679d3df0ad2,segment=NetworkSegment(414a8468-1d66-4792-9e81-d8ac5ccf1512),segment_id=414a8468-1d66-4792-9e81-d8ac5ccf1512)] {{(pid=91831) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 17:07:16.206045 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8757892955028', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8757892520933', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8757892521750'] for port, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:16.210461 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:07:16.211500 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ff6e1081-fc32-45e5-9ee6-43775065da52 admin admin] Pushing event updated for resources: {'Subnet': ['ID=6d7b3521-40af-42b0-b9ba-0605d0b34e3b,revision_number=0']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:07:16.215561 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-ff6e1081-fc32-45e5-9ee6-43775065da52 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.085s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:07:16.218204 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ff6e1081-fc32-45e5-9ee6-43775065da52 admin admin] Checking segment: {'id': 'f72d7b23-e2ca-41dd-83c7-c64087195ce8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 687, 'network_id': '3fa72d6e-1a8d-4d69-93de-30a32f8d5423'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91830) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 25 17:07:16.218568 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ff6e1081-fc32-45e5-9ee6-43775065da52 admin admin] Network hostable DHCP agents. Network: 3fa72d6e-1a8d-4d69-93de-30a32f8d5423, hostable agents: ['8d7401c6-8951-4f2b-ace4-208761782bfc'], hosted agents: [] {{(pid=91830) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 25 17:07:16.235787 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ff6e1081-fc32-45e5-9ee6-43775065da52 admin admin] Network 3fa72d6e-1a8d-4d69-93de-30a32f8d5423 is scheduled to be hosted by DHCP agent 8d7401c6-8951-4f2b-ace4-208761782bfc with binding_index 1 {{(pid=91830) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 25 17:07:16.245299 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-a01cbb65-e7a7-41b8-95ec-ab292e2a3a9b tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3832070'] for port, before_update {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:16.246737 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.scheduler.base_scheduler [None req-ff6e1081-fc32-45e5-9ee6-43775065da52 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-790492-4-iscsi, 3fa72d6e-1a8d-4d69-93de-30a32f8d5423) {{(pid=91830) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 17:07:16.262435 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ff6e1081-fc32-45e5-9ee6-43775065da52 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=91830) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:07:16.263420 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-ff6e1081-fc32-45e5-9ee6-43775065da52 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-551373'] for subnet, before_response {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:16.264524 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b31fe4ca-833d-4b28-a028-3aa950d52182 None None] Network 3fa72d6e-1a8d-4d69-93de-30a32f8d5423 requested from dv-cinder-790492-4-iscsi {{(pid=91831) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} May 25 17:07:16.288018 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [None req-ff6e1081-fc32-45e5-9ee6-43775065da52 admin admin] 10.222.0.62 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 848 time: 0.7647541 May 25 17:07:16.288018 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.wsgi [-] (91830) accepted ('10.222.0.62', 35956) {{(pid=91830) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:07:16.295592 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.v2.base [None req-e455943a-168b-4563-be26-6d358cd2868d admin admin] Request body: {'router': {'name': 'tempest-TestVolumeBootPattern-2097476481-router', 'tenant_id': 'ebceaa13caaa4258abf32e19141de493', 'external_gateway_info': {'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74'}}} {{(pid=91830) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 17:07:16.300414 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.quota.driver [None req-e455943a-168b-4563-be26-6d358cd2868d admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91830) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 17:07:16.304581 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [None req-e455943a-168b-4563-be26-6d358cd2868d admin admin] Usage tracker for resource:router and tenant:ebceaa13caaa4258abf32e19141de493 is out of sync, need to count used quota {{(pid=91830) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 17:07:16.308701 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [None req-e455943a-168b-4563-be26-6d358cd2868d admin admin] Quota usage for router was recalculated. Used quota:0. {{(pid=91830) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 17:07:16.315458 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.quota.driver [None req-e455943a-168b-4563-be26-6d358cd2868d admin admin] Attempting to reserve 1 items for resource router. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91830) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 17:07:16.328736 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-e455943a-168b-4563-be26-6d358cd2868d admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create-684888', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-31042'] for router, before_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:16.330303 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-e455943a-168b-4563-be26-6d358cd2868d admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-684376', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-683143', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-647018', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-31049'] for router, precommit_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:16.349385 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-e455943a-168b-4563-be26-6d358cd2868d admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:16.369122 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Pushing event updated for resources: {'Port': ['ID=2fef7852-acf7-462f-beee-5679d3df0ad2,revision_number=4']} {{(pid=91831) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:07:16.374914 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.167s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:07:16.467987 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-a01cbb65-e7a7-41b8-95ec-ab292e2a3a9b tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Notify callbacks [] for port, precommit_update {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:16.472710 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-a01cbb65-e7a7-41b8-95ec-ab292e2a3a9b tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8757892955028', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8757892520933', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8757892521750', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28230801'] for port, after_update {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:16.482500 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-0dd53d8e-5dd0-41b0-a28c-023cb6a5c924 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:07:16.519072 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8e9bec64-51dc-4ad8-81d1-f85333f92b58 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp6d7ebc81-b6b5-52ec-b8f5-10a9de34bf46-3fa72d6e-1a8d-4d69-93de-30a32f8d5423', 'network_id': '3fa72d6e-1a8d-4d69-93de-30a32f8d5423', 'tenant_id': 'ebceaa13caaa4258abf32e19141de493', 'fixed_ips': [{'subnet_id': '6d7b3521-40af-42b0-b9ba-0605d0b34e3b'}]}} from dv-cinder-790492-4-iscsi. {{(pid=91831) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} May 25 17:07:16.521529 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-8e9bec64-51dc-4ad8-81d1-f85333f92b58 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3832070'] for port, before_create {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:16.595294 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a01cbb65-e7a7-41b8-95ec-ab292e2a3a9b tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Pushing event updated for resources: {'Port': ['ID=f18a74f7-36aa-484b-b8c1-4df0ed9b9127,revision_number=2']} {{(pid=91829) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:07:16.600831 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-a01cbb65-e7a7-41b8-95ec-ab292e2a3a9b tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.118s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:07:16.601732 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-a01cbb65-e7a7-41b8-95ec-ab292e2a3a9b tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-683033'] for floatingip, after_update {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:16.626867 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-a01cbb65-e7a7-41b8-95ec-ab292e2a3a9b tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-178712'] for floatingip, before_response {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:16.628150 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [None req-a01cbb65-e7a7-41b8-95ec-ab292e2a3a9b tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 692 time: 1.2103677 May 25 17:07:16.657018 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-e455943a-168b-4563-be26-6d358cd2868d admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-683170', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-684906', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-31039'] for router, precommit_update {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:16.704004 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.db_base_plugin_common [None req-8e9bec64-51dc-4ad8-81d1-f85333f92b58 None None] Allocated IP 172.20.0.2 (3fa72d6e-1a8d-4d69-93de-30a32f8d5423/6d7b3521-40af-42b0-b9ba-0605d0b34e3b/421abc1f-bb97-4830-9969-bc5d30acd0d7) {{(pid=91831) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 25 17:07:16.790603 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a08071a1-bd08-4379-bcaf-d58b7984ac13 None None] Sync routers for ids ['269c6b7b-91cc-4880-9e6d-b8889bac29f6'] in dv-cinder-790492-4-iscsi {{(pid=91832) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 25 17:07:16.801482 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a08071a1-bd08-4379-bcaf-d58b7984ac13 None None] Routers {'269c6b7b-91cc-4880-9e6d-b8889bac29f6'} bound to L3 agent in host dv-cinder-790492-4-iscsi {{(pid=91832) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 17:07:16.803077 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.db.l3_hamode_db [None req-a08071a1-bd08-4379-bcaf-d58b7984ac13 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-790492-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-05-25T16:50:28Z,description=,heartbeat_timestamp=2021-05-25T17:06:58Z,host='dv-cinder-790492-4-iscsi',id=a2d427c1-2d07-43e8-afbe-218c9f7d0445,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T16:50:28Z,topic='l3_agent')) {'router_ids': ['269c6b7b-91cc-4880-9e6d-b8889bac29f6'], 'active': True} {{(pid=91832) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 17:07:16.905181 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.quota.resource [req-12ee782f-9a38-4246-bf24-a25f3760602e req-9ae7b9ff-7c99-4da8-b4e7-a6a06e5e3430 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Synchronizing usage tracker for tenant:bbb9e99759bc47d08005f3b1e036a6cf on resource:security_group {{(pid=91829) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 25 17:07:16.924892 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.quota.resource [req-12ee782f-9a38-4246-bf24-a25f3760602e req-9ae7b9ff-7c99-4da8-b4e7-a6a06e5e3430 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Unset dirty status for tenant:bbb9e99759bc47d08005f3b1e036a6cf on resource:security_group {{(pid=91829) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 25 17:07:16.926827 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-12ee782f-9a38-4246-bf24-a25f3760602e req-9ae7b9ff-7c99-4da8-b4e7-a6a06e5e3430 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/security-groups?name=tempest-securitygroup--734774&fields=id&tenant_id=bbb9e99759bc47d08005f3b1e036a6cf HTTP/1.1" status: 200 len: 267 time: 0.0754614 May 25 17:07:17.000394 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-e455943a-168b-4563-be26-6d358cd2868d admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:17.008209 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.db.l3_dvr_db [None req-a08071a1-bd08-4379-bcaf-d58b7984ac13 None None] Set router 269c6b7b-91cc-4880-9e6d-b8889bac29f6 gateway port host: dv-cinder-790492-4-iscsi {{(pid=91832) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 17:07:17.040385 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-e455943a-168b-4563-be26-6d358cd2868d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3832070'] for port, before_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:17.063646 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-8e9bec64-51dc-4ad8-81d1-f85333f92b58 None None] Notify callbacks [] for port, precommit_create {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:17.075873 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.provisioning_blocks [None req-8e9bec64-51dc-4ad8-81d1-f85333f92b58 None None] Transition to ACTIVE for port object 421abc1f-bb97-4830-9969-bc5d30acd0d7 will not be triggered until provisioned by entity L2. {{(pid=91831) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 25 17:07:17.097647 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.provisioning_blocks [None req-8e9bec64-51dc-4ad8-81d1-f85333f92b58 None None] Transition to ACTIVE for port object 421abc1f-bb97-4830-9969-bc5d30acd0d7 will not be triggered until provisioned by entity DHCP. {{(pid=91831) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 25 17:07:17.101721 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-12ee782f-9a38-4246-bf24-a25f3760602e req-5c93917a-fa9b-4a3b-8b32-e260df01fae0 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:07:17.103370 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-12ee782f-9a38-4246-bf24-a25f3760602e req-5c93917a-fa9b-4a3b-8b32-e260df01fae0 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/networks?id=e5be4c6a-143f-474c-a90b-37180778cefe HTTP/1.1" status: 200 len: 816 time: 0.1691546 May 25 17:07:17.106678 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-8e9bec64-51dc-4ad8-81d1-f85333f92b58 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8757892520915'] for port, after_create {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:17.112501 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:07:17.120378 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-12ee782f-9a38-4246-bf24-a25f3760602e req-cd34a716-10ea-427a-a104-a91da283cb71 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/quotas/bbb9e99759bc47d08005f3b1e036a6cf HTTP/1.1" status: 200 len: 375 time: 0.0097992 May 25 17:07:17.187521 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8e9bec64-51dc-4ad8-81d1-f85333f92b58 None None] Network 3fa72d6e-1a8d-4d69-93de-30a32f8d5423 is already hosted by enough agents. {{(pid=91831) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 25 17:07:17.191161 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.scheduler.base_scheduler [None req-8e9bec64-51dc-4ad8-81d1-f85333f92b58 None None] Resources bound (agent type, host, resource id): {{(pid=91831) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 17:07:17.199062 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8e9bec64-51dc-4ad8-81d1-f85333f92b58 None None] Received port after_create {{(pid=91831) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 25 17:07:17.204326 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.db_base_plugin_common [None req-e455943a-168b-4563-be26-6d358cd2868d admin admin] Allocated IP 172.27.2.190 (4364b6ab-4117-4a92-baeb-f5ee2f45bf74/b947e790-d731-4b63-afc4-4aa112afe0f6/4ee74cc9-30db-4402-aed3-82be47c1be1e) {{(pid=91830) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 25 17:07:17.224017 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.quota.resource [req-12ee782f-9a38-4246-bf24-a25f3760602e req-80bca899-ce0e-441d-b49b-005862033a9e tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Synchronizing usage tracker for tenant:bbb9e99759bc47d08005f3b1e036a6cf on resource:port {{(pid=91829) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 25 17:07:17.243120 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.quota.resource [req-12ee782f-9a38-4246-bf24-a25f3760602e req-80bca899-ce0e-441d-b49b-005862033a9e tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Unset dirty status for tenant:bbb9e99759bc47d08005f3b1e036a6cf on resource:port {{(pid=91829) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 25 17:07:17.255961 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e9bec64-51dc-4ad8-81d1-f85333f92b58 None None] Pushing event updated for resources: {'Port': ['ID=421abc1f-bb97-4830-9969-bc5d30acd0d7,revision_number=1']} {{(pid=91831) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:07:17.259075 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [None req-8e9bec64-51dc-4ad8-81d1-f85333f92b58 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.146s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:07:17.264359 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-12ee782f-9a38-4246-bf24-a25f3760602e req-80bca899-ce0e-441d-b49b-005862033a9e tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/ports?tenant_id=bbb9e99759bc47d08005f3b1e036a6cf&fields=id HTTP/1.1" status: 200 len: 348 time: 0.1252575 May 25 17:07:17.312888 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.managers [None req-8e9bec64-51dc-4ad8-81d1-f85333f92b58 None None] Attempting to bind port 421abc1f-bb97-4830-9969-bc5d30acd0d7 on host dv-cinder-790492-4-iscsi for vnic_type normal with profile {{(pid=91831) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 25 17:07:17.313262 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.managers [None req-8e9bec64-51dc-4ad8-81d1-f85333f92b58 None None] Attempting to bind port 421abc1f-bb97-4830-9969-bc5d30acd0d7 by drivers openvswitch,hyperv on host dv-cinder-790492-4-iscsi at level 0 using segments [{'id': 'f72d7b23-e2ca-41dd-83c7-c64087195ce8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 687, 'network_id': '3fa72d6e-1a8d-4d69-93de-30a32f8d5423'}] {{(pid=91831) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 25 17:07:17.313632 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8e9bec64-51dc-4ad8-81d1-f85333f92b58 None None] Attempting to bind port 421abc1f-bb97-4830-9969-bc5d30acd0d7 on network 3fa72d6e-1a8d-4d69-93de-30a32f8d5423 {{(pid=91831) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 25 17:07:17.320131 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8e9bec64-51dc-4ad8-81d1-f85333f92b58 None None] Checking agent: {'id': 'fc8251e1-071c-49f7-bc10-1337f1d37d1b', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-790492-4-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 25, 16, 50, 28), 'started_at': datetime.datetime(2021, 5, 25, 16, 50, 58), 'heartbeat_timestamp': datetime.datetime(2021, 5, 25, 17, 6, 58), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-790492-4-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=91831) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 25 17:07:17.320660 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8e9bec64-51dc-4ad8-81d1-f85333f92b58 None None] Checking segment: {'id': 'f72d7b23-e2ca-41dd-83c7-c64087195ce8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 687, 'network_id': '3fa72d6e-1a8d-4d69-93de-30a32f8d5423'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91831) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 25 17:07:17.321076 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-8e9bec64-51dc-4ad8-81d1-f85333f92b58 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:17.321474 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8e9bec64-51dc-4ad8-81d1-f85333f92b58 None None] Bound using segment: {'id': 'f72d7b23-e2ca-41dd-83c7-c64087195ce8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 687, 'network_id': '3fa72d6e-1a8d-4d69-93de-30a32f8d5423'} {{(pid=91831) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 25 17:07:17.321964 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.managers [None req-8e9bec64-51dc-4ad8-81d1-f85333f92b58 None None] Bound port: 421abc1f-bb97-4830-9969-bc5d30acd0d7, host: dv-cinder-790492-4-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'f72d7b23-e2ca-41dd-83c7-c64087195ce8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 687, 'network_id': '3fa72d6e-1a8d-4d69-93de-30a32f8d5423'}}] {{(pid=91831) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 25 17:07:17.322353 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-8e9bec64-51dc-4ad8-81d1-f85333f92b58 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3832070'] for port, before_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:17.392965 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-e455943a-168b-4563-be26-6d358cd2868d admin admin] Notify callbacks [] for port, precommit_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:17.412953 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.db.l3_hamode_db [None req-a08071a1-bd08-4379-bcaf-d58b7984ac13 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '269c6b7b-91cc-4880-9e6d-b8889bac29f6', 'name': 'tempest-TestVolumeBootPattern-219116984-router', 'tenant_id': '5397bf60956945c3a2bf43c6b1aa614b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'external_fixed_ips': [{'subnet_id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'ip_address': '172.27.2.227'}], 'enable_snat': True}, 'gw_port_id': '2fef7852-acf7-462f-beee-5679d3df0ad2', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T17:07:09Z', 'updated_at': '2021-05-25T17:07:13Z', 'revision_number': 4, 'project_id': '5397bf60956945c3a2bf43c6b1aa614b', 'gw_port': {'id': '2fef7852-acf7-462f-beee-5679d3df0ad2', 'name': '', 'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'tenant_id': '', 'mac_address': 'fa:16:3e:35:b9:d0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '269c6b7b-91cc-4880-9e6d-b8889bac29f6', 'device_owner': 'network:router_gateway', 'standard_attr_id': 533, 'fixed_ips': [{'subnet_id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'ip_address': '172.27.2.227', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790492-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:07:09Z', 'updated_at': '2021-05-25T17:07:16Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-790492-4-iscsi', '_interfaces': [{'id': '4972e3a9-91eb-48ce-8b7b-b0906822cebf', 'name': '', 'network_id': '17a0e39e-1e1f-4550-b28b-d5ae3bdca362', 'tenant_id': '5397bf60956945c3a2bf43c6b1aa614b', 'mac_address': 'fa:16:3e:ce:fe:1a', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '269c6b7b-91cc-4880-9e6d-b8889bac29f6', 'device_owner': 'network:router_interface', 'standard_attr_id': 534, 'fixed_ips': [{'subnet_id': 'f5599a2e-9942-4423-a1ac-67e9b2650770', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:07:12Z', 'updated_at': '2021-05-25T17:07:13Z', 'revision_number': 2, 'project_id': '5397bf60956945c3a2bf43c6b1aa614b', 'subnets': [{'id': 'f5599a2e-9942-4423-a1ac-67e9b2650770', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-790492-4-iscsi', False) {} {{(pid=91832) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 17:07:17.421324 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a08071a1-bd08-4379-bcaf-d58b7984ac13 None None] Checking router: 269c6b7b-91cc-4880-9e6d-b8889bac29f6 for host: dv-cinder-790492-4-iscsi {{(pid=91832) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 25 17:07:17.422353 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a08071a1-bd08-4379-bcaf-d58b7984ac13 None None] Updating router 269c6b7b-91cc-4880-9e6d-b8889bac29f6 port 4972e3a9-91eb-48ce-8b7b-b0906822cebf binding host dv-cinder-790492-4-iscsi {{(pid=91832) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} May 25 17:07:17.423658 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.db [None req-8e9bec64-51dc-4ad8-81d1-f85333f92b58 None None] For port 421abc1f-bb97-4830-9969-bc5d30acd0d7, host dv-cinder-790492-4-iscsi, cleared binding levels {{(pid=91831) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 25 17:07:17.426549 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-e455943a-168b-4563-be26-6d358cd2868d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8757892520915', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-27483019'] for port, after_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:17.427838 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.db [None req-8e9bec64-51dc-4ad8-81d1-f85333f92b58 None None] For port 421abc1f-bb97-4830-9969-bc5d30acd0d7, host dv-cinder-790492-4-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-790492-4-iscsi',level=0,port_id=421abc1f-bb97-4830-9969-bc5d30acd0d7,segment=NetworkSegment(f72d7b23-e2ca-41dd-83c7-c64087195ce8),segment_id=f72d7b23-e2ca-41dd-83c7-c64087195ce8)] {{(pid=91831) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 25 17:07:17.432780 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-f398e8e9-a61a-4bfc-8582-613156d7bda0 tempest-DeleteServersTestJSON-1172980508 tempest-DeleteServersTestJSON-1172980508-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:07:17.433517 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-8e9bec64-51dc-4ad8-81d1-f85333f92b58 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8757892955028', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8757892520933', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8757892521750'] for port, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:17.439008 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:07:17.488038 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron_lib.callbacks.manager [None req-a08071a1-bd08-4379-bcaf-d58b7984ac13 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3832070'] for port, before_update {{(pid=91832) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:17.505706 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e455943a-168b-4563-be26-6d358cd2868d admin admin] Network 4364b6ab-4117-4a92-baeb-f5ee2f45bf74 is already hosted by enough agents. {{(pid=91830) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 25 17:07:17.508520 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.scheduler.base_scheduler [None req-e455943a-168b-4563-be26-6d358cd2868d admin admin] Resources bound (agent type, host, resource id): {{(pid=91830) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 17:07:17.512920 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e455943a-168b-4563-be26-6d358cd2868d admin admin] Received port after_create {{(pid=91830) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 25 17:07:17.530269 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e9bec64-51dc-4ad8-81d1-f85333f92b58 None None] Pushing event updated for resources: {'Port': ['ID=421abc1f-bb97-4830-9969-bc5d30acd0d7,revision_number=2']} {{(pid=91831) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:07:17.533464 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [None req-8e9bec64-51dc-4ad8-81d1-f85333f92b58 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.095s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:07:17.547124 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e455943a-168b-4563-be26-6d358cd2868d admin admin] Pushing event updated for resources: {'Port': ['ID=4ee74cc9-30db-4402-aed3-82be47c1be1e,revision_number=1']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:07:17.553458 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-e455943a-168b-4563-be26-6d358cd2868d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.121s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:07:17.558971 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-12ee782f-9a38-4246-bf24-a25f3760602e req-6b25c836-3dd6-44ea-9792-94cf5c041783 service neutron] 10.222.0.62 "GET /v2.0/networks/e5be4c6a-143f-474c-a90b-37180778cefe?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2937331 May 25 17:07:17.706446 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-12ee782f-9a38-4246-bf24-a25f3760602e req-f7139334-b2e1-4e45-9dba-9405220c22ed service neutron] 10.222.0.62 "GET /v2.0/networks/e5be4c6a-143f-474c-a90b-37180778cefe?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1404221 May 25 17:07:17.963052 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron_lib.callbacks.manager [None req-a08071a1-bd08-4379-bcaf-d58b7984ac13 None None] Notify callbacks [] for port, precommit_update {{(pid=91832) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:17.993776 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.db.provisioning_blocks [None req-a08071a1-bd08-4379-bcaf-d58b7984ac13 None None] Transition to ACTIVE for port object 4972e3a9-91eb-48ce-8b7b-b0906822cebf will not be triggered until provisioned by entity L2. {{(pid=91832) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 25 17:07:18.002586 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron_lib.callbacks.manager [None req-a08071a1-bd08-4379-bcaf-d58b7984ac13 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8757892955028', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8757892520933', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8757892521750'] for port, after_update {{(pid=91832) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:18.006551 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:07:18.150724 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.rpc [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Device 2fef7852-acf7-462f-beee-5679d3df0ad2 up at agent ovs-agent-dv-cinder-790492-4-iscsi {{(pid=91831) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 25 17:07:18.235162 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fc23a5c5-ddb1-4ef0-940a-8faf8dad91b2 None None] Pushing event updated for resources: {'Port': ['ID=4972e3a9-91eb-48ce-8b7b-b0906822cebf,revision_number=3']} {{(pid=91832) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:07:18.283662 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-e455943a-168b-4563-be26-6d358cd2868d admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:18.289589 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.provisioning_blocks [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Provisioning complete for port 2fef7852-acf7-462f-beee-5679d3df0ad2 triggered by entity L2. {{(pid=91831) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 17:07:18.289997 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3854128'] for port, provisioning_complete {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:18.298666 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-86d5adcc-bc19-4590-8e8d-e75c2cc558f8 req-e428b044-140f-48b4-96e9-a62c745ede38 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/ports?device_id=bdaa3d25-adc2-4a52-8a36-66a599b4b6e2 HTTP/1.1" status: 200 len: 210 time: 0.2924995 May 25 17:07:18.313299 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fc23a5c5-ddb1-4ef0-940a-8faf8dad91b2 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91832) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:07:18.313759 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fc23a5c5-ddb1-4ef0-940a-8faf8dad91b2 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91832) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:07:18.314010 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fc23a5c5-ddb1-4ef0-940a-8faf8dad91b2 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91832) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:07:18.314342 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fc23a5c5-ddb1-4ef0-940a-8faf8dad91b2 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91832) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:07:18.314670 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fc23a5c5-ddb1-4ef0-940a-8faf8dad91b2 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91832) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:07:18.314994 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fc23a5c5-ddb1-4ef0-940a-8faf8dad91b2 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91832) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:07:18.315314 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fc23a5c5-ddb1-4ef0-940a-8faf8dad91b2 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91832) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:07:18.315654 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fc23a5c5-ddb1-4ef0-940a-8faf8dad91b2 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91832) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:07:18.318912 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fc23a5c5-ddb1-4ef0-940a-8faf8dad91b2 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91832) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:07:18.319487 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fc23a5c5-ddb1-4ef0-940a-8faf8dad91b2 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91832) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:07:18.319979 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fc23a5c5-ddb1-4ef0-940a-8faf8dad91b2 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91832) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:07:18.331469 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fc23a5c5-ddb1-4ef0-940a-8faf8dad91b2 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91832) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:07:18.353597 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG oslo_concurrency.lockutils [None req-fc23a5c5-ddb1-4ef0-940a-8faf8dad91b2 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.347s {{(pid=91832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:07:18.358450 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.plugins.ml2.managers [None req-a08071a1-bd08-4379-bcaf-d58b7984ac13 None None] Attempting to bind port 4972e3a9-91eb-48ce-8b7b-b0906822cebf on host dv-cinder-790492-4-iscsi for vnic_type normal with profile {{(pid=91832) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 25 17:07:18.358823 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.plugins.ml2.managers [None req-a08071a1-bd08-4379-bcaf-d58b7984ac13 None None] Attempting to bind port 4972e3a9-91eb-48ce-8b7b-b0906822cebf by drivers openvswitch,hyperv on host dv-cinder-790492-4-iscsi at level 0 using segments [{'id': '50ed67e9-f8d3-4927-b257-bd17654cce34', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 657, 'network_id': '17a0e39e-1e1f-4550-b28b-d5ae3bdca362'}] {{(pid=91832) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 25 17:07:18.359192 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a08071a1-bd08-4379-bcaf-d58b7984ac13 None None] Attempting to bind port 4972e3a9-91eb-48ce-8b7b-b0906822cebf on network 17a0e39e-1e1f-4550-b28b-d5ae3bdca362 {{(pid=91832) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 25 17:07:18.365351 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a08071a1-bd08-4379-bcaf-d58b7984ac13 None None] Checking agent: {'id': 'fc8251e1-071c-49f7-bc10-1337f1d37d1b', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-790492-4-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 25, 16, 50, 28), 'started_at': datetime.datetime(2021, 5, 25, 16, 50, 58), 'heartbeat_timestamp': datetime.datetime(2021, 5, 25, 17, 6, 58), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-790492-4-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=91832) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 25 17:07:18.367271 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a08071a1-bd08-4379-bcaf-d58b7984ac13 None None] Checking segment: {'id': '50ed67e9-f8d3-4927-b257-bd17654cce34', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 657, 'network_id': '17a0e39e-1e1f-4550-b28b-d5ae3bdca362'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91832) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 25 17:07:18.369117 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron_lib.callbacks.manager [None req-a08071a1-bd08-4379-bcaf-d58b7984ac13 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=91832) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:18.371088 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a08071a1-bd08-4379-bcaf-d58b7984ac13 None None] Bound using segment: {'id': '50ed67e9-f8d3-4927-b257-bd17654cce34', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 657, 'network_id': '17a0e39e-1e1f-4550-b28b-d5ae3bdca362'} {{(pid=91832) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 25 17:07:18.371684 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.plugins.ml2.managers [None req-a08071a1-bd08-4379-bcaf-d58b7984ac13 None None] Bound port: 4972e3a9-91eb-48ce-8b7b-b0906822cebf, host: dv-cinder-790492-4-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '50ed67e9-f8d3-4927-b257-bd17654cce34', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 657, 'network_id': '17a0e39e-1e1f-4550-b28b-d5ae3bdca362'}}] {{(pid=91832) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 25 17:07:18.372082 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron_lib.callbacks.manager [None req-a08071a1-bd08-4379-bcaf-d58b7984ac13 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3832070'] for port, before_update {{(pid=91832) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:18.471116 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.rpc [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Device 421abc1f-bb97-4830-9969-bc5d30acd0d7 up at agent ovs-agent-dv-cinder-790492-4-iscsi {{(pid=91831) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 25 17:07:18.530663 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.plugins.ml2.db [None req-a08071a1-bd08-4379-bcaf-d58b7984ac13 None None] For port 4972e3a9-91eb-48ce-8b7b-b0906822cebf, host dv-cinder-790492-4-iscsi, cleared binding levels {{(pid=91832) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 25 17:07:18.534388 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.plugins.ml2.db [None req-a08071a1-bd08-4379-bcaf-d58b7984ac13 None None] For port 4972e3a9-91eb-48ce-8b7b-b0906822cebf, host dv-cinder-790492-4-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-790492-4-iscsi',level=0,port_id=4972e3a9-91eb-48ce-8b7b-b0906822cebf,segment=NetworkSegment(50ed67e9-f8d3-4927-b257-bd17654cce34),segment_id=50ed67e9-f8d3-4927-b257-bd17654cce34)] {{(pid=91832) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 25 17:07:18.544718 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron_lib.callbacks.manager [None req-a08071a1-bd08-4379-bcaf-d58b7984ac13 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8757892955028', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8757892520933', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8757892521750'] for port, after_update {{(pid=91832) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:18.550200 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG oslo_concurrency.lockutils [None req-fc23a5c5-ddb1-4ef0-940a-8faf8dad91b2 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:07:18.571410 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.provisioning_blocks [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Provisioning for port 421abc1f-bb97-4830-9969-bc5d30acd0d7 completed by entity L2. {{(pid=91831) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 25 17:07:18.634168 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a08071a1-bd08-4379-bcaf-d58b7984ac13 None None] Routers {'269c6b7b-91cc-4880-9e6d-b8889bac29f6'} bound to L3 agent in host dv-cinder-790492-4-iscsi {{(pid=91832) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 17:07:18.635178 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.db.l3_hamode_db [None req-a08071a1-bd08-4379-bcaf-d58b7984ac13 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-790492-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-05-25T16:50:28Z,description=,heartbeat_timestamp=2021-05-25T17:06:58Z,host='dv-cinder-790492-4-iscsi',id=a2d427c1-2d07-43e8-afbe-218c9f7d0445,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T16:50:28Z,topic='l3_agent')) {'router_ids': ['269c6b7b-91cc-4880-9e6d-b8889bac29f6'], 'active': True} {{(pid=91832) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 17:07:18.704195 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fc23a5c5-ddb1-4ef0-940a-8faf8dad91b2 None None] Pushing event updated for resources: {'Port': ['ID=4972e3a9-91eb-48ce-8b7b-b0906822cebf,revision_number=4']} {{(pid=91832) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:07:18.715677 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG oslo_concurrency.lockutils [None req-fc23a5c5-ddb1-4ef0-940a-8faf8dad91b2 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.165s {{(pid=91832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:07:18.727419 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-e455943a-168b-4563-be26-6d358cd2868d admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-684881', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-683233'] for router, after_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:18.832453 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.db.l3_dvr_db [None req-a08071a1-bd08-4379-bcaf-d58b7984ac13 None None] Set router 269c6b7b-91cc-4880-9e6d-b8889bac29f6 gateway port host: dv-cinder-790492-4-iscsi {{(pid=91832) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 17:07:18.898384 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7f7034a8-ec6e-4d86-b0f5-8940e7801788 None None] Network 3fa72d6e-1a8d-4d69-93de-30a32f8d5423 requested from dv-cinder-790492-4-iscsi {{(pid=91831) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} May 25 17:07:18.949103 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-e455943a-168b-4563-be26-6d358cd2868d admin admin] Router a31e34e2-420e-4dd6-820b-1ec7d895549e is scheduled to L3 agent a2d427c1-2d07-43e8-afbe-218c9f7d0445 with binding_index 1 {{(pid=91830) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:210}} May 25 17:07:19.023494 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.provisioning_blocks [None req-36c72504-6892-45fe-ada1-cc78b8e5b707 None None] Provisioning for port 421abc1f-bb97-4830-9969-bc5d30acd0d7 completed by entity DHCP. {{(pid=91831) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 25 17:07:19.034706 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.provisioning_blocks [None req-36c72504-6892-45fe-ada1-cc78b8e5b707 None None] Provisioning complete for port 421abc1f-bb97-4830-9969-bc5d30acd0d7 triggered by entity DHCP. {{(pid=91831) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 17:07:19.035009 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-36c72504-6892-45fe-ada1-cc78b8e5b707 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3854128'] for port, provisioning_complete {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:19.136093 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-e455943a-168b-4563-be26-6d358cd2868d admin admin] Notify agent at l3_agent.dv-cinder-790492-4-iscsi the message routers_updated {{(pid=91830) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 25 17:07:19.161883 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-e455943a-168b-4563-be26-6d358cd2868d admin admin] Notify callbacks [] for router, before_response {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:19.162607 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.db.l3_hamode_db [None req-a08071a1-bd08-4379-bcaf-d58b7984ac13 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '269c6b7b-91cc-4880-9e6d-b8889bac29f6', 'name': 'tempest-TestVolumeBootPattern-219116984-router', 'tenant_id': '5397bf60956945c3a2bf43c6b1aa614b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'external_fixed_ips': [{'subnet_id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'ip_address': '172.27.2.227'}], 'enable_snat': True}, 'gw_port_id': '2fef7852-acf7-462f-beee-5679d3df0ad2', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T17:07:09Z', 'updated_at': '2021-05-25T17:07:13Z', 'revision_number': 4, 'project_id': '5397bf60956945c3a2bf43c6b1aa614b', 'gw_port': {'id': '2fef7852-acf7-462f-beee-5679d3df0ad2', 'name': '', 'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'tenant_id': '', 'mac_address': 'fa:16:3e:35:b9:d0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '269c6b7b-91cc-4880-9e6d-b8889bac29f6', 'device_owner': 'network:router_gateway', 'standard_attr_id': 533, 'fixed_ips': [{'subnet_id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'ip_address': '172.27.2.227', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790492-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:07:09Z', 'updated_at': '2021-05-25T17:07:16Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-790492-4-iscsi', '_interfaces': [{'id': '4972e3a9-91eb-48ce-8b7b-b0906822cebf', 'name': '', 'network_id': '17a0e39e-1e1f-4550-b28b-d5ae3bdca362', 'tenant_id': '5397bf60956945c3a2bf43c6b1aa614b', 'mac_address': 'fa:16:3e:ce:fe:1a', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '269c6b7b-91cc-4880-9e6d-b8889bac29f6', 'device_owner': 'network:router_interface', 'standard_attr_id': 534, 'fixed_ips': [{'subnet_id': 'f5599a2e-9942-4423-a1ac-67e9b2650770', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790492-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:07:12Z', 'updated_at': '2021-05-25T17:07:18Z', 'revision_number': 4, 'project_id': '5397bf60956945c3a2bf43c6b1aa614b', 'subnets': [{'id': 'f5599a2e-9942-4423-a1ac-67e9b2650770', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-790492-4-iscsi', False) {} {{(pid=91832) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 17:07:19.163239 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [None req-e455943a-168b-4563-be26-6d358cd2868d admin admin] 10.222.0.62 "POST /v2.0/routers HTTP/1.1" status: 201 len: 924 time: 2.8742995 May 25 17:07:19.166376 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.wsgi [-] (91830) accepted ('10.222.0.62', 35988) {{(pid=91830) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:07:19.167756 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a08071a1-bd08-4379-bcaf-d58b7984ac13 None None] The sync data for ids ['269c6b7b-91cc-4880-9e6d-b8889bac29f6'] in dv-cinder-790492-4-iscsi is: [{'id': '269c6b7b-91cc-4880-9e6d-b8889bac29f6', 'name': 'tempest-TestVolumeBootPattern-219116984-router', 'tenant_id': '5397bf60956945c3a2bf43c6b1aa614b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'external_fixed_ips': [{'subnet_id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'ip_address': '172.27.2.227'}], 'enable_snat': True}, 'gw_port_id': '2fef7852-acf7-462f-beee-5679d3df0ad2', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T17:07:09Z', 'updated_at': '2021-05-25T17:07:13Z', 'revision_number': 4, 'project_id': '5397bf60956945c3a2bf43c6b1aa614b', 'gw_port': {'id': '2fef7852-acf7-462f-beee-5679d3df0ad2', 'name': '', 'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'tenant_id': '', 'mac_address': 'fa:16:3e:35:b9:d0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '269c6b7b-91cc-4880-9e6d-b8889bac29f6', 'device_owner': 'network:router_gateway', 'standard_attr_id': 533, 'fixed_ips': [{'subnet_id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'ip_address': '172.27.2.227', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790492-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:07:09Z', 'updated_at': '2021-05-25T17:07:16Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-790492-4-iscsi', '_interfaces': [{'id': '4972e3a9-91eb-48ce-8b7b-b0906822cebf', 'name': '', 'network_id': '17a0e39e-1e1f-4550-b28b-d5ae3bdca362', 'tenant_id': '5397bf60956945c3a2bf43c6b1aa614b', 'mac_address': 'fa:16:3e:ce:fe:1a', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '269c6b7b-91cc-4880-9e6d-b8889bac29f6', 'device_owner': 'network:router_interface', 'standard_attr_id': 534, 'fixed_ips': [{'subnet_id': 'f5599a2e-9942-4423-a1ac-67e9b2650770', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790492-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:07:12Z', 'updated_at': '2021-05-25T17:07:18Z', 'revision_number': 4, 'project_id': '5397bf60956945c3a2bf43c6b1aa614b', 'subnets': [{'id': 'f5599a2e-9942-4423-a1ac-67e9b2650770', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=91832) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 25 17:07:19.171145 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-30fb9ea6-54af-4771-973d-57a05c8f61b6 None None] Sync routers for ids ['a31e34e2-420e-4dd6-820b-1ec7d895549e'] in dv-cinder-790492-4-iscsi {{(pid=91831) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 25 17:07:19.228421 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.l3_dvrscheduler_db [None req-30fb9ea6-54af-4771-973d-57a05c8f61b6 None None] Routers {'a31e34e2-420e-4dd6-820b-1ec7d895549e'} bound to L3 agent in host dv-cinder-790492-4-iscsi {{(pid=91831) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 17:07:19.229102 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.l3_hamode_db [None req-30fb9ea6-54af-4771-973d-57a05c8f61b6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-790492-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-05-25T16:50:28Z,description=,heartbeat_timestamp=2021-05-25T17:06:58Z,host='dv-cinder-790492-4-iscsi',id=a2d427c1-2d07-43e8-afbe-218c9f7d0445,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T16:50:28Z,topic='l3_agent')) {'router_ids': ['a31e34e2-420e-4dd6-820b-1ec7d895549e'], 'active': True} {{(pid=91831) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 17:07:19.409716 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-36c72504-6892-45fe-ada1-cc78b8e5b707 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3832070'] for port, before_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:19.476467 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.db [None req-36c72504-6892-45fe-ada1-cc78b8e5b707 None None] For port 421abc1f-bb97-4830-9969-bc5d30acd0d7, host dv-cinder-790492-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-790492-4-iscsi',level=0,port_id=421abc1f-bb97-4830-9969-bc5d30acd0d7,segment=NetworkSegment(f72d7b23-e2ca-41dd-83c7-c64087195ce8),segment_id=f72d7b23-e2ca-41dd-83c7-c64087195ce8)] {{(pid=91831) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 17:07:19.481158 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.l3_dvr_db [None req-30fb9ea6-54af-4771-973d-57a05c8f61b6 None None] Set router a31e34e2-420e-4dd6-820b-1ec7d895549e gateway port host: dv-cinder-790492-4-iscsi {{(pid=91831) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 17:07:19.539310 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-36c72504-6892-45fe-ada1-cc78b8e5b707 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8757892955028', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8757892520933', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8757892521750'] for port, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:19.564646 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-21ce48c2-57b8-4224-937a-6a4e2d62727a req-e7c70278-1c9c-42dd-a413-2ab063d7f4ce tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/ports?device_id=bdaa3d25-adc2-4a52-8a36-66a599b4b6e2 HTTP/1.1" status: 200 len: 210 time: 0.1063359 May 25 17:07:19.624539 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:07:19.882495 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-36c72504-6892-45fe-ada1-cc78b8e5b707 None None] Pushing event updated for resources: {'Port': ['ID=421abc1f-bb97-4830-9969-bc5d30acd0d7,revision_number=3']} {{(pid=91831) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:07:19.894535 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [None req-36c72504-6892-45fe-ada1-cc78b8e5b707 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.270s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:07:19.933269 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.provisioning_blocks [None req-0e2c007b-66fc-4ced-a1a3-071a9bb308d9 None None] Provisioning complete for port 421abc1f-bb97-4830-9969-bc5d30acd0d7 triggered by entity DHCP. {{(pid=91831) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 17:07:19.933640 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-0e2c007b-66fc-4ced-a1a3-071a9bb308d9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3854128'] for port, provisioning_complete {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:20.035546 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.rpc [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Device 4972e3a9-91eb-48ce-8b7b-b0906822cebf up at agent ovs-agent-dv-cinder-790492-4-iscsi {{(pid=91831) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 25 17:07:20.112383 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-64442b91-1a28-4d7d-b9ec-f1cb42b9f2bd admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3832070'] for port, before_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:20.193227 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.provisioning_blocks [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Provisioning for port 4972e3a9-91eb-48ce-8b7b-b0906822cebf completed by entity L2. {{(pid=91831) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 25 17:07:20.201478 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.provisioning_blocks [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Provisioning complete for port 4972e3a9-91eb-48ce-8b7b-b0906822cebf triggered by entity L2. {{(pid=91831) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 17:07:20.201940 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3854128'] for port, provisioning_complete {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:20.234174 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.l3_hamode_db [None req-30fb9ea6-54af-4771-973d-57a05c8f61b6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'a31e34e2-420e-4dd6-820b-1ec7d895549e', 'name': 'tempest-TestVolumeBootPattern-2097476481-router', 'tenant_id': 'ebceaa13caaa4258abf32e19141de493', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'external_fixed_ips': [{'subnet_id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'ip_address': '172.27.2.190'}], 'enable_snat': True}, 'gw_port_id': '4ee74cc9-30db-4402-aed3-82be47c1be1e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T17:07:16Z', 'updated_at': '2021-05-25T17:07:17Z', 'revision_number': 3, 'project_id': 'ebceaa13caaa4258abf32e19141de493', 'gw_port': {'id': '4ee74cc9-30db-4402-aed3-82be47c1be1e', 'name': '', 'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'tenant_id': '', 'mac_address': 'fa:16:3e:b9:81:81', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'a31e34e2-420e-4dd6-820b-1ec7d895549e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 552, 'fixed_ips': [{'subnet_id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'ip_address': '172.27.2.190', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:07:17Z', 'updated_at': '2021-05-25T17:07:17Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-790492-4-iscsi'}], 'dv-cinder-790492-4-iscsi', False) {} {{(pid=91831) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 17:07:20.252521 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-30fb9ea6-54af-4771-973d-57a05c8f61b6 None None] Checking router: a31e34e2-420e-4dd6-820b-1ec7d895549e for host: dv-cinder-790492-4-iscsi {{(pid=91831) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 25 17:07:20.252950 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-30fb9ea6-54af-4771-973d-57a05c8f61b6 None None] Updating router a31e34e2-420e-4dd6-820b-1ec7d895549e port 4ee74cc9-30db-4402-aed3-82be47c1be1e binding host dv-cinder-790492-4-iscsi {{(pid=91831) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} May 25 17:07:20.325739 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-30fb9ea6-54af-4771-973d-57a05c8f61b6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3832070'] for port, before_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:20.331367 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.db_base_plugin_common [None req-64442b91-1a28-4d7d-b9ec-f1cb42b9f2bd admin admin] Allocated IP 172.20.0.1 (3fa72d6e-1a8d-4d69-93de-30a32f8d5423/6d7b3521-40af-42b0-b9ba-0605d0b34e3b/5cd66991-16ba-46db-b805-74a3af76a470) {{(pid=91830) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 25 17:07:20.499822 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3832070'] for port, before_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:20.500318 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-12ee782f-9a38-4246-bf24-a25f3760602e req-1c6723c7-c27e-419d-96e1-a0712213e4a1 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:07:20.502494 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-12ee782f-9a38-4246-bf24-a25f3760602e req-1c6723c7-c27e-419d-96e1-a0712213e4a1 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.32 "GET /v2.0/networks?id=e5be4c6a-143f-474c-a90b-37180778cefe HTTP/1.1" status: 200 len: 816 time: 0.1776979 May 25 17:07:20.506701 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-64442b91-1a28-4d7d-b9ec-f1cb42b9f2bd admin admin] Notify callbacks [] for port, precommit_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:20.524622 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.provisioning_blocks [None req-64442b91-1a28-4d7d-b9ec-f1cb42b9f2bd admin admin] Transition to ACTIVE for port object 5cd66991-16ba-46db-b805-74a3af76a470 will not be triggered until provisioned by entity DHCP. {{(pid=91830) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 25 17:07:20.555814 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-64442b91-1a28-4d7d-b9ec-f1cb42b9f2bd admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8757892520915', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-27483019'] for port, after_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:20.560713 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-b497bade-28f9-4a02-be35-5fb97f089477 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:07:20.568218 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.db [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] For port 4972e3a9-91eb-48ce-8b7b-b0906822cebf, host dv-cinder-790492-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-790492-4-iscsi',level=0,port_id=4972e3a9-91eb-48ce-8b7b-b0906822cebf,segment=NetworkSegment(50ed67e9-f8d3-4927-b257-bd17654cce34),segment_id=50ed67e9-f8d3-4927-b257-bd17654cce34)] {{(pid=91831) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 17:07:20.577587 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-12ee782f-9a38-4246-bf24-a25f3760602e req-7d53eeba-5214-4396-ba6f-5373283dedab tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.32 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=bbb9e99759bc47d08005f3b1e036a6cf HTTP/1.1" status: 200 len: 376 time: 0.0652745 May 25 17:07:20.605984 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.v2.base [req-12ee782f-9a38-4246-bf24-a25f3760602e req-68f2a308-6f22-414d-866c-1bae95c209c2 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Request body: {'port': {'device_id': 'bdaa3d25-adc2-4a52-8a36-66a599b4b6e2', 'network_id': 'e5be4c6a-143f-474c-a90b-37180778cefe', 'admin_state_up': True, 'tenant_id': 'bbb9e99759bc47d08005f3b1e036a6cf', 'security_groups': ['4e6b7b77-0833-47dc-be2e-ec9c7c960bb9']}} {{(pid=91829) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 17:07:20.622822 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8757892955028', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8757892520933', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8757892521750'] for port, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:20.630795 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-64442b91-1a28-4d7d-b9ec-f1cb42b9f2bd admin admin] Network 3fa72d6e-1a8d-4d69-93de-30a32f8d5423 is already hosted by enough agents. {{(pid=91830) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 25 17:07:20.633784 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.scheduler.base_scheduler [None req-64442b91-1a28-4d7d-b9ec-f1cb42b9f2bd admin admin] Resources bound (agent type, host, resource id): {{(pid=91830) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 17:07:20.636493 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.l3_dvrscheduler_db [None req-64442b91-1a28-4d7d-b9ec-f1cb42b9f2bd admin admin] Received port after_create {{(pid=91830) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 25 17:07:20.678600 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-64442b91-1a28-4d7d-b9ec-f1cb42b9f2bd admin admin] Pushing event updated for resources: {'Port': ['ID=5cd66991-16ba-46db-b805-74a3af76a470,revision_number=1']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:07:20.691727 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-64442b91-1a28-4d7d-b9ec-f1cb42b9f2bd admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.131s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:07:20.714697 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-64442b91-1a28-4d7d-b9ec-f1cb42b9f2bd admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-680080'] for router_interface, before_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:20.727208 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:07:20.781090 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-efcb954a-b5dd-4582-a403-617d209fff27 req-81281540-b91d-4bc2-a285-22c96be3ffab tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/ports?device_id=bdaa3d25-adc2-4a52-8a36-66a599b4b6e2 HTTP/1.1" status: 200 len: 210 time: 0.0606997 May 25 17:07:20.819871 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.quota.driver [req-12ee782f-9a38-4246-bf24-a25f3760602e req-68f2a308-6f22-414d-866c-1bae95c209c2 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91829) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 17:07:20.826627 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.quota.driver [req-12ee782f-9a38-4246-bf24-a25f3760602e req-68f2a308-6f22-414d-866c-1bae95c209c2 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Attempting to reserve 1 items for resource port. Total usage: 3; quota limit: 500; headroom:497 {{(pid=91829) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 17:07:20.839277 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-12ee782f-9a38-4246-bf24-a25f3760602e req-68f2a308-6f22-414d-866c-1bae95c209c2 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Made reservation on behalf of bbb9e99759bc47d08005f3b1e036a6cf for: {'port': 1} {{(pid=91829) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 25 17:07:20.842884 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [req-12ee782f-9a38-4246-bf24-a25f3760602e req-68f2a308-6f22-414d-866c-1bae95c209c2 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3832070'] for port, before_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:20.864178 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-64442b91-1a28-4d7d-b9ec-f1cb42b9f2bd admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3832070'] for port, before_update {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:20.872755 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Pushing event updated for resources: {'Port': ['ID=4972e3a9-91eb-48ce-8b7b-b0906822cebf,revision_number=5']} {{(pid=91831) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:07:20.885829 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.159s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:07:20.888462 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-30fb9ea6-54af-4771-973d-57a05c8f61b6 None None] Notify callbacks [] for port, precommit_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:20.902319 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.provisioning_blocks [None req-30fb9ea6-54af-4771-973d-57a05c8f61b6 None None] Transition to ACTIVE for port object 4ee74cc9-30db-4402-aed3-82be47c1be1e will not be triggered until provisioned by entity L2. {{(pid=91831) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 25 17:07:20.913160 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-30fb9ea6-54af-4771-973d-57a05c8f61b6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8757892955028', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8757892520933', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8757892521750'] for port, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:20.923149 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:07:20.996440 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.managers [None req-30fb9ea6-54af-4771-973d-57a05c8f61b6 None None] Attempting to bind port 4ee74cc9-30db-4402-aed3-82be47c1be1e on host dv-cinder-790492-4-iscsi for vnic_type normal with profile {{(pid=91831) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 25 17:07:20.996807 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.managers [None req-30fb9ea6-54af-4771-973d-57a05c8f61b6 None None] Attempting to bind port 4ee74cc9-30db-4402-aed3-82be47c1be1e by drivers openvswitch,hyperv on host dv-cinder-790492-4-iscsi at level 0 using segments [{'id': '414a8468-1d66-4792-9e81-d8ac5ccf1512', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74'}] {{(pid=91831) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 25 17:07:20.997173 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-30fb9ea6-54af-4771-973d-57a05c8f61b6 None None] Attempting to bind port 4ee74cc9-30db-4402-aed3-82be47c1be1e on network 4364b6ab-4117-4a92-baeb-f5ee2f45bf74 {{(pid=91831) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 25 17:07:21.012561 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d0f024dd-07c7-48eb-8843-58c92b934fb8 None None] Pushing event updated for resources: {'Port': ['ID=4ee74cc9-30db-4402-aed3-82be47c1be1e,revision_number=2']} {{(pid=91831) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:07:21.021603 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-30fb9ea6-54af-4771-973d-57a05c8f61b6 None None] Checking agent: {'id': 'fc8251e1-071c-49f7-bc10-1337f1d37d1b', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-790492-4-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 25, 16, 50, 28), 'started_at': datetime.datetime(2021, 5, 25, 16, 50, 58), 'heartbeat_timestamp': datetime.datetime(2021, 5, 25, 17, 6, 58), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-790492-4-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=91831) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 25 17:07:21.022007 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-30fb9ea6-54af-4771-973d-57a05c8f61b6 None None] Checking segment: {'id': '414a8468-1d66-4792-9e81-d8ac5ccf1512', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91831) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 25 17:07:21.022409 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-30fb9ea6-54af-4771-973d-57a05c8f61b6 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:21.022800 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-30fb9ea6-54af-4771-973d-57a05c8f61b6 None None] Bound using segment: {'id': '414a8468-1d66-4792-9e81-d8ac5ccf1512', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74'} {{(pid=91831) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 25 17:07:21.023279 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.managers [None req-30fb9ea6-54af-4771-973d-57a05c8f61b6 None None] Bound port: 4ee74cc9-30db-4402-aed3-82be47c1be1e, host: dv-cinder-790492-4-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '414a8468-1d66-4792-9e81-d8ac5ccf1512', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74'}}] {{(pid=91831) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 25 17:07:21.023651 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-30fb9ea6-54af-4771-973d-57a05c8f61b6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3832070'] for port, before_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:21.028350 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.db_base_plugin_common [req-12ee782f-9a38-4246-bf24-a25f3760602e req-68f2a308-6f22-414d-866c-1bae95c209c2 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Allocated IP 172.20.0.12 (e5be4c6a-143f-474c-a90b-37180778cefe/6e6b5897-e23d-4281-96cb-a6fdf9b68134/bfd709e1-823e-4b01-8a88-fa341f7e700a) {{(pid=91829) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 25 17:07:21.056686 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [None req-d0f024dd-07c7-48eb-8843-58c92b934fb8 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.133s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:07:21.073562 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.provisioning_blocks [None req-6d98c053-c7ae-494e-9121-d1f3d242dc61 None None] Provisioning for port 5cd66991-16ba-46db-b805-74a3af76a470 completed by entity DHCP. {{(pid=91831) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 25 17:07:21.083496 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.provisioning_blocks [None req-6d98c053-c7ae-494e-9121-d1f3d242dc61 None None] Provisioning complete for port 5cd66991-16ba-46db-b805-74a3af76a470 triggered by entity DHCP. {{(pid=91831) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 17:07:21.083874 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-6d98c053-c7ae-494e-9121-d1f3d242dc61 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3854128'] for port, provisioning_complete {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:21.132558 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-64442b91-1a28-4d7d-b9ec-f1cb42b9f2bd admin admin] Notify callbacks [] for port, precommit_update {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:21.137827 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-64442b91-1a28-4d7d-b9ec-f1cb42b9f2bd admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8757892955028', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8757892520933', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8757892521750', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-27483010'] for port, after_update {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:21.156815 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.plugin [None req-6d98c053-c7ae-494e-9121-d1f3d242dc61 None None] Port 5cd66991-16ba-46db-b805-74a3af76a470 cannot update to ACTIVE because it is not bound. {{(pid=91831) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 25 17:07:21.158645 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.db [None req-30fb9ea6-54af-4771-973d-57a05c8f61b6 None None] For port 4ee74cc9-30db-4402-aed3-82be47c1be1e, host dv-cinder-790492-4-iscsi, cleared binding levels {{(pid=91831) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 25 17:07:21.161986 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.db [None req-30fb9ea6-54af-4771-973d-57a05c8f61b6 None None] For port 4ee74cc9-30db-4402-aed3-82be47c1be1e, host dv-cinder-790492-4-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-790492-4-iscsi',level=0,port_id=4ee74cc9-30db-4402-aed3-82be47c1be1e,segment=NetworkSegment(414a8468-1d66-4792-9e81-d8ac5ccf1512),segment_id=414a8468-1d66-4792-9e81-d8ac5ccf1512)] {{(pid=91831) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 25 17:07:21.167344 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-30fb9ea6-54af-4771-973d-57a05c8f61b6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8757892955028', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8757892520933', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8757892521750'] for port, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:21.168882 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-7369b2c7-0e07-4a2c-a1a4-6ce7fc2f8c9d tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:07:21.171805 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:07:21.229357 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [req-12ee782f-9a38-4246-bf24-a25f3760602e req-68f2a308-6f22-414d-866c-1bae95c209c2 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Notify callbacks [] for port, precommit_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:21.247981 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.l3_dvrscheduler_db [None req-30fb9ea6-54af-4771-973d-57a05c8f61b6 None None] Routers {'a31e34e2-420e-4dd6-820b-1ec7d895549e'} bound to L3 agent in host dv-cinder-790492-4-iscsi {{(pid=91831) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 17:07:21.248608 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.l3_hamode_db [None req-30fb9ea6-54af-4771-973d-57a05c8f61b6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-790492-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-05-25T16:50:28Z,description=,heartbeat_timestamp=2021-05-25T17:06:58Z,host='dv-cinder-790492-4-iscsi',id=a2d427c1-2d07-43e8-afbe-218c9f7d0445,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T16:50:28Z,topic='l3_agent')) {'router_ids': ['a31e34e2-420e-4dd6-820b-1ec7d895549e'], 'active': True} {{(pid=91831) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 17:07:21.250478 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.provisioning_blocks [req-12ee782f-9a38-4246-bf24-a25f3760602e req-68f2a308-6f22-414d-866c-1bae95c209c2 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Transition to ACTIVE for port object bfd709e1-823e-4b01-8a88-fa341f7e700a will not be triggered until provisioned by entity DHCP. {{(pid=91829) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 25 17:07:21.256606 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-64442b91-1a28-4d7d-b9ec-f1cb42b9f2bd admin admin] Pushing event updated for resources: {'Port': ['ID=5cd66991-16ba-46db-b805-74a3af76a470,revision_number=2']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:07:21.259472 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-64442b91-1a28-4d7d-b9ec-f1cb42b9f2bd admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.091s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:07:21.260420 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-64442b91-1a28-4d7d-b9ec-f1cb42b9f2bd admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-549138', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-679997'] for router_interface, after_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:21.277573 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [req-12ee782f-9a38-4246-bf24-a25f3760602e req-68f2a308-6f22-414d-866c-1bae95c209c2 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8757892520915', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28230808'] for port, after_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:21.283246 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-2dfcd7ce-2023-49aa-9728-a381803c759e admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:07:21.318379 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d0f024dd-07c7-48eb-8843-58c92b934fb8 None None] Pushing event updated for resources: {'Port': ['ID=4ee74cc9-30db-4402-aed3-82be47c1be1e,revision_number=3']} {{(pid=91831) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:07:21.323373 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [None req-d0f024dd-07c7-48eb-8843-58c92b934fb8 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.152s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:07:21.352545 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-12ee782f-9a38-4246-bf24-a25f3760602e req-68f2a308-6f22-414d-866c-1bae95c209c2 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Network e5be4c6a-143f-474c-a90b-37180778cefe is already hosted by enough agents. {{(pid=91829) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 25 17:07:21.356326 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.scheduler.base_scheduler [req-12ee782f-9a38-4246-bf24-a25f3760602e req-68f2a308-6f22-414d-866c-1bae95c209c2 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Resources bound (agent type, host, resource id): {{(pid=91829) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 17:07:21.361043 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.l3_dvrscheduler_db [req-12ee782f-9a38-4246-bf24-a25f3760602e req-68f2a308-6f22-414d-866c-1bae95c209c2 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Received port after_create {{(pid=91829) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 25 17:07:21.391709 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-68f2a308-6f22-414d-866c-1bae95c209c2 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Pushing event updated for resources: {'Port': ['ID=bfd709e1-823e-4b01-8a88-fa341f7e700a,revision_number=1']} {{(pid=91829) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:07:21.397608 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-68f2a308-6f22-414d-866c-1bae95c209c2 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.114s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:07:21.438232 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.l3_dvr_db [None req-30fb9ea6-54af-4771-973d-57a05c8f61b6 None None] Set router a31e34e2-420e-4dd6-820b-1ec7d895549e gateway port host: dv-cinder-790492-4-iscsi {{(pid=91831) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 17:07:21.439086 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-12ee782f-9a38-4246-bf24-a25f3760602e req-68f2a308-6f22-414d-866c-1bae95c209c2 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:07:21.439815 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [req-12ee782f-9a38-4246-bf24-a25f3760602e req-68f2a308-6f22-414d-866c-1bae95c209c2 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-178712'] for port, before_response {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:21.469873 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-12ee782f-9a38-4246-bf24-a25f3760602e req-68f2a308-6f22-414d-866c-1bae95c209c2 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.32 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 0.8872890 May 25 17:07:21.483171 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.v2.base [req-12ee782f-9a38-4246-bf24-a25f3760602e req-81a851f4-d95e-4ce6-b494-26edcd907e37 service neutron] Request body: {'port': {'device_id': 'bdaa3d25-adc2-4a52-8a36-66a599b4b6e2', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-79049'}} {{(pid=91829) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 17:07:21.569026 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-64442b91-1a28-4d7d-b9ec-f1cb42b9f2bd admin admin] Network 3fa72d6e-1a8d-4d69-93de-30a32f8d5423 is already hosted by enough agents. {{(pid=91830) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 25 17:07:21.570195 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.scheduler.base_scheduler [None req-64442b91-1a28-4d7d-b9ec-f1cb42b9f2bd admin admin] Resources bound (agent type, host, resource id): {{(pid=91830) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 17:07:21.606425 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [req-12ee782f-9a38-4246-bf24-a25f3760602e req-81a851f4-d95e-4ce6-b494-26edcd907e37 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3832070'] for port, before_update {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:21.732762 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.provisioning_blocks [None req-97902022-4942-47c1-9d9c-a5f816095377 None None] Provisioning for port bfd709e1-823e-4b01-8a88-fa341f7e700a completed by entity DHCP. {{(pid=91831) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 25 17:07:21.751993 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.provisioning_blocks [None req-97902022-4942-47c1-9d9c-a5f816095377 None None] Provisioning complete for port bfd709e1-823e-4b01-8a88-fa341f7e700a triggered by entity DHCP. {{(pid=91831) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 17:07:21.752368 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-97902022-4942-47c1-9d9c-a5f816095377 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3854128'] for port, provisioning_complete {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:21.804119 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-64442b91-1a28-4d7d-b9ec-f1cb42b9f2bd admin admin] Router a31e34e2-420e-4dd6-820b-1ec7d895549e has already been hosted by L3 agent a2d427c1-2d07-43e8-afbe-218c9f7d0445 {{(pid=91830) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 25 17:07:21.866924 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.plugin [None req-97902022-4942-47c1-9d9c-a5f816095377 None None] Port bfd709e1-823e-4b01-8a88-fa341f7e700a cannot update to ACTIVE because it is not bound. {{(pid=91831) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 25 17:07:21.928827 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.l3_hamode_db [None req-30fb9ea6-54af-4771-973d-57a05c8f61b6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'a31e34e2-420e-4dd6-820b-1ec7d895549e', 'name': 'tempest-TestVolumeBootPattern-2097476481-router', 'tenant_id': 'ebceaa13caaa4258abf32e19141de493', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'external_fixed_ips': [{'subnet_id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'ip_address': '172.27.2.190'}], 'enable_snat': True}, 'gw_port_id': '4ee74cc9-30db-4402-aed3-82be47c1be1e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T17:07:16Z', 'updated_at': '2021-05-25T17:07:20Z', 'revision_number': 4, 'project_id': 'ebceaa13caaa4258abf32e19141de493', 'gw_port': {'id': '4ee74cc9-30db-4402-aed3-82be47c1be1e', 'name': '', 'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'tenant_id': '', 'mac_address': 'fa:16:3e:b9:81:81', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'a31e34e2-420e-4dd6-820b-1ec7d895549e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 552, 'fixed_ips': [{'subnet_id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'ip_address': '172.27.2.190', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790492-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:07:17Z', 'updated_at': '2021-05-25T17:07:21Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-790492-4-iscsi', '_interfaces': [{'id': '5cd66991-16ba-46db-b805-74a3af76a470', 'name': '', 'network_id': '3fa72d6e-1a8d-4d69-93de-30a32f8d5423', 'tenant_id': 'ebceaa13caaa4258abf32e19141de493', 'mac_address': 'fa:16:3e:24:51:cd', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'a31e34e2-420e-4dd6-820b-1ec7d895549e', 'device_owner': 'network:router_interface', 'standard_attr_id': 553, 'fixed_ips': [{'subnet_id': '6d7b3521-40af-42b0-b9ba-0605d0b34e3b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:07:20Z', 'updated_at': '2021-05-25T17:07:20Z', 'revision_number': 2, 'project_id': 'ebceaa13caaa4258abf32e19141de493', 'subnets': [{'id': '6d7b3521-40af-42b0-b9ba-0605d0b34e3b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-790492-4-iscsi', False) {} {{(pid=91831) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 17:07:21.938448 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-30fb9ea6-54af-4771-973d-57a05c8f61b6 None None] The sync data for ids ['a31e34e2-420e-4dd6-820b-1ec7d895549e'] in dv-cinder-790492-4-iscsi is: [{'id': 'a31e34e2-420e-4dd6-820b-1ec7d895549e', 'name': 'tempest-TestVolumeBootPattern-2097476481-router', 'tenant_id': 'ebceaa13caaa4258abf32e19141de493', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'external_fixed_ips': [{'subnet_id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'ip_address': '172.27.2.190'}], 'enable_snat': True}, 'gw_port_id': '4ee74cc9-30db-4402-aed3-82be47c1be1e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T17:07:16Z', 'updated_at': '2021-05-25T17:07:20Z', 'revision_number': 4, 'project_id': 'ebceaa13caaa4258abf32e19141de493', 'gw_port': {'id': '4ee74cc9-30db-4402-aed3-82be47c1be1e', 'name': '', 'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'tenant_id': '', 'mac_address': 'fa:16:3e:b9:81:81', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'a31e34e2-420e-4dd6-820b-1ec7d895549e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 552, 'fixed_ips': [{'subnet_id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'ip_address': '172.27.2.190', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790492-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:07:17Z', 'updated_at': '2021-05-25T17:07:21Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-790492-4-iscsi', '_interfaces': [{'id': '5cd66991-16ba-46db-b805-74a3af76a470', 'name': '', 'network_id': '3fa72d6e-1a8d-4d69-93de-30a32f8d5423', 'tenant_id': 'ebceaa13caaa4258abf32e19141de493', 'mac_address': 'fa:16:3e:24:51:cd', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'a31e34e2-420e-4dd6-820b-1ec7d895549e', 'device_owner': 'network:router_interface', 'standard_attr_id': 553, 'fixed_ips': [{'subnet_id': '6d7b3521-40af-42b0-b9ba-0605d0b34e3b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:07:20Z', 'updated_at': '2021-05-25T17:07:20Z', 'revision_number': 2, 'project_id': 'ebceaa13caaa4258abf32e19141de493', 'subnets': [{'id': '6d7b3521-40af-42b0-b9ba-0605d0b34e3b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=91831) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 25 17:07:21.956753 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.rpc [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Device 4972e3a9-91eb-48ce-8b7b-b0906822cebf up at agent ovs-agent-dv-cinder-790492-4-iscsi {{(pid=91831) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 25 17:07:22.030647 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.provisioning_blocks [None req-fa1c8947-ab3d-4735-8efb-b45399d2efb3 None None] Provisioning complete for port 5cd66991-16ba-46db-b805-74a3af76a470 triggered by entity DHCP. {{(pid=91831) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 17:07:22.031026 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-fa1c8947-ab3d-4735-8efb-b45399d2efb3 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3854128'] for port, provisioning_complete {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:22.043652 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-64442b91-1a28-4d7d-b9ec-f1cb42b9f2bd admin admin] Notify agent at l3_agent.dv-cinder-790492-4-iscsi the message routers_updated {{(pid=91830) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 25 17:07:22.061943 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [None req-64442b91-1a28-4d7d-b9ec-f1cb42b9f2bd admin admin] 10.222.0.62 "PUT /v2.0/routers/a31e34e2-420e-4dd6-820b-1ec7d895549e/add_router_interface HTTP/1.1" status: 200 len: 503 time: 2.8854165 May 25 17:07:22.074024 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.notifiers.nova [req-12ee782f-9a38-4246-bf24-a25f3760602e req-81a851f4-d95e-4ce6-b494-26edcd907e37 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id bfd709e1-823e-4b01-8a88-fa341f7e700a {{(pid=91829) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} May 25 17:07:22.083094 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [req-12ee782f-9a38-4246-bf24-a25f3760602e req-81a851f4-d95e-4ce6-b494-26edcd907e37 service neutron] Notify callbacks [] for port, precommit_update {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:22.093207 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.plugin [None req-fa1c8947-ab3d-4735-8efb-b45399d2efb3 None None] Port 5cd66991-16ba-46db-b805-74a3af76a470 cannot update to ACTIVE because it is not bound. {{(pid=91831) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 25 17:07:22.105011 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.provisioning_blocks [req-12ee782f-9a38-4246-bf24-a25f3760602e req-81a851f4-d95e-4ce6-b494-26edcd907e37 service neutron] Transition to ACTIVE for port object bfd709e1-823e-4b01-8a88-fa341f7e700a will not be triggered until provisioned by entity L2. {{(pid=91829) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 25 17:07:22.107258 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.provisioning_blocks [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Provisioning complete for port 4972e3a9-91eb-48ce-8b7b-b0906822cebf triggered by entity L2. {{(pid=91831) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 17:07:22.107703 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3854128'] for port, provisioning_complete {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:22.114860 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e970e0a3-7797-4165-8e71-f0232c4b937f req-8ea87779-68b9-4c03-9697-65c6d7daba2a tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:07:22.115730 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.quota.resource [req-e970e0a3-7797-4165-8e71-f0232c4b937f req-8ea87779-68b9-4c03-9697-65c6d7daba2a tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Synchronizing usage tracker for tenant:bbb9e99759bc47d08005f3b1e036a6cf on resource:port {{(pid=91829) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 25 17:07:22.123330 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [req-12ee782f-9a38-4246-bf24-a25f3760602e req-81a851f4-d95e-4ce6-b494-26edcd907e37 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8757892955028', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8757892520933', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8757892521750', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28230801'] for port, after_update {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:22.128746 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-9a6c48b3-3d85-4d75-8c27-40673fc49cb0 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:07:22.150121 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.db.agents_db [None req-504cb04f-4543-46c1-8db7-349e21db7634 None None] Agent healthcheck: found 6 active agents {{(pid=91832) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} May 25 17:07:22.268565 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.quota.resource [req-e970e0a3-7797-4165-8e71-f0232c4b937f req-8ea87779-68b9-4c03-9697-65c6d7daba2a tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Unset dirty status for tenant:bbb9e99759bc47d08005f3b1e036a6cf on resource:port {{(pid=91829) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 25 17:07:22.277174 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-e970e0a3-7797-4165-8e71-f0232c4b937f req-8ea87779-68b9-4c03-9697-65c6d7daba2a tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/ports?device_id=bdaa3d25-adc2-4a52-8a36-66a599b4b6e2 HTTP/1.1" status: 200 len: 932 time: 0.3331771 May 25 17:07:22.286857 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.rpc [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Device 421abc1f-bb97-4830-9969-bc5d30acd0d7 up at agent ovs-agent-dv-cinder-790492-4-iscsi {{(pid=91831) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 25 17:07:22.395579 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.provisioning_blocks [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Provisioning complete for port 421abc1f-bb97-4830-9969-bc5d30acd0d7 triggered by entity L2. {{(pid=91831) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 17:07:22.398745 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3854128'] for port, provisioning_complete {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:22.581438 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-81a851f4-d95e-4ce6-b494-26edcd907e37 service neutron] Pushing event updated for resources: {'Port': ['ID=bfd709e1-823e-4b01-8a88-fa341f7e700a,revision_number=2']} {{(pid=91829) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:07:22.593597 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-e970e0a3-7797-4165-8e71-f0232c4b937f req-2544b8ac-8727-484f-ad8a-7910c874d9ab tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/security-groups?id=4e6b7b77-0833-47dc-be2e-ec9c7c960bb9&fields=id&fields=name HTTP/1.1" status: 200 len: 309 time: 0.3155136 May 25 17:07:22.596474 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-81a851f4-d95e-4ce6-b494-26edcd907e37 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.468s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:07:22.634323 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.plugins.ml2.managers [req-12ee782f-9a38-4246-bf24-a25f3760602e req-81a851f4-d95e-4ce6-b494-26edcd907e37 service neutron] Attempting to bind port bfd709e1-823e-4b01-8a88-fa341f7e700a on host hv-cinder-79049 for vnic_type normal with profile {{(pid=91829) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 25 17:07:22.635531 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.plugins.ml2.managers [req-12ee782f-9a38-4246-bf24-a25f3760602e req-81a851f4-d95e-4ce6-b494-26edcd907e37 service neutron] Attempting to bind port bfd709e1-823e-4b01-8a88-fa341f7e700a by drivers openvswitch,hyperv on host hv-cinder-79049 at level 0 using segments [{'id': 'a8fb0313-938a-4f5e-8ff4-96df8acd943b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 695, 'network_id': 'e5be4c6a-143f-474c-a90b-37180778cefe'}] {{(pid=91829) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 25 17:07:22.635712 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-12ee782f-9a38-4246-bf24-a25f3760602e req-81a851f4-d95e-4ce6-b494-26edcd907e37 service neutron] Attempting to bind port bfd709e1-823e-4b01-8a88-fa341f7e700a on network e5be4c6a-143f-474c-a90b-37180778cefe {{(pid=91829) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 25 17:07:22.640529 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-12ee782f-9a38-4246-bf24-a25f3760602e req-81a851f4-d95e-4ce6-b494-26edcd907e37 service neutron] Port bfd709e1-823e-4b01-8a88-fa341f7e700a on network e5be4c6a-143f-474c-a90b-37180778cefe not bound, no agent of type Open vSwitch agent registered on host hv-cinder-79049 {{(pid=91829) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 25 17:07:22.640956 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-12ee782f-9a38-4246-bf24-a25f3760602e req-81a851f4-d95e-4ce6-b494-26edcd907e37 service neutron] Attempting to bind port bfd709e1-823e-4b01-8a88-fa341f7e700a on network e5be4c6a-143f-474c-a90b-37180778cefe {{(pid=91829) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 25 17:07:22.646153 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-12ee782f-9a38-4246-bf24-a25f3760602e req-81a851f4-d95e-4ce6-b494-26edcd907e37 service neutron] Checking agent: {'id': '3a1fdee1-bff0-49fb-b470-e13b95ee1b4d', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-79049', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 25, 16, 56, 32), 'started_at': datetime.datetime(2021, 5, 25, 16, 56, 32), 'heartbeat_timestamp': datetime.datetime(2021, 5, 25, 17, 7, 7), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=91829) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 25 17:07:22.646605 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-12ee782f-9a38-4246-bf24-a25f3760602e req-81a851f4-d95e-4ce6-b494-26edcd907e37 service neutron] Checking segment: {'id': 'a8fb0313-938a-4f5e-8ff4-96df8acd943b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 695, 'network_id': 'e5be4c6a-143f-474c-a90b-37180778cefe'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91829) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 25 17:07:22.647111 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-12ee782f-9a38-4246-bf24-a25f3760602e req-81a851f4-d95e-4ce6-b494-26edcd907e37 service neutron] Bound using segment: {'id': 'a8fb0313-938a-4f5e-8ff4-96df8acd943b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 695, 'network_id': 'e5be4c6a-143f-474c-a90b-37180778cefe'} {{(pid=91829) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 25 17:07:22.647638 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.plugins.ml2.managers [req-12ee782f-9a38-4246-bf24-a25f3760602e req-81a851f4-d95e-4ce6-b494-26edcd907e37 service neutron] Bound port: bfd709e1-823e-4b01-8a88-fa341f7e700a, host: hv-cinder-79049, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'a8fb0313-938a-4f5e-8ff4-96df8acd943b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 695, 'network_id': 'e5be4c6a-143f-474c-a90b-37180778cefe'}}] {{(pid=91829) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 25 17:07:22.648083 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [req-12ee782f-9a38-4246-bf24-a25f3760602e req-81a851f4-d95e-4ce6-b494-26edcd907e37 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3832070'] for port, before_update {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:22.758205 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.plugins.ml2.db [req-12ee782f-9a38-4246-bf24-a25f3760602e req-81a851f4-d95e-4ce6-b494-26edcd907e37 service neutron] For port bfd709e1-823e-4b01-8a88-fa341f7e700a, host hv-cinder-79049, cleared binding levels {{(pid=91829) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 25 17:07:22.767314 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.plugins.ml2.db [req-12ee782f-9a38-4246-bf24-a25f3760602e req-81a851f4-d95e-4ce6-b494-26edcd907e37 service neutron] For port bfd709e1-823e-4b01-8a88-fa341f7e700a, host hv-cinder-79049, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79049',level=0,port_id=bfd709e1-823e-4b01-8a88-fa341f7e700a,segment=NetworkSegment(a8fb0313-938a-4f5e-8ff4-96df8acd943b),segment_id=a8fb0313-938a-4f5e-8ff4-96df8acd943b)] {{(pid=91829) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 25 17:07:22.771984 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [req-12ee782f-9a38-4246-bf24-a25f3760602e req-81a851f4-d95e-4ce6-b494-26edcd907e37 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8757892955028', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8757892520933', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8757892521750', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28230801'] for port, after_update {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:22.777131 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-649faa7b-8601-49a5-904d-c5c84f26c6d3 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:07:22.847929 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-12ee782f-9a38-4246-bf24-a25f3760602e req-81a851f4-d95e-4ce6-b494-26edcd907e37 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:07:22.848525 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [req-12ee782f-9a38-4246-bf24-a25f3760602e req-81a851f4-d95e-4ce6-b494-26edcd907e37 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-178712'] for port, before_response {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:22.850153 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-12ee782f-9a38-4246-bf24-a25f3760602e req-81a851f4-d95e-4ce6-b494-26edcd907e37 service neutron] 10.222.0.32 "PUT /v2.0/ports/bfd709e1-823e-4b01-8a88-fa341f7e700a HTTP/1.1" status: 200 len: 1094 time: 1.3722618 May 25 17:07:22.850806 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'bdaa3d25-adc2-4a52-8a36-66a599b4b6e2', 'tag': 'bfd709e1-823e-4b01-8a88-fa341f7e700a'}] {{(pid=91829) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 25 17:07:22.899409 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-81a851f4-d95e-4ce6-b494-26edcd907e37 service neutron] Pushing event updated for resources: {'Port': ['ID=bfd709e1-823e-4b01-8a88-fa341f7e700a,revision_number=3']} {{(pid=91829) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:07:22.957656 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-81a851f4-d95e-4ce6-b494-26edcd907e37 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.181s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:07:22.965221 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'bdaa3d25-adc2-4a52-8a36-66a599b4b6e2', 'tag': 'bfd709e1-823e-4b01-8a88-fa341f7e700a', 'status': 'completed', 'code': 200} May 25 17:07:23.016752 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-12ee782f-9a38-4246-bf24-a25f3760602e req-a3da182d-823f-4235-9e0f-102d61f6c759 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:07:23.022499 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-12ee782f-9a38-4246-bf24-a25f3760602e req-a3da182d-823f-4235-9e0f-102d61f6c759 service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=bbb9e99759bc47d08005f3b1e036a6cf&device_id=bdaa3d25-adc2-4a52-8a36-66a599b4b6e2 HTTP/1.1" status: 200 len: 1097 time: 0.1183610 May 25 17:07:23.104492 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-12ee782f-9a38-4246-bf24-a25f3760602e req-31708fc6-4479-44ae-b24c-613cf678c62c service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=bfd709e1-823e-4b01-8a88-fa341f7e700a HTTP/1.1" status: 200 len: 217 time: 0.0727801 May 25 17:07:23.105925 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.wsgi [-] (91829) accepted ('10.222.0.62', 36014) {{(pid=91829) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:07:23.111049 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.v2.base [None req-61806269-c732-454d-b3d7-21e470c98966 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-1745610358', 'description': 'tempest-secgroup-smoke-1745610358 description', 'project_id': '5397bf60956945c3a2bf43c6b1aa614b'}} {{(pid=91829) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 17:07:23.151851 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.quota.driver [None req-61806269-c732-454d-b3d7-21e470c98966 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91829) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 17:07:23.161041 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.quota.resource [None req-61806269-c732-454d-b3d7-21e470c98966 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Usage tracker for resource:security_group and tenant:5397bf60956945c3a2bf43c6b1aa614b is out of sync, need to count used quota {{(pid=91829) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 17:07:23.169598 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.quota.resource [None req-61806269-c732-454d-b3d7-21e470c98966 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Quota usage for security_group was recalculated. Used quota:1. {{(pid=91829) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 17:07:23.178549 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.quota.driver [None req-61806269-c732-454d-b3d7-21e470c98966 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=91829) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 17:07:23.193234 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-12ee782f-9a38-4246-bf24-a25f3760602e req-dccb70fa-36b8-4430-8569-3aed8bca23f9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:07:23.194696 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-12ee782f-9a38-4246-bf24-a25f3760602e req-dccb70fa-36b8-4430-8569-3aed8bca23f9 service neutron] 10.222.0.32 "GET /v2.0/subnets?id=6e6b5897-e23d-4281-96cb-a6fdf9b68134 HTTP/1.1" status: 200 len: 855 time: 0.0793214 May 25 17:07:23.195875 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-61806269-c732-454d-b3d7-21e470c98966 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Notify callbacks [] for security_group, before_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:23.268176 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.quota.driver [None req-61806269-c732-454d-b3d7-21e470c98966 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91829) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 17:07:23.274869 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.quota.resource [None req-61806269-c732-454d-b3d7-21e470c98966 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Usage tracker for resource:security_group_rule and tenant:5397bf60956945c3a2bf43c6b1aa614b is out of sync, need to count used quota {{(pid=91829) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 17:07:23.278488 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.quota.resource [None req-61806269-c732-454d-b3d7-21e470c98966 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=91829) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 17:07:23.286831 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.quota.driver [None req-61806269-c732-454d-b3d7-21e470c98966 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=91829) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 17:07:23.319263 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-12ee782f-9a38-4246-bf24-a25f3760602e req-15878ee7-69b6-4837-99a1-7e2c1c4a5be0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:07:23.320747 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-12ee782f-9a38-4246-bf24-a25f3760602e req-15878ee7-69b6-4837-99a1-7e2c1c4a5be0 service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=e5be4c6a-143f-474c-a90b-37180778cefe&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.1151395 May 25 17:07:23.455353 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-61806269-c732-454d-b3d7-21e470c98966 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Notify callbacks [] for security_group, precommit_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:23.465978 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-61806269-c732-454d-b3d7-21e470c98966 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-640836'] for security_group, after_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:23.472903 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-d4d5a7f3-bdd4-423b-998c-926193b1755f admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:07:23.529058 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-12ee782f-9a38-4246-bf24-a25f3760602e req-562338c7-7678-43b1-95e8-4fbb3781b5b6 service neutron] 10.222.0.32 "GET /v2.0/networks/e5be4c6a-143f-474c-a90b-37180778cefe?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2011220 May 25 17:07:23.529722 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-61806269-c732-454d-b3d7-21e470c98966 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Pushing event updated for resources: {'SecurityGroup': ['ID=58fab80b-49b2-4bca-89e6-fef7473221ef,revision_number=1']} {{(pid=91829) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:07:23.532332 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-61806269-c732-454d-b3d7-21e470c98966 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Notify callbacks [] for security_group, before_response {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:23.536009 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [None req-61806269-c732-454d-b3d7-21e470c98966 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] 10.222.0.62 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1794 time: 0.4265161 May 25 17:07:23.536009 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-61806269-c732-454d-b3d7-21e470c98966 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.062s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:07:23.536380 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.wsgi [-] (91830) accepted ('10.222.0.62', 36018) {{(pid=91830) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:07:23.542166 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.v2.base [None req-a56293d1-dc67-4236-823a-69ab4b1323aa tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Request body: {'security_group_rule': {'security_group_id': '58fab80b-49b2-4bca-89e6-fef7473221ef', 'project_id': '5397bf60956945c3a2bf43c6b1aa614b', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=91830) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 17:07:23.552221 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.quota.driver [None req-a56293d1-dc67-4236-823a-69ab4b1323aa tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91830) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 17:07:23.556062 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [None req-a56293d1-dc67-4236-823a-69ab4b1323aa tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Usage tracker for resource:security_group_rule and tenant:5397bf60956945c3a2bf43c6b1aa614b is out of sync, need to count used quota {{(pid=91830) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 17:07:23.559826 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [None req-a56293d1-dc67-4236-823a-69ab4b1323aa tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=91830) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 17:07:23.566822 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.quota.driver [None req-a56293d1-dc67-4236-823a-69ab4b1323aa tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=91830) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 17:07:23.585290 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-a56293d1-dc67-4236-823a-69ab4b1323aa tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Notify callbacks [] for security_group_rule, before_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:23.655076 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-a56293d1-dc67-4236-823a-69ab4b1323aa tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:23.662598 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-a56293d1-dc67-4236-823a-69ab4b1323aa tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-640874'] for security_group_rule, after_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:23.664724 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:07:23.674313 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-12ee782f-9a38-4246-bf24-a25f3760602e req-811b929c-f149-4a9f-8c23-fbf5271a37f8 service neutron] 10.222.0.32 "GET /v2.0/networks/e5be4c6a-143f-474c-a90b-37180778cefe?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1385467 May 25 17:07:23.692703 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a56293d1-dc67-4236-823a-69ab4b1323aa tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=570c4202-48c7-43c4-ad0c-e8f2c498bcdd,revision_number=0']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:07:23.700500 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-a56293d1-dc67-4236-823a-69ab4b1323aa tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.036s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:07:23.708586 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-a56293d1-dc67-4236-823a-69ab4b1323aa tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Notify callbacks [] for security_group_rule, before_response {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:23.712746 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [None req-a56293d1-dc67-4236-823a-69ab4b1323aa tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] 10.222.0.62 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.1726882 May 25 17:07:23.714091 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.wsgi [-] (91830) accepted ('10.222.0.62', 36024) {{(pid=91830) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:07:23.722933 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.v2.base [None req-67270961-bbab-4455-848c-862727d83ff9 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Request body: {'security_group_rule': {'security_group_id': '58fab80b-49b2-4bca-89e6-fef7473221ef', 'project_id': '5397bf60956945c3a2bf43c6b1aa614b', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=91830) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 17:07:23.729938 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.quota.driver [None req-67270961-bbab-4455-848c-862727d83ff9 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91830) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 17:07:23.733947 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [None req-67270961-bbab-4455-848c-862727d83ff9 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Usage tracker for resource:security_group_rule and tenant:5397bf60956945c3a2bf43c6b1aa614b is out of sync, need to count used quota {{(pid=91830) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 17:07:23.737053 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [None req-67270961-bbab-4455-848c-862727d83ff9 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Quota usage for security_group_rule was recalculated. Used quota:7. {{(pid=91830) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 17:07:23.743174 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.quota.driver [None req-67270961-bbab-4455-848c-862727d83ff9 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 7; quota limit: 100; headroom:93 {{(pid=91830) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 17:07:23.761036 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-67270961-bbab-4455-848c-862727d83ff9 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Notify callbacks [] for security_group_rule, before_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:23.829409 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-67270961-bbab-4455-848c-862727d83ff9 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:23.833646 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-67270961-bbab-4455-848c-862727d83ff9 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-640874'] for security_group_rule, after_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:23.836397 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:07:23.861174 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-67270961-bbab-4455-848c-862727d83ff9 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=599bf38a-5089-404a-8538-78972068462f,revision_number=0']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:07:23.862144 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-63e87e2d-f2d9-445d-b944-cca7bfff44d8 req-71b0f7c7-fed3-4c71-84d1-0715df0f8a9f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:07:23.864479 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-63e87e2d-f2d9-445d-b944-cca7bfff44d8 req-71b0f7c7-fed3-4c71-84d1-0715df0f8a9f service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=bbb9e99759bc47d08005f3b1e036a6cf&device_id=bdaa3d25-adc2-4a52-8a36-66a599b4b6e2 HTTP/1.1" status: 200 len: 1097 time: 0.1066658 May 25 17:07:23.872731 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-67270961-bbab-4455-848c-862727d83ff9 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.036s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:07:23.873509 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7c82b741-a2af-463f-9e6c-580f38059676 req-bfd0560c-a2a4-4ad2-a726-c78461d80a37 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:07:23.880497 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-7c82b741-a2af-463f-9e6c-580f38059676 req-bfd0560c-a2a4-4ad2-a726-c78461d80a37 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/ports?device_id=bdaa3d25-adc2-4a52-8a36-66a599b4b6e2 HTTP/1.1" status: 200 len: 944 time: 0.1679883 May 25 17:07:23.883820 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-67270961-bbab-4455-848c-862727d83ff9 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Notify callbacks [] for security_group_rule, before_response {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:23.888650 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [None req-67270961-bbab-4455-848c-862727d83ff9 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] 10.222.0.62 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.1735590 May 25 17:07:23.889387 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.wsgi [-] (91830) accepted ('10.222.0.62', 36028) {{(pid=91830) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:07:23.902707 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.v2.base [None req-82168444-d8a3-4697-a27a-c0beb5d38da2 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Request body: {'security_group_rule': {'security_group_id': '58fab80b-49b2-4bca-89e6-fef7473221ef', 'project_id': '5397bf60956945c3a2bf43c6b1aa614b', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=91830) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 17:07:23.914550 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.quota.driver [None req-82168444-d8a3-4697-a27a-c0beb5d38da2 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91830) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 17:07:23.920783 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [None req-82168444-d8a3-4697-a27a-c0beb5d38da2 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Usage tracker for resource:security_group_rule and tenant:5397bf60956945c3a2bf43c6b1aa614b is out of sync, need to count used quota {{(pid=91830) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 17:07:23.925099 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [None req-82168444-d8a3-4697-a27a-c0beb5d38da2 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Quota usage for security_group_rule was recalculated. Used quota:8. {{(pid=91830) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 17:07:23.933619 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.quota.driver [None req-82168444-d8a3-4697-a27a-c0beb5d38da2 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 8; quota limit: 100; headroom:92 {{(pid=91830) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 17:07:23.959864 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-82168444-d8a3-4697-a27a-c0beb5d38da2 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Notify callbacks [] for security_group_rule, before_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:24.000175 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.rpc [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Device 4ee74cc9-30db-4402-aed3-82be47c1be1e up at agent ovs-agent-dv-cinder-790492-4-iscsi {{(pid=91831) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 25 17:07:24.007686 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-7c82b741-a2af-463f-9e6c-580f38059676 req-099005a7-8bf7-4521-a7fb-6c77819f9fe6 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/security-groups?id=4e6b7b77-0833-47dc-be2e-ec9c7c960bb9&fields=id&fields=name HTTP/1.1" status: 200 len: 309 time: 0.1263275 May 25 17:07:24.037497 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-82168444-d8a3-4697-a27a-c0beb5d38da2 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:24.043694 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-82168444-d8a3-4697-a27a-c0beb5d38da2 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-640874'] for security_group_rule, after_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:24.046079 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-f637ca7f-d248-46f1-8e22-b8ca54674981 tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:07:24.065162 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-63e87e2d-f2d9-445d-b944-cca7bfff44d8 req-af4b09f1-ce41-4a96-a9f3-8742e189c028 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:07:24.067477 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-63e87e2d-f2d9-445d-b944-cca7bfff44d8 req-af4b09f1-ce41-4a96-a9f3-8742e189c028 service neutron] 10.222.0.32 "GET /v2.0/networks?id=e5be4c6a-143f-474c-a90b-37180778cefe HTTP/1.1" status: 200 len: 917 time: 0.1843572 May 25 17:07:24.074830 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-82168444-d8a3-4697-a27a-c0beb5d38da2 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=6e2b5568-9e66-483e-896a-250c03a90f10,revision_number=0']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:07:24.077592 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-82168444-d8a3-4697-a27a-c0beb5d38da2 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.032s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:07:24.081632 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-82168444-d8a3-4697-a27a-c0beb5d38da2 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Notify callbacks [] for security_group_rule, before_response {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:24.082888 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [None req-82168444-d8a3-4697-a27a-c0beb5d38da2 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] 10.222.0.62 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.1919775 May 25 17:07:24.085543 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.wsgi [-] (91830) accepted ('10.222.0.62', 36032) {{(pid=91830) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:07:24.091561 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.v2.base [None req-14e4562b-52b8-4f2b-8b33-bc343cbc4af6 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Request body: {'security_group_rule': {'security_group_id': '58fab80b-49b2-4bca-89e6-fef7473221ef', 'project_id': '5397bf60956945c3a2bf43c6b1aa614b', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=91830) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 17:07:24.095748 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.provisioning_blocks [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Provisioning for port 4ee74cc9-30db-4402-aed3-82be47c1be1e completed by entity L2. {{(pid=91831) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 25 17:07:24.097850 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.quota.driver [None req-14e4562b-52b8-4f2b-8b33-bc343cbc4af6 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91830) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 17:07:24.101837 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [None req-14e4562b-52b8-4f2b-8b33-bc343cbc4af6 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Usage tracker for resource:security_group_rule and tenant:5397bf60956945c3a2bf43c6b1aa614b is out of sync, need to count used quota {{(pid=91830) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 17:07:24.102317 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.provisioning_blocks [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Provisioning complete for port 4ee74cc9-30db-4402-aed3-82be47c1be1e triggered by entity L2. {{(pid=91831) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 17:07:24.102738 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3854128'] for port, provisioning_complete {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:24.104728 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [None req-14e4562b-52b8-4f2b-8b33-bc343cbc4af6 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Quota usage for security_group_rule was recalculated. Used quota:9. {{(pid=91830) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 17:07:24.110479 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.quota.driver [None req-14e4562b-52b8-4f2b-8b33-bc343cbc4af6 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 9; quota limit: 100; headroom:91 {{(pid=91830) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 17:07:24.130206 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-14e4562b-52b8-4f2b-8b33-bc343cbc4af6 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Notify callbacks [] for security_group_rule, before_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:24.157977 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-63e87e2d-f2d9-445d-b944-cca7bfff44d8 req-5a160c45-a21d-4e21-bb97-eca5bf00f435 service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=bfd709e1-823e-4b01-8a88-fa341f7e700a HTTP/1.1" status: 200 len: 217 time: 0.0830269 May 25 17:07:24.214978 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-14e4562b-52b8-4f2b-8b33-bc343cbc4af6 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:24.219925 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-14e4562b-52b8-4f2b-8b33-bc343cbc4af6 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-640874'] for security_group_rule, after_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:24.222221 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:07:24.230445 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3832070'] for port, before_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:24.230630 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-63e87e2d-f2d9-445d-b944-cca7bfff44d8 req-310f3550-54e4-46f0-b2c8-1f48f6f5f34c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:07:24.232266 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-63e87e2d-f2d9-445d-b944-cca7bfff44d8 req-310f3550-54e4-46f0-b2c8-1f48f6f5f34c service neutron] 10.222.0.32 "GET /v2.0/subnets?id=6e6b5897-e23d-4281-96cb-a6fdf9b68134 HTTP/1.1" status: 200 len: 855 time: 0.0671391 May 25 17:07:24.247699 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.db [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] For port 4ee74cc9-30db-4402-aed3-82be47c1be1e, host dv-cinder-790492-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-790492-4-iscsi',level=0,port_id=4ee74cc9-30db-4402-aed3-82be47c1be1e,segment=NetworkSegment(414a8468-1d66-4792-9e81-d8ac5ccf1512),segment_id=414a8468-1d66-4792-9e81-d8ac5ccf1512)] {{(pid=91831) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 17:07:24.247961 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-14e4562b-52b8-4f2b-8b33-bc343cbc4af6 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=fdd5e1b6-5d4e-4384-884c-1a562597de22,revision_number=0']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:07:24.250359 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-14e4562b-52b8-4f2b-8b33-bc343cbc4af6 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.028s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:07:24.252483 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8757892955028', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8757892520933', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8757892521750'] for port, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:24.255957 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:07:24.259463 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-14e4562b-52b8-4f2b-8b33-bc343cbc4af6 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Notify callbacks [] for security_group_rule, before_response {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:24.261383 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [None req-14e4562b-52b8-4f2b-8b33-bc343cbc4af6 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] 10.222.0.62 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.1746187 May 25 17:07:24.264472 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.wsgi [-] (91830) accepted ('10.222.0.62', 36036) {{(pid=91830) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:07:24.270078 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.v2.base [None req-2b49ebba-56b2-445a-9da4-b6e2731857cc tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Request body: {'security_group_rule': {'security_group_id': '58fab80b-49b2-4bca-89e6-fef7473221ef', 'project_id': '5397bf60956945c3a2bf43c6b1aa614b', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=91830) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 17:07:24.278193 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.quota.driver [None req-2b49ebba-56b2-445a-9da4-b6e2731857cc tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91830) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 17:07:24.283187 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [None req-2b49ebba-56b2-445a-9da4-b6e2731857cc tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Usage tracker for resource:security_group_rule and tenant:5397bf60956945c3a2bf43c6b1aa614b is out of sync, need to count used quota {{(pid=91830) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 17:07:24.286979 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [None req-2b49ebba-56b2-445a-9da4-b6e2731857cc tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Quota usage for security_group_rule was recalculated. Used quota:10. {{(pid=91830) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 17:07:24.293015 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.quota.driver [None req-2b49ebba-56b2-445a-9da4-b6e2731857cc tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 10; quota limit: 100; headroom:90 {{(pid=91830) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 17:07:24.306725 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.db.securitygroups_db [None req-2b49ebba-56b2-445a-9da4-b6e2731857cc tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Project 5397bf60956945c3a2bf43c6b1aa614b added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. May 25 17:07:24.314417 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-2b49ebba-56b2-445a-9da4-b6e2731857cc tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Notify callbacks [] for security_group_rule, before_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:24.332087 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-63e87e2d-f2d9-445d-b944-cca7bfff44d8 req-cc22a225-8bf2-4711-98a2-f049fdee1384 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:07:24.333581 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-63e87e2d-f2d9-445d-b944-cca7bfff44d8 req-cc22a225-8bf2-4711-98a2-f049fdee1384 service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=e5be4c6a-143f-474c-a90b-37180778cefe&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0949283 May 25 17:07:24.333702 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Pushing event updated for resources: {'Port': ['ID=4ee74cc9-30db-4402-aed3-82be47c1be1e,revision_number=4']} {{(pid=91831) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:07:24.338902 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.082s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:07:24.383998 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-2b49ebba-56b2-445a-9da4-b6e2731857cc tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:24.388251 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-2b49ebba-56b2-445a-9da4-b6e2731857cc tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-640874'] for security_group_rule, after_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:24.390771 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-14e4562b-52b8-4f2b-8b33-bc343cbc4af6 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:07:24.413813 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2b49ebba-56b2-445a-9da4-b6e2731857cc tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=288c8245-10d5-47c4-94c6-20c0634f08e5,revision_number=0']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:07:24.419188 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-2b49ebba-56b2-445a-9da4-b6e2731857cc tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.028s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:07:24.424588 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-2b49ebba-56b2-445a-9da4-b6e2731857cc tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Notify callbacks [] for security_group_rule, before_response {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:24.426227 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [None req-2b49ebba-56b2-445a-9da4-b6e2731857cc tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] 10.222.0.62 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 774 time: 0.1605065 May 25 17:07:24.429099 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.wsgi [-] (91830) accepted ('10.222.0.62', 36040) {{(pid=91830) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:07:24.435436 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.v2.base [None req-07e7696b-9c13-40dc-861c-28c06baa4e8b tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Request body: {'security_group_rule': {'security_group_id': '58fab80b-49b2-4bca-89e6-fef7473221ef', 'project_id': '5397bf60956945c3a2bf43c6b1aa614b', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=91830) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 17:07:24.442913 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.quota.driver [None req-07e7696b-9c13-40dc-861c-28c06baa4e8b tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91830) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 17:07:24.448116 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [None req-07e7696b-9c13-40dc-861c-28c06baa4e8b tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Usage tracker for resource:security_group_rule and tenant:5397bf60956945c3a2bf43c6b1aa614b is out of sync, need to count used quota {{(pid=91830) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 17:07:24.451969 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [None req-07e7696b-9c13-40dc-861c-28c06baa4e8b tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Quota usage for security_group_rule was recalculated. Used quota:11. {{(pid=91830) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 17:07:24.457723 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.quota.driver [None req-07e7696b-9c13-40dc-861c-28c06baa4e8b tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 11; quota limit: 100; headroom:89 {{(pid=91830) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 17:07:24.468799 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.db.securitygroups_db [None req-07e7696b-9c13-40dc-861c-28c06baa4e8b tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Project 5397bf60956945c3a2bf43c6b1aa614b added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. May 25 17:07:24.476465 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-07e7696b-9c13-40dc-861c-28c06baa4e8b tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Notify callbacks [] for security_group_rule, before_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:24.559045 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-07e7696b-9c13-40dc-861c-28c06baa4e8b tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:24.564067 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-07e7696b-9c13-40dc-861c-28c06baa4e8b tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-640874'] for security_group_rule, after_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:24.566123 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:07:24.587175 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-63e87e2d-f2d9-445d-b944-cca7bfff44d8 req-39a5a209-96e1-4834-ba1f-bd1d86807c30 service neutron] 10.222.0.32 "GET /v2.0/networks/e5be4c6a-143f-474c-a90b-37180778cefe?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2456608 May 25 17:07:24.589596 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-07e7696b-9c13-40dc-861c-28c06baa4e8b tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=b4a56d25-678e-4ccf-9318-0455395d0672,revision_number=0']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:07:24.592278 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-07e7696b-9c13-40dc-861c-28c06baa4e8b tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.026s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:07:24.599462 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-07e7696b-9c13-40dc-861c-28c06baa4e8b tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Notify callbacks [] for security_group_rule, before_response {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:24.600605 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [None req-07e7696b-9c13-40dc-861c-28c06baa4e8b tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] 10.222.0.62 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 773 time: 0.1705165 May 25 17:07:24.722803 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-63e87e2d-f2d9-445d-b944-cca7bfff44d8 req-fb2465f2-bbc1-4409-8086-2cd2aff64568 service neutron] 10.222.0.32 "GET /v2.0/networks/e5be4c6a-143f-474c-a90b-37180778cefe?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1275015 May 25 17:07:25.212675 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eb628cca-42c7-41b1-9a83-9596988adc36 req-70601d61-f71e-4706-929d-8d2cea5af288 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:07:25.215002 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-eb628cca-42c7-41b1-9a83-9596988adc36 req-70601d61-f71e-4706-929d-8d2cea5af288 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/ports?device_id=bdaa3d25-adc2-4a52-8a36-66a599b4b6e2 HTTP/1.1" status: 200 len: 944 time: 0.0820758 May 25 17:07:25.273835 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-eb628cca-42c7-41b1-9a83-9596988adc36 req-c70cb843-591f-431d-850e-3b8351c82868 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/security-groups?id=4e6b7b77-0833-47dc-be2e-ec9c7c960bb9&fields=id&fields=name HTTP/1.1" status: 200 len: 309 time: 0.0404415 May 25 17:07:25.293589 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-c6926076-cffc-4383-93ab-a85e0537510c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:25.658548 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e74a7f34-5bf7-4bea-9567-1fedbc4b8a4f None None] Sync routers for ids ['a31e34e2-420e-4dd6-820b-1ec7d895549e'] in dv-cinder-790492-4-iscsi {{(pid=91832) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 25 17:07:25.668474 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e74a7f34-5bf7-4bea-9567-1fedbc4b8a4f None None] Routers {'a31e34e2-420e-4dd6-820b-1ec7d895549e'} bound to L3 agent in host dv-cinder-790492-4-iscsi {{(pid=91832) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 17:07:25.669361 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.db.l3_hamode_db [None req-e74a7f34-5bf7-4bea-9567-1fedbc4b8a4f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-790492-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-05-25T16:50:28Z,description=,heartbeat_timestamp=2021-05-25T17:06:58Z,host='dv-cinder-790492-4-iscsi',id=a2d427c1-2d07-43e8-afbe-218c9f7d0445,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T16:50:28Z,topic='l3_agent')) {'router_ids': ['a31e34e2-420e-4dd6-820b-1ec7d895549e'], 'active': True} {{(pid=91832) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 17:07:25.754247 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.rpc [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Device bfd709e1-823e-4b01-8a88-fa341f7e700a details requested by agent hyperv_hv-cinder-79049 with host hv-cinder-79049 {{(pid=91831) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 25 17:07:25.875035 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.db.l3_dvr_db [None req-e74a7f34-5bf7-4bea-9567-1fedbc4b8a4f None None] Set router a31e34e2-420e-4dd6-820b-1ec7d895549e gateway port host: dv-cinder-790492-4-iscsi {{(pid=91832) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 17:07:25.889868 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.db [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] For port bfd709e1-823e-4b01-8a88-fa341f7e700a, host hv-cinder-79049, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79049',level=0,port_id=bfd709e1-823e-4b01-8a88-fa341f7e700a,segment=NetworkSegment(a8fb0313-938a-4f5e-8ff4-96df8acd943b),segment_id=a8fb0313-938a-4f5e-8ff4-96df8acd943b)] {{(pid=91831) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 17:07:25.905100 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.rpc [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Returning: {'device': 'bfd709e1-823e-4b01-8a88-fa341f7e700a', 'network_id': 'e5be4c6a-143f-474c-a90b-37180778cefe', 'port_id': 'bfd709e1-823e-4b01-8a88-fa341f7e700a', 'mac_address': 'fa:16:3e:65:f3:f2', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 695, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '6e6b5897-e23d-4281-96cb-a6fdf9b68134', 'ip_address': '172.20.0.12'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=91831) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 25 17:07:25.951179 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.rpc [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Device 4ee74cc9-30db-4402-aed3-82be47c1be1e up at agent ovs-agent-dv-cinder-790492-4-iscsi {{(pid=91831) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 25 17:07:26.015262 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3832070'] for port, before_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:26.037186 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.notifiers.nova [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id bfd709e1-823e-4b01-8a88-fa341f7e700a {{(pid=91831) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} May 25 17:07:26.059816 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.db [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] For port bfd709e1-823e-4b01-8a88-fa341f7e700a, host hv-cinder-79049, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79049',level=0,port_id=bfd709e1-823e-4b01-8a88-fa341f7e700a,segment=NetworkSegment(a8fb0313-938a-4f5e-8ff4-96df8acd943b),segment_id=a8fb0313-938a-4f5e-8ff4-96df8acd943b)] {{(pid=91831) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 17:07:26.062810 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.provisioning_blocks [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Provisioning complete for port 4ee74cc9-30db-4402-aed3-82be47c1be1e triggered by entity L2. {{(pid=91831) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 17:07:26.063257 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3854128'] for port, provisioning_complete {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:26.092418 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8757892955028', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8757892520933', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8757892521750'] for port, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:26.104622 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:07:26.189695 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Pushing event updated for resources: {'Port': ['ID=bfd709e1-823e-4b01-8a88-fa341f7e700a,revision_number=4']} {{(pid=91831) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:07:26.193247 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.089s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:07:26.206441 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.db.l3_hamode_db [None req-e74a7f34-5bf7-4bea-9567-1fedbc4b8a4f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'a31e34e2-420e-4dd6-820b-1ec7d895549e', 'name': 'tempest-TestVolumeBootPattern-2097476481-router', 'tenant_id': 'ebceaa13caaa4258abf32e19141de493', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'external_fixed_ips': [{'subnet_id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'ip_address': '172.27.2.190'}], 'enable_snat': True}, 'gw_port_id': '4ee74cc9-30db-4402-aed3-82be47c1be1e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T17:07:16Z', 'updated_at': '2021-05-25T17:07:20Z', 'revision_number': 4, 'project_id': 'ebceaa13caaa4258abf32e19141de493', 'gw_port': {'id': '4ee74cc9-30db-4402-aed3-82be47c1be1e', 'name': '', 'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'tenant_id': '', 'mac_address': 'fa:16:3e:b9:81:81', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a31e34e2-420e-4dd6-820b-1ec7d895549e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 552, 'fixed_ips': [{'subnet_id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'ip_address': '172.27.2.190', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790492-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:07:17Z', 'updated_at': '2021-05-25T17:07:24Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-790492-4-iscsi', '_interfaces': [{'id': '5cd66991-16ba-46db-b805-74a3af76a470', 'name': '', 'network_id': '3fa72d6e-1a8d-4d69-93de-30a32f8d5423', 'tenant_id': 'ebceaa13caaa4258abf32e19141de493', 'mac_address': 'fa:16:3e:24:51:cd', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'a31e34e2-420e-4dd6-820b-1ec7d895549e', 'device_owner': 'network:router_interface', 'standard_attr_id': 553, 'fixed_ips': [{'subnet_id': '6d7b3521-40af-42b0-b9ba-0605d0b34e3b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:07:20Z', 'updated_at': '2021-05-25T17:07:20Z', 'revision_number': 2, 'project_id': 'ebceaa13caaa4258abf32e19141de493', 'subnets': [{'id': '6d7b3521-40af-42b0-b9ba-0605d0b34e3b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-790492-4-iscsi', False) {} {{(pid=91832) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 17:07:26.210140 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e74a7f34-5bf7-4bea-9567-1fedbc4b8a4f None None] Checking router: a31e34e2-420e-4dd6-820b-1ec7d895549e for host: dv-cinder-790492-4-iscsi {{(pid=91832) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 25 17:07:26.210499 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e74a7f34-5bf7-4bea-9567-1fedbc4b8a4f None None] Updating router a31e34e2-420e-4dd6-820b-1ec7d895549e port 5cd66991-16ba-46db-b805-74a3af76a470 binding host dv-cinder-790492-4-iscsi {{(pid=91832) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} May 25 17:07:26.265582 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron_lib.callbacks.manager [None req-e74a7f34-5bf7-4bea-9567-1fedbc4b8a4f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3832070'] for port, before_update {{(pid=91832) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:26.468570 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-23247f84-a62c-43ee-b425-4e961ba8b31f req-a9225293-fb6a-426e-b2e2-8c7cb8a287c5 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:07:26.470020 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-23247f84-a62c-43ee-b425-4e961ba8b31f req-a9225293-fb6a-426e-b2e2-8c7cb8a287c5 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/ports?device_id=bdaa3d25-adc2-4a52-8a36-66a599b4b6e2 HTTP/1.1" status: 200 len: 945 time: 0.0842824 May 25 17:07:26.514939 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-23247f84-a62c-43ee-b425-4e961ba8b31f req-07a7b9a0-b57c-4b5c-8244-f2cb2f86588f tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/security-groups?id=4e6b7b77-0833-47dc-be2e-ec9c7c960bb9&fields=id&fields=name HTTP/1.1" status: 200 len: 309 time: 0.0384111 May 25 17:07:26.521869 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.db [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] get_ports_and_sgs() called for port_ids ['bfd709e1-823e-4b01-8a88-fa341f7e700a'] {{(pid=91831) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 25 17:07:26.620286 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron_lib.callbacks.manager [None req-e74a7f34-5bf7-4bea-9567-1fedbc4b8a4f None None] Notify callbacks [] for port, precommit_update {{(pid=91832) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:26.631373 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.db.provisioning_blocks [None req-e74a7f34-5bf7-4bea-9567-1fedbc4b8a4f None None] Transition to ACTIVE for port object 5cd66991-16ba-46db-b805-74a3af76a470 will not be triggered until provisioned by entity L2. {{(pid=91832) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 25 17:07:26.638415 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron_lib.callbacks.manager [None req-e74a7f34-5bf7-4bea-9567-1fedbc4b8a4f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8757892955028', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8757892520933', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8757892521750'] for port, after_update {{(pid=91832) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:26.642390 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG oslo_concurrency.lockutils [None req-4626dc60-aafb-46df-8b04-f2467b8f81fa None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:07:26.794133 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ddeb3c63-165c-45fc-84d3-91eeff9f6b99 None None] Pushing event updated for resources: {'Port': ['ID=5cd66991-16ba-46db-b805-74a3af76a470,revision_number=3']} {{(pid=91832) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:07:26.802208 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG oslo_concurrency.lockutils [None req-ddeb3c63-165c-45fc-84d3-91eeff9f6b99 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.160s {{(pid=91832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:07:26.858746 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.plugins.ml2.managers [None req-e74a7f34-5bf7-4bea-9567-1fedbc4b8a4f None None] Attempting to bind port 5cd66991-16ba-46db-b805-74a3af76a470 on host dv-cinder-790492-4-iscsi for vnic_type normal with profile {{(pid=91832) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 25 17:07:26.859071 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.plugins.ml2.managers [None req-e74a7f34-5bf7-4bea-9567-1fedbc4b8a4f None None] Attempting to bind port 5cd66991-16ba-46db-b805-74a3af76a470 by drivers openvswitch,hyperv on host dv-cinder-790492-4-iscsi at level 0 using segments [{'id': 'f72d7b23-e2ca-41dd-83c7-c64087195ce8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 687, 'network_id': '3fa72d6e-1a8d-4d69-93de-30a32f8d5423'}] {{(pid=91832) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 25 17:07:26.859435 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e74a7f34-5bf7-4bea-9567-1fedbc4b8a4f None None] Attempting to bind port 5cd66991-16ba-46db-b805-74a3af76a470 on network 3fa72d6e-1a8d-4d69-93de-30a32f8d5423 {{(pid=91832) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 25 17:07:26.864916 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e74a7f34-5bf7-4bea-9567-1fedbc4b8a4f None None] Checking agent: {'id': 'fc8251e1-071c-49f7-bc10-1337f1d37d1b', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-790492-4-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 25, 16, 50, 28), 'started_at': datetime.datetime(2021, 5, 25, 16, 50, 58), 'heartbeat_timestamp': datetime.datetime(2021, 5, 25, 17, 6, 58), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-790492-4-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.8', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=91832) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 25 17:07:26.865555 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e74a7f34-5bf7-4bea-9567-1fedbc4b8a4f None None] Checking segment: {'id': 'f72d7b23-e2ca-41dd-83c7-c64087195ce8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 687, 'network_id': '3fa72d6e-1a8d-4d69-93de-30a32f8d5423'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91832) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 25 17:07:26.865664 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron_lib.callbacks.manager [None req-e74a7f34-5bf7-4bea-9567-1fedbc4b8a4f None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=91832) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:26.866096 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e74a7f34-5bf7-4bea-9567-1fedbc4b8a4f None None] Bound using segment: {'id': 'f72d7b23-e2ca-41dd-83c7-c64087195ce8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 687, 'network_id': '3fa72d6e-1a8d-4d69-93de-30a32f8d5423'} {{(pid=91832) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 25 17:07:26.866584 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.plugins.ml2.managers [None req-e74a7f34-5bf7-4bea-9567-1fedbc4b8a4f None None] Bound port: 5cd66991-16ba-46db-b805-74a3af76a470, host: dv-cinder-790492-4-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'f72d7b23-e2ca-41dd-83c7-c64087195ce8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 687, 'network_id': '3fa72d6e-1a8d-4d69-93de-30a32f8d5423'}}] {{(pid=91832) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 25 17:07:26.866939 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron_lib.callbacks.manager [None req-e74a7f34-5bf7-4bea-9567-1fedbc4b8a4f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3832070'] for port, before_update {{(pid=91832) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:26.959201 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.plugins.ml2.db [None req-e74a7f34-5bf7-4bea-9567-1fedbc4b8a4f None None] For port 5cd66991-16ba-46db-b805-74a3af76a470, host dv-cinder-790492-4-iscsi, cleared binding levels {{(pid=91832) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 25 17:07:26.963810 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.plugins.ml2.db [None req-e74a7f34-5bf7-4bea-9567-1fedbc4b8a4f None None] For port 5cd66991-16ba-46db-b805-74a3af76a470, host dv-cinder-790492-4-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-790492-4-iscsi',level=0,port_id=5cd66991-16ba-46db-b805-74a3af76a470,segment=NetworkSegment(f72d7b23-e2ca-41dd-83c7-c64087195ce8),segment_id=f72d7b23-e2ca-41dd-83c7-c64087195ce8)] {{(pid=91832) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 25 17:07:26.967908 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron_lib.callbacks.manager [None req-e74a7f34-5bf7-4bea-9567-1fedbc4b8a4f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8757892955028', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8757892520933', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8757892521750'] for port, after_update {{(pid=91832) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:26.972426 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:07:27.047385 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e74a7f34-5bf7-4bea-9567-1fedbc4b8a4f None None] Routers {'a31e34e2-420e-4dd6-820b-1ec7d895549e'} bound to L3 agent in host dv-cinder-790492-4-iscsi {{(pid=91832) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 17:07:27.048065 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.db.l3_hamode_db [None req-e74a7f34-5bf7-4bea-9567-1fedbc4b8a4f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-790492-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-05-25T16:50:28Z,description=,heartbeat_timestamp=2021-05-25T17:06:58Z,host='dv-cinder-790492-4-iscsi',id=a2d427c1-2d07-43e8-afbe-218c9f7d0445,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T16:50:28Z,topic='l3_agent')) {'router_ids': ['a31e34e2-420e-4dd6-820b-1ec7d895549e'], 'active': True} {{(pid=91832) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 17:07:27.108771 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ddeb3c63-165c-45fc-84d3-91eeff9f6b99 None None] Pushing event updated for resources: {'Port': ['ID=5cd66991-16ba-46db-b805-74a3af76a470,revision_number=4']} {{(pid=91832) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:07:27.119681 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG oslo_concurrency.lockutils [None req-ddeb3c63-165c-45fc-84d3-91eeff9f6b99 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.147s {{(pid=91832) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:07:27.239979 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.db.l3_dvr_db [None req-e74a7f34-5bf7-4bea-9567-1fedbc4b8a4f None None] Set router a31e34e2-420e-4dd6-820b-1ec7d895549e gateway port host: dv-cinder-790492-4-iscsi {{(pid=91832) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 17:07:27.582561 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.db.l3_hamode_db [None req-e74a7f34-5bf7-4bea-9567-1fedbc4b8a4f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'a31e34e2-420e-4dd6-820b-1ec7d895549e', 'name': 'tempest-TestVolumeBootPattern-2097476481-router', 'tenant_id': 'ebceaa13caaa4258abf32e19141de493', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'external_fixed_ips': [{'subnet_id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'ip_address': '172.27.2.190'}], 'enable_snat': True}, 'gw_port_id': '4ee74cc9-30db-4402-aed3-82be47c1be1e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T17:07:16Z', 'updated_at': '2021-05-25T17:07:20Z', 'revision_number': 4, 'project_id': 'ebceaa13caaa4258abf32e19141de493', 'gw_port': {'id': '4ee74cc9-30db-4402-aed3-82be47c1be1e', 'name': '', 'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'tenant_id': '', 'mac_address': 'fa:16:3e:b9:81:81', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a31e34e2-420e-4dd6-820b-1ec7d895549e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 552, 'fixed_ips': [{'subnet_id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'ip_address': '172.27.2.190', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790492-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:07:17Z', 'updated_at': '2021-05-25T17:07:24Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-790492-4-iscsi', '_interfaces': [{'id': '5cd66991-16ba-46db-b805-74a3af76a470', 'name': '', 'network_id': '3fa72d6e-1a8d-4d69-93de-30a32f8d5423', 'tenant_id': 'ebceaa13caaa4258abf32e19141de493', 'mac_address': 'fa:16:3e:24:51:cd', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'a31e34e2-420e-4dd6-820b-1ec7d895549e', 'device_owner': 'network:router_interface', 'standard_attr_id': 553, 'fixed_ips': [{'subnet_id': '6d7b3521-40af-42b0-b9ba-0605d0b34e3b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790492-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:07:20Z', 'updated_at': '2021-05-25T17:07:26Z', 'revision_number': 4, 'project_id': 'ebceaa13caaa4258abf32e19141de493', 'subnets': [{'id': '6d7b3521-40af-42b0-b9ba-0605d0b34e3b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-790492-4-iscsi', False) {} {{(pid=91832) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 17:07:27.586412 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e74a7f34-5bf7-4bea-9567-1fedbc4b8a4f None None] The sync data for ids ['a31e34e2-420e-4dd6-820b-1ec7d895549e'] in dv-cinder-790492-4-iscsi is: [{'id': 'a31e34e2-420e-4dd6-820b-1ec7d895549e', 'name': 'tempest-TestVolumeBootPattern-2097476481-router', 'tenant_id': 'ebceaa13caaa4258abf32e19141de493', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'external_fixed_ips': [{'subnet_id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'ip_address': '172.27.2.190'}], 'enable_snat': True}, 'gw_port_id': '4ee74cc9-30db-4402-aed3-82be47c1be1e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T17:07:16Z', 'updated_at': '2021-05-25T17:07:20Z', 'revision_number': 4, 'project_id': 'ebceaa13caaa4258abf32e19141de493', 'gw_port': {'id': '4ee74cc9-30db-4402-aed3-82be47c1be1e', 'name': '', 'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'tenant_id': '', 'mac_address': 'fa:16:3e:b9:81:81', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a31e34e2-420e-4dd6-820b-1ec7d895549e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 552, 'fixed_ips': [{'subnet_id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'ip_address': '172.27.2.190', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790492-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:07:17Z', 'updated_at': '2021-05-25T17:07:24Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-790492-4-iscsi', '_interfaces': [{'id': '5cd66991-16ba-46db-b805-74a3af76a470', 'name': '', 'network_id': '3fa72d6e-1a8d-4d69-93de-30a32f8d5423', 'tenant_id': 'ebceaa13caaa4258abf32e19141de493', 'mac_address': 'fa:16:3e:24:51:cd', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'a31e34e2-420e-4dd6-820b-1ec7d895549e', 'device_owner': 'network:router_interface', 'standard_attr_id': 553, 'fixed_ips': [{'subnet_id': '6d7b3521-40af-42b0-b9ba-0605d0b34e3b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790492-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:07:20Z', 'updated_at': '2021-05-25T17:07:26Z', 'revision_number': 4, 'project_id': 'ebceaa13caaa4258abf32e19141de493', 'subnets': [{'id': '6d7b3521-40af-42b0-b9ba-0605d0b34e3b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=91832) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 25 17:07:27.702889 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-3a8e3fa7-d420-4b79-bd7d-46a92e26a165 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:27.714791 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-69d7ef93-5ff8-4c35-a325-504107a46222 req-8aa7f161-453f-4790-a3b3-91d481259d39 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:07:27.716265 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-69d7ef93-5ff8-4c35-a325-504107a46222 req-8aa7f161-453f-4790-a3b3-91d481259d39 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/ports?device_id=bdaa3d25-adc2-4a52-8a36-66a599b4b6e2 HTTP/1.1" status: 200 len: 945 time: 0.0877736 May 25 17:07:27.765537 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-69d7ef93-5ff8-4c35-a325-504107a46222 req-de7a0413-1cf0-433f-ba01-105c266d119b tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/security-groups?id=4e6b7b77-0833-47dc-be2e-ec9c7c960bb9&fields=id&fields=name HTTP/1.1" status: 200 len: 309 time: 0.0432708 May 25 17:07:27.772425 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.rpc [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Device bfd709e1-823e-4b01-8a88-fa341f7e700a up at agent hyperv_hv-cinder-79049 {{(pid=91831) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 25 17:07:27.848871 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.provisioning_blocks [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Provisioning for port bfd709e1-823e-4b01-8a88-fa341f7e700a completed by entity L2. {{(pid=91831) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 25 17:07:27.853788 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.provisioning_blocks [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Provisioning complete for port bfd709e1-823e-4b01-8a88-fa341f7e700a triggered by entity L2. {{(pid=91831) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 17:07:27.854325 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3854128'] for port, provisioning_complete {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:27.958729 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:28.013737 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.rpc [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Device 5cd66991-16ba-46db-b805-74a3af76a470 up at agent ovs-agent-dv-cinder-790492-4-iscsi {{(pid=91831) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 25 17:07:28.093793 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3832070'] for port, before_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:28.126168 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'bdaa3d25-adc2-4a52-8a36-66a599b4b6e2', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'bfd709e1-823e-4b01-8a88-fa341f7e700a'}] {{(pid=91831) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 25 17:07:28.139903 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.db [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] For port bfd709e1-823e-4b01-8a88-fa341f7e700a, host hv-cinder-79049, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79049',level=0,port_id=bfd709e1-823e-4b01-8a88-fa341f7e700a,segment=NetworkSegment(a8fb0313-938a-4f5e-8ff4-96df8acd943b),segment_id=a8fb0313-938a-4f5e-8ff4-96df8acd943b)] {{(pid=91831) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 17:07:28.141846 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.provisioning_blocks [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Provisioning for port 5cd66991-16ba-46db-b805-74a3af76a470 completed by entity L2. {{(pid=91831) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 25 17:07:28.147925 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8757892955028', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8757892520933', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8757892521750'] for port, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:28.150004 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [None req-8e9bec64-51dc-4ad8-81d1-f85333f92b58 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:07:28.180588 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.provisioning_blocks [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Provisioning complete for port 5cd66991-16ba-46db-b805-74a3af76a470 triggered by entity L2. {{(pid=91831) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 17:07:28.180971 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3854128'] for port, provisioning_complete {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:28.211387 dv-cinder-790492-4-iscsi neutron-server[91831]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'bdaa3d25-adc2-4a52-8a36-66a599b4b6e2', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'bfd709e1-823e-4b01-8a88-fa341f7e700a', 'code': 200} May 25 17:07:28.275049 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Pushing event updated for resources: {'Port': ['ID=bfd709e1-823e-4b01-8a88-fa341f7e700a,revision_number=5']} {{(pid=91831) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:07:28.278498 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.128s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:07:28.337444 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3832070'] for port, before_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:28.371516 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.db [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] For port 5cd66991-16ba-46db-b805-74a3af76a470, host dv-cinder-790492-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-790492-4-iscsi',level=0,port_id=5cd66991-16ba-46db-b805-74a3af76a470,segment=NetworkSegment(f72d7b23-e2ca-41dd-83c7-c64087195ce8),segment_id=f72d7b23-e2ca-41dd-83c7-c64087195ce8)] {{(pid=91831) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 17:07:28.375325 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8757892955028', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8757892520933', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8757892521750'] for port, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:28.377520 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:07:28.455089 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Pushing event updated for resources: {'Port': ['ID=5cd66991-16ba-46db-b805-74a3af76a470,revision_number=5']} {{(pid=91831) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:07:28.458083 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.081s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:07:28.514587 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f3eff59d-e413-48ad-8a8e-8c206ae3a231 req-8bbc2552-46ae-4508-8969-ee85a18fc610 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:07:28.516040 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-f3eff59d-e413-48ad-8a8e-8c206ae3a231 req-8bbc2552-46ae-4508-8969-ee85a18fc610 service neutron] 10.222.0.32 "GET /v2.0/ports?device_id=bdaa3d25-adc2-4a52-8a36-66a599b4b6e2 HTTP/1.1" status: 200 len: 1099 time: 0.0800006 May 25 17:07:28.558348 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-f3eff59d-e413-48ad-8a8e-8c206ae3a231 req-5e3f17a2-3838-4e3e-9463-a8d85fd477e1 service neutron] 10.222.0.32 "GET /v2.0/security-groups?id=4e6b7b77-0833-47dc-be2e-ec9c7c960bb9&fields=id&fields=name HTTP/1.1" status: 200 len: 309 time: 0.0340922 May 25 17:07:28.631367 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-0a55eb4a-8b57-4233-84d6-6b423b4ed6db None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:28.962102 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e621f8ce-9de3-4aa0-a8e7-a277b4bcc4c1 req-6df3de49-b9bf-49a2-b9cb-96b2e03d9c5c tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:07:28.964019 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-e621f8ce-9de3-4aa0-a8e7-a277b4bcc4c1 req-6df3de49-b9bf-49a2-b9cb-96b2e03d9c5c tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/ports?device_id=bdaa3d25-adc2-4a52-8a36-66a599b4b6e2 HTTP/1.1" status: 200 len: 946 time: 0.0801477 May 25 17:07:29.012030 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-e621f8ce-9de3-4aa0-a8e7-a277b4bcc4c1 req-0c5777ac-19fc-48f7-8074-e1e3226ee84d tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/security-groups?id=4e6b7b77-0833-47dc-be2e-ec9c7c960bb9&fields=id&fields=name HTTP/1.1" status: 200 len: 309 time: 0.0423896 May 25 17:07:29.935583 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.rpc [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Device 5cd66991-16ba-46db-b805-74a3af76a470 up at agent ovs-agent-dv-cinder-790492-4-iscsi {{(pid=91831) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 25 17:07:30.007790 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.provisioning_blocks [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Provisioning complete for port 5cd66991-16ba-46db-b805-74a3af76a470 triggered by entity L2. {{(pid=91831) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 17:07:30.008237 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3854128'] for port, provisioning_complete {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:30.211163 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4705baca-1340-41bf-84b2-6c2cad6cd9be req-b401971c-6ea4-40f2-ad35-1ae571992cf8 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:07:30.212604 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-4705baca-1340-41bf-84b2-6c2cad6cd9be req-b401971c-6ea4-40f2-ad35-1ae571992cf8 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/ports?device_id=bdaa3d25-adc2-4a52-8a36-66a599b4b6e2 HTTP/1.1" status: 200 len: 946 time: 0.0833836 May 25 17:07:30.235269 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-57f11b47-1f51-4191-b7c9-af248a48372c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:30.260627 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-4705baca-1340-41bf-84b2-6c2cad6cd9be req-785afa7f-6519-41d7-8fcc-03f20617a7cb tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/security-groups?id=4e6b7b77-0833-47dc-be2e-ec9c7c960bb9&fields=id&fields=name HTTP/1.1" status: 200 len: 309 time: 0.0420303 May 25 17:07:30.450741 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3cda7b75-eccd-4c36-8d4f-7a431d80fd2b req-4f742466-daac-453b-8efb-e9e9823eec28 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:07:30.452091 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-3cda7b75-eccd-4c36-8d4f-7a431d80fd2b req-4f742466-daac-453b-8efb-e9e9823eec28 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/ports?device_id=bdaa3d25-adc2-4a52-8a36-66a599b4b6e2 HTTP/1.1" status: 200 len: 946 time: 0.0856047 May 25 17:07:30.460423 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.wsgi [-] (91829) accepted ('10.222.0.62', 36124) {{(pid=91829) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:07:30.465336 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.v2.base [None req-39190b13-8ce6-41c5-a6c0-3ff565fb83a2 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Request body: {'floatingip': {'port_id': 'bfd709e1-823e-4b01-8a88-fa341f7e700a'}} {{(pid=91829) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 17:07:30.543235 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-39190b13-8ce6-41c5-a6c0-3ff565fb83a2 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Notify callbacks [] for floatingip, before_update {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:31.245093 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-39190b13-8ce6-41c5-a6c0-3ff565fb83a2 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Notify callbacks [] for floatingip, precommit_update {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:31.249043 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-39190b13-8ce6-41c5-a6c0-3ff565fb83a2 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-683033'] for floatingip, after_update {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:31.421767 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.db.l3_db [None req-39190b13-8ce6-41c5-a6c0-3ff565fb83a2 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Floating IP d6475a43-aed3-4465-ad40-e19d12dbd869 associated. External IP: 172.27.2.15, port: bfd709e1-823e-4b01-8a88-fa341f7e700a. May 25 17:07:31.775450 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-39190b13-8ce6-41c5-a6c0-3ff565fb83a2 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Router d2ed6ef9-f77a-4b7a-b152-3e1b9c85e1ad has already been hosted by L3 agent a2d427c1-2d07-43e8-afbe-218c9f7d0445 {{(pid=91829) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 25 17:07:31.964329 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-39190b13-8ce6-41c5-a6c0-3ff565fb83a2 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Notify agent at l3_agent.dv-cinder-790492-4-iscsi the message routers_updated {{(pid=91829) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 25 17:07:31.968629 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-39190b13-8ce6-41c5-a6c0-3ff565fb83a2 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-178712'] for floatingip, before_response {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:31.974072 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ffba6652-0033-4a9b-8d27-00ece688313f None None] Sync routers for ids ['d2ed6ef9-f77a-4b7a-b152-3e1b9c85e1ad'] in dv-cinder-790492-4-iscsi {{(pid=91831) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 25 17:07:31.984567 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ffba6652-0033-4a9b-8d27-00ece688313f None None] Routers {'d2ed6ef9-f77a-4b7a-b152-3e1b9c85e1ad'} bound to L3 agent in host dv-cinder-790492-4-iscsi {{(pid=91831) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 17:07:31.985270 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.l3_hamode_db [None req-ffba6652-0033-4a9b-8d27-00ece688313f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-790492-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-05-25T16:50:28Z,description=,heartbeat_timestamp=2021-05-25T17:07:28Z,host='dv-cinder-790492-4-iscsi',id=a2d427c1-2d07-43e8-afbe-218c9f7d0445,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T16:50:28Z,topic='l3_agent')) {'router_ids': ['d2ed6ef9-f77a-4b7a-b152-3e1b9c85e1ad'], 'active': True} {{(pid=91831) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 17:07:32.024917 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [None req-39190b13-8ce6-41c5-a6c0-3ff565fb83a2 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "PUT /v2.0/floatingips/d6475a43-aed3-4465-ad40-e19d12dbd869 HTTP/1.1" status: 200 len: 991 time: 1.5634694 May 25 17:07:32.025718 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'bdaa3d25-adc2-4a52-8a36-66a599b4b6e2', 'tag': 'bfd709e1-823e-4b01-8a88-fa341f7e700a'}] {{(pid=91829) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 25 17:07:32.074172 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'bdaa3d25-adc2-4a52-8a36-66a599b4b6e2', 'tag': 'bfd709e1-823e-4b01-8a88-fa341f7e700a', 'status': 'completed', 'code': 200} May 25 17:07:32.171094 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.l3_dvr_db [None req-ffba6652-0033-4a9b-8d27-00ece688313f None None] Set router d2ed6ef9-f77a-4b7a-b152-3e1b9c85e1ad gateway port host: dv-cinder-790492-4-iscsi {{(pid=91831) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 17:07:32.183019 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0a9470ab-2b2a-491a-8e12-bb0b48d02fc6 req-9159119e-effb-446f-9a3a-5cb1135de34c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:07:32.184503 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-0a9470ab-2b2a-491a-8e12-bb0b48d02fc6 req-9159119e-effb-446f-9a3a-5cb1135de34c service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=bbb9e99759bc47d08005f3b1e036a6cf&device_id=bdaa3d25-adc2-4a52-8a36-66a599b4b6e2 HTTP/1.1" status: 200 len: 1099 time: 0.0781670 May 25 17:07:32.317791 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0a9470ab-2b2a-491a-8e12-bb0b48d02fc6 req-8ea120ea-2ec9-41d7-89b2-b9ff70447533 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:07:32.319400 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-0a9470ab-2b2a-491a-8e12-bb0b48d02fc6 req-8ea120ea-2ec9-41d7-89b2-b9ff70447533 service neutron] 10.222.0.32 "GET /v2.0/networks?id=e5be4c6a-143f-474c-a90b-37180778cefe HTTP/1.1" status: 200 len: 917 time: 0.1281021 May 25 17:07:32.428902 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-0a9470ab-2b2a-491a-8e12-bb0b48d02fc6 req-b38f50e8-b309-442c-8d09-291182a8ddd8 service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=bfd709e1-823e-4b01-8a88-fa341f7e700a HTTP/1.1" status: 200 len: 999 time: 0.0984788 May 25 17:07:32.493244 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0a9470ab-2b2a-491a-8e12-bb0b48d02fc6 req-88e3f457-5093-4b81-adfc-0e6cebe878e1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:07:32.495335 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-0a9470ab-2b2a-491a-8e12-bb0b48d02fc6 req-88e3f457-5093-4b81-adfc-0e6cebe878e1 service neutron] 10.222.0.32 "GET /v2.0/subnets?id=6e6b5897-e23d-4281-96cb-a6fdf9b68134 HTTP/1.1" status: 200 len: 855 time: 0.0577607 May 25 17:07:32.519532 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.l3_hamode_db [None req-ffba6652-0033-4a9b-8d27-00ece688313f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd2ed6ef9-f77a-4b7a-b152-3e1b9c85e1ad', 'name': 'tempest-AttachVolumeShelveTestJSON-437778030-router', 'tenant_id': 'bbb9e99759bc47d08005f3b1e036a6cf', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'external_fixed_ips': [{'subnet_id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'ip_address': '172.27.2.253'}], 'enable_snat': True}, 'gw_port_id': '3bc942c3-5854-4018-b3fb-5071bf6c70c6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T17:00:14Z', 'updated_at': '2021-05-25T17:00:25Z', 'revision_number': 4, 'project_id': 'bbb9e99759bc47d08005f3b1e036a6cf', 'gw_port': {'id': '3bc942c3-5854-4018-b3fb-5071bf6c70c6', 'name': '', 'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'tenant_id': '', 'mac_address': 'fa:16:3e:da:a2:c4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd2ed6ef9-f77a-4b7a-b152-3e1b9c85e1ad', 'device_owner': 'network:router_gateway', 'standard_attr_id': 294, 'fixed_ips': [{'subnet_id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'ip_address': '172.27.2.253', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790492-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:00:16Z', 'updated_at': '2021-05-25T17:00:27Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-790492-4-iscsi', '_floatingips': [{'id': 'd6475a43-aed3-4465-ad40-e19d12dbd869', 'tenant_id': 'bbb9e99759bc47d08005f3b1e036a6cf', 'floating_ip_address': '172.27.2.15', 'floating_network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'router_id': 'd2ed6ef9-f77a-4b7a-b152-3e1b9c85e1ad', 'port_id': 'bfd709e1-823e-4b01-8a88-fa341f7e700a', 'fixed_ip_address': '172.20.0.12', 'status': 'DOWN', 'standard_attr_id': 549, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'e5be4c6a-143f-474c-a90b-37180778cefe', 'mac_address': 'fa:16:3e:65:f3:f2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'bdaa3d25-adc2-4a52-8a36-66a599b4b6e2', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-25T17:07:16Z', 'updated_at': '2021-05-25T17:07:31Z', 'revision_number': 1, 'project_id': 'bbb9e99759bc47d08005f3b1e036a6cf', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '735e7c1b-31b2-48e2-b2b7-538c31dbffb6', 'name': '', 'network_id': 'e5be4c6a-143f-474c-a90b-37180778cefe', 'tenant_id': 'bbb9e99759bc47d08005f3b1e036a6cf', 'mac_address': 'fa:16:3e:9a:dc:e1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd2ed6ef9-f77a-4b7a-b152-3e1b9c85e1ad', 'device_owner': 'network:router_interface', 'standard_attr_id': 319, 'fixed_ips': [{'subnet_id': '6e6b5897-e23d-4281-96cb-a6fdf9b68134', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790492-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:00:21Z', 'updated_at': '2021-05-25T17:00:33Z', 'revision_number': 5, 'project_id': 'bbb9e99759bc47d08005f3b1e036a6cf', 'subnets': [{'id': '6e6b5897-e23d-4281-96cb-a6fdf9b68134', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-790492-4-iscsi', False) {} {{(pid=91831) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 17:07:32.523306 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ffba6652-0033-4a9b-8d27-00ece688313f None None] Checking router: d2ed6ef9-f77a-4b7a-b152-3e1b9c85e1ad for host: dv-cinder-790492-4-iscsi {{(pid=91831) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 25 17:07:32.531377 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ffba6652-0033-4a9b-8d27-00ece688313f None None] Routers {'d2ed6ef9-f77a-4b7a-b152-3e1b9c85e1ad'} bound to L3 agent in host dv-cinder-790492-4-iscsi {{(pid=91831) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 17:07:32.531969 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.l3_hamode_db [None req-ffba6652-0033-4a9b-8d27-00ece688313f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-790492-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-05-25T16:50:28Z,description=,heartbeat_timestamp=2021-05-25T17:07:28Z,host='dv-cinder-790492-4-iscsi',id=a2d427c1-2d07-43e8-afbe-218c9f7d0445,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T16:50:28Z,topic='l3_agent')) {'router_ids': ['d2ed6ef9-f77a-4b7a-b152-3e1b9c85e1ad'], 'active': True} {{(pid=91831) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 17:07:32.574188 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0a9470ab-2b2a-491a-8e12-bb0b48d02fc6 req-7ddfe033-37fd-48a1-9294-f4c6ed8c6b84 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:07:32.575625 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-0a9470ab-2b2a-491a-8e12-bb0b48d02fc6 req-7ddfe033-37fd-48a1-9294-f4c6ed8c6b84 service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=e5be4c6a-143f-474c-a90b-37180778cefe&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0738735 May 25 17:07:32.718916 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.l3_dvr_db [None req-ffba6652-0033-4a9b-8d27-00ece688313f None None] Set router d2ed6ef9-f77a-4b7a-b152-3e1b9c85e1ad gateway port host: dv-cinder-790492-4-iscsi {{(pid=91831) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 17:07:32.725629 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-0a9470ab-2b2a-491a-8e12-bb0b48d02fc6 req-34f4e519-38d1-41e5-bd81-a4a57e99d0f6 service neutron] 10.222.0.32 "GET /v2.0/networks/e5be4c6a-143f-474c-a90b-37180778cefe?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1380606 May 25 17:07:32.995055 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-0a9470ab-2b2a-491a-8e12-bb0b48d02fc6 req-1494af63-43a2-48d8-8535-9318ad1b8226 service neutron] 10.222.0.32 "GET /v2.0/networks/e5be4c6a-143f-474c-a90b-37180778cefe?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2624946 May 25 17:07:33.141627 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.l3_hamode_db [None req-ffba6652-0033-4a9b-8d27-00ece688313f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd2ed6ef9-f77a-4b7a-b152-3e1b9c85e1ad', 'name': 'tempest-AttachVolumeShelveTestJSON-437778030-router', 'tenant_id': 'bbb9e99759bc47d08005f3b1e036a6cf', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'external_fixed_ips': [{'subnet_id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'ip_address': '172.27.2.253'}], 'enable_snat': True}, 'gw_port_id': '3bc942c3-5854-4018-b3fb-5071bf6c70c6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T17:00:14Z', 'updated_at': '2021-05-25T17:00:25Z', 'revision_number': 4, 'project_id': 'bbb9e99759bc47d08005f3b1e036a6cf', 'gw_port': {'id': '3bc942c3-5854-4018-b3fb-5071bf6c70c6', 'name': '', 'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'tenant_id': '', 'mac_address': 'fa:16:3e:da:a2:c4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd2ed6ef9-f77a-4b7a-b152-3e1b9c85e1ad', 'device_owner': 'network:router_gateway', 'standard_attr_id': 294, 'fixed_ips': [{'subnet_id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'ip_address': '172.27.2.253', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790492-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:00:16Z', 'updated_at': '2021-05-25T17:00:27Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-790492-4-iscsi', '_floatingips': [{'id': 'd6475a43-aed3-4465-ad40-e19d12dbd869', 'tenant_id': 'bbb9e99759bc47d08005f3b1e036a6cf', 'floating_ip_address': '172.27.2.15', 'floating_network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'router_id': 'd2ed6ef9-f77a-4b7a-b152-3e1b9c85e1ad', 'port_id': 'bfd709e1-823e-4b01-8a88-fa341f7e700a', 'fixed_ip_address': '172.20.0.12', 'status': 'DOWN', 'standard_attr_id': 549, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'e5be4c6a-143f-474c-a90b-37180778cefe', 'mac_address': 'fa:16:3e:65:f3:f2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'bdaa3d25-adc2-4a52-8a36-66a599b4b6e2', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-25T17:07:16Z', 'updated_at': '2021-05-25T17:07:31Z', 'revision_number': 1, 'project_id': 'bbb9e99759bc47d08005f3b1e036a6cf', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '735e7c1b-31b2-48e2-b2b7-538c31dbffb6', 'name': '', 'network_id': 'e5be4c6a-143f-474c-a90b-37180778cefe', 'tenant_id': 'bbb9e99759bc47d08005f3b1e036a6cf', 'mac_address': 'fa:16:3e:9a:dc:e1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd2ed6ef9-f77a-4b7a-b152-3e1b9c85e1ad', 'device_owner': 'network:router_interface', 'standard_attr_id': 319, 'fixed_ips': [{'subnet_id': '6e6b5897-e23d-4281-96cb-a6fdf9b68134', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790492-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:00:21Z', 'updated_at': '2021-05-25T17:00:33Z', 'revision_number': 5, 'project_id': 'bbb9e99759bc47d08005f3b1e036a6cf', 'subnets': [{'id': '6e6b5897-e23d-4281-96cb-a6fdf9b68134', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-790492-4-iscsi', False) {} {{(pid=91831) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 17:07:33.145477 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ffba6652-0033-4a9b-8d27-00ece688313f None None] The sync data for ids ['d2ed6ef9-f77a-4b7a-b152-3e1b9c85e1ad'] in dv-cinder-790492-4-iscsi is: [{'id': 'd2ed6ef9-f77a-4b7a-b152-3e1b9c85e1ad', 'name': 'tempest-AttachVolumeShelveTestJSON-437778030-router', 'tenant_id': 'bbb9e99759bc47d08005f3b1e036a6cf', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'external_fixed_ips': [{'subnet_id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'ip_address': '172.27.2.253'}], 'enable_snat': True}, 'gw_port_id': '3bc942c3-5854-4018-b3fb-5071bf6c70c6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T17:00:14Z', 'updated_at': '2021-05-25T17:00:25Z', 'revision_number': 4, 'project_id': 'bbb9e99759bc47d08005f3b1e036a6cf', 'gw_port': {'id': '3bc942c3-5854-4018-b3fb-5071bf6c70c6', 'name': '', 'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'tenant_id': '', 'mac_address': 'fa:16:3e:da:a2:c4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd2ed6ef9-f77a-4b7a-b152-3e1b9c85e1ad', 'device_owner': 'network:router_gateway', 'standard_attr_id': 294, 'fixed_ips': [{'subnet_id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'ip_address': '172.27.2.253', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790492-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:00:16Z', 'updated_at': '2021-05-25T17:00:27Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-790492-4-iscsi', '_floatingips': [{'id': 'd6475a43-aed3-4465-ad40-e19d12dbd869', 'tenant_id': 'bbb9e99759bc47d08005f3b1e036a6cf', 'floating_ip_address': '172.27.2.15', 'floating_network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'router_id': 'd2ed6ef9-f77a-4b7a-b152-3e1b9c85e1ad', 'port_id': 'bfd709e1-823e-4b01-8a88-fa341f7e700a', 'fixed_ip_address': '172.20.0.12', 'status': 'DOWN', 'standard_attr_id': 549, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'e5be4c6a-143f-474c-a90b-37180778cefe', 'mac_address': 'fa:16:3e:65:f3:f2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'bdaa3d25-adc2-4a52-8a36-66a599b4b6e2', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-25T17:07:16Z', 'updated_at': '2021-05-25T17:07:31Z', 'revision_number': 1, 'project_id': 'bbb9e99759bc47d08005f3b1e036a6cf', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '735e7c1b-31b2-48e2-b2b7-538c31dbffb6', 'name': '', 'network_id': 'e5be4c6a-143f-474c-a90b-37180778cefe', 'tenant_id': 'bbb9e99759bc47d08005f3b1e036a6cf', 'mac_address': 'fa:16:3e:9a:dc:e1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd2ed6ef9-f77a-4b7a-b152-3e1b9c85e1ad', 'device_owner': 'network:router_interface', 'standard_attr_id': 319, 'fixed_ips': [{'subnet_id': '6e6b5897-e23d-4281-96cb-a6fdf9b68134', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790492-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:00:21Z', 'updated_at': '2021-05-25T17:00:33Z', 'revision_number': 5, 'project_id': 'bbb9e99759bc47d08005f3b1e036a6cf', 'subnets': [{'id': '6e6b5897-e23d-4281-96cb-a6fdf9b68134', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=91831) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 25 17:07:33.341408 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-405a1975-b36b-4b0d-a67a-2e457c86402a None None] New status for floating IP d6475a43-aed3-4465-ad40-e19d12dbd869: ACTIVE {{(pid=91832) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} May 25 17:07:35.860322 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-ad3e5d6a-08ba-4ed8-a03d-eba42778a732 req-8e6a6a6c-5880-4014-a5f0-a3fdfaefa7c0 service neutron] 10.222.0.32 "GET /v2.0/ports?device_id=482f4d0c-0df9-4de7-9c75-b28c728be580&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0694160 May 25 17:07:35.956363 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ad3e5d6a-08ba-4ed8-a03d-eba42778a732 req-270919eb-1bb1-41e5-bb40-74e37bf9d6f9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:07:35.957797 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-ad3e5d6a-08ba-4ed8-a03d-eba42778a732 req-270919eb-1bb1-41e5-bb40-74e37bf9d6f9 service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=a736cc60cc2143c4b6dea99321051da5&device_id=482f4d0c-0df9-4de7-9c75-b28c728be580 HTTP/1.1" status: 200 len: 1099 time: 0.0718029 May 25 17:07:36.110795 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ad3e5d6a-08ba-4ed8-a03d-eba42778a732 req-75130223-b10f-43b3-9428-2c8677cf343d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:07:36.112146 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-ad3e5d6a-08ba-4ed8-a03d-eba42778a732 req-75130223-b10f-43b3-9428-2c8677cf343d service neutron] 10.222.0.32 "GET /v2.0/networks?id=613457eb-6f6d-4604-8f6c-f2d318ff9bc5 HTTP/1.1" status: 200 len: 910 time: 0.1337183 May 25 17:07:36.224596 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-ad3e5d6a-08ba-4ed8-a03d-eba42778a732 req-316d7529-f5f6-4f1d-b628-b69d69103a79 service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=646693a2-80a9-425d-bb26-ffda8fa453a7 HTTP/1.1" status: 200 len: 1002 time: 0.1043971 May 25 17:07:36.290623 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ad3e5d6a-08ba-4ed8-a03d-eba42778a732 req-ab0ecd49-48c9-4bd9-9ec2-0969ca5f22c4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:07:36.292553 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-ad3e5d6a-08ba-4ed8-a03d-eba42778a732 req-ab0ecd49-48c9-4bd9-9ec2-0969ca5f22c4 service neutron] 10.222.0.32 "GET /v2.0/subnets?id=3fc60650-484d-4574-bb67-0e4931bc9854 HTTP/1.1" status: 200 len: 848 time: 0.0609162 May 25 17:07:36.371904 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ad3e5d6a-08ba-4ed8-a03d-eba42778a732 req-685e4d5d-f828-4a83-ac24-be9b5c2aac23 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:07:36.373557 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-ad3e5d6a-08ba-4ed8-a03d-eba42778a732 req-685e4d5d-f828-4a83-ac24-be9b5c2aac23 service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=613457eb-6f6d-4604-8f6c-f2d318ff9bc5&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0736525 May 25 17:07:36.514136 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-ad3e5d6a-08ba-4ed8-a03d-eba42778a732 req-aeedb68e-f479-454c-ab2b-6d10005dd7dd service neutron] 10.222.0.32 "GET /v2.0/networks/613457eb-6f6d-4604-8f6c-f2d318ff9bc5?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1328695 May 25 17:07:36.543611 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:36.670335 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-ad3e5d6a-08ba-4ed8-a03d-eba42778a732 req-72042fbd-7c95-4325-b97c-937fb41dc243 service neutron] 10.222.0.32 "GET /v2.0/networks/613457eb-6f6d-4604-8f6c-f2d318ff9bc5?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1456566 May 25 17:07:37.019029 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e18cc7b8-150e-4ace-9b0d-ab6c02590628 req-b488ba58-dcfa-4957-9b2d-f69c26b6536f tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:07:37.020442 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-e18cc7b8-150e-4ace-9b0d-ab6c02590628 req-b488ba58-dcfa-4957-9b2d-f69c26b6536f tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] 10.222.0.62 "GET /v2.0/ports?device_id=4758207a-3093-4ef3-802c-dc11d895da7a HTTP/1.1" status: 200 len: 946 time: 0.0861187 May 25 17:07:37.066345 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-e18cc7b8-150e-4ace-9b0d-ab6c02590628 req-90da7c4f-bd5f-466a-bf32-9af3e6124df8 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] 10.222.0.62 "GET /v2.0/security-groups?id=7cad7118-dc73-4cab-9cb2-fa41cd4499bd&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0400665 May 25 17:07:38.248081 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-883a6e3b-49b3-41c2-8061-2dfe58808fc6 req-7c4c40f4-ac1f-43d0-95d2-635a2b146786 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:07:38.249449 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-883a6e3b-49b3-41c2-8061-2dfe58808fc6 req-7c4c40f4-ac1f-43d0-95d2-635a2b146786 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] 10.222.0.62 "GET /v2.0/ports?device_id=4758207a-3093-4ef3-802c-dc11d895da7a HTTP/1.1" status: 200 len: 946 time: 0.0801740 May 25 17:07:38.294621 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-883a6e3b-49b3-41c2-8061-2dfe58808fc6 req-87e20c61-5e20-4bbc-9272-8b7d27d48e3a tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] 10.222.0.62 "GET /v2.0/security-groups?id=7cad7118-dc73-4cab-9cb2-fa41cd4499bd&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0395622 May 25 17:07:39.491094 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-02674e19-b911-4b56-aa22-dc1ac0d9f1c2 req-1f624e9a-669e-4c19-bcf5-3bdfe422c8c4 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:07:39.492518 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-02674e19-b911-4b56-aa22-dc1ac0d9f1c2 req-1f624e9a-669e-4c19-bcf5-3bdfe422c8c4 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] 10.222.0.62 "GET /v2.0/ports?device_id=4758207a-3093-4ef3-802c-dc11d895da7a HTTP/1.1" status: 200 len: 946 time: 0.0843685 May 25 17:07:39.535804 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-02674e19-b911-4b56-aa22-dc1ac0d9f1c2 req-27573d8f-95b5-4324-ad26-06f11de739ca tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] 10.222.0.62 "GET /v2.0/security-groups?id=7cad7118-dc73-4cab-9cb2-fa41cd4499bd&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0371091 May 25 17:07:40.715989 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2163df27-27a8-4e9f-b023-34a6610635df req-626a56b1-eeff-4df8-9fed-0e816f242462 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:07:40.717349 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-2163df27-27a8-4e9f-b023-34a6610635df req-626a56b1-eeff-4df8-9fed-0e816f242462 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] 10.222.0.62 "GET /v2.0/ports?device_id=4758207a-3093-4ef3-802c-dc11d895da7a HTTP/1.1" status: 200 len: 946 time: 0.0805318 May 25 17:07:40.764757 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-2163df27-27a8-4e9f-b023-34a6610635df req-36771167-72e0-4b23-b5fb-74c01e4afce5 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] 10.222.0.62 "GET /v2.0/security-groups?id=7cad7118-dc73-4cab-9cb2-fa41cd4499bd&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0418279 May 25 17:07:41.950483 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b92f459a-23be-4b64-82a0-5c38ed9030b3 req-5d02441b-7df4-4698-ab96-115e4c593871 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:07:41.951932 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-b92f459a-23be-4b64-82a0-5c38ed9030b3 req-5d02441b-7df4-4698-ab96-115e4c593871 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] 10.222.0.62 "GET /v2.0/ports?device_id=4758207a-3093-4ef3-802c-dc11d895da7a HTTP/1.1" status: 200 len: 946 time: 0.0834515 May 25 17:07:41.996402 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-b92f459a-23be-4b64-82a0-5c38ed9030b3 req-74d1de23-6889-42a8-9787-8d8a2cea530c tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] 10.222.0.62 "GET /v2.0/security-groups?id=7cad7118-dc73-4cab-9cb2-fa41cd4499bd&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0388596 May 25 17:07:43.179246 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-764bed93-bf35-434c-9834-971c925783ee req-5b0b8105-a0e1-4a30-9678-0393be986cf9 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:07:43.180652 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-764bed93-bf35-434c-9834-971c925783ee req-5b0b8105-a0e1-4a30-9678-0393be986cf9 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] 10.222.0.62 "GET /v2.0/ports?device_id=4758207a-3093-4ef3-802c-dc11d895da7a HTTP/1.1" status: 200 len: 946 time: 0.0787058 May 25 17:07:43.226986 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-764bed93-bf35-434c-9834-971c925783ee req-851255aa-ddb6-427b-84eb-783c5726764b tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] 10.222.0.62 "GET /v2.0/security-groups?id=7cad7118-dc73-4cab-9cb2-fa41cd4499bd&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0404716 May 25 17:07:44.408280 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-57677e86-9181-4fbc-a71c-eac53de730ca req-db7ef024-55dc-47f6-8299-e9d9ba32fd75 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:07:44.409756 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-57677e86-9181-4fbc-a71c-eac53de730ca req-db7ef024-55dc-47f6-8299-e9d9ba32fd75 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] 10.222.0.62 "GET /v2.0/ports?device_id=4758207a-3093-4ef3-802c-dc11d895da7a HTTP/1.1" status: 200 len: 946 time: 0.0783200 May 25 17:07:44.454889 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-57677e86-9181-4fbc-a71c-eac53de730ca req-c6aa6150-54fb-4f12-af7c-c40d3727c501 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] 10.222.0.62 "GET /v2.0/security-groups?id=7cad7118-dc73-4cab-9cb2-fa41cd4499bd&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0394380 May 25 17:07:45.724164 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-082691ca-ce21-4481-999b-2e7ee5da3cd1 req-10de2bb0-9bf7-49af-aa31-1e8a44e29c9e tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:07:45.725605 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-082691ca-ce21-4481-999b-2e7ee5da3cd1 req-10de2bb0-9bf7-49af-aa31-1e8a44e29c9e tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] 10.222.0.62 "GET /v2.0/ports?device_id=4758207a-3093-4ef3-802c-dc11d895da7a HTTP/1.1" status: 200 len: 946 time: 0.1665449 May 25 17:07:45.770011 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-082691ca-ce21-4481-999b-2e7ee5da3cd1 req-881105ff-b8d2-4650-8870-f26f5da44dc8 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] 10.222.0.62 "GET /v2.0/security-groups?id=7cad7118-dc73-4cab-9cb2-fa41cd4499bd&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0385385 May 25 17:07:46.967220 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1303ddef-0077-434a-964d-e8a14fcab427 req-d6917e29-8c53-41d0-94fc-dc9641661558 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:07:46.968550 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-1303ddef-0077-434a-964d-e8a14fcab427 req-d6917e29-8c53-41d0-94fc-dc9641661558 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] 10.222.0.62 "GET /v2.0/ports?device_id=4758207a-3093-4ef3-802c-dc11d895da7a HTTP/1.1" status: 200 len: 946 time: 0.0789127 May 25 17:07:47.013562 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-1303ddef-0077-434a-964d-e8a14fcab427 req-7aeffadb-e5d4-4b6e-a187-dc11983fc86a tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] 10.222.0.62 "GET /v2.0/security-groups?id=7cad7118-dc73-4cab-9cb2-fa41cd4499bd&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0393817 May 25 17:07:48.198908 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0b0e11a6-2fe9-4203-88f6-0229b467d8c5 req-3443f97b-63ab-49c3-ad3d-2a3ea5f5686d tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:07:48.200372 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-0b0e11a6-2fe9-4203-88f6-0229b467d8c5 req-3443f97b-63ab-49c3-ad3d-2a3ea5f5686d tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] 10.222.0.62 "GET /v2.0/ports?device_id=4758207a-3093-4ef3-802c-dc11d895da7a HTTP/1.1" status: 200 len: 946 time: 0.0834091 May 25 17:07:48.243636 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-0b0e11a6-2fe9-4203-88f6-0229b467d8c5 req-5784ca5e-1d54-4c79-b1a1-ecd91682938b tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] 10.222.0.62 "GET /v2.0/security-groups?id=7cad7118-dc73-4cab-9cb2-fa41cd4499bd&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0376680 May 25 17:07:48.632095 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c51ff19a-a7b5-4bfc-b38e-8aaeb7e969f9 req-3a0d59c7-6abe-4d9d-9439-637cbdbedba9 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:07:48.633415 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-c51ff19a-a7b5-4bfc-b38e-8aaeb7e969f9 req-3a0d59c7-6abe-4d9d-9439-637cbdbedba9 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] 10.222.0.62 "GET /v2.0/ports?device_id=4758207a-3093-4ef3-802c-dc11d895da7a HTTP/1.1" status: 200 len: 946 time: 0.1301286 May 25 17:07:48.674773 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-57ea63eb-c01f-4d65-835d-741888ee7e8a req-df442465-c9d5-4887-a853-5ce52f99a839 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:07:48.676142 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-57ea63eb-c01f-4d65-835d-741888ee7e8a req-df442465-c9d5-4887-a853-5ce52f99a839 service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=70dac097fff04aed99a4976fa955579b&device_id=4758207a-3093-4ef3-802c-dc11d895da7a HTTP/1.1" status: 200 len: 1099 time: 0.1139400 May 25 17:07:48.687480 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-c51ff19a-a7b5-4bfc-b38e-8aaeb7e969f9 req-dfab0c28-5a61-44f7-aeb5-dbea8d0899b9 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] 10.222.0.62 "GET /v2.0/security-groups?id=7cad7118-dc73-4cab-9cb2-fa41cd4499bd&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0463285 May 25 17:07:48.811264 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-57ea63eb-c01f-4d65-835d-741888ee7e8a req-3ab8ff3f-ddba-4995-ae2c-40469b8a422a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:07:48.812696 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-57ea63eb-c01f-4d65-835d-741888ee7e8a req-3ab8ff3f-ddba-4995-ae2c-40469b8a422a service neutron] 10.222.0.32 "GET /v2.0/networks?id=b351598a-3f6f-4a37-8095-8d9371896ccc HTTP/1.1" status: 200 len: 911 time: 0.1281788 May 25 17:07:48.917073 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-57ea63eb-c01f-4d65-835d-741888ee7e8a req-24b995cb-ec8a-4ecc-a6ce-7ff192eef824 service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=13752a02-2ccb-4f85-b36f-38ca98958db9 HTTP/1.1" status: 200 len: 1002 time: 0.0970700 May 25 17:07:48.984658 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-57ea63eb-c01f-4d65-835d-741888ee7e8a req-c1e017f7-4755-441c-8fe1-a32268553d40 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:07:48.986549 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-57ea63eb-c01f-4d65-835d-741888ee7e8a req-c1e017f7-4755-441c-8fe1-a32268553d40 service neutron] 10.222.0.32 "GET /v2.0/subnets?id=4bbae145-74ed-4fda-b7c0-ae77a3202a83 HTTP/1.1" status: 200 len: 849 time: 0.0626874 May 25 17:07:49.064098 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-57ea63eb-c01f-4d65-835d-741888ee7e8a req-4d965419-a7bf-4974-8f8e-51b8acc27836 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:07:49.065524 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-57ea63eb-c01f-4d65-835d-741888ee7e8a req-4d965419-a7bf-4974-8f8e-51b8acc27836 service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=b351598a-3f6f-4a37-8095-8d9371896ccc&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0713696 May 25 17:07:49.199774 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-57ea63eb-c01f-4d65-835d-741888ee7e8a req-dee4c3af-473a-4c50-87ed-d8360d32cb2e service neutron] 10.222.0.32 "GET /v2.0/networks/b351598a-3f6f-4a37-8095-8d9371896ccc?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1273470 May 25 17:07:49.329713 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-57ea63eb-c01f-4d65-835d-741888ee7e8a req-8c8c5a89-0021-461c-af32-38f88f1e6a14 service neutron] 10.222.0.32 "GET /v2.0/networks/b351598a-3f6f-4a37-8095-8d9371896ccc?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1236141 May 25 17:07:49.875362 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-08ac77ef-061e-4597-9bbd-ea3da352342e req-3f80d8fc-dfac-4144-9bea-92f6ec0ccc53 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:07:49.876816 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-08ac77ef-061e-4597-9bbd-ea3da352342e req-3f80d8fc-dfac-4144-9bea-92f6ec0ccc53 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] 10.222.0.62 "GET /v2.0/ports?device_id=4758207a-3093-4ef3-802c-dc11d895da7a HTTP/1.1" status: 200 len: 946 time: 0.0815387 May 25 17:07:49.927223 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-08ac77ef-061e-4597-9bbd-ea3da352342e req-4cf363d9-9b7d-489f-831e-9f441c3cd37a tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] 10.222.0.62 "GET /v2.0/security-groups?id=7cad7118-dc73-4cab-9cb2-fa41cd4499bd&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0445735 May 25 17:07:50.625305 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.quota.resource [req-10b73b93-d624-41df-a385-95c384d35149 req-3cab099b-0f06-4cce-ab23-ad7f46f57b03 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Synchronizing usage tracker for tenant:5397bf60956945c3a2bf43c6b1aa614b on resource:security_group {{(pid=91829) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 25 17:07:50.641136 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.quota.resource [req-10b73b93-d624-41df-a385-95c384d35149 req-3cab099b-0f06-4cce-ab23-ad7f46f57b03 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Unset dirty status for tenant:5397bf60956945c3a2bf43c6b1aa614b on resource:security_group {{(pid=91829) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 25 17:07:50.642284 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-10b73b93-d624-41df-a385-95c384d35149 req-3cab099b-0f06-4cce-ab23-ad7f46f57b03 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] 10.222.0.62 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-1745610358&fields=id&tenant_id=5397bf60956945c3a2bf43c6b1aa614b HTTP/1.1" status: 200 len: 267 time: 0.0586033 May 25 17:07:50.789028 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-10b73b93-d624-41df-a385-95c384d35149 req-dead841e-b693-43d6-afe8-a81bf357a91f tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:07:50.790477 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-10b73b93-d624-41df-a385-95c384d35149 req-dead841e-b693-43d6-afe8-a81bf357a91f tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] 10.222.0.62 "GET /v2.0/networks?id=17a0e39e-1e1f-4550-b28b-d5ae3bdca362 HTTP/1.1" status: 200 len: 811 time: 0.1416531 May 25 17:07:50.805143 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-10b73b93-d624-41df-a385-95c384d35149 req-94937b9a-03d7-4c69-b730-59a2b5415d9f tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] 10.222.0.62 "GET /v2.0/quotas/5397bf60956945c3a2bf43c6b1aa614b HTTP/1.1" status: 200 len: 375 time: 0.0086560 May 25 17:07:50.893319 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-10b73b93-d624-41df-a385-95c384d35149 req-6e2e5807-c316-4290-aad9-508612ae131e tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] 10.222.0.62 "GET /v2.0/ports?tenant_id=5397bf60956945c3a2bf43c6b1aa614b&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0831859 May 25 17:07:51.033730 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-10b73b93-d624-41df-a385-95c384d35149 req-2aa568ad-a84f-421e-8954-f17b5ddeaea1 service neutron] 10.222.0.62 "GET /v2.0/networks/17a0e39e-1e1f-4550-b28b-d5ae3bdca362?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1286259 May 25 17:07:51.316497 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-10b73b93-d624-41df-a385-95c384d35149 req-6714441f-6d10-4158-8de2-cb86e7ed8b02 service neutron] 10.222.0.62 "GET /v2.0/networks/17a0e39e-1e1f-4550-b28b-d5ae3bdca362?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2768235 May 25 17:07:51.325209 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4ef422a2-33fa-4fdf-ada0-cf8ee5fcb6a1 req-eb1ace0d-28ec-4f33-af02-03677d82bc1a tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:07:51.326597 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-4ef422a2-33fa-4fdf-ada0-cf8ee5fcb6a1 req-eb1ace0d-28ec-4f33-af02-03677d82bc1a tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] 10.222.0.62 "GET /v2.0/ports?device_id=4758207a-3093-4ef3-802c-dc11d895da7a HTTP/1.1" status: 200 len: 946 time: 0.2859724 May 25 17:07:51.371443 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-4ef422a2-33fa-4fdf-ada0-cf8ee5fcb6a1 req-a57b1308-c372-4910-ae2a-4da2d70cd11d tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] 10.222.0.62 "GET /v2.0/security-groups?id=7cad7118-dc73-4cab-9cb2-fa41cd4499bd&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0389912 May 25 17:07:51.706374 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-d68f074b-43cb-43a4-b304-da40f8e48fff req-e6962808-2b94-4844-a700-349f9ded9783 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] 10.222.0.62 "GET /v2.0/ports?device_id=8af1dd48-45a0-4c07-9019-859effb1b06d HTTP/1.1" status: 200 len: 210 time: 0.0453656 May 25 17:07:52.757857 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-10b73b93-d624-41df-a385-95c384d35149 req-849c3d17-650d-4820-bcfc-7d7461666bf6 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:07:52.760992 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-10b73b93-d624-41df-a385-95c384d35149 req-849c3d17-650d-4820-bcfc-7d7461666bf6 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] 10.222.0.32 "GET /v2.0/networks?id=17a0e39e-1e1f-4550-b28b-d5ae3bdca362 HTTP/1.1" status: 200 len: 811 time: 0.1507504 May 25 17:07:52.815085 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-10b73b93-d624-41df-a385-95c384d35149 req-46744268-14b4-44a8-a6f5-41b03817b045 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] 10.222.0.32 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=5397bf60956945c3a2bf43c6b1aa614b HTTP/1.1" status: 200 len: 380 time: 0.0471740 May 25 17:07:52.850444 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.v2.base [req-10b73b93-d624-41df-a385-95c384d35149 req-f59c74d8-136e-4fb4-8860-87b398d30a1a tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Request body: {'port': {'device_id': '8af1dd48-45a0-4c07-9019-859effb1b06d', 'network_id': '17a0e39e-1e1f-4550-b28b-d5ae3bdca362', 'admin_state_up': True, 'tenant_id': '5397bf60956945c3a2bf43c6b1aa614b', 'security_groups': ['58fab80b-49b2-4bca-89e6-fef7473221ef']}} {{(pid=91829) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 17:07:52.879790 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-da76e307-a79f-49a8-90d0-64d44c527a94 req-5f6abd40-e943-4a68-b329-9556a5a33524 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] 10.222.0.62 "GET /v2.0/ports?device_id=8af1dd48-45a0-4c07-9019-859effb1b06d HTTP/1.1" status: 200 len: 210 time: 0.0637531 May 25 17:07:52.999473 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.quota.driver [req-10b73b93-d624-41df-a385-95c384d35149 req-f59c74d8-136e-4fb4-8860-87b398d30a1a tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91829) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 17:07:53.003206 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.quota.resource [req-10b73b93-d624-41df-a385-95c384d35149 req-f59c74d8-136e-4fb4-8860-87b398d30a1a tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Usage tracker for resource:port and tenant:5397bf60956945c3a2bf43c6b1aa614b is out of sync, need to count used quota {{(pid=91829) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 17:07:53.005932 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.quota.resource [req-10b73b93-d624-41df-a385-95c384d35149 req-f59c74d8-136e-4fb4-8860-87b398d30a1a tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Quota usage for port was recalculated. Used quota:2. {{(pid=91829) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 17:07:53.012154 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.quota.driver [req-10b73b93-d624-41df-a385-95c384d35149 req-f59c74d8-136e-4fb4-8860-87b398d30a1a tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Attempting to reserve 1 items for resource port. Total usage: 2; quota limit: 500; headroom:498 {{(pid=91829) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 17:07:53.022881 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-10b73b93-d624-41df-a385-95c384d35149 req-f59c74d8-136e-4fb4-8860-87b398d30a1a tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Made reservation on behalf of 5397bf60956945c3a2bf43c6b1aa614b for: {'port': 1} {{(pid=91829) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 25 17:07:53.026406 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [req-10b73b93-d624-41df-a385-95c384d35149 req-f59c74d8-136e-4fb4-8860-87b398d30a1a tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3832070'] for port, before_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:53.187466 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.db_base_plugin_common [req-10b73b93-d624-41df-a385-95c384d35149 req-f59c74d8-136e-4fb4-8860-87b398d30a1a tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Allocated IP 172.20.0.9 (17a0e39e-1e1f-4550-b28b-d5ae3bdca362/f5599a2e-9942-4423-a1ac-67e9b2650770/0b29d882-4e62-44e0-acc0-5deb97293c57) {{(pid=91829) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 25 17:07:53.377518 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [req-10b73b93-d624-41df-a385-95c384d35149 req-f59c74d8-136e-4fb4-8860-87b398d30a1a tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Notify callbacks [] for port, precommit_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:53.392589 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.provisioning_blocks [req-10b73b93-d624-41df-a385-95c384d35149 req-f59c74d8-136e-4fb4-8860-87b398d30a1a tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Transition to ACTIVE for port object 0b29d882-4e62-44e0-acc0-5deb97293c57 will not be triggered until provisioned by entity DHCP. {{(pid=91829) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 25 17:07:53.417427 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [req-10b73b93-d624-41df-a385-95c384d35149 req-f59c74d8-136e-4fb4-8860-87b398d30a1a tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8757892520915', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28230808'] for port, after_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:53.423135 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-29714c98-817b-4459-af55-7db1747da55c tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:07:53.491871 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-10b73b93-d624-41df-a385-95c384d35149 req-f59c74d8-136e-4fb4-8860-87b398d30a1a tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Network 17a0e39e-1e1f-4550-b28b-d5ae3bdca362 is already hosted by enough agents. {{(pid=91829) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 25 17:07:53.495217 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.scheduler.base_scheduler [req-10b73b93-d624-41df-a385-95c384d35149 req-f59c74d8-136e-4fb4-8860-87b398d30a1a tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Resources bound (agent type, host, resource id): {{(pid=91829) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 17:07:53.499099 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.l3_dvrscheduler_db [req-10b73b93-d624-41df-a385-95c384d35149 req-f59c74d8-136e-4fb4-8860-87b398d30a1a tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Received port after_create {{(pid=91829) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 25 17:07:53.529811 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f59c74d8-136e-4fb4-8860-87b398d30a1a tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Pushing event updated for resources: {'Port': ['ID=0b29d882-4e62-44e0-acc0-5deb97293c57,revision_number=1']} {{(pid=91829) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:07:53.549495 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f59c74d8-136e-4fb4-8860-87b398d30a1a tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91829) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:07:53.549747 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f59c74d8-136e-4fb4-8860-87b398d30a1a tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91829) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:07:53.550133 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f59c74d8-136e-4fb4-8860-87b398d30a1a tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91829) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:07:53.550484 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f59c74d8-136e-4fb4-8860-87b398d30a1a tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91829) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:07:53.550831 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f59c74d8-136e-4fb4-8860-87b398d30a1a tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91829) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:07:53.551176 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f59c74d8-136e-4fb4-8860-87b398d30a1a tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91829) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:07:53.551522 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f59c74d8-136e-4fb4-8860-87b398d30a1a tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91829) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:07:53.551867 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f59c74d8-136e-4fb4-8860-87b398d30a1a tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91829) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:07:53.552209 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f59c74d8-136e-4fb4-8860-87b398d30a1a tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91829) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:07:53.552549 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f59c74d8-136e-4fb4-8860-87b398d30a1a tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91829) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:07:53.552884 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f59c74d8-136e-4fb4-8860-87b398d30a1a tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91829) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:07:53.553228 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f59c74d8-136e-4fb4-8860-87b398d30a1a tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91829) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:07:53.559766 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-f59c74d8-136e-4fb4-8860-87b398d30a1a tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.137s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:07:53.577404 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-10b73b93-d624-41df-a385-95c384d35149 req-f59c74d8-136e-4fb4-8860-87b398d30a1a tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:07:53.578059 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [req-10b73b93-d624-41df-a385-95c384d35149 req-f59c74d8-136e-4fb4-8860-87b398d30a1a tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-178712'] for port, before_response {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:53.598914 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-10b73b93-d624-41df-a385-95c384d35149 req-f59c74d8-136e-4fb4-8860-87b398d30a1a tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] 10.222.0.32 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.7520213 May 25 17:07:53.613535 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.v2.base [req-10b73b93-d624-41df-a385-95c384d35149 req-39147570-64f0-440b-a478-00b6abb26226 service neutron] Request body: {'port': {'device_id': '8af1dd48-45a0-4c07-9019-859effb1b06d', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-79049'}} {{(pid=91829) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 17:07:53.738519 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [req-10b73b93-d624-41df-a385-95c384d35149 req-39147570-64f0-440b-a478-00b6abb26226 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3832070'] for port, before_update {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:53.749394 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.provisioning_blocks [None req-a496cb69-4a27-4070-ac54-ddc681ff6f6a None None] Provisioning for port 0b29d882-4e62-44e0-acc0-5deb97293c57 completed by entity DHCP. {{(pid=91831) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 25 17:07:53.754552 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.provisioning_blocks [None req-a496cb69-4a27-4070-ac54-ddc681ff6f6a None None] Provisioning complete for port 0b29d882-4e62-44e0-acc0-5deb97293c57 triggered by entity DHCP. {{(pid=91831) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 17:07:53.754933 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-a496cb69-4a27-4070-ac54-ddc681ff6f6a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3854128'] for port, provisioning_complete {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:53.809081 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.plugin [None req-a496cb69-4a27-4070-ac54-ddc681ff6f6a None None] Port 0b29d882-4e62-44e0-acc0-5deb97293c57 cannot update to ACTIVE because it is not bound. {{(pid=91831) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 25 17:07:54.143576 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6f9e9079-ccda-4dfe-81dc-7f4d62973d60 req-9fb5b72d-636a-49bd-9235-ed7e1b30ea52 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:07:54.144153 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.quota.resource [req-6f9e9079-ccda-4dfe-81dc-7f4d62973d60 req-9fb5b72d-636a-49bd-9235-ed7e1b30ea52 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Synchronizing usage tracker for tenant:5397bf60956945c3a2bf43c6b1aa614b on resource:port {{(pid=91829) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 25 17:07:54.147559 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.notifiers.nova [req-10b73b93-d624-41df-a385-95c384d35149 req-39147570-64f0-440b-a478-00b6abb26226 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 0b29d882-4e62-44e0-acc0-5deb97293c57 {{(pid=91829) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} May 25 17:07:54.156125 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [req-10b73b93-d624-41df-a385-95c384d35149 req-39147570-64f0-440b-a478-00b6abb26226 service neutron] Notify callbacks [] for port, precommit_update {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:54.176536 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.provisioning_blocks [req-10b73b93-d624-41df-a385-95c384d35149 req-39147570-64f0-440b-a478-00b6abb26226 service neutron] Transition to ACTIVE for port object 0b29d882-4e62-44e0-acc0-5deb97293c57 will not be triggered until provisioned by entity L2. {{(pid=91829) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 25 17:07:54.179982 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.quota.resource [req-6f9e9079-ccda-4dfe-81dc-7f4d62973d60 req-9fb5b72d-636a-49bd-9235-ed7e1b30ea52 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Unset dirty status for tenant:5397bf60956945c3a2bf43c6b1aa614b on resource:port {{(pid=91829) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 25 17:07:54.181420 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-6f9e9079-ccda-4dfe-81dc-7f4d62973d60 req-9fb5b72d-636a-49bd-9235-ed7e1b30ea52 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] 10.222.0.62 "GET /v2.0/ports?device_id=8af1dd48-45a0-4c07-9019-859effb1b06d HTTP/1.1" status: 200 len: 931 time: 0.1873477 May 25 17:07:54.182474 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [req-10b73b93-d624-41df-a385-95c384d35149 req-39147570-64f0-440b-a478-00b6abb26226 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8757892955028', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8757892520933', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8757892521750', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28230801'] for port, after_update {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:54.187255 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-11322510-0860-4b24-bea0-e87b70011e99 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:07:54.475465 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-6f9e9079-ccda-4dfe-81dc-7f4d62973d60 req-66cdaf9f-c379-433f-92e4-fe797826d825 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] 10.222.0.62 "GET /v2.0/security-groups?id=58fab80b-49b2-4bca-89e6-fef7473221ef&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1621213 May 25 17:07:54.476110 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-39147570-64f0-440b-a478-00b6abb26226 service neutron] Pushing event updated for resources: {'Port': ['ID=0b29d882-4e62-44e0-acc0-5deb97293c57,revision_number=2']} {{(pid=91829) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:07:54.484272 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-39147570-64f0-440b-a478-00b6abb26226 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.296s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:07:54.561884 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.plugins.ml2.managers [req-10b73b93-d624-41df-a385-95c384d35149 req-39147570-64f0-440b-a478-00b6abb26226 service neutron] Attempting to bind port 0b29d882-4e62-44e0-acc0-5deb97293c57 on host hv-cinder-79049 for vnic_type normal with profile {{(pid=91829) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 25 17:07:54.562298 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.plugins.ml2.managers [req-10b73b93-d624-41df-a385-95c384d35149 req-39147570-64f0-440b-a478-00b6abb26226 service neutron] Attempting to bind port 0b29d882-4e62-44e0-acc0-5deb97293c57 by drivers openvswitch,hyperv on host hv-cinder-79049 at level 0 using segments [{'id': '50ed67e9-f8d3-4927-b257-bd17654cce34', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 657, 'network_id': '17a0e39e-1e1f-4550-b28b-d5ae3bdca362'}] {{(pid=91829) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 25 17:07:54.562657 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-10b73b93-d624-41df-a385-95c384d35149 req-39147570-64f0-440b-a478-00b6abb26226 service neutron] Attempting to bind port 0b29d882-4e62-44e0-acc0-5deb97293c57 on network 17a0e39e-1e1f-4550-b28b-d5ae3bdca362 {{(pid=91829) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 25 17:07:54.567139 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-10b73b93-d624-41df-a385-95c384d35149 req-39147570-64f0-440b-a478-00b6abb26226 service neutron] Port 0b29d882-4e62-44e0-acc0-5deb97293c57 on network 17a0e39e-1e1f-4550-b28b-d5ae3bdca362 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-79049 {{(pid=91829) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 25 17:07:54.567458 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-10b73b93-d624-41df-a385-95c384d35149 req-39147570-64f0-440b-a478-00b6abb26226 service neutron] Attempting to bind port 0b29d882-4e62-44e0-acc0-5deb97293c57 on network 17a0e39e-1e1f-4550-b28b-d5ae3bdca362 {{(pid=91829) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 25 17:07:54.573138 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-10b73b93-d624-41df-a385-95c384d35149 req-39147570-64f0-440b-a478-00b6abb26226 service neutron] Checking agent: {'id': '3a1fdee1-bff0-49fb-b470-e13b95ee1b4d', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-79049', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 25, 16, 56, 32), 'started_at': datetime.datetime(2021, 5, 25, 16, 56, 32), 'heartbeat_timestamp': datetime.datetime(2021, 5, 25, 17, 7, 37), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=91829) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 25 17:07:54.573374 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-10b73b93-d624-41df-a385-95c384d35149 req-39147570-64f0-440b-a478-00b6abb26226 service neutron] Checking segment: {'id': '50ed67e9-f8d3-4927-b257-bd17654cce34', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 657, 'network_id': '17a0e39e-1e1f-4550-b28b-d5ae3bdca362'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91829) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 25 17:07:54.573751 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-10b73b93-d624-41df-a385-95c384d35149 req-39147570-64f0-440b-a478-00b6abb26226 service neutron] Bound using segment: {'id': '50ed67e9-f8d3-4927-b257-bd17654cce34', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 657, 'network_id': '17a0e39e-1e1f-4550-b28b-d5ae3bdca362'} {{(pid=91829) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 25 17:07:54.574210 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.plugins.ml2.managers [req-10b73b93-d624-41df-a385-95c384d35149 req-39147570-64f0-440b-a478-00b6abb26226 service neutron] Bound port: 0b29d882-4e62-44e0-acc0-5deb97293c57, host: hv-cinder-79049, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '50ed67e9-f8d3-4927-b257-bd17654cce34', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 657, 'network_id': '17a0e39e-1e1f-4550-b28b-d5ae3bdca362'}}] {{(pid=91829) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 25 17:07:54.574553 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [req-10b73b93-d624-41df-a385-95c384d35149 req-39147570-64f0-440b-a478-00b6abb26226 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3832070'] for port, before_update {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:54.660389 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.plugins.ml2.db [req-10b73b93-d624-41df-a385-95c384d35149 req-39147570-64f0-440b-a478-00b6abb26226 service neutron] For port 0b29d882-4e62-44e0-acc0-5deb97293c57, host hv-cinder-79049, cleared binding levels {{(pid=91829) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 25 17:07:54.663706 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.plugins.ml2.db [req-10b73b93-d624-41df-a385-95c384d35149 req-39147570-64f0-440b-a478-00b6abb26226 service neutron] For port 0b29d882-4e62-44e0-acc0-5deb97293c57, host hv-cinder-79049, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79049',level=0,port_id=0b29d882-4e62-44e0-acc0-5deb97293c57,segment=NetworkSegment(50ed67e9-f8d3-4927-b257-bd17654cce34),segment_id=50ed67e9-f8d3-4927-b257-bd17654cce34)] {{(pid=91829) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 25 17:07:54.667207 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [req-10b73b93-d624-41df-a385-95c384d35149 req-39147570-64f0-440b-a478-00b6abb26226 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8757892955028', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8757892520933', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8757892521750', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28230801'] for port, after_update {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:54.671654 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-8119e332-56aa-494e-9705-2ca05af0a9ff admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:07:54.731287 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-10b73b93-d624-41df-a385-95c384d35149 req-39147570-64f0-440b-a478-00b6abb26226 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:07:54.731958 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [req-10b73b93-d624-41df-a385-95c384d35149 req-39147570-64f0-440b-a478-00b6abb26226 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-178712'] for port, before_response {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:54.733234 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-10b73b93-d624-41df-a385-95c384d35149 req-39147570-64f0-440b-a478-00b6abb26226 service neutron] 10.222.0.32 "PUT /v2.0/ports/0b29d882-4e62-44e0-acc0-5deb97293c57 HTTP/1.1" status: 200 len: 1093 time: 1.1241004 May 25 17:07:54.735813 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '8af1dd48-45a0-4c07-9019-859effb1b06d', 'tag': '0b29d882-4e62-44e0-acc0-5deb97293c57'}] {{(pid=91829) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 25 17:07:54.758367 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-39147570-64f0-440b-a478-00b6abb26226 service neutron] Pushing event updated for resources: {'Port': ['ID=0b29d882-4e62-44e0-acc0-5deb97293c57,revision_number=3']} {{(pid=91829) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:07:54.763145 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-39147570-64f0-440b-a478-00b6abb26226 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.091s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:07:54.819387 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '8af1dd48-45a0-4c07-9019-859effb1b06d', 'tag': '0b29d882-4e62-44e0-acc0-5deb97293c57', 'status': 'completed', 'code': 200} May 25 17:07:54.856418 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-10b73b93-d624-41df-a385-95c384d35149 req-ef6ffc56-723a-4a56-95c8-f79a12089912 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:07:54.857942 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-10b73b93-d624-41df-a385-95c384d35149 req-ef6ffc56-723a-4a56-95c8-f79a12089912 service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=5397bf60956945c3a2bf43c6b1aa614b&device_id=8af1dd48-45a0-4c07-9019-859effb1b06d HTTP/1.1" status: 200 len: 1096 time: 0.0784225 May 25 17:07:54.936089 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-10b73b93-d624-41df-a385-95c384d35149 req-90e187de-7fa6-4eab-8eb7-173488d1b536 service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=0b29d882-4e62-44e0-acc0-5deb97293c57 HTTP/1.1" status: 200 len: 217 time: 0.0708327 May 25 17:07:55.000752 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-10b73b93-d624-41df-a385-95c384d35149 req-5518928c-e82a-4434-b18f-30b7beade06d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:07:55.002135 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-10b73b93-d624-41df-a385-95c384d35149 req-5518928c-e82a-4434-b18f-30b7beade06d service neutron] 10.222.0.32 "GET /v2.0/subnets?id=f5599a2e-9942-4423-a1ac-67e9b2650770 HTTP/1.1" status: 200 len: 850 time: 0.0599520 May 25 17:07:55.081374 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-10b73b93-d624-41df-a385-95c384d35149 req-2248bbd7-8f40-4fc2-97f1-601f5c034030 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:07:55.082877 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-10b73b93-d624-41df-a385-95c384d35149 req-2248bbd7-8f40-4fc2-97f1-601f5c034030 service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=17a0e39e-1e1f-4550-b28b-d5ae3bdca362&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0737143 May 25 17:07:55.212549 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-10b73b93-d624-41df-a385-95c384d35149 req-5f4b1265-edfb-4394-99d3-c0f65f34bb50 service neutron] 10.222.0.32 "GET /v2.0/networks/17a0e39e-1e1f-4550-b28b-d5ae3bdca362?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1218879 May 25 17:07:55.301092 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-790faada-a72e-481e-9d0b-363447bbb0fb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:55.344231 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-10b73b93-d624-41df-a385-95c384d35149 req-33bbce7d-c9ce-4e8a-8b4d-c77ea47d5393 service neutron] 10.222.0.32 "GET /v2.0/networks/17a0e39e-1e1f-4550-b28b-d5ae3bdca362?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1246898 May 25 17:07:55.462053 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8965f284-7ea9-4120-829a-35683b2f371d req-09e969d9-9520-4640-96e7-f4ae73d89bdb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:07:55.464039 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-8965f284-7ea9-4120-829a-35683b2f371d req-09e969d9-9520-4640-96e7-f4ae73d89bdb service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=5397bf60956945c3a2bf43c6b1aa614b&device_id=8af1dd48-45a0-4c07-9019-859effb1b06d HTTP/1.1" status: 200 len: 1096 time: 0.0687609 May 25 17:07:55.633733 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8965f284-7ea9-4120-829a-35683b2f371d req-cc70af78-b513-4ca1-b866-f69081e4f4e7 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:07:55.635640 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-8965f284-7ea9-4120-829a-35683b2f371d req-cc70af78-b513-4ca1-b866-f69081e4f4e7 service neutron] 10.222.0.32 "GET /v2.0/networks?id=17a0e39e-1e1f-4550-b28b-d5ae3bdca362 HTTP/1.1" status: 200 len: 912 time: 0.1623034 May 25 17:07:55.707750 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-8965f284-7ea9-4120-829a-35683b2f371d req-6ff8de67-9353-4ee5-b8fc-5ccd769fe821 service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=0b29d882-4e62-44e0-acc0-5deb97293c57 HTTP/1.1" status: 200 len: 217 time: 0.0647130 May 25 17:07:55.784518 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9ce7b8cf-1cba-409b-b336-3d86ec19e362 req-360c8d2b-0bbc-4b1a-9ed5-1ad46f15ae1d tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:07:55.785865 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-9ce7b8cf-1cba-409b-b336-3d86ec19e362 req-360c8d2b-0bbc-4b1a-9ed5-1ad46f15ae1d tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] 10.222.0.62 "GET /v2.0/ports?device_id=8af1dd48-45a0-4c07-9019-859effb1b06d HTTP/1.1" status: 200 len: 943 time: 0.1951070 May 25 17:07:55.790971 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8965f284-7ea9-4120-829a-35683b2f371d req-a3121a94-c094-4166-b159-fbaeb3ebe484 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:07:55.792292 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-8965f284-7ea9-4120-829a-35683b2f371d req-a3121a94-c094-4166-b159-fbaeb3ebe484 service neutron] 10.222.0.32 "GET /v2.0/subnets?id=f5599a2e-9942-4423-a1ac-67e9b2650770 HTTP/1.1" status: 200 len: 850 time: 0.0771418 May 25 17:07:55.877186 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-9ce7b8cf-1cba-409b-b336-3d86ec19e362 req-5dec8550-0384-44a5-8888-ce48c64acd6a tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] 10.222.0.62 "GET /v2.0/security-groups?id=58fab80b-49b2-4bca-89e6-fef7473221ef&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0839801 May 25 17:07:55.896472 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8965f284-7ea9-4120-829a-35683b2f371d req-324d0f24-a790-4e43-88f1-e9fca5c5cbcd service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:07:55.897924 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-8965f284-7ea9-4120-829a-35683b2f371d req-324d0f24-a790-4e43-88f1-e9fca5c5cbcd service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=17a0e39e-1e1f-4550-b28b-d5ae3bdca362&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0924828 May 25 17:07:56.116864 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-8965f284-7ea9-4120-829a-35683b2f371d req-62a0f037-2d08-4559-8a06-e9797aced792 service neutron] 10.222.0.32 "GET /v2.0/networks/17a0e39e-1e1f-4550-b28b-d5ae3bdca362?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2117703 May 25 17:07:56.247676 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-8965f284-7ea9-4120-829a-35683b2f371d req-0600c9f4-806b-4222-8c46-6466d412bf66 service neutron] 10.222.0.32 "GET /v2.0/networks/17a0e39e-1e1f-4550-b28b-d5ae3bdca362?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1236115 May 25 17:07:57.075942 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-acea92f4-c27c-4778-933e-0e5f2183a775 req-0a07b01a-44ff-4bf4-9a6a-c0916ea12719 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:07:57.077386 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-acea92f4-c27c-4778-933e-0e5f2183a775 req-0a07b01a-44ff-4bf4-9a6a-c0916ea12719 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] 10.222.0.62 "GET /v2.0/ports?device_id=8af1dd48-45a0-4c07-9019-859effb1b06d HTTP/1.1" status: 200 len: 943 time: 0.0832491 May 25 17:07:57.121144 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-acea92f4-c27c-4778-933e-0e5f2183a775 req-6e82e66f-6f0a-4704-bf15-8ef8c9366ac7 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] 10.222.0.62 "GET /v2.0/security-groups?id=58fab80b-49b2-4bca-89e6-fef7473221ef&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0382090 May 25 17:07:57.705453 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-810e05cf-301a-44f0-99dc-1f10cdb69d36 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:57.884347 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:58.194153 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.wsgi [-] (91830) accepted ('10.222.0.62', 36306) {{(pid=91830) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:07:58.306363 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f561cf86-4b9a-4ade-a1c1-0b51b69b2618 req-a0d39d7f-642e-4ccd-8940-b5920fd8b0aa tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:07:58.308001 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-f561cf86-4b9a-4ade-a1c1-0b51b69b2618 req-a0d39d7f-642e-4ccd-8940-b5920fd8b0aa tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] 10.222.0.62 "GET /v2.0/ports?device_id=8af1dd48-45a0-4c07-9019-859effb1b06d HTTP/1.1" status: 200 len: 943 time: 0.0822351 May 25 17:07:58.356608 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-f561cf86-4b9a-4ade-a1c1-0b51b69b2618 req-76a6d929-2a7e-4b51-bee6-54356af53aaa tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] 10.222.0.62 "GET /v2.0/security-groups?id=58fab80b-49b2-4bca-89e6-fef7473221ef&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0423319 May 25 17:07:58.461212 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.plugins.ml2.plugin [None req-2c065330-5d3b-47ae-81e7-8b8726a703f5 tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] Deleting port a8be13ac-177f-401c-919c-2457ab2749cb {{(pid=91830) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 25 17:07:58.461550 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-2c065330-5d3b-47ae-81e7-8b8726a703f5 tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8757892952899'] for port, before_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:58.579194 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-2c065330-5d3b-47ae-81e7-8b8726a703f5 tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-683770'] for port, precommit_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:58.579446 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-2c065330-5d3b-47ae-81e7-8b8726a703f5 tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:58.633285 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-0a55eb4a-8b57-4233-84d6-6b423b4ed6db None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:58.705545 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.plugins.ml2.plugin [None req-2c065330-5d3b-47ae-81e7-8b8726a703f5 tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] Calling delete_port for a8be13ac-177f-401c-919c-2457ab2749cb owned by network:floatingip {{(pid=91830) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 25 17:07:58.824458 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-2c065330-5d3b-47ae-81e7-8b8726a703f5 tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8757892955046', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8757892520924', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-27483019'] for port, after_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:58.829025 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-bd25d8f1-f2d7-4316-b35f-71f1b84f20eb tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:07:58.971339 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2c065330-5d3b-47ae-81e7-8b8726a703f5 tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] Pushing event deleted for resources: {'Port': ['ID=a8be13ac-177f-401c-919c-2457ab2749cb,revision_number=None']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:07:59.012334 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2c065330-5d3b-47ae-81e7-8b8726a703f5 tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91830) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:07:59.012711 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2c065330-5d3b-47ae-81e7-8b8726a703f5 tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91830) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:07:59.013079 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2c065330-5d3b-47ae-81e7-8b8726a703f5 tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91830) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:07:59.013440 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2c065330-5d3b-47ae-81e7-8b8726a703f5 tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91830) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:07:59.013801 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2c065330-5d3b-47ae-81e7-8b8726a703f5 tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91830) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:07:59.014187 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2c065330-5d3b-47ae-81e7-8b8726a703f5 tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91830) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:07:59.014541 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2c065330-5d3b-47ae-81e7-8b8726a703f5 tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91830) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:07:59.014894 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2c065330-5d3b-47ae-81e7-8b8726a703f5 tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91830) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:07:59.015244 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2c065330-5d3b-47ae-81e7-8b8726a703f5 tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91830) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:07:59.015593 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2c065330-5d3b-47ae-81e7-8b8726a703f5 tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91830) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:07:59.015944 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2c065330-5d3b-47ae-81e7-8b8726a703f5 tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91830) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:07:59.016292 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2c065330-5d3b-47ae-81e7-8b8726a703f5 tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91830) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:07:59.045330 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-2c065330-5d3b-47ae-81e7-8b8726a703f5 tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.216s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:07:59.074834 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-2c065330-5d3b-47ae-81e7-8b8726a703f5 tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] Notify callbacks [] for floatingip, after_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:59.075169 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.db.l3_db [None req-2c065330-5d3b-47ae-81e7-8b8726a703f5 tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] Floating IP 2eb8e904-a20e-4e25-838a-b9ec0488e5ae disassociated (deleted). External IP: 172.27.2.213, port: 646693a2-80a9-425d-bb26-ffda8fa453a7. May 25 17:07:59.148892 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.db.agents_db [None req-504cb04f-4543-46c1-8db7-349e21db7634 None None] Agent healthcheck: found 6 active agents {{(pid=91832) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} May 25 17:07:59.433098 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-2c065330-5d3b-47ae-81e7-8b8726a703f5 tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] Router c063ed68-292f-4e35-ba01-24f34d8a5e42 has already been hosted by L3 agent a2d427c1-2d07-43e8-afbe-218c9f7d0445 {{(pid=91830) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 25 17:07:59.542238 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ac3db74f-3288-45af-8c64-7485e565da99 req-5fb4388d-6336-4def-82fe-96be07facbfa tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:07:59.543662 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-ac3db74f-3288-45af-8c64-7485e565da99 req-5fb4388d-6336-4def-82fe-96be07facbfa tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] 10.222.0.62 "GET /v2.0/ports?device_id=8af1dd48-45a0-4c07-9019-859effb1b06d HTTP/1.1" status: 200 len: 943 time: 0.0798311 May 25 17:07:59.587434 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-ac3db74f-3288-45af-8c64-7485e565da99 req-74e76d76-cde5-4528-8ee5-33c200f53c4c tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] 10.222.0.62 "GET /v2.0/security-groups?id=58fab80b-49b2-4bca-89e6-fef7473221ef&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0380566 May 25 17:07:59.616564 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-2c065330-5d3b-47ae-81e7-8b8726a703f5 tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] Notify agent at l3_agent.dv-cinder-790492-4-iscsi the message routers_updated {{(pid=91830) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 25 17:07:59.626060 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-67950ffa-a271-457c-94b8-968f0fa02fca None None] Sync routers for ids ['c063ed68-292f-4e35-ba01-24f34d8a5e42'] in dv-cinder-790492-4-iscsi {{(pid=91831) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 25 17:07:59.633081 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-2c065330-5d3b-47ae-81e7-8b8726a703f5 tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-178712'] for floatingip, before_response {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:07:59.635297 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.l3_dvrscheduler_db [None req-67950ffa-a271-457c-94b8-968f0fa02fca None None] Routers {'c063ed68-292f-4e35-ba01-24f34d8a5e42'} bound to L3 agent in host dv-cinder-790492-4-iscsi {{(pid=91831) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 17:07:59.635911 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.l3_hamode_db [None req-67950ffa-a271-457c-94b8-968f0fa02fca None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-790492-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-05-25T16:50:28Z,description=,heartbeat_timestamp=2021-05-25T17:07:58Z,host='dv-cinder-790492-4-iscsi',id=a2d427c1-2d07-43e8-afbe-218c9f7d0445,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T16:50:28Z,topic='l3_agent')) {'router_ids': ['c063ed68-292f-4e35-ba01-24f34d8a5e42'], 'active': True} {{(pid=91831) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 17:07:59.688752 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [None req-2c065330-5d3b-47ae-81e7-8b8726a703f5 tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] 10.222.0.62 "DELETE /v2.0/floatingips/2eb8e904-a20e-4e25-838a-b9ec0488e5ae HTTP/1.1" status: 204 len: 168 time: 1.4934089 May 25 17:07:59.689516 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '482f4d0c-0df9-4de7-9c75-b28c728be580', 'tag': '646693a2-80a9-425d-bb26-ffda8fa453a7'}] {{(pid=91830) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 25 17:07:59.735649 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '482f4d0c-0df9-4de7-9c75-b28c728be580', 'tag': '646693a2-80a9-425d-bb26-ffda8fa453a7', 'status': 'completed', 'code': 200} May 25 17:07:59.821773 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.l3_dvr_db [None req-67950ffa-a271-457c-94b8-968f0fa02fca None None] Set router c063ed68-292f-4e35-ba01-24f34d8a5e42 gateway port host: dv-cinder-790492-4-iscsi {{(pid=91831) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 17:07:59.835671 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b91cbc18-a7b1-44a1-8b4c-6d6173b80632 req-3df91fb5-8bcd-4bca-9263-1c7361ea0e0e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:07:59.837141 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-b91cbc18-a7b1-44a1-8b4c-6d6173b80632 req-3df91fb5-8bcd-4bca-9263-1c7361ea0e0e service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=a736cc60cc2143c4b6dea99321051da5&device_id=482f4d0c-0df9-4de7-9c75-b28c728be580 HTTP/1.1" status: 200 len: 1099 time: 0.0770714 May 25 17:07:59.984504 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b91cbc18-a7b1-44a1-8b4c-6d6173b80632 req-98778566-99d0-41b4-a5be-c465946c7d04 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:07:59.985973 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-b91cbc18-a7b1-44a1-8b4c-6d6173b80632 req-98778566-99d0-41b4-a5be-c465946c7d04 service neutron] 10.222.0.32 "GET /v2.0/networks?id=613457eb-6f6d-4604-8f6c-f2d318ff9bc5 HTTP/1.1" status: 200 len: 910 time: 0.1422539 May 25 17:08:00.097111 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-b91cbc18-a7b1-44a1-8b4c-6d6173b80632 req-60eb3bec-7fbe-416d-8547-17dd1875eb8f service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=646693a2-80a9-425d-bb26-ffda8fa453a7 HTTP/1.1" status: 200 len: 217 time: 0.0790775 May 25 17:08:00.151192 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.l3_hamode_db [None req-67950ffa-a271-457c-94b8-968f0fa02fca None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'c063ed68-292f-4e35-ba01-24f34d8a5e42', 'name': 'tempest-TestShelveInstance-1452464711-router', 'tenant_id': 'a736cc60cc2143c4b6dea99321051da5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'external_fixed_ips': [{'subnet_id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'ip_address': '172.27.2.75'}], 'enable_snat': True}, 'gw_port_id': '703dfe81-5ded-48db-9e96-d09ac4afce0f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T17:00:08Z', 'updated_at': '2021-05-25T17:00:15Z', 'revision_number': 4, 'project_id': 'a736cc60cc2143c4b6dea99321051da5', 'gw_port': {'id': '703dfe81-5ded-48db-9e96-d09ac4afce0f', 'name': '', 'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'tenant_id': '', 'mac_address': 'fa:16:3e:32:8f:aa', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c063ed68-292f-4e35-ba01-24f34d8a5e42', 'device_owner': 'network:router_gateway', 'standard_attr_id': 268, 'fixed_ips': [{'subnet_id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'ip_address': '172.27.2.75', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790492-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:00:09Z', 'updated_at': '2021-05-25T17:00:17Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-790492-4-iscsi', '_interfaces': [{'id': 'a3cc4b79-05f1-4b3f-95e5-18e49199b00a', 'name': '', 'network_id': '613457eb-6f6d-4604-8f6c-f2d318ff9bc5', 'tenant_id': 'a736cc60cc2143c4b6dea99321051da5', 'mac_address': 'fa:16:3e:c6:46:19', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c063ed68-292f-4e35-ba01-24f34d8a5e42', 'device_owner': 'network:router_interface', 'standard_attr_id': 282, 'fixed_ips': [{'subnet_id': '3fc60650-484d-4574-bb67-0e4931bc9854', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790492-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:00:13Z', 'updated_at': '2021-05-25T17:00:27Z', 'revision_number': 5, 'project_id': 'a736cc60cc2143c4b6dea99321051da5', 'subnets': [{'id': '3fc60650-484d-4574-bb67-0e4931bc9854', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-790492-4-iscsi', False) {} {{(pid=91831) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 17:08:00.156120 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-67950ffa-a271-457c-94b8-968f0fa02fca None None] Checking router: c063ed68-292f-4e35-ba01-24f34d8a5e42 for host: dv-cinder-790492-4-iscsi {{(pid=91831) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 25 17:08:00.164794 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.l3_dvrscheduler_db [None req-67950ffa-a271-457c-94b8-968f0fa02fca None None] Routers {'c063ed68-292f-4e35-ba01-24f34d8a5e42'} bound to L3 agent in host dv-cinder-790492-4-iscsi {{(pid=91831) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 17:08:00.165423 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.l3_hamode_db [None req-67950ffa-a271-457c-94b8-968f0fa02fca None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-790492-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-05-25T16:50:28Z,description=,heartbeat_timestamp=2021-05-25T17:07:58Z,host='dv-cinder-790492-4-iscsi',id=a2d427c1-2d07-43e8-afbe-218c9f7d0445,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T16:50:28Z,topic='l3_agent')) {'router_ids': ['c063ed68-292f-4e35-ba01-24f34d8a5e42'], 'active': True} {{(pid=91831) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 17:08:00.171113 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b91cbc18-a7b1-44a1-8b4c-6d6173b80632 req-6bbac8a4-5785-45dc-a485-ecec2fdd1bce service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:08:00.172546 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-b91cbc18-a7b1-44a1-8b4c-6d6173b80632 req-6bbac8a4-5785-45dc-a485-ecec2fdd1bce service neutron] 10.222.0.32 "GET /v2.0/subnets?id=3fc60650-484d-4574-bb67-0e4931bc9854 HTTP/1.1" status: 200 len: 848 time: 0.0676832 May 25 17:08:00.180745 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cd83a135-4842-4c95-920b-7ddb9d9b2f80 req-7de87106-4372-4e83-b431-b79f69147cc6 tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:08:00.182174 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-cd83a135-4842-4c95-920b-7ddb9d9b2f80 req-7de87106-4372-4e83-b431-b79f69147cc6 tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] 10.222.0.62 "GET /v2.0/ports?device_id=482f4d0c-0df9-4de7-9c75-b28c728be580 HTTP/1.1" status: 200 len: 946 time: 0.1953359 May 25 17:08:00.255295 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-57f11b47-1f51-4191-b7c9-af248a48372c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:08:00.276098 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-cd83a135-4842-4c95-920b-7ddb9d9b2f80 req-ed708f4e-f147-4586-b9cb-9716d3fc33d4 tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] 10.222.0.62 "GET /v2.0/security-groups?id=1468f899-860c-4905-aee3-f13adc83d0a4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0599346 May 25 17:08:00.293140 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b91cbc18-a7b1-44a1-8b4c-6d6173b80632 req-c3a3a06d-35c4-4ac1-830e-f1bbabfc5bf0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:08:00.294707 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-b91cbc18-a7b1-44a1-8b4c-6d6173b80632 req-c3a3a06d-35c4-4ac1-830e-f1bbabfc5bf0 service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=613457eb-6f6d-4604-8f6c-f2d318ff9bc5&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.1116927 May 25 17:08:00.357929 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.l3_dvr_db [None req-67950ffa-a271-457c-94b8-968f0fa02fca None None] Set router c063ed68-292f-4e35-ba01-24f34d8a5e42 gateway port host: dv-cinder-790492-4-iscsi {{(pid=91831) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 17:08:00.425412 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-b91cbc18-a7b1-44a1-8b4c-6d6173b80632 req-eac95e16-97c4-4216-86de-f87b1fc7be75 service neutron] 10.222.0.32 "GET /v2.0/networks/613457eb-6f6d-4604-8f6c-f2d318ff9bc5?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1231830 May 25 17:08:00.561576 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-b91cbc18-a7b1-44a1-8b4c-6d6173b80632 req-270d0e62-ac55-4d57-a7ba-b98720fc91e2 service neutron] 10.222.0.32 "GET /v2.0/networks/613457eb-6f6d-4604-8f6c-f2d318ff9bc5?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1279020 May 25 17:08:00.729642 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.l3_hamode_db [None req-67950ffa-a271-457c-94b8-968f0fa02fca None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'c063ed68-292f-4e35-ba01-24f34d8a5e42', 'name': 'tempest-TestShelveInstance-1452464711-router', 'tenant_id': 'a736cc60cc2143c4b6dea99321051da5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'external_fixed_ips': [{'subnet_id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'ip_address': '172.27.2.75'}], 'enable_snat': True}, 'gw_port_id': '703dfe81-5ded-48db-9e96-d09ac4afce0f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T17:00:08Z', 'updated_at': '2021-05-25T17:00:15Z', 'revision_number': 4, 'project_id': 'a736cc60cc2143c4b6dea99321051da5', 'gw_port': {'id': '703dfe81-5ded-48db-9e96-d09ac4afce0f', 'name': '', 'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'tenant_id': '', 'mac_address': 'fa:16:3e:32:8f:aa', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c063ed68-292f-4e35-ba01-24f34d8a5e42', 'device_owner': 'network:router_gateway', 'standard_attr_id': 268, 'fixed_ips': [{'subnet_id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'ip_address': '172.27.2.75', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790492-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:00:09Z', 'updated_at': '2021-05-25T17:00:17Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-790492-4-iscsi', '_interfaces': [{'id': 'a3cc4b79-05f1-4b3f-95e5-18e49199b00a', 'name': '', 'network_id': '613457eb-6f6d-4604-8f6c-f2d318ff9bc5', 'tenant_id': 'a736cc60cc2143c4b6dea99321051da5', 'mac_address': 'fa:16:3e:c6:46:19', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c063ed68-292f-4e35-ba01-24f34d8a5e42', 'device_owner': 'network:router_interface', 'standard_attr_id': 282, 'fixed_ips': [{'subnet_id': '3fc60650-484d-4574-bb67-0e4931bc9854', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790492-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:00:13Z', 'updated_at': '2021-05-25T17:00:27Z', 'revision_number': 5, 'project_id': 'a736cc60cc2143c4b6dea99321051da5', 'subnets': [{'id': '3fc60650-484d-4574-bb67-0e4931bc9854', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-790492-4-iscsi', False) {} {{(pid=91831) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 17:08:00.733497 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-67950ffa-a271-457c-94b8-968f0fa02fca None None] The sync data for ids ['c063ed68-292f-4e35-ba01-24f34d8a5e42'] in dv-cinder-790492-4-iscsi is: [{'id': 'c063ed68-292f-4e35-ba01-24f34d8a5e42', 'name': 'tempest-TestShelveInstance-1452464711-router', 'tenant_id': 'a736cc60cc2143c4b6dea99321051da5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'external_fixed_ips': [{'subnet_id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'ip_address': '172.27.2.75'}], 'enable_snat': True}, 'gw_port_id': '703dfe81-5ded-48db-9e96-d09ac4afce0f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T17:00:08Z', 'updated_at': '2021-05-25T17:00:15Z', 'revision_number': 4, 'project_id': 'a736cc60cc2143c4b6dea99321051da5', 'gw_port': {'id': '703dfe81-5ded-48db-9e96-d09ac4afce0f', 'name': '', 'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'tenant_id': '', 'mac_address': 'fa:16:3e:32:8f:aa', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c063ed68-292f-4e35-ba01-24f34d8a5e42', 'device_owner': 'network:router_gateway', 'standard_attr_id': 268, 'fixed_ips': [{'subnet_id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'ip_address': '172.27.2.75', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790492-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:00:09Z', 'updated_at': '2021-05-25T17:00:17Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-790492-4-iscsi', '_interfaces': [{'id': 'a3cc4b79-05f1-4b3f-95e5-18e49199b00a', 'name': '', 'network_id': '613457eb-6f6d-4604-8f6c-f2d318ff9bc5', 'tenant_id': 'a736cc60cc2143c4b6dea99321051da5', 'mac_address': 'fa:16:3e:c6:46:19', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c063ed68-292f-4e35-ba01-24f34d8a5e42', 'device_owner': 'network:router_interface', 'standard_attr_id': 282, 'fixed_ips': [{'subnet_id': '3fc60650-484d-4574-bb67-0e4931bc9854', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790492-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:00:13Z', 'updated_at': '2021-05-25T17:00:27Z', 'revision_number': 5, 'project_id': 'a736cc60cc2143c4b6dea99321051da5', 'subnets': [{'id': '3fc60650-484d-4574-bb67-0e4931bc9854', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=91831) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 25 17:08:00.774726 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1aad4d2c-592c-4f07-9f9a-8d13d5923321 req-04bc6a8f-6f02-470b-a1a4-249d384f98f1 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:08:00.776258 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-1aad4d2c-592c-4f07-9f9a-8d13d5923321 req-04bc6a8f-6f02-470b-a1a4-249d384f98f1 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] 10.222.0.62 "GET /v2.0/ports?device_id=8af1dd48-45a0-4c07-9019-859effb1b06d HTTP/1.1" status: 200 len: 943 time: 0.0812035 May 25 17:08:00.822989 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-1aad4d2c-592c-4f07-9f9a-8d13d5923321 req-3348c8fd-0695-460b-b78f-bc9e0ced0e2c tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] 10.222.0.62 "GET /v2.0/security-groups?id=58fab80b-49b2-4bca-89e6-fef7473221ef&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0403926 May 25 17:08:00.938921 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-828f2c9e-684a-4f9d-8ed2-c10992c74a70 None None] New status for floating IP 2eb8e904-a20e-4e25-838a-b9ec0488e5ae: DOWN {{(pid=91832) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} May 25 17:08:01.467348 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-209dddd0-1827-46cc-82e9-9a7cae7329ba req-a9fc0751-a78b-4b64-bc05-5fadeef57f50 tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:08:01.468798 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-209dddd0-1827-46cc-82e9-9a7cae7329ba req-a9fc0751-a78b-4b64-bc05-5fadeef57f50 tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] 10.222.0.62 "GET /v2.0/ports?device_id=482f4d0c-0df9-4de7-9c75-b28c728be580 HTTP/1.1" status: 200 len: 946 time: 0.0821812 May 25 17:08:01.512613 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-209dddd0-1827-46cc-82e9-9a7cae7329ba req-7ffeea4f-53f9-4dc7-ad29-0c11c071dd41 tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] 10.222.0.62 "GET /v2.0/security-groups?id=1468f899-860c-4905-aee3-f13adc83d0a4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0381560 May 25 17:08:02.093863 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-926f5c9f-a21a-4701-b0a5-eab2a3a951d0 req-d816951a-ac37-43a4-ae84-27692593b3a1 tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:08:02.095320 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-926f5c9f-a21a-4701-b0a5-eab2a3a951d0 req-d816951a-ac37-43a4-ae84-27692593b3a1 tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] 10.222.0.32 "GET /v2.0/ports?device_id=482f4d0c-0df9-4de7-9c75-b28c728be580 HTTP/1.1" status: 200 len: 946 time: 0.2241979 May 25 17:08:02.172775 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eaaf9a37-2c51-4f2c-9fed-cd5c18bb1950 req-b95d15ff-915d-4ed0-b5c0-1cc4c9e41122 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:08:02.174102 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-eaaf9a37-2c51-4f2c-9fed-cd5c18bb1950 req-b95d15ff-915d-4ed0-b5c0-1cc4c9e41122 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] 10.222.0.62 "GET /v2.0/ports?device_id=8af1dd48-45a0-4c07-9019-859effb1b06d HTTP/1.1" status: 200 len: 943 time: 0.2427752 May 25 17:08:02.264733 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-eaaf9a37-2c51-4f2c-9fed-cd5c18bb1950 req-55e28f29-bbf9-4fe1-9a85-73bf44e88178 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] 10.222.0.62 "GET /v2.0/security-groups?id=58fab80b-49b2-4bca-89e6-fef7473221ef&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0603747 May 25 17:08:02.277784 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.plugins.ml2.plugin [req-926f5c9f-a21a-4701-b0a5-eab2a3a951d0 req-8237fa25-e7a9-42a8-a6c5-7c6ac670ef33 tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] Deleting port 646693a2-80a9-425d-bb26-ffda8fa453a7 {{(pid=91829) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 25 17:08:02.278153 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [req-926f5c9f-a21a-4701-b0a5-eab2a3a951d0 req-8237fa25-e7a9-42a8-a6c5-7c6ac670ef33 tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8757892952899'] for port, before_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:08:02.408666 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.plugins.ml2.db [req-926f5c9f-a21a-4701-b0a5-eab2a3a951d0 req-8237fa25-e7a9-42a8-a6c5-7c6ac670ef33 tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] For port 646693a2-80a9-425d-bb26-ffda8fa453a7, host hv-cinder-79049, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79049',level=0,port_id=646693a2-80a9-425d-bb26-ffda8fa453a7,segment=NetworkSegment(55bc70ae-213c-42ca-b035-b4a902044007),segment_id=55bc70ae-213c-42ca-b035-b4a902044007)] {{(pid=91829) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 17:08:02.409024 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [req-926f5c9f-a21a-4701-b0a5-eab2a3a951d0 req-8237fa25-e7a9-42a8-a6c5-7c6ac670ef33 tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-683770'] for port, precommit_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:08:02.532367 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.plugins.ml2.plugin [req-926f5c9f-a21a-4701-b0a5-eab2a3a951d0 req-8237fa25-e7a9-42a8-a6c5-7c6ac670ef33 tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] Calling delete_port for 646693a2-80a9-425d-bb26-ffda8fa453a7 owned by compute:nova {{(pid=91829) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 25 17:08:02.686117 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [req-926f5c9f-a21a-4701-b0a5-eab2a3a951d0 req-8237fa25-e7a9-42a8-a6c5-7c6ac670ef33 tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8757892955046', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8757892520924', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28230808'] for port, after_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:08:02.692742 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-35ab179e-7e88-49ca-b3e2-7f321ea42e38 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:08:02.740951 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8237fa25-e7a9-42a8-a6c5-7c6ac670ef33 tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] Pushing event deleted for resources: {'Port': ['ID=646693a2-80a9-425d-bb26-ffda8fa453a7,revision_number=None']} {{(pid=91829) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:08:02.745657 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-8237fa25-e7a9-42a8-a6c5-7c6ac670ef33 tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.053s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:08:02.825883 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.l3_dvrscheduler_db [req-926f5c9f-a21a-4701-b0a5-eab2a3a951d0 req-8237fa25-e7a9-42a8-a6c5-7c6ac670ef33 tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] No DVR routers for this DVR port 646693a2-80a9-425d-bb26-ffda8fa453a7 on host hv-cinder-79049 {{(pid=91829) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 25 17:08:02.829358 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [req-926f5c9f-a21a-4701-b0a5-eab2a3a951d0 req-8237fa25-e7a9-42a8-a6c5-7c6ac670ef33 tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-178712'] for port, before_response {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:08:02.831808 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '482f4d0c-0df9-4de7-9c75-b28c728be580', 'name': 'network-vif-deleted', 'tag': '646693a2-80a9-425d-bb26-ffda8fa453a7'}] {{(pid=91829) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 25 17:08:02.845065 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c8ce2ad0-8e84-4041-bfb4-1f75bc8b4199 req-f9a814cd-3aec-46cc-9560-2fd5b10801d9 tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:08:02.846508 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-c8ce2ad0-8e84-4041-bfb4-1f75bc8b4199 req-f9a814cd-3aec-46cc-9560-2fd5b10801d9 tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] 10.222.0.62 "GET /v2.0/ports?device_id=482f4d0c-0df9-4de7-9c75-b28c728be580 HTTP/1.1" status: 200 len: 867 time: 0.2196472 May 25 17:08:02.852776 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-926f5c9f-a21a-4701-b0a5-eab2a3a951d0 req-8237fa25-e7a9-42a8-a6c5-7c6ac670ef33 tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] 10.222.0.32 "DELETE /v2.0/ports/646693a2-80a9-425d-bb26-ffda8fa453a7 HTTP/1.1" status: 204 len: 173 time: 0.7497039 May 25 17:08:02.886120 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '482f4d0c-0df9-4de7-9c75-b28c728be580', 'name': 'network-vif-deleted', 'tag': '646693a2-80a9-425d-bb26-ffda8fa453a7', 'status': 'completed', 'code': 200} May 25 17:08:02.898713 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-c8ce2ad0-8e84-4041-bfb4-1f75bc8b4199 req-56e5919f-8c91-4de9-86f3-72fd09bb6ec3 tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] 10.222.0.62 "GET /v2.0/security-groups?id=1468f899-860c-4905-aee3-f13adc83d0a4&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0451207 May 25 17:08:03.456449 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-41663397-a5ac-49b2-92db-abe672da8066 req-6ae55e13-661e-4e0f-b773-ab5fc862bd62 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:08:03.457766 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-41663397-a5ac-49b2-92db-abe672da8066 req-6ae55e13-661e-4e0f-b773-ab5fc862bd62 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] 10.222.0.62 "GET /v2.0/ports?device_id=8af1dd48-45a0-4c07-9019-859effb1b06d HTTP/1.1" status: 200 len: 943 time: 0.0810361 May 25 17:08:03.501151 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-41663397-a5ac-49b2-92db-abe672da8066 req-d8d79a7b-80e2-466a-8fbb-1bcff239d65e tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] 10.222.0.62 "GET /v2.0/security-groups?id=58fab80b-49b2-4bca-89e6-fef7473221ef&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0372241 May 25 17:08:03.967247 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.rpc [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Device 0b29d882-4e62-44e0-acc0-5deb97293c57 details requested by agent hyperv_hv-cinder-79049 with host hv-cinder-79049 {{(pid=91831) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 25 17:08:03.969581 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.rpc [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Device 646693a2-80a9-425d-bb26-ffda8fa453a7 no longer exists at agent hyperv_hv-cinder-79049 {{(pid=91831) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 25 17:08:03.996605 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.wsgi [-] (91829) accepted ('10.222.0.62', 36344) {{(pid=91829) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:08:04.006573 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.plugin [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] No Port match for: 646693a2-80a9-425d-bb26-ffda8fa453a7 {{(pid=91831) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}} May 25 17:08:04.006921 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.rpc [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Device 646693a2-80a9-425d-bb26-ffda8fa453a7 not bound to the agent host hv-cinder-79049 {{(pid=91831) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 25 17:08:04.068953 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-a65d5483-6daa-497a-b18c-7fac2d0f79f5 tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] Notify callbacks [] for security_group, before_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:08:04.102920 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-a65d5483-6daa-497a-b18c-7fac2d0f79f5 tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] Notify callbacks [] for security_group, precommit_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:08:04.139194 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.db [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] For port 0b29d882-4e62-44e0-acc0-5deb97293c57, host hv-cinder-79049, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79049',level=0,port_id=0b29d882-4e62-44e0-acc0-5deb97293c57,segment=NetworkSegment(50ed67e9-f8d3-4927-b257-bd17654cce34),segment_id=50ed67e9-f8d3-4927-b257-bd17654cce34)] {{(pid=91831) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 17:08:04.154212 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.rpc [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Returning: {'device': '0b29d882-4e62-44e0-acc0-5deb97293c57', 'network_id': '17a0e39e-1e1f-4550-b28b-d5ae3bdca362', 'port_id': '0b29d882-4e62-44e0-acc0-5deb97293c57', 'mac_address': 'fa:16:3e:c3:a2:21', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 657, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'f5599a2e-9942-4423-a1ac-67e9b2650770', 'ip_address': '172.20.0.9'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=91831) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 25 17:08:04.169083 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-a65d5483-6daa-497a-b18c-7fac2d0f79f5 tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-640836'] for security_group, after_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:08:04.172987 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-8a0888b5-a9ab-4b87-bfc4-0d6f61161c64 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:08:04.189227 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a65d5483-6daa-497a-b18c-7fac2d0f79f5 tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=1468f899-860c-4905-aee3-f13adc83d0a4,revision_number=None']} {{(pid=91829) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:08:04.192812 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-a65d5483-6daa-497a-b18c-7fac2d0f79f5 tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.020s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:08:04.202176 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-a65d5483-6daa-497a-b18c-7fac2d0f79f5 tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] Notify callbacks [] for security_group, before_response {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:08:04.205833 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [None req-a65d5483-6daa-497a-b18c-7fac2d0f79f5 tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] 10.222.0.62 "DELETE /v2.0/security-groups/1468f899-860c-4905-aee3-f13adc83d0a4 HTTP/1.1" status: 204 len: 168 time: 0.2055707 May 25 17:08:04.227681 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3832070'] for port, before_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:08:04.246126 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.notifiers.nova [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 0b29d882-4e62-44e0-acc0-5deb97293c57 {{(pid=91831) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} May 25 17:08:04.249460 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.wsgi [-] (91829) accepted ('10.222.0.62', 36350) {{(pid=91829) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:08:04.262492 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.db [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] For port 0b29d882-4e62-44e0-acc0-5deb97293c57, host hv-cinder-79049, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79049',level=0,port_id=0b29d882-4e62-44e0-acc0-5deb97293c57,segment=NetworkSegment(50ed67e9-f8d3-4927-b257-bd17654cce34),segment_id=50ed67e9-f8d3-4927-b257-bd17654cce34)] {{(pid=91831) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 17:08:04.266172 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8757892955028', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8757892520933', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8757892521750'] for port, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:08:04.267873 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:08:04.332085 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Pushing event updated for resources: {'Port': ['ID=0b29d882-4e62-44e0-acc0-5deb97293c57,revision_number=4']} {{(pid=91831) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:08:04.340594 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91831) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:08:04.340932 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91831) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:08:04.341262 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91831) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:08:04.341589 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91831) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:08:04.341938 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91831) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:08:04.342264 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91831) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:08:04.342573 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91831) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:08:04.342890 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91831) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:08:04.343205 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91831) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:08:04.343516 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91831) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:08:04.343827 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91831) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:08:04.344135 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91831) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:08:04.347876 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.080s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:08:04.639613 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.db [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] get_ports_and_sgs() called for port_ids ['0b29d882-4e62-44e0-acc0-5deb97293c57'] {{(pid=91831) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 25 17:08:04.918242 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-82a1c402-3ac4-4f76-96a2-5e82804b6785 req-49990452-9421-43e4-98c6-934ddd08d505 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:08:04.919699 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-82a1c402-3ac4-4f76-96a2-5e82804b6785 req-49990452-9421-43e4-98c6-934ddd08d505 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] 10.222.0.62 "GET /v2.0/ports?device_id=8af1dd48-45a0-4c07-9019-859effb1b06d HTTP/1.1" status: 200 len: 944 time: 0.3127570 May 25 17:08:05.019445 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-82a1c402-3ac4-4f76-96a2-5e82804b6785 req-c1609e35-d3e8-4ae4-bb5e-08e6795c9e45 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] 10.222.0.62 "GET /v2.0/security-groups?id=58fab80b-49b2-4bca-89e6-fef7473221ef&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0913131 May 25 17:08:05.110142 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-80580940-6740-42e5-8c43-51ed00634953 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-679979'] for router_interface, before_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:08:05.525264 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.plugins.ml2.plugin [None req-80580940-6740-42e5-8c43-51ed00634953 admin admin] Deleting port a3cc4b79-05f1-4b3f-95e5-18e49199b00a {{(pid=91829) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 25 17:08:05.526144 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-80580940-6740-42e5-8c43-51ed00634953 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8757892952899'] for port, before_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:08:05.646091 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.plugins.ml2.db [None req-80580940-6740-42e5-8c43-51ed00634953 admin admin] For port a3cc4b79-05f1-4b3f-95e5-18e49199b00a, host dv-cinder-790492-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-790492-4-iscsi',level=0,port_id=a3cc4b79-05f1-4b3f-95e5-18e49199b00a,segment=NetworkSegment(55bc70ae-213c-42ca-b035-b4a902044007),segment_id=55bc70ae-213c-42ca-b035-b4a902044007)] {{(pid=91829) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 17:08:05.646469 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-80580940-6740-42e5-8c43-51ed00634953 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-683770'] for port, precommit_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:08:05.767258 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.plugins.ml2.plugin [None req-80580940-6740-42e5-8c43-51ed00634953 admin admin] Calling delete_port for a3cc4b79-05f1-4b3f-95e5-18e49199b00a owned by network:router_interface {{(pid=91829) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 25 17:08:05.912192 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-80580940-6740-42e5-8c43-51ed00634953 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8757892955046', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8757892520924', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28230808'] for port, after_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:08:05.916507 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-c3f8ff20-c736-45cb-8b95-10c55816ffa9 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:08:05.960824 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-80580940-6740-42e5-8c43-51ed00634953 admin admin] Pushing event deleted for resources: {'Port': ['ID=a3cc4b79-05f1-4b3f-95e5-18e49199b00a,revision_number=None']} {{(pid=91829) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:08:05.986065 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.rpc [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Device 0b29d882-4e62-44e0-acc0-5deb97293c57 up at agent hyperv_hv-cinder-79049 {{(pid=91831) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 25 17:08:05.988809 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-80580940-6740-42e5-8c43-51ed00634953 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.072s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:08:06.069721 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.provisioning_blocks [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Provisioning for port 0b29d882-4e62-44e0-acc0-5deb97293c57 completed by entity L2. {{(pid=91831) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 25 17:08:06.076755 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.provisioning_blocks [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Provisioning complete for port 0b29d882-4e62-44e0-acc0-5deb97293c57 triggered by entity L2. {{(pid=91831) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 17:08:06.077137 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3854128'] for port, provisioning_complete {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:08:06.213642 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3832070'] for port, before_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:08:06.241497 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '8af1dd48-45a0-4c07-9019-859effb1b06d', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '0b29d882-4e62-44e0-acc0-5deb97293c57'}] {{(pid=91831) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 25 17:08:06.251632 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.db [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] For port 0b29d882-4e62-44e0-acc0-5deb97293c57, host hv-cinder-79049, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79049',level=0,port_id=0b29d882-4e62-44e0-acc0-5deb97293c57,segment=NetworkSegment(50ed67e9-f8d3-4927-b257-bd17654cce34),segment_id=50ed67e9-f8d3-4927-b257-bd17654cce34)] {{(pid=91831) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 17:08:06.255449 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8757892955028', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8757892520933', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8757892521750'] for port, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:08:06.257560 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [None req-2233b088-d8cd-45b3-9faf-a8cc6ef4490c None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:08:06.310318 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-80580940-6740-42e5-8c43-51ed00634953 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-551393', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-682171'] for router_interface, after_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:08:06.319219 dv-cinder-790492-4-iscsi neutron-server[91831]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '8af1dd48-45a0-4c07-9019-859effb1b06d', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '0b29d882-4e62-44e0-acc0-5deb97293c57', 'code': 200} May 25 17:08:06.321668 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f3cd62c9-7f92-45db-897d-a812a853ff29 req-e52e44c5-7a34-4bc2-b295-c82f06ba47e1 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:08:06.323917 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-f3cd62c9-7f92-45db-897d-a812a853ff29 req-e52e44c5-7a34-4bc2-b295-c82f06ba47e1 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] 10.222.0.62 "GET /v2.0/ports?device_id=8af1dd48-45a0-4c07-9019-859effb1b06d HTTP/1.1" status: 200 len: 944 time: 0.1759369 May 25 17:08:06.328501 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Pushing event updated for resources: {'Port': ['ID=0b29d882-4e62-44e0-acc0-5deb97293c57,revision_number=5']} {{(pid=91831) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:08:06.331380 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.074s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:08:06.556438 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:08:06.657106 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-f3cd62c9-7f92-45db-897d-a812a853ff29 req-15466f57-69d0-4408-94e9-8041af92fbdd tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] 10.222.0.62 "GET /v2.0/security-groups?id=58fab80b-49b2-4bca-89e6-fef7473221ef&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2731106 May 25 17:08:06.785177 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1cb4fb5b-3cea-4600-84e8-9dcd5a824bc2 req-a1703301-55de-4c3c-a899-d901709ace0b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:08:06.786667 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-1cb4fb5b-3cea-4600-84e8-9dcd5a824bc2 req-a1703301-55de-4c3c-a899-d901709ace0b service neutron] 10.222.0.32 "GET /v2.0/ports?device_id=8af1dd48-45a0-4c07-9019-859effb1b06d HTTP/1.1" status: 200 len: 1098 time: 0.1789424 May 25 17:08:06.911481 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-1cb4fb5b-3cea-4600-84e8-9dcd5a824bc2 req-cd6ba447-fe6a-44fa-b44d-ce410be628d6 service neutron] 10.222.0.32 "GET /v2.0/security-groups?id=58fab80b-49b2-4bca-89e6-fef7473221ef&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1153276 May 25 17:08:06.924475 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-80580940-6740-42e5-8c43-51ed00634953 admin admin] Router c063ed68-292f-4e35-ba01-24f34d8a5e42 has already been hosted by L3 agent a2d427c1-2d07-43e8-afbe-218c9f7d0445 {{(pid=91829) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 25 17:08:07.099206 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-80580940-6740-42e5-8c43-51ed00634953 admin admin] Notify agent at l3_agent.dv-cinder-790492-4-iscsi the message routers_updated {{(pid=91829) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 25 17:08:07.108024 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5506bfc9-57c6-4014-b54e-5d199c02b344 None None] Sync routers for ids ['c063ed68-292f-4e35-ba01-24f34d8a5e42'] in dv-cinder-790492-4-iscsi {{(pid=91831) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 25 17:08:07.113441 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [None req-80580940-6740-42e5-8c43-51ed00634953 admin admin] 10.222.0.62 "PUT /v2.0/routers/c063ed68-292f-4e35-ba01-24f34d8a5e42/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 2.8608136 May 25 17:08:07.113837 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.wsgi [-] (91829) accepted ('10.222.0.62', 36366) {{(pid=91829) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:08:07.117967 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5506bfc9-57c6-4014-b54e-5d199c02b344 None None] Routers {'c063ed68-292f-4e35-ba01-24f34d8a5e42'} bound to L3 agent in host dv-cinder-790492-4-iscsi {{(pid=91831) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 17:08:07.118589 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.l3_hamode_db [None req-5506bfc9-57c6-4014-b54e-5d199c02b344 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-790492-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-05-25T16:50:28Z,description=,heartbeat_timestamp=2021-05-25T17:07:58Z,host='dv-cinder-790492-4-iscsi',id=a2d427c1-2d07-43e8-afbe-218c9f7d0445,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T16:50:28Z,topic='l3_agent')) {'router_ids': ['c063ed68-292f-4e35-ba01-24f34d8a5e42'], 'active': True} {{(pid=91831) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 17:08:07.285970 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-d66cee2a-af15-43c4-8c53-7e89c052c9d3 admin admin] Notify callbacks [] for router, before_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:08:07.298965 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.l3_dvr_db [None req-5506bfc9-57c6-4014-b54e-5d199c02b344 None None] Set router c063ed68-292f-4e35-ba01-24f34d8a5e42 gateway port host: dv-cinder-790492-4-iscsi {{(pid=91831) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 17:08:07.467148 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-d66cee2a-af15-43c4-8c53-7e89c052c9d3 admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:08:07.538327 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.plugins.ml2.plugin [None req-d66cee2a-af15-43c4-8c53-7e89c052c9d3 admin admin] Deleting port 703dfe81-5ded-48db-9e96-d09ac4afce0f {{(pid=91829) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 25 17:08:07.538629 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-d66cee2a-af15-43c4-8c53-7e89c052c9d3 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8757892952899'] for port, before_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:08:07.615908 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.l3_hamode_db [None req-5506bfc9-57c6-4014-b54e-5d199c02b344 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'c063ed68-292f-4e35-ba01-24f34d8a5e42', 'name': 'tempest-TestShelveInstance-1452464711-router', 'tenant_id': 'a736cc60cc2143c4b6dea99321051da5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'external_fixed_ips': [{'subnet_id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'ip_address': '172.27.2.75'}], 'enable_snat': True}, 'gw_port_id': '703dfe81-5ded-48db-9e96-d09ac4afce0f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T17:00:08Z', 'updated_at': '2021-05-25T17:08:05Z', 'revision_number': 5, 'project_id': 'a736cc60cc2143c4b6dea99321051da5', 'gw_port': {'id': '703dfe81-5ded-48db-9e96-d09ac4afce0f', 'name': '', 'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'tenant_id': '', 'mac_address': 'fa:16:3e:32:8f:aa', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c063ed68-292f-4e35-ba01-24f34d8a5e42', 'device_owner': 'network:router_gateway', 'standard_attr_id': 268, 'fixed_ips': [{'subnet_id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'ip_address': '172.27.2.75', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790492-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:00:09Z', 'updated_at': '2021-05-25T17:00:17Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-790492-4-iscsi'}], 'dv-cinder-790492-4-iscsi', False) {} {{(pid=91831) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 17:08:07.620170 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5506bfc9-57c6-4014-b54e-5d199c02b344 None None] Checking router: c063ed68-292f-4e35-ba01-24f34d8a5e42 for host: dv-cinder-790492-4-iscsi {{(pid=91831) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 25 17:08:07.628365 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5506bfc9-57c6-4014-b54e-5d199c02b344 None None] Routers {'c063ed68-292f-4e35-ba01-24f34d8a5e42'} bound to L3 agent in host dv-cinder-790492-4-iscsi {{(pid=91831) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 17:08:07.628980 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.l3_hamode_db [None req-5506bfc9-57c6-4014-b54e-5d199c02b344 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-790492-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-05-25T16:50:28Z,description=,heartbeat_timestamp=2021-05-25T17:07:58Z,host='dv-cinder-790492-4-iscsi',id=a2d427c1-2d07-43e8-afbe-218c9f7d0445,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T16:50:28Z,topic='l3_agent')) {'router_ids': ['c063ed68-292f-4e35-ba01-24f34d8a5e42'], 'active': True} {{(pid=91831) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 17:08:07.658722 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.plugins.ml2.db [None req-d66cee2a-af15-43c4-8c53-7e89c052c9d3 admin admin] For port 703dfe81-5ded-48db-9e96-d09ac4afce0f, host dv-cinder-790492-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-790492-4-iscsi',level=0,port_id=703dfe81-5ded-48db-9e96-d09ac4afce0f,segment=NetworkSegment(414a8468-1d66-4792-9e81-d8ac5ccf1512),segment_id=414a8468-1d66-4792-9e81-d8ac5ccf1512)] {{(pid=91829) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 17:08:07.659076 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-d66cee2a-af15-43c4-8c53-7e89c052c9d3 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-683770'] for port, precommit_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:08:07.780880 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.l3_dvr_db [None req-5506bfc9-57c6-4014-b54e-5d199c02b344 None None] Set router c063ed68-292f-4e35-ba01-24f34d8a5e42 gateway port host: None {{(pid=91831) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 17:08:07.783942 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.plugins.ml2.plugin [None req-d66cee2a-af15-43c4-8c53-7e89c052c9d3 admin admin] Calling delete_port for 703dfe81-5ded-48db-9e96-d09ac4afce0f owned by network:router_gateway {{(pid=91829) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 25 17:08:07.893484 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.l3_hamode_db [None req-5506bfc9-57c6-4014-b54e-5d199c02b344 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'c063ed68-292f-4e35-ba01-24f34d8a5e42', 'name': 'tempest-TestShelveInstance-1452464711-router', 'tenant_id': 'a736cc60cc2143c4b6dea99321051da5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T17:00:08Z', 'updated_at': '2021-05-25T17:08:07Z', 'revision_number': 6, 'project_id': 'a736cc60cc2143c4b6dea99321051da5', 'gw_port_host': None}], 'dv-cinder-790492-4-iscsi', False) {} {{(pid=91831) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 17:08:07.897141 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5506bfc9-57c6-4014-b54e-5d199c02b344 None None] The sync data for ids ['c063ed68-292f-4e35-ba01-24f34d8a5e42'] in dv-cinder-790492-4-iscsi is: [{'id': 'c063ed68-292f-4e35-ba01-24f34d8a5e42', 'name': 'tempest-TestShelveInstance-1452464711-router', 'tenant_id': 'a736cc60cc2143c4b6dea99321051da5', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T17:00:08Z', 'updated_at': '2021-05-25T17:08:07Z', 'revision_number': 6, 'project_id': 'a736cc60cc2143c4b6dea99321051da5', 'gw_port_host': None}] {{(pid=91831) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 25 17:08:08.017182 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4ea8f84d-6d3c-4e18-9957-a43796a8e78d req-8a220354-4404-4bbf-b35e-d6f379bea8ad tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:08:08.018823 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-4ea8f84d-6d3c-4e18-9957-a43796a8e78d req-8a220354-4404-4bbf-b35e-d6f379bea8ad tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] 10.222.0.62 "GET /v2.0/ports?device_id=8af1dd48-45a0-4c07-9019-859effb1b06d HTTP/1.1" status: 200 len: 945 time: 0.2427459 May 25 17:08:08.081203 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-4ea8f84d-6d3c-4e18-9957-a43796a8e78d req-88f0de18-93e4-4d15-82ed-53440e5c1cce tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] 10.222.0.62 "GET /v2.0/security-groups?id=58fab80b-49b2-4bca-89e6-fef7473221ef&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0551896 May 25 17:08:08.164603 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-d66cee2a-af15-43c4-8c53-7e89c052c9d3 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8757892955046', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8757892520924', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28230808'] for port, after_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:08:08.168386 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-56f40224-9733-4a16-a301-e067d5fc8037 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:08:08.216951 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d66cee2a-af15-43c4-8c53-7e89c052c9d3 admin admin] Pushing event deleted for resources: {'Port': ['ID=703dfe81-5ded-48db-9e96-d09ac4afce0f,revision_number=None']} {{(pid=91829) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:08:08.245866 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-d66cee2a-af15-43c4-8c53-7e89c052c9d3 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.077s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:08:08.314057 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-d66cee2a-af15-43c4-8c53-7e89c052c9d3 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-683062'] for router_gateway, after_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:08:08.488868 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-d66cee2a-af15-43c4-8c53-7e89c052c9d3 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-684987', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-31024'] for router, precommit_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:08:08.491054 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-d66cee2a-af15-43c4-8c53-7e89c052c9d3 admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:08:08.514576 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-d66cee2a-af15-43c4-8c53-7e89c052c9d3 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-685959'] for router, after_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:08:08.515105 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-d66cee2a-af15-43c4-8c53-7e89c052c9d3 admin admin] Fanout notify agent at l3_agent the message router_deleted on router c063ed68-292f-4e35-ba01-24f34d8a5e42 {{(pid=91829) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}} May 25 17:08:08.527634 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-d66cee2a-af15-43c4-8c53-7e89c052c9d3 admin admin] Notify callbacks [] for router, before_response {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:08:08.528726 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [None req-d66cee2a-af15-43c4-8c53-7e89c052c9d3 admin admin] 10.222.0.62 "DELETE /v2.0/routers/c063ed68-292f-4e35-ba01-24f34d8a5e42 HTTP/1.1" status: 204 len: 168 time: 1.4139655 May 25 17:08:08.531290 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.wsgi [-] (91829) accepted ('10.222.0.62', 36376) {{(pid=91829) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:08:08.590546 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.db_base_plugin_v2 [None req-5c3cc1d8-141d-43e0-96b3-8ae6ba63f413 admin admin] Deleting subnet 3fc60650-484d-4574-bb67-0e4931bc9854 {{(pid=91829) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}} May 25 17:08:08.593575 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-5c3cc1d8-141d-43e0-96b3-8ae6ba63f413 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:08:08.645465 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-5c3cc1d8-141d-43e0-96b3-8ae6ba63f413 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-28283188'] for subnet, precommit_delete_associations {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:08:08.765078 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-5c3cc1d8-141d-43e0-96b3-8ae6ba63f413 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3856586'] for subnet, precommit_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:08:09.014270 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-5c3cc1d8-141d-43e0-96b3-8ae6ba63f413 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3857535', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55886', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-27333739', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-28266126'] for subnet, after_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:08:09.017897 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:08:09.056074 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5c3cc1d8-141d-43e0-96b3-8ae6ba63f413 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=3fc60650-484d-4574-bb67-0e4931bc9854,revision_number=None']} {{(pid=91829) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:08:09.061257 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-5c3cc1d8-141d-43e0-96b3-8ae6ba63f413 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.043s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:08:09.062095 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-5c3cc1d8-141d-43e0-96b3-8ae6ba63f413 admin admin] Notify callbacks [] for subnet, before_response {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:08:09.066182 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-35d790e7-41dd-4c6c-a08e-fd71a0f63c76 None None] Network 613457eb-6f6d-4604-8f6c-f2d318ff9bc5 requested from dv-cinder-790492-4-iscsi {{(pid=91831) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} May 25 17:08:09.068719 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [None req-5c3cc1d8-141d-43e0-96b3-8ae6ba63f413 admin admin] 10.222.0.62 "DELETE /v2.0/subnets/3fc60650-484d-4574-bb67-0e4931bc9854 HTTP/1.1" status: 204 len: 168 time: 0.5364890 May 25 17:08:09.071274 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.wsgi [-] (91829) accepted ('10.222.0.62', 36380) {{(pid=91829) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:08:09.177984 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-6a324333-237c-4c25-b6ff-2f9f9c3c2a98 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3867326'] for network, before_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:08:09.254523 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.plugins.ml2.plugin [None req-6a324333-237c-4c25-b6ff-2f9f9c3c2a98 admin admin] Deleting port 282005bd-4eac-4a0e-8b78-006226f21c55 {{(pid=91829) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 25 17:08:09.254983 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-6a324333-237c-4c25-b6ff-2f9f9c3c2a98 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8757892952899'] for port, before_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:08:09.330561 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ea0551dd-5aa4-4d4f-9f41-1d5509d14814 None None] DHCP port deletion for 613457eb-6f6d-4604-8f6c-f2d318ff9bc5 request from dv-cinder-790492-4-iscsi {{(pid=91831) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} May 25 17:08:09.398018 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.plugin [None req-ea0551dd-5aa4-4d4f-9f41-1d5509d14814 None None] Deleting port 282005bd-4eac-4a0e-8b78-006226f21c55 {{(pid=91831) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 25 17:08:09.398417 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-ea0551dd-5aa4-4d4f-9f41-1d5509d14814 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8757892952899'] for port, before_delete {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:08:09.408384 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.plugins.ml2.db [None req-6a324333-237c-4c25-b6ff-2f9f9c3c2a98 admin admin] For port 282005bd-4eac-4a0e-8b78-006226f21c55, host dv-cinder-790492-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-790492-4-iscsi',level=0,port_id=282005bd-4eac-4a0e-8b78-006226f21c55,segment=NetworkSegment(55bc70ae-213c-42ca-b035-b4a902044007),segment_id=55bc70ae-213c-42ca-b035-b4a902044007)] {{(pid=91829) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 17:08:09.408740 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-6a324333-237c-4c25-b6ff-2f9f9c3c2a98 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-683770'] for port, precommit_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:08:09.502570 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.db [None req-ea0551dd-5aa4-4d4f-9f41-1d5509d14814 None None] For port 282005bd-4eac-4a0e-8b78-006226f21c55, host dv-cinder-790492-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-790492-4-iscsi',level=0,port_id=282005bd-4eac-4a0e-8b78-006226f21c55,segment=NetworkSegment(55bc70ae-213c-42ca-b035-b4a902044007),segment_id=55bc70ae-213c-42ca-b035-b4a902044007)] {{(pid=91831) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 17:08:09.502969 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-ea0551dd-5aa4-4d4f-9f41-1d5509d14814 None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-683770'] for port, precommit_delete {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:08:09.627832 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.plugin [None req-ea0551dd-5aa4-4d4f-9f41-1d5509d14814 None None] Calling delete_port for 282005bd-4eac-4a0e-8b78-006226f21c55 owned by network:dhcp {{(pid=91831) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 25 17:08:09.641973 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.plugins.ml2.plugin [None req-6a324333-237c-4c25-b6ff-2f9f9c3c2a98 admin admin] Calling delete_port for 282005bd-4eac-4a0e-8b78-006226f21c55 owned by network:dhcp {{(pid=91829) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 25 17:08:09.659738 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3efdfbda-8c92-4f3c-975e-7f4982b50317 req-19475424-ad39-4c8c-a111-36bbf147cdc5 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:08:09.661186 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-3efdfbda-8c92-4f3c-975e-7f4982b50317 req-19475424-ad39-4c8c-a111-36bbf147cdc5 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] 10.222.0.62 "GET /v2.0/ports?device_id=8af1dd48-45a0-4c07-9019-859effb1b06d HTTP/1.1" status: 200 len: 945 time: 0.4448247 May 25 17:08:09.678182 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-ea0551dd-5aa4-4d4f-9f41-1d5509d14814 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8757892955046', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8757892520924'] for port, after_delete {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:08:09.681792 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:08:09.718608 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-3efdfbda-8c92-4f3c-975e-7f4982b50317 req-48403d61-458e-41db-a601-2f8a2c19af4c tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] 10.222.0.62 "GET /v2.0/security-groups?id=58fab80b-49b2-4bca-89e6-fef7473221ef&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0474982 May 25 17:08:09.729013 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ea0551dd-5aa4-4d4f-9f41-1d5509d14814 None None] Pushing event deleted for resources: {'Port': ['ID=282005bd-4eac-4a0e-8b78-006226f21c55,revision_number=None']} {{(pid=91831) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:08:09.731583 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [None req-ea0551dd-5aa4-4d4f-9f41-1d5509d14814 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.050s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:08:09.738745 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ea0551dd-5aa4-4d4f-9f41-1d5509d14814 None None] No DVR routers for this DVR port 282005bd-4eac-4a0e-8b78-006226f21c55 on host dv-cinder-790492-4-iscsi {{(pid=91831) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 25 17:08:09.743854 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-6a324333-237c-4c25-b6ff-2f9f9c3c2a98 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8757892955046', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8757892520924', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28230808'] for port, after_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:08:09.747712 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-3e64f1ec-f6ab-4fc8-8b2a-bb7956bf3d6a tempest-VolumesSnapshotTestJSON-991813121 tempest-VolumesSnapshotTestJSON-991813121-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:08:09.790769 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6a324333-237c-4c25-b6ff-2f9f9c3c2a98 admin admin] Pushing event deleted for resources: {'Port': ['ID=282005bd-4eac-4a0e-8b78-006226f21c55,revision_number=None']} {{(pid=91829) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:08:09.793855 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-6a324333-237c-4c25-b6ff-2f9f9c3c2a98 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.046s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:08:09.794663 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6a324333-237c-4c25-b6ff-2f9f9c3c2a98 admin admin] No DVR routers for this DVR port 282005bd-4eac-4a0e-8b78-006226f21c55 on host dv-cinder-790492-4-iscsi {{(pid=91829) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 25 17:08:09.956017 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.rpc [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Device 703dfe81-5ded-48db-9e96-d09ac4afce0f no longer exists at agent ovs-agent-dv-cinder-790492-4-iscsi {{(pid=91831) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 25 17:08:09.961710 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-6a324333-237c-4c25-b6ff-2f9f9c3c2a98 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3858245', 'neutron.services.segments.db._delete_segments_for_network-8757892982492'] for network, precommit_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:08:09.977837 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.services.segments.db [None req-6a324333-237c-4c25-b6ff-2f9f9c3c2a98 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['613457eb-6f6d-4604-8f6c-f2d318ff9bc5']}} {{(pid=91829) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 17:08:09.991697 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.plugin [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] No Port match for: 703dfe81-5ded-48db-9e96-d09ac4afce0f {{(pid=91831) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}} May 25 17:08:09.992175 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.rpc [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Device 703dfe81-5ded-48db-9e96-d09ac4afce0f not bound to the agent host dv-cinder-790492-4-iscsi {{(pid=91831) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 25 17:08:09.992512 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.rpc [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Device a3cc4b79-05f1-4b3f-95e5-18e49199b00a no longer exists at agent ovs-agent-dv-cinder-790492-4-iscsi {{(pid=91831) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 25 17:08:09.993587 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.services.segments.db [None req-6a324333-237c-4c25-b6ff-2f9f9c3c2a98 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '55bc70ae-213c-42ca-b035-b4a902044007') {'for_net_delete': True} {{(pid=91829) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 17:08:09.993879 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.services.segments.db [None req-6a324333-237c-4c25-b6ff-2f9f9c3c2a98 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '55bc70ae-213c-42ca-b035-b4a902044007') {} {{(pid=91829) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 17:08:10.008611 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-6a324333-237c-4c25-b6ff-2f9f9c3c2a98 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8757892991389', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-28283199'] for segment, before_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:08:10.026311 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.plugin [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] No Port match for: a3cc4b79-05f1-4b3f-95e5-18e49199b00a {{(pid=91831) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}} May 25 17:08:10.026683 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.rpc [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Device a3cc4b79-05f1-4b3f-95e5-18e49199b00a not bound to the agent host dv-cinder-790492-4-iscsi {{(pid=91831) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 25 17:08:10.027087 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.rpc [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Device 282005bd-4eac-4a0e-8b78-006226f21c55 no longer exists at agent ovs-agent-dv-cinder-790492-4-iscsi {{(pid=91831) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 25 17:08:10.033620 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c055b19d-9640-48fc-863a-b783e441f0e7 req-01ce175d-7fbb-4287-a635-f863cc159c42 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:08:10.035078 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-c055b19d-9640-48fc-863a-b783e441f0e7 req-01ce175d-7fbb-4287-a635-f863cc159c42 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] 10.222.0.62 "GET /v2.0/ports?device_id=8af1dd48-45a0-4c07-9019-859effb1b06d HTTP/1.1" status: 200 len: 945 time: 0.1945245 May 25 17:08:10.035988 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-6a324333-237c-4c25-b6ff-2f9f9c3c2a98 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3809789'] for segment, precommit_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:08:10.043675 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-6a324333-237c-4c25-b6ff-2f9f9c3c2a98 admin admin] Releasing vlan 659 on physical network physnet1 to pool {{(pid=91829) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 25 17:08:10.044058 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-6a324333-237c-4c25-b6ff-2f9f9c3c2a98 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3809789', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-28230861'] for segment, after_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:08:10.057587 dv-cinder-790492-4-iscsi neutron-server[91829]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ml2_port_bindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. May 25 17:08:10.057587 dv-cinder-790492-4-iscsi neutron-server[91829]: util.warn( May 25 17:08:10.057587 dv-cinder-790492-4-iscsi neutron-server[91829]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ml2_port_binding_levels' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. May 25 17:08:10.057587 dv-cinder-790492-4-iscsi neutron-server[91829]: util.warn( May 25 17:08:10.057587 dv-cinder-790492-4-iscsi neutron-server[91829]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'portsecuritybindings' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. May 25 17:08:10.057587 dv-cinder-790492-4-iscsi neutron-server[91829]: util.warn( May 25 17:08:10.057587 dv-cinder-790492-4-iscsi neutron-server[91829]: /usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py:1359: SAWarning: DELETE statement on table 'ports' expected to delete 1 row(s); 0 were matched. Please set confirm_deleted_rows=False within the mapper configuration to prevent this warning. May 25 17:08:10.057587 dv-cinder-790492-4-iscsi neutron-server[91829]: util.warn( May 25 17:08:10.057587 dv-cinder-790492-4-iscsi neutron-server[91829]: Traceback (most recent call last): May 25 17:08:10.057587 dv-cinder-790492-4-iscsi neutron-server[91829]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 25 17:08:10.057587 dv-cinder-790492-4-iscsi neutron-server[91829]: timer() May 25 17:08:10.057587 dv-cinder-790492-4-iscsi neutron-server[91829]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 25 17:08:10.057587 dv-cinder-790492-4-iscsi neutron-server[91829]: cb(*args, **kw) May 25 17:08:10.057587 dv-cinder-790492-4-iscsi neutron-server[91829]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper May 25 17:08:10.057587 dv-cinder-790492-4-iscsi neutron-server[91829]: return func(*args, **kwargs) May 25 17:08:10.057587 dv-cinder-790492-4-iscsi neutron-server[91829]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 25 17:08:10.057587 dv-cinder-790492-4-iscsi neutron-server[91829]: self._notify() May 25 17:08:10.057587 dv-cinder-790492-4-iscsi neutron-server[91829]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 25 17:08:10.057587 dv-cinder-790492-4-iscsi neutron-server[91829]: self.callback(batched_events) May 25 17:08:10.057587 dv-cinder-790492-4-iscsi neutron-server[91829]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 25 17:08:10.057587 dv-cinder-790492-4-iscsi neutron-server[91829]: event.method(event) May 25 17:08:10.057587 dv-cinder-790492-4-iscsi neutron-server[91829]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 25 17:08:10.057587 dv-cinder-790492-4-iscsi neutron-server[91829]: aggregate_id = self._get_aggregate_id(event.segment_id) May 25 17:08:10.057587 dv-cinder-790492-4-iscsi neutron-server[91829]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 25 17:08:10.057587 dv-cinder-790492-4-iscsi neutron-server[91829]: aggregate_uuid = self.p_client.list_aggregates( May 25 17:08:10.057587 dv-cinder-790492-4-iscsi neutron-server[91829]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 25 17:08:10.057587 dv-cinder-790492-4-iscsi neutron-server[91829]: return f(self, *a, **k) May 25 17:08:10.057587 dv-cinder-790492-4-iscsi neutron-server[91829]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 25 17:08:10.057587 dv-cinder-790492-4-iscsi neutron-server[91829]: return self._get(url).json() May 25 17:08:10.057587 dv-cinder-790492-4-iscsi neutron-server[91829]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 25 17:08:10.057587 dv-cinder-790492-4-iscsi neutron-server[91829]: return self._client.get(url, endpoint_filter=self._ks_filter, May 25 17:08:10.057587 dv-cinder-790492-4-iscsi neutron-server[91829]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 25 17:08:10.057587 dv-cinder-790492-4-iscsi neutron-server[91829]: return self.request(url, 'GET', **kwargs) May 25 17:08:10.057587 dv-cinder-790492-4-iscsi neutron-server[91829]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 25 17:08:10.057587 dv-cinder-790492-4-iscsi neutron-server[91829]: base_url = self.get_endpoint(auth, allow=allow, May 25 17:08:10.057587 dv-cinder-790492-4-iscsi neutron-server[91829]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 25 17:08:10.057587 dv-cinder-790492-4-iscsi neutron-server[91829]: auth = self._auth_required(auth, 'determine endpoint URL') May 25 17:08:10.057587 dv-cinder-790492-4-iscsi neutron-server[91829]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 25 17:08:10.057587 dv-cinder-790492-4-iscsi neutron-server[91829]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 25 17:08:10.057587 dv-cinder-790492-4-iscsi neutron-server[91829]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 25 17:08:10.063487 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.plugin [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] No Port match for: 282005bd-4eac-4a0e-8b78-006226f21c55 {{(pid=91831) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}} May 25 17:08:10.063841 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.rpc [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Device 282005bd-4eac-4a0e-8b78-006226f21c55 not bound to the agent host dv-cinder-790492-4-iscsi {{(pid=91831) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 25 17:08:10.159580 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-c055b19d-9640-48fc-863a-b783e441f0e7 req-7fb65774-43ee-4ac7-bfa1-62a0f0bedd9d tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] 10.222.0.62 "GET /v2.0/security-groups?id=58fab80b-49b2-4bca-89e6-fef7473221ef&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1174819 May 25 17:08:10.161551 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-6a324333-237c-4c25-b6ff-2f9f9c3c2a98 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3858252', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-640806', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-551400', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-683051'] for network, after_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:08:10.165068 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:08:10.179128 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-6a324333-237c-4c25-b6ff-2f9f9c3c2a98 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-551373'] for network, before_response {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:08:10.187439 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.wsgi [-] (91830) accepted ('10.222.0.62', 36392) {{(pid=91830) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:08:10.190286 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6a324333-237c-4c25-b6ff-2f9f9c3c2a98 admin admin] Pushing event deleted for resources: {'Network': ['ID=613457eb-6f6d-4604-8f6c-f2d318ff9bc5,revision_number=None']} {{(pid=91829) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:08:10.193502 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-6a324333-237c-4c25-b6ff-2f9f9c3c2a98 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.028s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:08:10.204679 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [None req-6a324333-237c-4c25-b6ff-2f9f9c3c2a98 admin admin] 10.222.0.62 "DELETE /v2.0/networks/613457eb-6f6d-4604-8f6c-f2d318ff9bc5 HTTP/1.1" status: 204 len: 168 time: 1.1323817 May 25 17:08:10.207572 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.wsgi [-] (91829) accepted ('10.222.0.62', 36398) {{(pid=91829) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:08:10.312487 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-94d4ff98-63e2-4ba0-af0f-b8d6423fb949 tempest-TestVolumeBootPattern-1585578645 tempest-TestVolumeBootPattern-1585578645-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91830) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:08:10.313196 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [None req-94d4ff98-63e2-4ba0-af0f-b8d6423fb949 tempest-TestVolumeBootPattern-1585578645 tempest-TestVolumeBootPattern-1585578645-project-admin] Synchronizing usage tracker for tenant:ebceaa13caaa4258abf32e19141de493 on resource:port {{(pid=91830) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 25 17:08:10.329670 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [None req-94d4ff98-63e2-4ba0-af0f-b8d6423fb949 tempest-TestVolumeBootPattern-1585578645 tempest-TestVolumeBootPattern-1585578645-project-admin] Unset dirty status for tenant:ebceaa13caaa4258abf32e19141de493 on resource:port {{(pid=91830) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 25 17:08:10.330859 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [None req-94d4ff98-63e2-4ba0-af0f-b8d6423fb949 tempest-TestVolumeBootPattern-1585578645 tempest-TestVolumeBootPattern-1585578645-project-admin] 10.222.0.62 "GET /v2.0/ports?device_id=8af1dd48-45a0-4c07-9019-859effb1b06d HTTP/1.1" status: 200 len: 1093 time: 0.1424289 May 25 17:08:10.333737 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.wsgi [-] (91830) accepted ('10.222.0.62', 36402) {{(pid=91830) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:08:10.338778 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.v2.base [None req-fe569bd0-4673-4308-99d9-afc2ff7aafe3 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Request body: {'floatingip': {'floating_network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'port_id': '0b29d882-4e62-44e0-acc0-5deb97293c57', 'tenant_id': '5397bf60956945c3a2bf43c6b1aa614b', 'fixed_ip_address': '172.20.0.9'}} {{(pid=91830) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 17:08:10.344484 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.quota.driver [None req-fe569bd0-4673-4308-99d9-afc2ff7aafe3 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91830) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 17:08:10.348194 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [None req-fe569bd0-4673-4308-99d9-afc2ff7aafe3 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Usage tracker for resource:floatingip and tenant:5397bf60956945c3a2bf43c6b1aa614b is out of sync, need to count used quota {{(pid=91830) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 17:08:10.351000 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [None req-fe569bd0-4673-4308-99d9-afc2ff7aafe3 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Quota usage for floatingip was recalculated. Used quota:0. {{(pid=91830) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 17:08:10.357418 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.quota.driver [None req-fe569bd0-4673-4308-99d9-afc2ff7aafe3 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Attempting to reserve 1 items for resource floatingip. Total usage: 0; quota limit: 50; headroom:50 {{(pid=91830) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 17:08:10.371627 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-fe569bd0-4673-4308-99d9-afc2ff7aafe3 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Notify callbacks [] for floatingip, before_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:08:10.505798 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-fe569bd0-4673-4308-99d9-afc2ff7aafe3 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3832070'] for port, before_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:08:10.642351 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.db_base_plugin_common [None req-fe569bd0-4673-4308-99d9-afc2ff7aafe3 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Allocated IP 172.27.2.164 (4364b6ab-4117-4a92-baeb-f5ee2f45bf74/b947e790-d731-4b63-afc4-4aa112afe0f6/30ba6fd4-41df-4530-8e1d-306e49a95743) {{(pid=91830) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 25 17:08:10.750060 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-92f34ba3-c69d-41db-b55f-403b855654ab admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-679979'] for router_interface, before_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:08:10.792630 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-fe569bd0-4673-4308-99d9-afc2ff7aafe3 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Notify callbacks [] for port, precommit_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:08:10.822307 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-fe569bd0-4673-4308-99d9-afc2ff7aafe3 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8757892520915', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-27483019'] for port, after_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:08:10.826762 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-64442b91-1a28-4d7d-b9ec-f1cb42b9f2bd admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:08:10.892212 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-fe569bd0-4673-4308-99d9-afc2ff7aafe3 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Network 4364b6ab-4117-4a92-baeb-f5ee2f45bf74 is already hosted by enough agents. {{(pid=91830) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 25 17:08:10.895142 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.scheduler.base_scheduler [None req-fe569bd0-4673-4308-99d9-afc2ff7aafe3 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Resources bound (agent type, host, resource id): {{(pid=91830) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 17:08:10.899332 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fe569bd0-4673-4308-99d9-afc2ff7aafe3 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Received port after_create {{(pid=91830) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 25 17:08:10.943139 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fe569bd0-4673-4308-99d9-afc2ff7aafe3 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Pushing event updated for resources: {'Port': ['ID=30ba6fd4-41df-4530-8e1d-306e49a95743,revision_number=1']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:08:10.948076 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-fe569bd0-4673-4308-99d9-afc2ff7aafe3 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.121s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:08:11.287338 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.plugins.ml2.plugin [None req-92f34ba3-c69d-41db-b55f-403b855654ab admin admin] Deleting port a713d455-65c7-40a2-ac4c-0b352efc4cd0 {{(pid=91829) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 25 17:08:11.287932 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-92f34ba3-c69d-41db-b55f-403b855654ab admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8757892952899'] for port, before_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:08:11.408280 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.plugins.ml2.db [None req-92f34ba3-c69d-41db-b55f-403b855654ab admin admin] For port a713d455-65c7-40a2-ac4c-0b352efc4cd0, host dv-cinder-790492-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-790492-4-iscsi',level=0,port_id=a713d455-65c7-40a2-ac4c-0b352efc4cd0,segment=NetworkSegment(cb1a8cf9-1f34-483f-8b10-2d2767734b93),segment_id=cb1a8cf9-1f34-483f-8b10-2d2767734b93)] {{(pid=91829) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 17:08:11.408636 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-92f34ba3-c69d-41db-b55f-403b855654ab admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-683770'] for port, precommit_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:08:11.414162 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-fe569bd0-4673-4308-99d9-afc2ff7aafe3 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Notify callbacks [] for floatingip, precommit_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:08:11.489247 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-fe569bd0-4673-4308-99d9-afc2ff7aafe3 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3832070'] for port, before_update {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:08:11.532086 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.plugins.ml2.plugin [None req-92f34ba3-c69d-41db-b55f-403b855654ab admin admin] Calling delete_port for a713d455-65c7-40a2-ac4c-0b352efc4cd0 owned by network:router_interface {{(pid=91829) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 25 17:08:11.682506 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-92f34ba3-c69d-41db-b55f-403b855654ab admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8757892955046', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8757892520924', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28230808'] for port, after_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:08:11.687351 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-a01cbb65-e7a7-41b8-95ec-ab292e2a3a9b tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:08:11.696880 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-fe569bd0-4673-4308-99d9-afc2ff7aafe3 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Notify callbacks [] for port, precommit_update {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:08:11.702832 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-fe569bd0-4673-4308-99d9-afc2ff7aafe3 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8757892955028', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8757892520933', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8757892521750', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-27483010'] for port, after_update {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:08:11.706373 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-4e460861-9934-411b-ac4d-726f1f5a043b service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:08:11.762980 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-92f34ba3-c69d-41db-b55f-403b855654ab admin admin] Pushing event deleted for resources: {'Port': ['ID=a713d455-65c7-40a2-ac4c-0b352efc4cd0,revision_number=None']} {{(pid=91829) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:08:11.768788 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-92f34ba3-c69d-41db-b55f-403b855654ab admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.081s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:08:11.825973 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fe569bd0-4673-4308-99d9-afc2ff7aafe3 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Pushing event updated for resources: {'Port': ['ID=30ba6fd4-41df-4530-8e1d-306e49a95743,revision_number=2']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:08:11.830608 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-fe569bd0-4673-4308-99d9-afc2ff7aafe3 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-683033'] for floatingip, after_update {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:08:11.884432 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-fe569bd0-4673-4308-99d9-afc2ff7aafe3 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.178s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:08:12.020546 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-92f34ba3-c69d-41db-b55f-403b855654ab admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-551393', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-682171'] for router_interface, after_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:08:12.021867 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.db.l3_db [None req-fe569bd0-4673-4308-99d9-afc2ff7aafe3 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Floating IP c1e3ebd3-1b86-4539-8592-0028e75cf6d4 associated. External IP: 172.27.2.164, port: 0b29d882-4e62-44e0-acc0-5deb97293c57. May 25 17:08:12.370592 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-fe569bd0-4673-4308-99d9-afc2ff7aafe3 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Router 269c6b7b-91cc-4880-9e6d-b8889bac29f6 has already been hosted by L3 agent a2d427c1-2d07-43e8-afbe-218c9f7d0445 {{(pid=91830) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 25 17:08:12.388362 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-92f34ba3-c69d-41db-b55f-403b855654ab admin admin] Router efdd8e5d-d3d0-40ed-9f26-6c99ecf4debd has already been hosted by L3 agent a2d427c1-2d07-43e8-afbe-218c9f7d0445 {{(pid=91829) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 25 17:08:12.661548 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-fe569bd0-4673-4308-99d9-afc2ff7aafe3 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Notify agent at l3_agent.dv-cinder-790492-4-iscsi the message routers_updated {{(pid=91830) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 25 17:08:12.671603 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c5cc6896-70a1-441e-9354-d98ad7ab27e1 None None] Sync routers for ids ['269c6b7b-91cc-4880-9e6d-b8889bac29f6'] in dv-cinder-790492-4-iscsi {{(pid=91832) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 25 17:08:12.680944 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c5cc6896-70a1-441e-9354-d98ad7ab27e1 None None] Routers {'269c6b7b-91cc-4880-9e6d-b8889bac29f6'} bound to L3 agent in host dv-cinder-790492-4-iscsi {{(pid=91832) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 17:08:12.681142 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-92f34ba3-c69d-41db-b55f-403b855654ab admin admin] Notify agent at l3_agent.dv-cinder-790492-4-iscsi the message routers_updated {{(pid=91829) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 25 17:08:12.681679 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.db.l3_hamode_db [None req-c5cc6896-70a1-441e-9354-d98ad7ab27e1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-790492-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-05-25T16:50:28Z,description=,heartbeat_timestamp=2021-05-25T17:07:58Z,host='dv-cinder-790492-4-iscsi',id=a2d427c1-2d07-43e8-afbe-218c9f7d0445,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T16:50:28Z,topic='l3_agent')) {'router_ids': ['269c6b7b-91cc-4880-9e6d-b8889bac29f6'], 'active': True} {{(pid=91832) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 17:08:12.688211 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-fe569bd0-4673-4308-99d9-afc2ff7aafe3 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-178712'] for floatingip, before_response {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:08:12.692313 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bb178611-43b4-4dd0-822d-fee93202b07d None None] Sync routers for ids ['efdd8e5d-d3d0-40ed-9f26-6c99ecf4debd'] in dv-cinder-790492-4-iscsi {{(pid=91831) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 25 17:08:12.705416 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bb178611-43b4-4dd0-822d-fee93202b07d None None] Routers {'efdd8e5d-d3d0-40ed-9f26-6c99ecf4debd'} bound to L3 agent in host dv-cinder-790492-4-iscsi {{(pid=91831) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 17:08:12.710469 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.l3_hamode_db [None req-bb178611-43b4-4dd0-822d-fee93202b07d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-790492-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-05-25T16:50:28Z,description=,heartbeat_timestamp=2021-05-25T17:07:58Z,host='dv-cinder-790492-4-iscsi',id=a2d427c1-2d07-43e8-afbe-218c9f7d0445,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T16:50:28Z,topic='l3_agent')) {'router_ids': ['efdd8e5d-d3d0-40ed-9f26-6c99ecf4debd'], 'active': True} {{(pid=91831) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 17:08:12.720752 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [None req-92f34ba3-c69d-41db-b55f-403b855654ab admin admin] 10.222.0.62 "PUT /v2.0/routers/efdd8e5d-d3d0-40ed-9f26-6c99ecf4debd/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 2.5099142 May 25 17:08:12.720997 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.wsgi [-] (91829) accepted ('10.222.0.62', 36410) {{(pid=91829) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:08:12.766759 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [None req-fe569bd0-4673-4308-99d9-afc2ff7aafe3 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] 10.222.0.62 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 996 time: 2.4319153 May 25 17:08:12.767461 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '8af1dd48-45a0-4c07-9019-859effb1b06d', 'tag': '0b29d882-4e62-44e0-acc0-5deb97293c57'}] {{(pid=91830) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 25 17:08:12.828024 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '8af1dd48-45a0-4c07-9019-859effb1b06d', 'tag': '0b29d882-4e62-44e0-acc0-5deb97293c57', 'status': 'completed', 'code': 200} May 25 17:08:12.887452 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.db.l3_dvr_db [None req-c5cc6896-70a1-441e-9354-d98ad7ab27e1 None None] Set router 269c6b7b-91cc-4880-9e6d-b8889bac29f6 gateway port host: dv-cinder-790492-4-iscsi {{(pid=91832) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 17:08:12.909259 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.l3_dvr_db [None req-bb178611-43b4-4dd0-822d-fee93202b07d None None] Set router efdd8e5d-d3d0-40ed-9f26-6c99ecf4debd gateway port host: dv-cinder-790492-4-iscsi {{(pid=91831) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 17:08:12.980549 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-ac1e31bd-f0ca-4d33-af28-8e55bfe55694 admin admin] Notify callbacks [] for router, before_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:08:13.154858 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-de36e597-e598-452d-82e0-b6d0fc81d921 req-430ea6d0-a72d-40e3-8b45-c3e56cf72512 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:08:13.156669 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-de36e597-e598-452d-82e0-b6d0fc81d921 req-430ea6d0-a72d-40e3-8b45-c3e56cf72512 service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=5397bf60956945c3a2bf43c6b1aa614b&device_id=8af1dd48-45a0-4c07-9019-859effb1b06d HTTP/1.1" status: 200 len: 1098 time: 0.2690015 May 25 17:08:13.253852 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.l3_hamode_db [None req-bb178611-43b4-4dd0-822d-fee93202b07d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'efdd8e5d-d3d0-40ed-9f26-6c99ecf4debd', 'name': 'tempest-TestShelveInstance-1848885781-router', 'tenant_id': '6a788f87b23b492da7fbfb18883b9d2d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'external_fixed_ips': [{'subnet_id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'ip_address': '172.27.2.5'}], 'enable_snat': True}, 'gw_port_id': 'f2ed4d81-44b1-4fbd-a5db-c3ed5a03b7de', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T17:00:23Z', 'updated_at': '2021-05-25T17:08:11Z', 'revision_number': 5, 'project_id': '6a788f87b23b492da7fbfb18883b9d2d', 'gw_port': {'id': 'f2ed4d81-44b1-4fbd-a5db-c3ed5a03b7de', 'name': '', 'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'tenant_id': '', 'mac_address': 'fa:16:3e:f1:11:4f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'efdd8e5d-d3d0-40ed-9f26-6c99ecf4debd', 'device_owner': 'network:router_gateway', 'standard_attr_id': 323, 'fixed_ips': [{'subnet_id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'ip_address': '172.27.2.5', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790492-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:00:25Z', 'updated_at': '2021-05-25T17:00:34Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-790492-4-iscsi'}], 'dv-cinder-790492-4-iscsi', False) {} {{(pid=91831) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 17:08:13.257679 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bb178611-43b4-4dd0-822d-fee93202b07d None None] Checking router: efdd8e5d-d3d0-40ed-9f26-6c99ecf4debd for host: dv-cinder-790492-4-iscsi {{(pid=91831) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 25 17:08:13.262160 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.db.l3_hamode_db [None req-c5cc6896-70a1-441e-9354-d98ad7ab27e1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '269c6b7b-91cc-4880-9e6d-b8889bac29f6', 'name': 'tempest-TestVolumeBootPattern-219116984-router', 'tenant_id': '5397bf60956945c3a2bf43c6b1aa614b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'external_fixed_ips': [{'subnet_id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'ip_address': '172.27.2.227'}], 'enable_snat': True}, 'gw_port_id': '2fef7852-acf7-462f-beee-5679d3df0ad2', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T17:07:09Z', 'updated_at': '2021-05-25T17:07:13Z', 'revision_number': 4, 'project_id': '5397bf60956945c3a2bf43c6b1aa614b', 'gw_port': {'id': '2fef7852-acf7-462f-beee-5679d3df0ad2', 'name': '', 'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'tenant_id': '', 'mac_address': 'fa:16:3e:35:b9:d0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '269c6b7b-91cc-4880-9e6d-b8889bac29f6', 'device_owner': 'network:router_gateway', 'standard_attr_id': 533, 'fixed_ips': [{'subnet_id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'ip_address': '172.27.2.227', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790492-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:07:09Z', 'updated_at': '2021-05-25T17:07:16Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-790492-4-iscsi', '_floatingips': [{'id': 'c1e3ebd3-1b86-4539-8592-0028e75cf6d4', 'tenant_id': '5397bf60956945c3a2bf43c6b1aa614b', 'floating_ip_address': '172.27.2.164', 'floating_network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'router_id': '269c6b7b-91cc-4880-9e6d-b8889bac29f6', 'port_id': '0b29d882-4e62-44e0-acc0-5deb97293c57', 'fixed_ip_address': '172.20.0.9', 'status': 'DOWN', 'standard_attr_id': 566, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '17a0e39e-1e1f-4550-b28b-d5ae3bdca362', 'mac_address': 'fa:16:3e:c3:a2:21', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8af1dd48-45a0-4c07-9019-859effb1b06d', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-25T17:08:11Z', 'updated_at': '2021-05-25T17:08:11Z', 'revision_number': 0, 'project_id': '5397bf60956945c3a2bf43c6b1aa614b', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '4972e3a9-91eb-48ce-8b7b-b0906822cebf', 'name': '', 'network_id': '17a0e39e-1e1f-4550-b28b-d5ae3bdca362', 'tenant_id': '5397bf60956945c3a2bf43c6b1aa614b', 'mac_address': 'fa:16:3e:ce:fe:1a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '269c6b7b-91cc-4880-9e6d-b8889bac29f6', 'device_owner': 'network:router_interface', 'standard_attr_id': 534, 'fixed_ips': [{'subnet_id': 'f5599a2e-9942-4423-a1ac-67e9b2650770', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790492-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:07:12Z', 'updated_at': '2021-05-25T17:07:20Z', 'revision_number': 5, 'project_id': '5397bf60956945c3a2bf43c6b1aa614b', 'subnets': [{'id': 'f5599a2e-9942-4423-a1ac-67e9b2650770', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-790492-4-iscsi', False) {} {{(pid=91832) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 17:08:13.266353 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bb178611-43b4-4dd0-822d-fee93202b07d None None] Routers {'efdd8e5d-d3d0-40ed-9f26-6c99ecf4debd'} bound to L3 agent in host dv-cinder-790492-4-iscsi {{(pid=91831) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 17:08:13.266491 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c5cc6896-70a1-441e-9354-d98ad7ab27e1 None None] Checking router: 269c6b7b-91cc-4880-9e6d-b8889bac29f6 for host: dv-cinder-790492-4-iscsi {{(pid=91832) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 25 17:08:13.266975 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.l3_hamode_db [None req-bb178611-43b4-4dd0-822d-fee93202b07d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-790492-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-05-25T16:50:28Z,description=,heartbeat_timestamp=2021-05-25T17:07:58Z,host='dv-cinder-790492-4-iscsi',id=a2d427c1-2d07-43e8-afbe-218c9f7d0445,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T16:50:28Z,topic='l3_agent')) {'router_ids': ['efdd8e5d-d3d0-40ed-9f26-6c99ecf4debd'], 'active': True} {{(pid=91831) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 17:08:13.272546 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-ac1e31bd-f0ca-4d33-af28-8e55bfe55694 admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:08:13.275663 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c5cc6896-70a1-441e-9354-d98ad7ab27e1 None None] Routers {'269c6b7b-91cc-4880-9e6d-b8889bac29f6'} bound to L3 agent in host dv-cinder-790492-4-iscsi {{(pid=91832) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 17:08:13.276263 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.db.l3_hamode_db [None req-c5cc6896-70a1-441e-9354-d98ad7ab27e1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-790492-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-05-25T16:50:28Z,description=,heartbeat_timestamp=2021-05-25T17:07:58Z,host='dv-cinder-790492-4-iscsi',id=a2d427c1-2d07-43e8-afbe-218c9f7d0445,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T16:50:28Z,topic='l3_agent')) {'router_ids': ['269c6b7b-91cc-4880-9e6d-b8889bac29f6'], 'active': True} {{(pid=91832) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 17:08:13.356568 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-de36e597-e598-452d-82e0-b6d0fc81d921 req-4a825b82-f1a7-4027-a755-a2631145d00e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:08:13.358053 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-de36e597-e598-452d-82e0-b6d0fc81d921 req-4a825b82-f1a7-4027-a755-a2631145d00e service neutron] 10.222.0.32 "GET /v2.0/networks?id=17a0e39e-1e1f-4550-b28b-d5ae3bdca362 HTTP/1.1" status: 200 len: 912 time: 0.1943021 May 25 17:08:13.425773 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.l3_dvr_db [None req-bb178611-43b4-4dd0-822d-fee93202b07d None None] Set router efdd8e5d-d3d0-40ed-9f26-6c99ecf4debd gateway port host: None {{(pid=91831) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 17:08:13.462151 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.plugins.ml2.plugin [None req-ac1e31bd-f0ca-4d33-af28-8e55bfe55694 admin admin] Deleting port f2ed4d81-44b1-4fbd-a5db-c3ed5a03b7de {{(pid=91829) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 25 17:08:13.462791 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-ac1e31bd-f0ca-4d33-af28-8e55bfe55694 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8757892952899'] for port, before_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:08:13.485748 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.db.l3_dvr_db [None req-c5cc6896-70a1-441e-9354-d98ad7ab27e1 None None] Set router 269c6b7b-91cc-4880-9e6d-b8889bac29f6 gateway port host: dv-cinder-790492-4-iscsi {{(pid=91832) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 17:08:13.534014 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.l3_hamode_db [None req-bb178611-43b4-4dd0-822d-fee93202b07d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'efdd8e5d-d3d0-40ed-9f26-6c99ecf4debd', 'name': 'tempest-TestShelveInstance-1848885781-router', 'tenant_id': '6a788f87b23b492da7fbfb18883b9d2d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T17:00:23Z', 'updated_at': '2021-05-25T17:08:13Z', 'revision_number': 6, 'project_id': '6a788f87b23b492da7fbfb18883b9d2d', 'gw_port_host': None}], 'dv-cinder-790492-4-iscsi', False) {} {{(pid=91831) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 17:08:13.538257 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bb178611-43b4-4dd0-822d-fee93202b07d None None] The sync data for ids ['efdd8e5d-d3d0-40ed-9f26-6c99ecf4debd'] in dv-cinder-790492-4-iscsi is: [{'id': 'efdd8e5d-d3d0-40ed-9f26-6c99ecf4debd', 'name': 'tempest-TestShelveInstance-1848885781-router', 'tenant_id': '6a788f87b23b492da7fbfb18883b9d2d', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T17:00:23Z', 'updated_at': '2021-05-25T17:08:13Z', 'revision_number': 6, 'project_id': '6a788f87b23b492da7fbfb18883b9d2d', 'gw_port_host': None}] {{(pid=91831) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 25 17:08:13.541195 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-de36e597-e598-452d-82e0-b6d0fc81d921 req-469a1520-db41-4b6a-99f1-fd5744b6751b service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=0b29d882-4e62-44e0-acc0-5deb97293c57 HTTP/1.1" status: 200 len: 999 time: 0.1690052 May 25 17:08:13.647781 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.plugins.ml2.db [None req-ac1e31bd-f0ca-4d33-af28-8e55bfe55694 admin admin] For port f2ed4d81-44b1-4fbd-a5db-c3ed5a03b7de, host dv-cinder-790492-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-790492-4-iscsi',level=0,port_id=f2ed4d81-44b1-4fbd-a5db-c3ed5a03b7de,segment=NetworkSegment(414a8468-1d66-4792-9e81-d8ac5ccf1512),segment_id=414a8468-1d66-4792-9e81-d8ac5ccf1512)] {{(pid=91829) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 17:08:13.648133 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-ac1e31bd-f0ca-4d33-af28-8e55bfe55694 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-683770'] for port, precommit_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:08:13.663459 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-de36e597-e598-452d-82e0-b6d0fc81d921 req-1e1ff424-579b-46c0-95e7-d9b96f16e396 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:08:13.664926 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-de36e597-e598-452d-82e0-b6d0fc81d921 req-1e1ff424-579b-46c0-95e7-d9b96f16e396 service neutron] 10.222.0.32 "GET /v2.0/subnets?id=f5599a2e-9942-4423-a1ac-67e9b2650770 HTTP/1.1" status: 200 len: 850 time: 0.0927896 May 25 17:08:13.807424 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.plugins.ml2.plugin [None req-ac1e31bd-f0ca-4d33-af28-8e55bfe55694 admin admin] Calling delete_port for f2ed4d81-44b1-4fbd-a5db-c3ed5a03b7de owned by network:router_gateway {{(pid=91829) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 25 17:08:13.831799 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.db.l3_hamode_db [None req-c5cc6896-70a1-441e-9354-d98ad7ab27e1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '269c6b7b-91cc-4880-9e6d-b8889bac29f6', 'name': 'tempest-TestVolumeBootPattern-219116984-router', 'tenant_id': '5397bf60956945c3a2bf43c6b1aa614b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'external_fixed_ips': [{'subnet_id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'ip_address': '172.27.2.227'}], 'enable_snat': True}, 'gw_port_id': '2fef7852-acf7-462f-beee-5679d3df0ad2', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T17:07:09Z', 'updated_at': '2021-05-25T17:07:13Z', 'revision_number': 4, 'project_id': '5397bf60956945c3a2bf43c6b1aa614b', 'gw_port': {'id': '2fef7852-acf7-462f-beee-5679d3df0ad2', 'name': '', 'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'tenant_id': '', 'mac_address': 'fa:16:3e:35:b9:d0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '269c6b7b-91cc-4880-9e6d-b8889bac29f6', 'device_owner': 'network:router_gateway', 'standard_attr_id': 533, 'fixed_ips': [{'subnet_id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'ip_address': '172.27.2.227', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790492-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:07:09Z', 'updated_at': '2021-05-25T17:07:16Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-790492-4-iscsi', '_floatingips': [{'id': 'c1e3ebd3-1b86-4539-8592-0028e75cf6d4', 'tenant_id': '5397bf60956945c3a2bf43c6b1aa614b', 'floating_ip_address': '172.27.2.164', 'floating_network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'router_id': '269c6b7b-91cc-4880-9e6d-b8889bac29f6', 'port_id': '0b29d882-4e62-44e0-acc0-5deb97293c57', 'fixed_ip_address': '172.20.0.9', 'status': 'DOWN', 'standard_attr_id': 566, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '17a0e39e-1e1f-4550-b28b-d5ae3bdca362', 'mac_address': 'fa:16:3e:c3:a2:21', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8af1dd48-45a0-4c07-9019-859effb1b06d', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-25T17:08:11Z', 'updated_at': '2021-05-25T17:08:11Z', 'revision_number': 0, 'project_id': '5397bf60956945c3a2bf43c6b1aa614b', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '4972e3a9-91eb-48ce-8b7b-b0906822cebf', 'name': '', 'network_id': '17a0e39e-1e1f-4550-b28b-d5ae3bdca362', 'tenant_id': '5397bf60956945c3a2bf43c6b1aa614b', 'mac_address': 'fa:16:3e:ce:fe:1a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '269c6b7b-91cc-4880-9e6d-b8889bac29f6', 'device_owner': 'network:router_interface', 'standard_attr_id': 534, 'fixed_ips': [{'subnet_id': 'f5599a2e-9942-4423-a1ac-67e9b2650770', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790492-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:07:12Z', 'updated_at': '2021-05-25T17:07:20Z', 'revision_number': 5, 'project_id': '5397bf60956945c3a2bf43c6b1aa614b', 'subnets': [{'id': 'f5599a2e-9942-4423-a1ac-67e9b2650770', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-790492-4-iscsi', False) {} {{(pid=91832) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 17:08:13.835729 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c5cc6896-70a1-441e-9354-d98ad7ab27e1 None None] The sync data for ids ['269c6b7b-91cc-4880-9e6d-b8889bac29f6'] in dv-cinder-790492-4-iscsi is: [{'id': '269c6b7b-91cc-4880-9e6d-b8889bac29f6', 'name': 'tempest-TestVolumeBootPattern-219116984-router', 'tenant_id': '5397bf60956945c3a2bf43c6b1aa614b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'external_fixed_ips': [{'subnet_id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'ip_address': '172.27.2.227'}], 'enable_snat': True}, 'gw_port_id': '2fef7852-acf7-462f-beee-5679d3df0ad2', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T17:07:09Z', 'updated_at': '2021-05-25T17:07:13Z', 'revision_number': 4, 'project_id': '5397bf60956945c3a2bf43c6b1aa614b', 'gw_port': {'id': '2fef7852-acf7-462f-beee-5679d3df0ad2', 'name': '', 'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'tenant_id': '', 'mac_address': 'fa:16:3e:35:b9:d0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '269c6b7b-91cc-4880-9e6d-b8889bac29f6', 'device_owner': 'network:router_gateway', 'standard_attr_id': 533, 'fixed_ips': [{'subnet_id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'ip_address': '172.27.2.227', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790492-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:07:09Z', 'updated_at': '2021-05-25T17:07:16Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-790492-4-iscsi', '_floatingips': [{'id': 'c1e3ebd3-1b86-4539-8592-0028e75cf6d4', 'tenant_id': '5397bf60956945c3a2bf43c6b1aa614b', 'floating_ip_address': '172.27.2.164', 'floating_network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'router_id': '269c6b7b-91cc-4880-9e6d-b8889bac29f6', 'port_id': '0b29d882-4e62-44e0-acc0-5deb97293c57', 'fixed_ip_address': '172.20.0.9', 'status': 'DOWN', 'standard_attr_id': 566, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '17a0e39e-1e1f-4550-b28b-d5ae3bdca362', 'mac_address': 'fa:16:3e:c3:a2:21', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8af1dd48-45a0-4c07-9019-859effb1b06d', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-25T17:08:11Z', 'updated_at': '2021-05-25T17:08:11Z', 'revision_number': 0, 'project_id': '5397bf60956945c3a2bf43c6b1aa614b', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '4972e3a9-91eb-48ce-8b7b-b0906822cebf', 'name': '', 'network_id': '17a0e39e-1e1f-4550-b28b-d5ae3bdca362', 'tenant_id': '5397bf60956945c3a2bf43c6b1aa614b', 'mac_address': 'fa:16:3e:ce:fe:1a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '269c6b7b-91cc-4880-9e6d-b8889bac29f6', 'device_owner': 'network:router_interface', 'standard_attr_id': 534, 'fixed_ips': [{'subnet_id': 'f5599a2e-9942-4423-a1ac-67e9b2650770', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790492-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:07:12Z', 'updated_at': '2021-05-25T17:07:20Z', 'revision_number': 5, 'project_id': '5397bf60956945c3a2bf43c6b1aa614b', 'subnets': [{'id': 'f5599a2e-9942-4423-a1ac-67e9b2650770', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=91832) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 25 17:08:13.867978 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-de36e597-e598-452d-82e0-b6d0fc81d921 req-f0c8d891-3b7b-4e40-97d9-f8b9a45ca0e2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:08:13.870006 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-de36e597-e598-452d-82e0-b6d0fc81d921 req-f0c8d891-3b7b-4e40-97d9-f8b9a45ca0e2 service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=17a0e39e-1e1f-4550-b28b-d5ae3bdca362&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.1560576 May 25 17:08:13.924528 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.rpc [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Device a713d455-65c7-40a2-ac4c-0b352efc4cd0 no longer exists at agent ovs-agent-dv-cinder-790492-4-iscsi {{(pid=91831) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 25 17:08:13.965084 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.plugin [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] No Port match for: a713d455-65c7-40a2-ac4c-0b352efc4cd0 {{(pid=91831) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}} May 25 17:08:13.965455 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.rpc [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Device a713d455-65c7-40a2-ac4c-0b352efc4cd0 not bound to the agent host dv-cinder-790492-4-iscsi {{(pid=91831) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 25 17:08:14.076530 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2029bd67-3dbb-4c68-957b-08010c4ee85f None None] New status for floating IP c1e3ebd3-1b86-4539-8592-0028e75cf6d4: ACTIVE {{(pid=91832) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} May 25 17:08:14.156060 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-de36e597-e598-452d-82e0-b6d0fc81d921 req-79d612a5-ba7b-4805-9447-a1f7dc9c417c service neutron] 10.222.0.32 "GET /v2.0/networks/17a0e39e-1e1f-4550-b28b-d5ae3bdca362?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2746513 May 25 17:08:14.309322 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-ac1e31bd-f0ca-4d33-af28-8e55bfe55694 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8757892955046', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8757892520924', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28230808'] for port, after_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:08:14.315022 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-6a05ffe7-47b4-4052-a66d-6a288a2748d7 tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:08:14.373715 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ac1e31bd-f0ca-4d33-af28-8e55bfe55694 admin admin] Pushing event deleted for resources: {'Port': ['ID=f2ed4d81-44b1-4fbd-a5db-c3ed5a03b7de,revision_number=None']} {{(pid=91829) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:08:14.379354 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-ac1e31bd-f0ca-4d33-af28-8e55bfe55694 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.064s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:08:14.413819 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-de36e597-e598-452d-82e0-b6d0fc81d921 req-fa10b23e-c2cb-4358-a481-d3e04678cdac service neutron] 10.222.0.32 "GET /v2.0/networks/17a0e39e-1e1f-4550-b28b-d5ae3bdca362?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2299001 May 25 17:08:14.472669 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-ac1e31bd-f0ca-4d33-af28-8e55bfe55694 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-683062'] for router_gateway, after_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:08:14.646024 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-ac1e31bd-f0ca-4d33-af28-8e55bfe55694 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-684987', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-31024'] for router, precommit_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:08:14.648146 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-ac1e31bd-f0ca-4d33-af28-8e55bfe55694 admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:08:14.670764 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-ac1e31bd-f0ca-4d33-af28-8e55bfe55694 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-685959'] for router, after_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:08:14.671289 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-ac1e31bd-f0ca-4d33-af28-8e55bfe55694 admin admin] Fanout notify agent at l3_agent the message router_deleted on router efdd8e5d-d3d0-40ed-9f26-6c99ecf4debd {{(pid=91829) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}} May 25 17:08:14.684643 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-ac1e31bd-f0ca-4d33-af28-8e55bfe55694 admin admin] Notify callbacks [] for router, before_response {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:08:14.685819 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [None req-ac1e31bd-f0ca-4d33-af28-8e55bfe55694 admin admin] 10.222.0.62 "DELETE /v2.0/routers/efdd8e5d-d3d0-40ed-9f26-6c99ecf4debd HTTP/1.1" status: 204 len: 168 time: 1.9639022 May 25 17:08:14.688507 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.wsgi [-] (91830) accepted ('10.222.0.62', 36422) {{(pid=91830) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:08:14.753207 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.db_base_plugin_v2 [None req-1d10e9ef-9020-45e3-9b32-e13cf29b5ac1 admin admin] Deleting subnet 04a2fff9-c99b-4a81-8cff-a0e02839c1f9 {{(pid=91830) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}} May 25 17:08:14.756885 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-1d10e9ef-9020-45e3-9b32-e13cf29b5ac1 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:08:14.804539 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-1d10e9ef-9020-45e3-9b32-e13cf29b5ac1 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-28085025'] for subnet, precommit_delete_associations {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:08:14.886543 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-1d10e9ef-9020-45e3-9b32-e13cf29b5ac1 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3856586'] for subnet, precommit_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:08:15.133435 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-1d10e9ef-9020-45e3-9b32-e13cf29b5ac1 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3857535', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55886', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-28085112', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1152740'] for subnet, after_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:08:15.138210 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-c904d6d3-edc9-48fe-9fc9-b0a8e93d9066 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:08:15.178343 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1d10e9ef-9020-45e3-9b32-e13cf29b5ac1 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=04a2fff9-c99b-4a81-8cff-a0e02839c1f9,revision_number=None']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:08:15.180254 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-1d10e9ef-9020-45e3-9b32-e13cf29b5ac1 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-551373'] for subnet, before_response {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:08:15.182717 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-1d10e9ef-9020-45e3-9b32-e13cf29b5ac1 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.045s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:08:15.184976 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-731c01da-5073-4340-aedd-5f7f4f7bd1b9 None None] Network b3bf2911-47e9-4eda-9fe8-ec380a12f536 requested from dv-cinder-790492-4-iscsi {{(pid=91831) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} May 25 17:08:15.187367 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [None req-1d10e9ef-9020-45e3-9b32-e13cf29b5ac1 admin admin] 10.222.0.62 "DELETE /v2.0/subnets/04a2fff9-c99b-4a81-8cff-a0e02839c1f9 HTTP/1.1" status: 204 len: 168 time: 0.4978440 May 25 17:08:15.189795 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.wsgi [-] (91830) accepted ('10.222.0.62', 36426) {{(pid=91830) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:08:15.295461 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-7bf27a5a-bc7c-404a-8456-821154867166 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3867326'] for network, before_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:08:15.368328 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.plugins.ml2.plugin [None req-7bf27a5a-bc7c-404a-8456-821154867166 admin admin] Deleting port 85d0b73a-29b1-4d99-843e-521434d55130 {{(pid=91830) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 25 17:08:15.368674 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-7bf27a5a-bc7c-404a-8456-821154867166 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8757892952899'] for port, before_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:08:15.442707 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2b84a801-d692-4281-b0f3-c7b59a98d8da None None] DHCP port deletion for b3bf2911-47e9-4eda-9fe8-ec380a12f536 request from dv-cinder-790492-4-iscsi {{(pid=91831) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} May 25 17:08:15.478397 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.plugins.ml2.db [None req-7bf27a5a-bc7c-404a-8456-821154867166 admin admin] For port 85d0b73a-29b1-4d99-843e-521434d55130, host dv-cinder-790492-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-790492-4-iscsi',level=0,port_id=85d0b73a-29b1-4d99-843e-521434d55130,segment=NetworkSegment(cb1a8cf9-1f34-483f-8b10-2d2767734b93),segment_id=cb1a8cf9-1f34-483f-8b10-2d2767734b93)] {{(pid=91830) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 17:08:15.478890 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-7bf27a5a-bc7c-404a-8456-821154867166 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-683770'] for port, precommit_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:08:15.509507 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.plugin [None req-2b84a801-d692-4281-b0f3-c7b59a98d8da None None] Deleting port 85d0b73a-29b1-4d99-843e-521434d55130 {{(pid=91831) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 25 17:08:15.510418 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-2b84a801-d692-4281-b0f3-c7b59a98d8da None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8757892952899'] for port, before_delete {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:08:15.602934 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.plugins.ml2.plugin [None req-7bf27a5a-bc7c-404a-8456-821154867166 admin admin] Calling delete_port for 85d0b73a-29b1-4d99-843e-521434d55130 owned by network:dhcp {{(pid=91830) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 25 17:08:15.607401 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.db [None req-2b84a801-d692-4281-b0f3-c7b59a98d8da None None] For port 85d0b73a-29b1-4d99-843e-521434d55130, host dv-cinder-790492-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-790492-4-iscsi',level=0,port_id=85d0b73a-29b1-4d99-843e-521434d55130,segment=NetworkSegment(cb1a8cf9-1f34-483f-8b10-2d2767734b93),segment_id=cb1a8cf9-1f34-483f-8b10-2d2767734b93)] {{(pid=91831) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 17:08:15.607787 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-2b84a801-d692-4281-b0f3-c7b59a98d8da None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-683770'] for port, precommit_delete {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:08:15.648278 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-7bf27a5a-bc7c-404a-8456-821154867166 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8757892955046', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8757892520924', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-27483019'] for port, after_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:08:15.652780 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-dd6e8004-21bb-45eb-8eb3-38145b043107 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:08:15.699939 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7bf27a5a-bc7c-404a-8456-821154867166 admin admin] Pushing event deleted for resources: {'Port': ['ID=85d0b73a-29b1-4d99-843e-521434d55130,revision_number=None']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:08:15.703020 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-7bf27a5a-bc7c-404a-8456-821154867166 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.050s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:08:15.703787 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7bf27a5a-bc7c-404a-8456-821154867166 admin admin] No DVR routers for this DVR port 85d0b73a-29b1-4d99-843e-521434d55130 on host dv-cinder-790492-4-iscsi {{(pid=91830) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 25 17:08:15.728969 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.plugin [None req-2b84a801-d692-4281-b0f3-c7b59a98d8da None None] Calling delete_port for 85d0b73a-29b1-4d99-843e-521434d55130 owned by network:dhcp {{(pid=91831) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 25 17:08:15.771513 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-2b84a801-d692-4281-b0f3-c7b59a98d8da None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8757892955046', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8757892520924'] for port, after_delete {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:08:15.775029 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:08:15.818063 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2b84a801-d692-4281-b0f3-c7b59a98d8da None None] Pushing event deleted for resources: {'Port': ['ID=85d0b73a-29b1-4d99-843e-521434d55130,revision_number=None']} {{(pid=91831) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:08:15.820077 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-7bf27a5a-bc7c-404a-8456-821154867166 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3858245', 'neutron.services.segments.db._delete_segments_for_network-8757892982492'] for network, precommit_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:08:15.820856 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [None req-2b84a801-d692-4281-b0f3-c7b59a98d8da None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.046s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:08:15.821647 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2b84a801-d692-4281-b0f3-c7b59a98d8da None None] No DVR routers for this DVR port 85d0b73a-29b1-4d99-843e-521434d55130 on host dv-cinder-790492-4-iscsi {{(pid=91831) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 25 17:08:15.833968 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.services.segments.db [None req-7bf27a5a-bc7c-404a-8456-821154867166 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['b3bf2911-47e9-4eda-9fe8-ec380a12f536']}} {{(pid=91830) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 17:08:15.846516 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.services.segments.db [None req-7bf27a5a-bc7c-404a-8456-821154867166 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'cb1a8cf9-1f34-483f-8b10-2d2767734b93') {'for_net_delete': True} {{(pid=91830) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 17:08:15.846812 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.services.segments.db [None req-7bf27a5a-bc7c-404a-8456-821154867166 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'cb1a8cf9-1f34-483f-8b10-2d2767734b93') {} {{(pid=91830) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 17:08:15.858028 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-7bf27a5a-bc7c-404a-8456-821154867166 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8757892991389', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-28085034'] for segment, before_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:08:15.874345 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-7bf27a5a-bc7c-404a-8456-821154867166 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3809789'] for segment, precommit_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:08:15.880330 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-7bf27a5a-bc7c-404a-8456-821154867166 admin admin] Releasing vlan 698 on physical network physnet1 to pool {{(pid=91830) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 25 17:08:15.880708 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-7bf27a5a-bc7c-404a-8456-821154867166 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3809789', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-27483102'] for segment, after_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:08:15.894169 dv-cinder-790492-4-iscsi neutron-server[91830]: Traceback (most recent call last): May 25 17:08:15.894169 dv-cinder-790492-4-iscsi neutron-server[91830]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 25 17:08:15.894169 dv-cinder-790492-4-iscsi neutron-server[91830]: timer() May 25 17:08:15.894169 dv-cinder-790492-4-iscsi neutron-server[91830]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 25 17:08:15.894169 dv-cinder-790492-4-iscsi neutron-server[91830]: cb(*args, **kw) May 25 17:08:15.894169 dv-cinder-790492-4-iscsi neutron-server[91830]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper May 25 17:08:15.894169 dv-cinder-790492-4-iscsi neutron-server[91830]: return func(*args, **kwargs) May 25 17:08:15.894169 dv-cinder-790492-4-iscsi neutron-server[91830]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 25 17:08:15.894169 dv-cinder-790492-4-iscsi neutron-server[91830]: self._notify() May 25 17:08:15.894169 dv-cinder-790492-4-iscsi neutron-server[91830]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 25 17:08:15.894169 dv-cinder-790492-4-iscsi neutron-server[91830]: self.callback(batched_events) May 25 17:08:15.894169 dv-cinder-790492-4-iscsi neutron-server[91830]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 25 17:08:15.894169 dv-cinder-790492-4-iscsi neutron-server[91830]: event.method(event) May 25 17:08:15.894169 dv-cinder-790492-4-iscsi neutron-server[91830]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 25 17:08:15.894169 dv-cinder-790492-4-iscsi neutron-server[91830]: aggregate_id = self._get_aggregate_id(event.segment_id) May 25 17:08:15.894169 dv-cinder-790492-4-iscsi neutron-server[91830]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 25 17:08:15.894169 dv-cinder-790492-4-iscsi neutron-server[91830]: aggregate_uuid = self.p_client.list_aggregates( May 25 17:08:15.894169 dv-cinder-790492-4-iscsi neutron-server[91830]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 25 17:08:15.894169 dv-cinder-790492-4-iscsi neutron-server[91830]: return f(self, *a, **k) May 25 17:08:15.894169 dv-cinder-790492-4-iscsi neutron-server[91830]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 25 17:08:15.894169 dv-cinder-790492-4-iscsi neutron-server[91830]: return self._get(url).json() May 25 17:08:15.894169 dv-cinder-790492-4-iscsi neutron-server[91830]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 25 17:08:15.894169 dv-cinder-790492-4-iscsi neutron-server[91830]: return self._client.get(url, endpoint_filter=self._ks_filter, May 25 17:08:15.894169 dv-cinder-790492-4-iscsi neutron-server[91830]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 25 17:08:15.894169 dv-cinder-790492-4-iscsi neutron-server[91830]: return self.request(url, 'GET', **kwargs) May 25 17:08:15.894169 dv-cinder-790492-4-iscsi neutron-server[91830]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 25 17:08:15.894169 dv-cinder-790492-4-iscsi neutron-server[91830]: base_url = self.get_endpoint(auth, allow=allow, May 25 17:08:15.894169 dv-cinder-790492-4-iscsi neutron-server[91830]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 25 17:08:15.894169 dv-cinder-790492-4-iscsi neutron-server[91830]: auth = self._auth_required(auth, 'determine endpoint URL') May 25 17:08:15.894169 dv-cinder-790492-4-iscsi neutron-server[91830]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 25 17:08:15.894169 dv-cinder-790492-4-iscsi neutron-server[91830]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 25 17:08:15.894169 dv-cinder-790492-4-iscsi neutron-server[91830]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 25 17:08:15.956540 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.rpc [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Device 85d0b73a-29b1-4d99-843e-521434d55130 no longer exists at agent ovs-agent-dv-cinder-790492-4-iscsi {{(pid=91831) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 25 17:08:15.971221 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-7bf27a5a-bc7c-404a-8456-821154867166 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3858252', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-640806', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-551400', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-683051'] for network, after_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:08:15.981164 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-7bf27a5a-bc7c-404a-8456-821154867166 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-551373'] for network, before_response {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:08:15.983247 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:08:15.995923 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.plugin [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] No Port match for: 85d0b73a-29b1-4d99-843e-521434d55130 {{(pid=91831) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}} May 25 17:08:15.996279 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.rpc [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Device 85d0b73a-29b1-4d99-843e-521434d55130 not bound to the agent host dv-cinder-790492-4-iscsi {{(pid=91831) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 25 17:08:15.996700 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.rpc [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Device f2ed4d81-44b1-4fbd-a5db-c3ed5a03b7de no longer exists at agent ovs-agent-dv-cinder-790492-4-iscsi {{(pid=91831) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 25 17:08:16.005783 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7bf27a5a-bc7c-404a-8456-821154867166 admin admin] Pushing event deleted for resources: {'Network': ['ID=b3bf2911-47e9-4eda-9fe8-ec380a12f536,revision_number=None']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:08:16.008192 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-7bf27a5a-bc7c-404a-8456-821154867166 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.025s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:08:16.010906 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [None req-7bf27a5a-bc7c-404a-8456-821154867166 admin admin] 10.222.0.62 "DELETE /v2.0/networks/b3bf2911-47e9-4eda-9fe8-ec380a12f536 HTTP/1.1" status: 204 len: 168 time: 0.8196208 May 25 17:08:16.031267 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.plugin [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] No Port match for: f2ed4d81-44b1-4fbd-a5db-c3ed5a03b7de {{(pid=91831) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}} May 25 17:08:16.031624 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.rpc [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Device f2ed4d81-44b1-4fbd-a5db-c3ed5a03b7de not bound to the agent host dv-cinder-790492-4-iscsi {{(pid=91831) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 25 17:08:16.122221 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.wsgi [-] (91829) accepted ('10.222.0.62', 36434) {{(pid=91829) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:08:16.170816 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [None req-bbd3d8f5-b8e4-4722-aa0c-6b29bda06e6e admin admin] 10.222.0.62 "GET /v2.0/security-groups?tenant_id=a736cc60cc2143c4b6dea99321051da5&name=default HTTP/1.1" status: 200 len: 2979 time: 0.0473235 May 25 17:08:16.172975 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.wsgi [-] (91829) accepted ('10.222.0.62', 36438) {{(pid=91829) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:08:16.234240 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-b25b1780-d981-4ae7-b1ff-06364fc5e9f5 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:08:16.259297 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-b25b1780-d981-4ae7-b1ff-06364fc5e9f5 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:08:16.311468 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-b25b1780-d981-4ae7-b1ff-06364fc5e9f5 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-640836'] for security_group, after_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:08:16.315985 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-03f5db71-1f7a-487a-9694-a420ccefc745 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:08:16.330258 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b25b1780-d981-4ae7-b1ff-06364fc5e9f5 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=da846e59-0f03-40bf-a502-658c82363359,revision_number=None']} {{(pid=91829) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:08:16.333125 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-b25b1780-d981-4ae7-b1ff-06364fc5e9f5 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.017s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:08:16.335182 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-b25b1780-d981-4ae7-b1ff-06364fc5e9f5 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:08:16.336140 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [None req-b25b1780-d981-4ae7-b1ff-06364fc5e9f5 admin admin] 10.222.0.62 "DELETE /v2.0/security-groups/da846e59-0f03-40bf-a502-658c82363359 HTTP/1.1" status: 204 len: 168 time: 0.1623065 May 25 17:08:16.676955 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.wsgi [-] (91829) accepted ('10.222.0.62', 36448) {{(pid=91829) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:08:16.723975 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [None req-18f92aab-0f4f-4da3-bc4d-1c1c7a9b278f admin admin] 10.222.0.62 "GET /v2.0/security-groups?tenant_id=6a788f87b23b492da7fbfb18883b9d2d&name=default HTTP/1.1" status: 200 len: 2979 time: 0.0455759 May 25 17:08:16.726208 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.wsgi [-] (91829) accepted ('10.222.0.62', 36452) {{(pid=91829) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:08:16.782078 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-c895379a-a69d-486f-8888-b53085739106 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:08:16.807689 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-c895379a-a69d-486f-8888-b53085739106 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:08:16.862001 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-c895379a-a69d-486f-8888-b53085739106 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-640836'] for security_group, after_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:08:16.866614 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-d0c105f6-e595-4c5c-a1e6-37cacb67507b admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:08:16.880863 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c895379a-a69d-486f-8888-b53085739106 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=53122d9f-c7a0-4593-a2bf-ee307f9f6354,revision_number=None']} {{(pid=91829) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:08:16.883863 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-c895379a-a69d-486f-8888-b53085739106 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.017s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:08:16.885105 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-c895379a-a69d-486f-8888-b53085739106 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:08:16.886233 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [None req-c895379a-a69d-486f-8888-b53085739106 admin admin] 10.222.0.62 "DELETE /v2.0/security-groups/53122d9f-c7a0-4593-a2bf-ee307f9f6354 HTTP/1.1" status: 204 len: 168 time: 0.1591554 May 25 17:08:25.303902 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-94a73dfa-6a18-4cec-8713-1b04d26d2bc8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:08:27.706772 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-c22460a3-a174-4cd4-be03-68969009ac59 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:08:27.886885 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:08:28.634372 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-0a55eb4a-8b57-4233-84d6-6b423b4ed6db None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:08:30.242024 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-57f11b47-1f51-4191-b7c9-af248a48372c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:08:36.147050 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.db.agents_db [None req-504cb04f-4543-46c1-8db7-349e21db7634 None None] Agent healthcheck: found 6 active agents {{(pid=91832) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} May 25 17:08:36.570249 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:08:36.881244 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-c318e2b1-9497-43f9-8b46-4c1d869662a4 req-4637b633-b0ce-4809-9f75-eb67a2a36429 service neutron] 10.222.0.32 "GET /v2.0/ports?device_id=4758207a-3093-4ef3-802c-dc11d895da7a&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0698960 May 25 17:08:36.980703 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c318e2b1-9497-43f9-8b46-4c1d869662a4 req-c63746f9-dfea-49c0-989d-da3779d50929 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:08:36.982182 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-c318e2b1-9497-43f9-8b46-4c1d869662a4 req-c63746f9-dfea-49c0-989d-da3779d50929 service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=70dac097fff04aed99a4976fa955579b&device_id=4758207a-3093-4ef3-802c-dc11d895da7a HTTP/1.1" status: 200 len: 1099 time: 0.0745332 May 25 17:08:37.133684 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c318e2b1-9497-43f9-8b46-4c1d869662a4 req-d78bd5b2-4ea0-40c6-b93d-575564055823 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:08:37.135625 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-c318e2b1-9497-43f9-8b46-4c1d869662a4 req-d78bd5b2-4ea0-40c6-b93d-575564055823 service neutron] 10.222.0.32 "GET /v2.0/networks?id=b351598a-3f6f-4a37-8095-8d9371896ccc HTTP/1.1" status: 200 len: 911 time: 0.1338787 May 25 17:08:37.234692 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-c318e2b1-9497-43f9-8b46-4c1d869662a4 req-a6f9577c-79a7-46b7-ba75-d9726a7c94e3 service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=13752a02-2ccb-4f85-b36f-38ca98958db9 HTTP/1.1" status: 200 len: 1002 time: 0.0925491 May 25 17:08:37.299054 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c318e2b1-9497-43f9-8b46-4c1d869662a4 req-18cbc617-bbc0-4218-b2e2-a3fdc880ff08 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:08:37.300421 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-c318e2b1-9497-43f9-8b46-4c1d869662a4 req-18cbc617-bbc0-4218-b2e2-a3fdc880ff08 service neutron] 10.222.0.32 "GET /v2.0/subnets?id=4bbae145-74ed-4fda-b7c0-ae77a3202a83 HTTP/1.1" status: 200 len: 849 time: 0.0594137 May 25 17:08:37.374915 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c318e2b1-9497-43f9-8b46-4c1d869662a4 req-a1491efe-8a4c-45e0-9029-7729b44b954a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:08:37.376306 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-c318e2b1-9497-43f9-8b46-4c1d869662a4 req-a1491efe-8a4c-45e0-9029-7729b44b954a service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=b351598a-3f6f-4a37-8095-8d9371896ccc&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0683014 May 25 17:08:37.512847 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-c318e2b1-9497-43f9-8b46-4c1d869662a4 req-bbb12d4a-e6c2-48c8-9ab4-56ae347e804f service neutron] 10.222.0.32 "GET /v2.0/networks/b351598a-3f6f-4a37-8095-8d9371896ccc?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1288002 May 25 17:08:37.737405 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-c318e2b1-9497-43f9-8b46-4c1d869662a4 req-eeb93d99-9371-4ac7-aaf8-78eddefa058f service neutron] 10.222.0.32 "GET /v2.0/networks/b351598a-3f6f-4a37-8095-8d9371896ccc?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2180827 May 25 17:08:55.304841 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-64682f9b-5b8f-4d94-aa7f-a420b24dde44 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:08:57.708057 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-c2389fcf-20d3-4df3-ad94-140804c60b73 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:08:57.889412 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:08:58.637227 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-0a55eb4a-8b57-4233-84d6-6b423b4ed6db None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:09:00.246554 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-57f11b47-1f51-4191-b7c9-af248a48372c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:09:06.561234 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:09:09.613194 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8fdd41b8-6be5-4499-962b-3081097b7682 req-6bf8cfb3-3447-4b4d-a9a0-65883f916a81 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:09:09.614652 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-8fdd41b8-6be5-4499-962b-3081097b7682 req-6bf8cfb3-3447-4b4d-a9a0-65883f916a81 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] 10.222.0.62 "GET /v2.0/ports?device_id=4758207a-3093-4ef3-802c-dc11d895da7a HTTP/1.1" status: 200 len: 946 time: 0.0831583 May 25 17:09:09.658458 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-8fdd41b8-6be5-4499-962b-3081097b7682 req-f4b0ef32-5709-4f8d-b44b-6174ad2f450f tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] 10.222.0.62 "GET /v2.0/security-groups?id=7cad7118-dc73-4cab-9cb2-fa41cd4499bd&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0381384 May 25 17:09:10.848512 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1980f5c5-ab9a-42b0-ac54-084ea0a8368d req-b83a03aa-385b-40a9-a968-847985f798ba tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:09:10.849990 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-1980f5c5-ab9a-42b0-ac54-084ea0a8368d req-b83a03aa-385b-40a9-a968-847985f798ba tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] 10.222.0.62 "GET /v2.0/ports?device_id=4758207a-3093-4ef3-802c-dc11d895da7a HTTP/1.1" status: 200 len: 946 time: 0.0810556 May 25 17:09:10.894968 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-1980f5c5-ab9a-42b0-ac54-084ea0a8368d req-aaa2d166-52ea-49ae-8313-f3405df43506 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] 10.222.0.62 "GET /v2.0/security-groups?id=7cad7118-dc73-4cab-9cb2-fa41cd4499bd&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0385122 May 25 17:09:11.207995 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3d0c4e08-3d40-4b1e-bc1e-96b1b36eebfb req-bc4c14e8-1ecf-44f8-be02-0164446744ce tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:09:11.210459 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-3d0c4e08-3d40-4b1e-bc1e-96b1b36eebfb req-bc4c14e8-1ecf-44f8-be02-0164446744ce tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] 10.222.0.32 "GET /v2.0/ports?device_id=4758207a-3093-4ef3-802c-dc11d895da7a HTTP/1.1" status: 200 len: 946 time: 0.1091969 May 25 17:09:11.347894 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.plugins.ml2.plugin [req-3d0c4e08-3d40-4b1e-bc1e-96b1b36eebfb req-6789e5d5-e11c-47bc-bc23-6326dcf6f42b tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Deleting port 13752a02-2ccb-4f85-b36f-38ca98958db9 {{(pid=91829) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 25 17:09:11.348233 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [req-3d0c4e08-3d40-4b1e-bc1e-96b1b36eebfb req-6789e5d5-e11c-47bc-bc23-6326dcf6f42b tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8757892952899'] for port, before_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:09:11.477142 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.plugins.ml2.db [req-3d0c4e08-3d40-4b1e-bc1e-96b1b36eebfb req-6789e5d5-e11c-47bc-bc23-6326dcf6f42b tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] For port 13752a02-2ccb-4f85-b36f-38ca98958db9, host hv-cinder-79049, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79049',level=0,port_id=13752a02-2ccb-4f85-b36f-38ca98958db9,segment=NetworkSegment(b8ba5240-28ce-40db-a6e6-b4a42435e0b6),segment_id=b8ba5240-28ce-40db-a6e6-b4a42435e0b6)] {{(pid=91829) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 17:09:11.477492 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [req-3d0c4e08-3d40-4b1e-bc1e-96b1b36eebfb req-6789e5d5-e11c-47bc-bc23-6326dcf6f42b tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-683770'] for port, precommit_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:09:11.778240 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [req-3d0c4e08-3d40-4b1e-bc1e-96b1b36eebfb req-6789e5d5-e11c-47bc-bc23-6326dcf6f42b tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Notify callbacks [] for floatingip, precommit_update {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:09:11.778518 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [req-3d0c4e08-3d40-4b1e-bc1e-96b1b36eebfb req-6789e5d5-e11c-47bc-bc23-6326dcf6f42b tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-683033'] for floatingip, after_update {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:09:11.778835 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.db.l3_db [req-3d0c4e08-3d40-4b1e-bc1e-96b1b36eebfb req-6789e5d5-e11c-47bc-bc23-6326dcf6f42b tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Floating IP 2a4488c9-1454-49a3-8879-33de4dc6f828 disassociated. External IP: 172.27.2.221, port: 13752a02-2ccb-4f85-b36f-38ca98958db9. May 25 17:09:11.779173 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.plugins.ml2.plugin [req-3d0c4e08-3d40-4b1e-bc1e-96b1b36eebfb req-6789e5d5-e11c-47bc-bc23-6326dcf6f42b tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Calling delete_port for 13752a02-2ccb-4f85-b36f-38ca98958db9 owned by compute:nova {{(pid=91829) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 25 17:09:11.892916 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [req-3d0c4e08-3d40-4b1e-bc1e-96b1b36eebfb req-6789e5d5-e11c-47bc-bc23-6326dcf6f42b tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8757892955046', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8757892520924', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28230808'] for port, after_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:09:11.898254 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-aa9adaab-1c7d-4401-87d9-7e0864e39231 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:09:11.943345 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6789e5d5-e11c-47bc-bc23-6326dcf6f42b tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Pushing event deleted for resources: {'Port': ['ID=13752a02-2ccb-4f85-b36f-38ca98958db9,revision_number=None']} {{(pid=91829) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:09:11.953418 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6789e5d5-e11c-47bc-bc23-6326dcf6f42b tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91829) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:09:11.953778 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6789e5d5-e11c-47bc-bc23-6326dcf6f42b tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91829) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:09:11.954161 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6789e5d5-e11c-47bc-bc23-6326dcf6f42b tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91829) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:09:11.954508 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6789e5d5-e11c-47bc-bc23-6326dcf6f42b tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91829) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:09:11.954860 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6789e5d5-e11c-47bc-bc23-6326dcf6f42b tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91829) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:09:11.955196 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6789e5d5-e11c-47bc-bc23-6326dcf6f42b tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91829) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:09:11.955543 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6789e5d5-e11c-47bc-bc23-6326dcf6f42b tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91829) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:09:11.955884 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6789e5d5-e11c-47bc-bc23-6326dcf6f42b tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91829) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:09:11.956224 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6789e5d5-e11c-47bc-bc23-6326dcf6f42b tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91829) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:09:11.956649 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6789e5d5-e11c-47bc-bc23-6326dcf6f42b tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91829) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:09:11.956880 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6789e5d5-e11c-47bc-bc23-6326dcf6f42b tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91829) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:09:11.957215 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6789e5d5-e11c-47bc-bc23-6326dcf6f42b tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91829) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:09:11.961091 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-6789e5d5-e11c-47bc-bc23-6326dcf6f42b tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.063s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:09:12.077158 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-724817eb-5eb4-4a83-9d23-cb17e5849dbf req-b8797699-71b4-47f7-9eda-1a8e5786d731 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] 10.222.0.62 "GET /v2.0/ports?device_id=4758207a-3093-4ef3-802c-dc11d895da7a HTTP/1.1" status: 200 len: 210 time: 0.0590858 May 25 17:09:12.181165 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.scheduler.l3_agent_scheduler [req-3d0c4e08-3d40-4b1e-bc1e-96b1b36eebfb req-6789e5d5-e11c-47bc-bc23-6326dcf6f42b tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Router f1e3cf65-0e20-4226-8986-652055868473 has already been hosted by L3 agent a2d427c1-2d07-43e8-afbe-218c9f7d0445 {{(pid=91829) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 25 17:09:12.471268 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-3d0c4e08-3d40-4b1e-bc1e-96b1b36eebfb req-6789e5d5-e11c-47bc-bc23-6326dcf6f42b tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Notify agent at l3_agent.dv-cinder-790492-4-iscsi the message routers_updated {{(pid=91829) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 25 17:09:12.483337 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-02d36f28-cc1e-40d6-a8c2-4396d1fad4c1 None None] Sync routers for ids ['f1e3cf65-0e20-4226-8986-652055868473'] in dv-cinder-790492-4-iscsi {{(pid=91831) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 25 17:09:12.535138 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.l3_dvrscheduler_db [None req-02d36f28-cc1e-40d6-a8c2-4396d1fad4c1 None None] Routers {'f1e3cf65-0e20-4226-8986-652055868473'} bound to L3 agent in host dv-cinder-790492-4-iscsi {{(pid=91831) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 17:09:12.536038 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.l3_hamode_db [None req-02d36f28-cc1e-40d6-a8c2-4396d1fad4c1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-790492-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-05-25T16:50:28Z,description=,heartbeat_timestamp=2021-05-25T17:08:58Z,host='dv-cinder-790492-4-iscsi',id=a2d427c1-2d07-43e8-afbe-218c9f7d0445,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T16:50:28Z,topic='l3_agent')) {'router_ids': ['f1e3cf65-0e20-4226-8986-652055868473'], 'active': True} {{(pid=91831) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 17:09:12.544471 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.l3_dvrscheduler_db [req-3d0c4e08-3d40-4b1e-bc1e-96b1b36eebfb req-6789e5d5-e11c-47bc-bc23-6326dcf6f42b tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] No DVR routers for this DVR port 13752a02-2ccb-4f85-b36f-38ca98958db9 on host hv-cinder-79049 {{(pid=91829) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 25 17:09:12.547296 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [req-3d0c4e08-3d40-4b1e-bc1e-96b1b36eebfb req-6789e5d5-e11c-47bc-bc23-6326dcf6f42b tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-178712'] for port, before_response {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:09:12.550393 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '4758207a-3093-4ef3-802c-dc11d895da7a', 'name': 'network-vif-deleted', 'tag': '13752a02-2ccb-4f85-b36f-38ca98958db9'}] {{(pid=91829) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 25 17:09:12.559808 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-3d0c4e08-3d40-4b1e-bc1e-96b1b36eebfb req-6789e5d5-e11c-47bc-bc23-6326dcf6f42b tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] 10.222.0.32 "DELETE /v2.0/ports/13752a02-2ccb-4f85-b36f-38ca98958db9 HTTP/1.1" status: 204 len: 173 time: 1.3437028 May 25 17:09:12.638046 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '4758207a-3093-4ef3-802c-dc11d895da7a', 'name': 'network-vif-deleted', 'tag': '13752a02-2ccb-4f85-b36f-38ca98958db9', 'status': 'completed', 'code': 200} May 25 17:09:12.741105 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.l3_dvr_db [None req-02d36f28-cc1e-40d6-a8c2-4396d1fad4c1 None None] Set router f1e3cf65-0e20-4226-8986-652055868473 gateway port host: dv-cinder-790492-4-iscsi {{(pid=91831) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 17:09:13.059611 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.l3_hamode_db [None req-02d36f28-cc1e-40d6-a8c2-4396d1fad4c1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'f1e3cf65-0e20-4226-8986-652055868473', 'name': 'tempest-AttachVolumeTestJSON-312968156-router', 'tenant_id': '70dac097fff04aed99a4976fa955579b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'external_fixed_ips': [{'subnet_id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'ip_address': '172.27.2.63'}], 'enable_snat': True}, 'gw_port_id': 'd0e34ea8-e4eb-48d0-812d-3e5358c5b247', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T17:03:07Z', 'updated_at': '2021-05-25T17:03:12Z', 'revision_number': 4, 'project_id': '70dac097fff04aed99a4976fa955579b', 'gw_port': {'id': 'd0e34ea8-e4eb-48d0-812d-3e5358c5b247', 'name': '', 'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'tenant_id': '', 'mac_address': 'fa:16:3e:be:2a:11', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f1e3cf65-0e20-4226-8986-652055868473', 'device_owner': 'network:router_gateway', 'standard_attr_id': 477, 'fixed_ips': [{'subnet_id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'ip_address': '172.27.2.63', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790492-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:03:08Z', 'updated_at': '2021-05-25T17:03:16Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-790492-4-iscsi', '_interfaces': [{'id': '6561ca57-f5fa-4bba-803c-ac716f98a0fb', 'name': '', 'network_id': 'b351598a-3f6f-4a37-8095-8d9371896ccc', 'tenant_id': '70dac097fff04aed99a4976fa955579b', 'mac_address': 'fa:16:3e:2f:70:71', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f1e3cf65-0e20-4226-8986-652055868473', 'device_owner': 'network:router_interface', 'standard_attr_id': 478, 'fixed_ips': [{'subnet_id': '4bbae145-74ed-4fda-b7c0-ae77a3202a83', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790492-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:03:12Z', 'updated_at': '2021-05-25T17:03:18Z', 'revision_number': 5, 'project_id': '70dac097fff04aed99a4976fa955579b', 'subnets': [{'id': '4bbae145-74ed-4fda-b7c0-ae77a3202a83', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-790492-4-iscsi', False) {} {{(pid=91831) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 17:09:13.064294 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-02d36f28-cc1e-40d6-a8c2-4396d1fad4c1 None None] Checking router: f1e3cf65-0e20-4226-8986-652055868473 for host: dv-cinder-790492-4-iscsi {{(pid=91831) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 25 17:09:13.073475 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.l3_dvrscheduler_db [None req-02d36f28-cc1e-40d6-a8c2-4396d1fad4c1 None None] Routers {'f1e3cf65-0e20-4226-8986-652055868473'} bound to L3 agent in host dv-cinder-790492-4-iscsi {{(pid=91831) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 17:09:13.074187 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.l3_hamode_db [None req-02d36f28-cc1e-40d6-a8c2-4396d1fad4c1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-790492-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-05-25T16:50:28Z,description=,heartbeat_timestamp=2021-05-25T17:08:58Z,host='dv-cinder-790492-4-iscsi',id=a2d427c1-2d07-43e8-afbe-218c9f7d0445,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T16:50:28Z,topic='l3_agent')) {'router_ids': ['f1e3cf65-0e20-4226-8986-652055868473'], 'active': True} {{(pid=91831) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 17:09:13.148962 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.db.agents_db [None req-504cb04f-4543-46c1-8db7-349e21db7634 None None] Agent healthcheck: found 6 active agents {{(pid=91832) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} May 25 17:09:13.248775 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.quota.resource [req-7b54b046-5263-4a52-875a-4fba91ea7cae req-e6a84f74-1490-4c54-b24b-58da8575b2f8 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Synchronizing usage tracker for tenant:70dac097fff04aed99a4976fa955579b on resource:port {{(pid=91829) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 25 17:09:13.259643 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.l3_dvr_db [None req-02d36f28-cc1e-40d6-a8c2-4396d1fad4c1 None None] Set router f1e3cf65-0e20-4226-8986-652055868473 gateway port host: dv-cinder-790492-4-iscsi {{(pid=91831) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 17:09:13.267032 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.quota.resource [req-7b54b046-5263-4a52-875a-4fba91ea7cae req-e6a84f74-1490-4c54-b24b-58da8575b2f8 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Unset dirty status for tenant:70dac097fff04aed99a4976fa955579b on resource:port {{(pid=91829) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 25 17:09:13.268359 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-7b54b046-5263-4a52-875a-4fba91ea7cae req-e6a84f74-1490-4c54-b24b-58da8575b2f8 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] 10.222.0.62 "GET /v2.0/ports?device_id=4758207a-3093-4ef3-802c-dc11d895da7a HTTP/1.1" status: 200 len: 210 time: 0.0652933 May 25 17:09:13.569276 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.l3_hamode_db [None req-02d36f28-cc1e-40d6-a8c2-4396d1fad4c1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'f1e3cf65-0e20-4226-8986-652055868473', 'name': 'tempest-AttachVolumeTestJSON-312968156-router', 'tenant_id': '70dac097fff04aed99a4976fa955579b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'external_fixed_ips': [{'subnet_id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'ip_address': '172.27.2.63'}], 'enable_snat': True}, 'gw_port_id': 'd0e34ea8-e4eb-48d0-812d-3e5358c5b247', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T17:03:07Z', 'updated_at': '2021-05-25T17:03:12Z', 'revision_number': 4, 'project_id': '70dac097fff04aed99a4976fa955579b', 'gw_port': {'id': 'd0e34ea8-e4eb-48d0-812d-3e5358c5b247', 'name': '', 'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'tenant_id': '', 'mac_address': 'fa:16:3e:be:2a:11', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f1e3cf65-0e20-4226-8986-652055868473', 'device_owner': 'network:router_gateway', 'standard_attr_id': 477, 'fixed_ips': [{'subnet_id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'ip_address': '172.27.2.63', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790492-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:03:08Z', 'updated_at': '2021-05-25T17:03:16Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-790492-4-iscsi', '_interfaces': [{'id': '6561ca57-f5fa-4bba-803c-ac716f98a0fb', 'name': '', 'network_id': 'b351598a-3f6f-4a37-8095-8d9371896ccc', 'tenant_id': '70dac097fff04aed99a4976fa955579b', 'mac_address': 'fa:16:3e:2f:70:71', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f1e3cf65-0e20-4226-8986-652055868473', 'device_owner': 'network:router_interface', 'standard_attr_id': 478, 'fixed_ips': [{'subnet_id': '4bbae145-74ed-4fda-b7c0-ae77a3202a83', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790492-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:03:12Z', 'updated_at': '2021-05-25T17:03:18Z', 'revision_number': 5, 'project_id': '70dac097fff04aed99a4976fa955579b', 'subnets': [{'id': '4bbae145-74ed-4fda-b7c0-ae77a3202a83', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-790492-4-iscsi', False) {} {{(pid=91831) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 17:09:13.573073 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-02d36f28-cc1e-40d6-a8c2-4396d1fad4c1 None None] The sync data for ids ['f1e3cf65-0e20-4226-8986-652055868473'] in dv-cinder-790492-4-iscsi is: [{'id': 'f1e3cf65-0e20-4226-8986-652055868473', 'name': 'tempest-AttachVolumeTestJSON-312968156-router', 'tenant_id': '70dac097fff04aed99a4976fa955579b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'external_fixed_ips': [{'subnet_id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'ip_address': '172.27.2.63'}], 'enable_snat': True}, 'gw_port_id': 'd0e34ea8-e4eb-48d0-812d-3e5358c5b247', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T17:03:07Z', 'updated_at': '2021-05-25T17:03:12Z', 'revision_number': 4, 'project_id': '70dac097fff04aed99a4976fa955579b', 'gw_port': {'id': 'd0e34ea8-e4eb-48d0-812d-3e5358c5b247', 'name': '', 'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'tenant_id': '', 'mac_address': 'fa:16:3e:be:2a:11', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f1e3cf65-0e20-4226-8986-652055868473', 'device_owner': 'network:router_gateway', 'standard_attr_id': 477, 'fixed_ips': [{'subnet_id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'ip_address': '172.27.2.63', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790492-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:03:08Z', 'updated_at': '2021-05-25T17:03:16Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-790492-4-iscsi', '_interfaces': [{'id': '6561ca57-f5fa-4bba-803c-ac716f98a0fb', 'name': '', 'network_id': 'b351598a-3f6f-4a37-8095-8d9371896ccc', 'tenant_id': '70dac097fff04aed99a4976fa955579b', 'mac_address': 'fa:16:3e:2f:70:71', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f1e3cf65-0e20-4226-8986-652055868473', 'device_owner': 'network:router_interface', 'standard_attr_id': 478, 'fixed_ips': [{'subnet_id': '4bbae145-74ed-4fda-b7c0-ae77a3202a83', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790492-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:03:12Z', 'updated_at': '2021-05-25T17:03:18Z', 'revision_number': 5, 'project_id': '70dac097fff04aed99a4976fa955579b', 'subnets': [{'id': '4bbae145-74ed-4fda-b7c0-ae77a3202a83', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=91831) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 25 17:09:13.777744 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-53906302-eac6-46ee-9469-d8d74dcb5fc2 None None] New status for floating IP 2a4488c9-1454-49a3-8879-33de4dc6f828: DOWN {{(pid=91832) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} May 25 17:09:14.387389 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.wsgi [-] (91829) accepted ('10.222.0.62', 36612) {{(pid=91829) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:09:14.450571 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-5e414c88-6448-443c-aed0-3bb0f7f816c0 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Notify callbacks [] for security_group, before_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:09:14.478136 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-5e414c88-6448-443c-aed0-3bb0f7f816c0 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Notify callbacks [] for security_group, precommit_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:09:14.528643 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-5e414c88-6448-443c-aed0-3bb0f7f816c0 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-640836'] for security_group, after_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:09:14.533316 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-0215f3dc-e834-44f6-974b-9d21b5cc3ae0 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:09:14.547858 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5e414c88-6448-443c-aed0-3bb0f7f816c0 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=7cad7118-dc73-4cab-9cb2-fa41cd4499bd,revision_number=None']} {{(pid=91829) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:09:14.551103 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-5e414c88-6448-443c-aed0-3bb0f7f816c0 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.017s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:09:14.558614 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-5e414c88-6448-443c-aed0-3bb0f7f816c0 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Notify callbacks [] for security_group, before_response {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:09:14.559700 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [None req-5e414c88-6448-443c-aed0-3bb0f7f816c0 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] 10.222.0.62 "DELETE /v2.0/security-groups/7cad7118-dc73-4cab-9cb2-fa41cd4499bd HTTP/1.1" status: 204 len: 168 time: 0.1713002 May 25 17:09:14.562674 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.wsgi [-] (91829) accepted ('10.222.0.62', 36616) {{(pid=91829) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:09:14.579054 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.api.v2.resource [None req-0495b98c-8901-4bac-8267-80f284b7228e tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] show failed (client error): The resource could not be found. May 25 17:09:14.579991 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [None req-0495b98c-8901-4bac-8267-80f284b7228e tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] 10.222.0.62 "GET /v2.0/security-groups/7cad7118-dc73-4cab-9cb2-fa41cd4499bd HTTP/1.1" status: 404 len: 347 time: 0.0164518 May 25 17:09:14.582709 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.wsgi [-] (91829) accepted ('10.222.0.62', 36620) {{(pid=91829) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:09:14.799981 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.plugins.ml2.plugin [None req-a6e7baa8-9a49-4d9b-9409-fe56eb57925d tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Deleting port 4046cecc-5593-4f96-8536-d712f0d987ad {{(pid=91829) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 25 17:09:14.800206 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-a6e7baa8-9a49-4d9b-9409-fe56eb57925d tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8757892952899'] for port, before_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:09:14.918093 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-a6e7baa8-9a49-4d9b-9409-fe56eb57925d tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-683770'] for port, precommit_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:09:14.918424 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-a6e7baa8-9a49-4d9b-9409-fe56eb57925d tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:09:15.044213 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.plugins.ml2.plugin [None req-a6e7baa8-9a49-4d9b-9409-fe56eb57925d tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Calling delete_port for 4046cecc-5593-4f96-8536-d712f0d987ad owned by network:floatingip {{(pid=91829) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 25 17:09:15.157793 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-a6e7baa8-9a49-4d9b-9409-fe56eb57925d tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8757892955046', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8757892520924', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28230808'] for port, after_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:09:15.162129 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:09:15.237953 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a6e7baa8-9a49-4d9b-9409-fe56eb57925d tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Pushing event deleted for resources: {'Port': ['ID=4046cecc-5593-4f96-8536-d712f0d987ad,revision_number=None']} {{(pid=91829) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:09:15.248706 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-a6e7baa8-9a49-4d9b-9409-fe56eb57925d tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.086s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:09:15.301455 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-a6e7baa8-9a49-4d9b-9409-fe56eb57925d tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Notify callbacks [] for floatingip, after_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:09:15.318887 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-a6e7baa8-9a49-4d9b-9409-fe56eb57925d tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-178712'] for floatingip, before_response {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:09:15.319931 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [None req-a6e7baa8-9a49-4d9b-9409-fe56eb57925d tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] 10.222.0.62 "DELETE /v2.0/floatingips/2a4488c9-1454-49a3-8879-33de4dc6f828 HTTP/1.1" status: 204 len: 168 time: 0.7363799 May 25 17:09:15.600243 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-28d91afd-e5fd-4230-b512-526e293217a7 req-f7a949a6-b93c-46f1-a83f-b50fdb366f72 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:09:15.601613 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-28d91afd-e5fd-4230-b512-526e293217a7 req-f7a949a6-b93c-46f1-a83f-b50fdb366f72 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/ports?device_id=bdaa3d25-adc2-4a52-8a36-66a599b4b6e2 HTTP/1.1" status: 200 len: 946 time: 0.0817628 May 25 17:09:15.645050 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-28d91afd-e5fd-4230-b512-526e293217a7 req-ab816142-98dd-497b-9cea-caa36ef9935e tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/security-groups?id=4e6b7b77-0833-47dc-be2e-ec9c7c960bb9&fields=id&fields=name HTTP/1.1" status: 200 len: 309 time: 0.0377114 May 25 17:09:15.890882 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.wsgi [-] (91829) accepted ('10.222.0.62', 36642) {{(pid=91829) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:09:15.896119 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.v2.base [None req-75f911c3-ef6f-423e-9efc-d3127ae10e53 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Request body: {'security_group': {'name': 'tempest-securitygroup--1202805282', 'description': 'tempest-description--2005593134'}} {{(pid=91829) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 17:09:15.901855 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.quota.driver [None req-75f911c3-ef6f-423e-9efc-d3127ae10e53 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91829) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 17:09:15.906026 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.quota.resource [None req-75f911c3-ef6f-423e-9efc-d3127ae10e53 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Usage tracker for resource:security_group and tenant:70dac097fff04aed99a4976fa955579b is out of sync, need to count used quota {{(pid=91829) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 17:09:15.908819 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.quota.resource [None req-75f911c3-ef6f-423e-9efc-d3127ae10e53 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Quota usage for security_group was recalculated. Used quota:1. {{(pid=91829) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 17:09:15.918615 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.quota.driver [None req-75f911c3-ef6f-423e-9efc-d3127ae10e53 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Attempting to reserve 1 items for resource security_group. Total usage: 1; quota limit: 100; headroom:99 {{(pid=91829) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 17:09:15.927713 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-75f911c3-ef6f-423e-9efc-d3127ae10e53 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Notify callbacks [] for security_group, before_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:09:15.949873 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.quota.driver [None req-75f911c3-ef6f-423e-9efc-d3127ae10e53 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91829) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 17:09:15.953616 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.quota.resource [None req-75f911c3-ef6f-423e-9efc-d3127ae10e53 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Usage tracker for resource:security_group_rule and tenant:70dac097fff04aed99a4976fa955579b is out of sync, need to count used quota {{(pid=91829) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 17:09:15.956397 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.quota.resource [None req-75f911c3-ef6f-423e-9efc-d3127ae10e53 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Quota usage for security_group_rule was recalculated. Used quota:4. {{(pid=91829) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 17:09:15.962076 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.quota.driver [None req-75f911c3-ef6f-423e-9efc-d3127ae10e53 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Attempting to reserve 2 items for resource security_group_rule. Total usage: 4; quota limit: 100; headroom:96 {{(pid=91829) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 17:09:16.030892 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-75f911c3-ef6f-423e-9efc-d3127ae10e53 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Notify callbacks [] for security_group, precommit_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:09:16.034575 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-75f911c3-ef6f-423e-9efc-d3127ae10e53 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-640836'] for security_group, after_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:09:16.038066 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-f396a8d1-b84a-4e82-a000-40d89b1a2555 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:09:16.078042 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-75f911c3-ef6f-423e-9efc-d3127ae10e53 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Pushing event updated for resources: {'SecurityGroup': ['ID=388811ac-c781-471a-a517-2ae8158e9b4a,revision_number=1']} {{(pid=91829) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:09:16.080980 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-75f911c3-ef6f-423e-9efc-d3127ae10e53 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.043s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:09:16.083818 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-75f911c3-ef6f-423e-9efc-d3127ae10e53 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Notify callbacks [] for security_group, before_response {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:09:16.085445 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [None req-75f911c3-ef6f-423e-9efc-d3127ae10e53 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] 10.222.0.62 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1780 time: 0.1935005 May 25 17:09:16.088371 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.wsgi [-] (91829) accepted ('10.222.0.62', 36646) {{(pid=91829) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:09:16.093366 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.v2.base [None req-86ddad3b-245c-4418-b388-0ae16159278d tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Request body: {'security_group_rule': {'security_group_id': '388811ac-c781-471a-a517-2ae8158e9b4a', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=91829) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 17:09:16.099108 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.quota.driver [None req-86ddad3b-245c-4418-b388-0ae16159278d tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91829) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 17:09:16.102987 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.quota.resource [None req-86ddad3b-245c-4418-b388-0ae16159278d tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Usage tracker for resource:security_group_rule and tenant:70dac097fff04aed99a4976fa955579b is out of sync, need to count used quota {{(pid=91829) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 17:09:16.105830 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.quota.resource [None req-86ddad3b-245c-4418-b388-0ae16159278d tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Quota usage for security_group_rule was recalculated. Used quota:6. {{(pid=91829) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 17:09:16.111582 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.quota.driver [None req-86ddad3b-245c-4418-b388-0ae16159278d tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 6; quota limit: 100; headroom:94 {{(pid=91829) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 17:09:16.127477 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-86ddad3b-245c-4418-b388-0ae16159278d tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Notify callbacks [] for security_group_rule, before_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:09:16.188521 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-86ddad3b-245c-4418-b388-0ae16159278d tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:09:16.192151 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-86ddad3b-245c-4418-b388-0ae16159278d tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-640874'] for security_group_rule, after_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:09:16.194383 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:09:16.215972 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-86ddad3b-245c-4418-b388-0ae16159278d tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=415297fd-0521-4d41-8a49-13b78511fa48,revision_number=0']} {{(pid=91829) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:09:16.221791 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-86ddad3b-245c-4418-b388-0ae16159278d tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.027s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:09:16.224372 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-86ddad3b-245c-4418-b388-0ae16159278d tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Notify callbacks [] for security_group_rule, before_response {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:09:16.228502 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [None req-86ddad3b-245c-4418-b388-0ae16159278d tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] 10.222.0.62 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.1364975 May 25 17:09:16.228630 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.wsgi [-] (91829) accepted ('10.222.0.62', 36650) {{(pid=91829) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:09:16.234004 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.v2.base [None req-9fa033db-fb41-4aa7-9b70-1216f86ca074 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Request body: {'security_group_rule': {'security_group_id': '388811ac-c781-471a-a517-2ae8158e9b4a', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=91829) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 17:09:16.239576 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.quota.driver [None req-9fa033db-fb41-4aa7-9b70-1216f86ca074 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91829) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 17:09:16.243321 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.quota.resource [None req-9fa033db-fb41-4aa7-9b70-1216f86ca074 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Usage tracker for resource:security_group_rule and tenant:70dac097fff04aed99a4976fa955579b is out of sync, need to count used quota {{(pid=91829) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 17:09:16.246743 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.quota.resource [None req-9fa033db-fb41-4aa7-9b70-1216f86ca074 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Quota usage for security_group_rule was recalculated. Used quota:7. {{(pid=91829) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 17:09:16.252907 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.quota.driver [None req-9fa033db-fb41-4aa7-9b70-1216f86ca074 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Attempting to reserve 1 items for resource security_group_rule. Total usage: 7; quota limit: 100; headroom:93 {{(pid=91829) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 17:09:16.267821 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-9fa033db-fb41-4aa7-9b70-1216f86ca074 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Notify callbacks [] for security_group_rule, before_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:09:16.293246 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.rpc [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Device 13752a02-2ccb-4f85-b36f-38ca98958db9 no longer exists at agent hyperv_hv-cinder-79049 {{(pid=91831) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 25 17:09:16.332169 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-9fa033db-fb41-4aa7-9b70-1216f86ca074 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:09:16.332504 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.plugin [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] No Port match for: 13752a02-2ccb-4f85-b36f-38ca98958db9 {{(pid=91831) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}} May 25 17:09:16.332865 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.rpc [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Device 13752a02-2ccb-4f85-b36f-38ca98958db9 not bound to the agent host hv-cinder-79049 {{(pid=91831) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 25 17:09:16.336358 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-9fa033db-fb41-4aa7-9b70-1216f86ca074 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-640874'] for security_group_rule, after_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:09:16.342244 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:09:16.361027 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9fa033db-fb41-4aa7-9b70-1216f86ca074 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=7a1c20cd-796b-4933-b902-3fab3999e483,revision_number=0']} {{(pid=91829) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:09:16.365249 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-9fa033db-fb41-4aa7-9b70-1216f86ca074 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.023s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:09:16.369531 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-9fa033db-fb41-4aa7-9b70-1216f86ca074 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Notify callbacks [] for security_group_rule, before_response {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:09:16.373854 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.wsgi [-] (91830) accepted ('10.222.0.62', 36654) {{(pid=91830) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:09:16.374390 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [None req-9fa033db-fb41-4aa7-9b70-1216f86ca074 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] 10.222.0.62 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.1444635 May 25 17:09:16.379349 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.v2.base [None req-4c30f282-59bd-4370-bef4-246fd93f74c0 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Request body: {'floatingip': {'floating_network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74'}} {{(pid=91830) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 17:09:16.385241 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.quota.driver [None req-4c30f282-59bd-4370-bef4-246fd93f74c0 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91830) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 17:09:16.390435 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [None req-4c30f282-59bd-4370-bef4-246fd93f74c0 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Usage tracker for resource:floatingip and tenant:70dac097fff04aed99a4976fa955579b is out of sync, need to count used quota {{(pid=91830) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 17:09:16.393295 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [None req-4c30f282-59bd-4370-bef4-246fd93f74c0 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Quota usage for floatingip was recalculated. Used quota:0. {{(pid=91830) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 17:09:16.399467 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.quota.driver [None req-4c30f282-59bd-4370-bef4-246fd93f74c0 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Attempting to reserve 1 items for resource floatingip. Total usage: 0; quota limit: 50; headroom:50 {{(pid=91830) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 17:09:16.409934 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-4c30f282-59bd-4370-bef4-246fd93f74c0 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Notify callbacks [] for floatingip, before_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:09:16.637702 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-4c30f282-59bd-4370-bef4-246fd93f74c0 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3832070'] for port, before_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:09:16.779123 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.db_base_plugin_common [None req-4c30f282-59bd-4370-bef4-246fd93f74c0 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Allocated IP 172.27.2.114 (4364b6ab-4117-4a92-baeb-f5ee2f45bf74/b947e790-d731-4b63-afc4-4aa112afe0f6/c3a854e5-7742-4a38-807f-bdcb08805240) {{(pid=91830) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 25 17:09:16.837619 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-077b38ab-bb71-4ab6-8370-693174d4c78c req-d7da9f2d-58bd-4c13-acfc-194bf0b5d077 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:09:16.839193 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-077b38ab-bb71-4ab6-8370-693174d4c78c req-d7da9f2d-58bd-4c13-acfc-194bf0b5d077 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/ports?device_id=bdaa3d25-adc2-4a52-8a36-66a599b4b6e2 HTTP/1.1" status: 200 len: 946 time: 0.0820801 May 25 17:09:16.883742 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-077b38ab-bb71-4ab6-8370-693174d4c78c req-7060d650-1b39-46db-b38e-b97085baf451 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/security-groups?id=4e6b7b77-0833-47dc-be2e-ec9c7c960bb9&fields=id&fields=name HTTP/1.1" status: 200 len: 309 time: 0.0387959 May 25 17:09:16.928954 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-4c30f282-59bd-4370-bef4-246fd93f74c0 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Notify callbacks [] for port, precommit_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:09:16.957792 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-4c30f282-59bd-4370-bef4-246fd93f74c0 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8757892520915', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-27483019'] for port, after_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:09:16.962167 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-a1077313-36b0-401c-ab2d-0646413d44d4 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:09:17.021324 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4c30f282-59bd-4370-bef4-246fd93f74c0 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Network 4364b6ab-4117-4a92-baeb-f5ee2f45bf74 is already hosted by enough agents. {{(pid=91830) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 25 17:09:17.024285 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.scheduler.base_scheduler [None req-4c30f282-59bd-4370-bef4-246fd93f74c0 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Resources bound (agent type, host, resource id): {{(pid=91830) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 17:09:17.027687 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4c30f282-59bd-4370-bef4-246fd93f74c0 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Received port after_create {{(pid=91830) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 25 17:09:17.063778 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4c30f282-59bd-4370-bef4-246fd93f74c0 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Pushing event updated for resources: {'Port': ['ID=c3a854e5-7742-4a38-807f-bdcb08805240,revision_number=1']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:09:17.083299 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4c30f282-59bd-4370-bef4-246fd93f74c0 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91830) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:09:17.083671 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4c30f282-59bd-4370-bef4-246fd93f74c0 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91830) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:09:17.084033 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4c30f282-59bd-4370-bef4-246fd93f74c0 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91830) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:09:17.084392 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4c30f282-59bd-4370-bef4-246fd93f74c0 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91830) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:09:17.084741 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4c30f282-59bd-4370-bef4-246fd93f74c0 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91830) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:09:17.085093 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4c30f282-59bd-4370-bef4-246fd93f74c0 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91830) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:09:17.085439 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4c30f282-59bd-4370-bef4-246fd93f74c0 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91830) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:09:17.085795 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4c30f282-59bd-4370-bef4-246fd93f74c0 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91830) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:09:17.086167 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4c30f282-59bd-4370-bef4-246fd93f74c0 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91830) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:09:17.086512 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4c30f282-59bd-4370-bef4-246fd93f74c0 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91830) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:09:17.086892 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4c30f282-59bd-4370-bef4-246fd93f74c0 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91830) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:09:17.087288 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4c30f282-59bd-4370-bef4-246fd93f74c0 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91830) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:09:17.092377 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-4c30f282-59bd-4370-bef4-246fd93f74c0 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.130s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:09:17.126073 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-4c30f282-59bd-4370-bef4-246fd93f74c0 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Notify callbacks [] for floatingip, precommit_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:09:17.182375 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-4c30f282-59bd-4370-bef4-246fd93f74c0 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3832070'] for port, before_update {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:09:17.382715 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-4c30f282-59bd-4370-bef4-246fd93f74c0 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Notify callbacks [] for port, precommit_update {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:09:17.386953 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-4c30f282-59bd-4370-bef4-246fd93f74c0 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8757892955028', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8757892520933', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8757892521750', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-27483010'] for port, after_update {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:09:17.390425 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-e26bfffe-33de-4b8c-a7fd-70b6fef486d2 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:09:17.494855 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4c30f282-59bd-4370-bef4-246fd93f74c0 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Pushing event updated for resources: {'Port': ['ID=c3a854e5-7742-4a38-807f-bdcb08805240,revision_number=2']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:09:17.498803 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-4c30f282-59bd-4370-bef4-246fd93f74c0 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.108s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:09:17.506868 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-4c30f282-59bd-4370-bef4-246fd93f74c0 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-683033'] for floatingip, after_update {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:09:17.528829 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-4c30f282-59bd-4370-bef4-246fd93f74c0 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-178712'] for floatingip, before_response {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:09:17.530057 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [None req-4c30f282-59bd-4370-bef4-246fd93f74c0 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] 10.222.0.62 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 693 time: 1.1551616 May 25 17:09:17.691321 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.quota.resource [req-357a5e6d-ddf2-46a6-a5dd-2b0fb056fb26 req-f88674bd-6c84-4b0c-8614-3717871a7b97 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Synchronizing usage tracker for tenant:70dac097fff04aed99a4976fa955579b on resource:security_group {{(pid=91829) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 25 17:09:17.707039 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.quota.resource [req-357a5e6d-ddf2-46a6-a5dd-2b0fb056fb26 req-f88674bd-6c84-4b0c-8614-3717871a7b97 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Unset dirty status for tenant:70dac097fff04aed99a4976fa955579b on resource:security_group {{(pid=91829) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 25 17:09:17.708161 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-357a5e6d-ddf2-46a6-a5dd-2b0fb056fb26 req-f88674bd-6c84-4b0c-8614-3717871a7b97 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] 10.222.0.62 "GET /v2.0/security-groups?name=tempest-securitygroup--1202805282&fields=id&tenant_id=70dac097fff04aed99a4976fa955579b HTTP/1.1" status: 200 len: 267 time: 0.0599222 May 25 17:09:17.855404 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-357a5e6d-ddf2-46a6-a5dd-2b0fb056fb26 req-1773e58d-ac5c-46c6-9466-891ac7b3c47d tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:09:17.856815 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-357a5e6d-ddf2-46a6-a5dd-2b0fb056fb26 req-1773e58d-ac5c-46c6-9466-891ac7b3c47d tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] 10.222.0.62 "GET /v2.0/networks?id=b351598a-3f6f-4a37-8095-8d9371896ccc HTTP/1.1" status: 200 len: 810 time: 0.1422338 May 25 17:09:17.871422 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-357a5e6d-ddf2-46a6-a5dd-2b0fb056fb26 req-6a357e94-56bd-4be4-ac16-f369e90e4423 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] 10.222.0.62 "GET /v2.0/quotas/70dac097fff04aed99a4976fa955579b HTTP/1.1" status: 200 len: 375 time: 0.0088425 May 25 17:09:17.960816 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.quota.resource [req-357a5e6d-ddf2-46a6-a5dd-2b0fb056fb26 req-2663c625-f79d-4364-a331-635af727277f tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Synchronizing usage tracker for tenant:70dac097fff04aed99a4976fa955579b on resource:port {{(pid=91829) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 25 17:09:17.976052 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.quota.resource [req-357a5e6d-ddf2-46a6-a5dd-2b0fb056fb26 req-2663c625-f79d-4364-a331-635af727277f tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Unset dirty status for tenant:70dac097fff04aed99a4976fa955579b on resource:port {{(pid=91829) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 25 17:09:17.980998 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-357a5e6d-ddf2-46a6-a5dd-2b0fb056fb26 req-2663c625-f79d-4364-a331-635af727277f tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] 10.222.0.62 "GET /v2.0/ports?tenant_id=70dac097fff04aed99a4976fa955579b&fields=id HTTP/1.1" status: 200 len: 348 time: 0.1009769 May 25 17:09:17.992905 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.wsgi [req-357a5e6d-ddf2-46a6-a5dd-2b0fb056fb26 req-90f8fc2a-4a7e-49e3-8c65-8005ec970033 service neutron] http://10.222.0.62:9696/v2.0/extensions returned with HTTP 200 {{(pid=91829) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} May 25 17:09:17.993840 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-357a5e6d-ddf2-46a6-a5dd-2b0fb056fb26 req-90f8fc2a-4a7e-49e3-8c65-8005ec970033 service neutron] 10.222.0.62 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 13640 time: 0.0052242 May 25 17:09:18.185973 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-357a5e6d-ddf2-46a6-a5dd-2b0fb056fb26 req-3b9faab1-9684-43f7-bfbd-060a72d98b23 service neutron] 10.222.0.62 "GET /v2.0/networks/b351598a-3f6f-4a37-8095-8d9371896ccc?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1862295 May 25 17:09:18.193224 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b51b9023-b234-43ae-8847-658df6d2efbc req-d17cfb5d-d262-4d92-b857-34cd77f23b2d tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:09:18.194601 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-b51b9023-b234-43ae-8847-658df6d2efbc req-d17cfb5d-d262-4d92-b857-34cd77f23b2d tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/ports?device_id=bdaa3d25-adc2-4a52-8a36-66a599b4b6e2 HTTP/1.1" status: 200 len: 946 time: 0.1775351 May 25 17:09:18.407544 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-b51b9023-b234-43ae-8847-658df6d2efbc req-9ddc4ba1-8d19-4d14-9858-9c500cf6a5b7 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/security-groups?id=4e6b7b77-0833-47dc-be2e-ec9c7c960bb9&fields=id&fields=name HTTP/1.1" status: 200 len: 309 time: 0.1012948 May 25 17:09:18.443406 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-357a5e6d-ddf2-46a6-a5dd-2b0fb056fb26 req-3ab37e82-f989-4890-9d99-3c5985b4eea8 service neutron] 10.222.0.62 "GET /v2.0/networks/b351598a-3f6f-4a37-8095-8d9371896ccc?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2478173 May 25 17:09:18.615755 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-13e7cdb8-b331-4ac1-914d-99d122a77a67 req-b1395890-11d1-4ea2-a1d2-ad60855bbbf1 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] 10.222.0.62 "GET /v2.0/ports?device_id=2c1b6af6-e585-417b-8583-2d6739261c16 HTTP/1.1" status: 200 len: 210 time: 0.0423665 May 25 17:09:19.602997 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-246d200b-cd54-4c49-8548-f806a242c76e req-0f7a8432-3b25-498e-b92b-83f20576c9d2 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:09:19.604450 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-246d200b-cd54-4c49-8548-f806a242c76e req-0f7a8432-3b25-498e-b92b-83f20576c9d2 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/ports?device_id=bdaa3d25-adc2-4a52-8a36-66a599b4b6e2 HTTP/1.1" status: 200 len: 946 time: 0.0856264 May 25 17:09:19.651587 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-246d200b-cd54-4c49-8548-f806a242c76e req-752ca61a-e81b-44b8-afab-c14ee1c3ac8c tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/security-groups?id=4e6b7b77-0833-47dc-be2e-ec9c7c960bb9&fields=id&fields=name HTTP/1.1" status: 200 len: 309 time: 0.0408292 May 25 17:09:19.763743 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-18aa9ed3-7802-4f1b-bba4-f74bd30db5ff req-82669502-fc1f-472f-82f1-d995e2a1514c tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] 10.222.0.62 "GET /v2.0/ports?device_id=2c1b6af6-e585-417b-8583-2d6739261c16 HTTP/1.1" status: 200 len: 210 time: 0.0431573 May 25 17:09:20.328495 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-357a5e6d-ddf2-46a6-a5dd-2b0fb056fb26 req-ed41f7af-d5e8-49ea-bb03-9721e0dcbc6a tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:09:20.329930 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-357a5e6d-ddf2-46a6-a5dd-2b0fb056fb26 req-ed41f7af-d5e8-49ea-bb03-9721e0dcbc6a tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] 10.222.0.32 "GET /v2.0/networks?id=b351598a-3f6f-4a37-8095-8d9371896ccc HTTP/1.1" status: 200 len: 810 time: 0.1494534 May 25 17:09:20.383308 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-357a5e6d-ddf2-46a6-a5dd-2b0fb056fb26 req-dbcf2a84-e9ea-421d-9d2b-ea49c4a2e9b2 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] 10.222.0.32 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=70dac097fff04aed99a4976fa955579b HTTP/1.1" status: 200 len: 380 time: 0.0418072 May 25 17:09:20.392328 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.v2.base [req-357a5e6d-ddf2-46a6-a5dd-2b0fb056fb26 req-54455d27-3807-4e46-a777-7c92623827e8 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Request body: {'port': {'device_id': '2c1b6af6-e585-417b-8583-2d6739261c16', 'network_id': 'b351598a-3f6f-4a37-8095-8d9371896ccc', 'admin_state_up': True, 'tenant_id': '70dac097fff04aed99a4976fa955579b', 'security_groups': ['388811ac-c781-471a-a517-2ae8158e9b4a']}} {{(pid=91829) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 17:09:20.526434 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.quota.driver [req-357a5e6d-ddf2-46a6-a5dd-2b0fb056fb26 req-54455d27-3807-4e46-a777-7c92623827e8 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91829) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 17:09:20.535568 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.quota.driver [req-357a5e6d-ddf2-46a6-a5dd-2b0fb056fb26 req-54455d27-3807-4e46-a777-7c92623827e8 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Attempting to reserve 1 items for resource port. Total usage: 3; quota limit: 500; headroom:497 {{(pid=91829) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 17:09:20.544725 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-357a5e6d-ddf2-46a6-a5dd-2b0fb056fb26 req-54455d27-3807-4e46-a777-7c92623827e8 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Made reservation on behalf of 70dac097fff04aed99a4976fa955579b for: {'port': 1} {{(pid=91829) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 25 17:09:20.548489 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [req-357a5e6d-ddf2-46a6-a5dd-2b0fb056fb26 req-54455d27-3807-4e46-a777-7c92623827e8 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3832070'] for port, before_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:09:20.708162 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.db_base_plugin_common [req-357a5e6d-ddf2-46a6-a5dd-2b0fb056fb26 req-54455d27-3807-4e46-a777-7c92623827e8 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Allocated IP 172.20.0.5 (b351598a-3f6f-4a37-8095-8d9371896ccc/4bbae145-74ed-4fda-b7c0-ae77a3202a83/efef57db-3376-4eb7-83b9-75c45a34667f) {{(pid=91829) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 25 17:09:20.929386 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-dc3acec5-7468-406c-af2f-1f5bccc1d497 req-9163f14a-130f-465a-8125-9158ae7a7044 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] 10.222.0.62 "GET /v2.0/ports?device_id=2c1b6af6-e585-417b-8583-2d6739261c16 HTTP/1.1" status: 200 len: 210 time: 0.0477302 May 25 17:09:21.006043 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b0ced8ae-64bc-4f49-8db4-09e45f14c84a req-cbe37594-a605-4f98-9b51-dba73d18e1d8 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:09:21.007461 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-b0ced8ae-64bc-4f49-8db4-09e45f14c84a req-cbe37594-a605-4f98-9b51-dba73d18e1d8 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/ports?device_id=bdaa3d25-adc2-4a52-8a36-66a599b4b6e2 HTTP/1.1" status: 200 len: 946 time: 0.2387297 May 25 17:09:21.011833 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [req-357a5e6d-ddf2-46a6-a5dd-2b0fb056fb26 req-54455d27-3807-4e46-a777-7c92623827e8 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Notify callbacks [] for port, precommit_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:09:21.046156 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.provisioning_blocks [req-357a5e6d-ddf2-46a6-a5dd-2b0fb056fb26 req-54455d27-3807-4e46-a777-7c92623827e8 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Transition to ACTIVE for port object efef57db-3376-4eb7-83b9-75c45a34667f will not be triggered until provisioned by entity DHCP. {{(pid=91829) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 25 17:09:21.067984 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-b0ced8ae-64bc-4f49-8db4-09e45f14c84a req-d3a6eac5-d235-4bdf-845b-45fe59896a5c tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/security-groups?id=4e6b7b77-0833-47dc-be2e-ec9c7c960bb9&fields=id&fields=name HTTP/1.1" status: 200 len: 309 time: 0.0531557 May 25 17:09:21.085332 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [req-357a5e6d-ddf2-46a6-a5dd-2b0fb056fb26 req-54455d27-3807-4e46-a777-7c92623827e8 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8757892520915', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28230808'] for port, after_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:09:21.099365 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-f59c74d8-136e-4fb4-8860-87b398d30a1a tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:09:21.163490 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-357a5e6d-ddf2-46a6-a5dd-2b0fb056fb26 req-54455d27-3807-4e46-a777-7c92623827e8 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Network b351598a-3f6f-4a37-8095-8d9371896ccc is already hosted by enough agents. {{(pid=91829) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 25 17:09:21.166272 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.scheduler.base_scheduler [req-357a5e6d-ddf2-46a6-a5dd-2b0fb056fb26 req-54455d27-3807-4e46-a777-7c92623827e8 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Resources bound (agent type, host, resource id): {{(pid=91829) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 17:09:21.170883 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.l3_dvrscheduler_db [req-357a5e6d-ddf2-46a6-a5dd-2b0fb056fb26 req-54455d27-3807-4e46-a777-7c92623827e8 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Received port after_create {{(pid=91829) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 25 17:09:21.204923 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-54455d27-3807-4e46-a777-7c92623827e8 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Pushing event updated for resources: {'Port': ['ID=efef57db-3376-4eb7-83b9-75c45a34667f,revision_number=1']} {{(pid=91829) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:09:21.211463 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-54455d27-3807-4e46-a777-7c92623827e8 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.112s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:09:21.241421 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-357a5e6d-ddf2-46a6-a5dd-2b0fb056fb26 req-54455d27-3807-4e46-a777-7c92623827e8 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:09:21.242063 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [req-357a5e6d-ddf2-46a6-a5dd-2b0fb056fb26 req-54455d27-3807-4e46-a777-7c92623827e8 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-178712'] for port, before_response {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:09:21.268085 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-357a5e6d-ddf2-46a6-a5dd-2b0fb056fb26 req-54455d27-3807-4e46-a777-7c92623827e8 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] 10.222.0.32 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.8792729 May 25 17:09:21.279744 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.wsgi [req-357a5e6d-ddf2-46a6-a5dd-2b0fb056fb26 req-0b042d79-3c79-468c-b9cd-441a600aca13 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] http://10.222.0.62:9696/v2.0/extensions returned with HTTP 200 {{(pid=91829) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} May 25 17:09:21.280685 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-357a5e6d-ddf2-46a6-a5dd-2b0fb056fb26 req-0b042d79-3c79-468c-b9cd-441a600aca13 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] 10.222.0.32 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 13640 time: 0.0059063 May 25 17:09:21.357742 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.provisioning_blocks [None req-115bcbfc-acb8-4206-9e11-5ec10d34fa83 None None] Provisioning for port efef57db-3376-4eb7-83b9-75c45a34667f completed by entity DHCP. {{(pid=91831) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 25 17:09:21.362583 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.provisioning_blocks [None req-115bcbfc-acb8-4206-9e11-5ec10d34fa83 None None] Provisioning complete for port efef57db-3376-4eb7-83b9-75c45a34667f triggered by entity DHCP. {{(pid=91831) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 17:09:21.362977 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-115bcbfc-acb8-4206-9e11-5ec10d34fa83 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3854128'] for port, provisioning_complete {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:09:21.393575 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.v2.base [req-357a5e6d-ddf2-46a6-a5dd-2b0fb056fb26 req-7db128ba-013f-4cc8-ab63-b5137447fa37 service neutron] Request body: {'port': {'device_id': '2c1b6af6-e585-417b-8583-2d6739261c16', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-79049'}} {{(pid=91829) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 17:09:21.415782 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.plugin [None req-115bcbfc-acb8-4206-9e11-5ec10d34fa83 None None] Port efef57db-3376-4eb7-83b9-75c45a34667f cannot update to ACTIVE because it is not bound. {{(pid=91831) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 25 17:09:21.499680 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [req-357a5e6d-ddf2-46a6-a5dd-2b0fb056fb26 req-7db128ba-013f-4cc8-ab63-b5137447fa37 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3832070'] for port, before_update {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:09:21.931158 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.notifiers.nova [req-357a5e6d-ddf2-46a6-a5dd-2b0fb056fb26 req-7db128ba-013f-4cc8-ab63-b5137447fa37 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id efef57db-3376-4eb7-83b9-75c45a34667f {{(pid=91829) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} May 25 17:09:21.939368 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [req-357a5e6d-ddf2-46a6-a5dd-2b0fb056fb26 req-7db128ba-013f-4cc8-ab63-b5137447fa37 service neutron] Notify callbacks [] for port, precommit_update {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:09:21.953757 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.provisioning_blocks [req-357a5e6d-ddf2-46a6-a5dd-2b0fb056fb26 req-7db128ba-013f-4cc8-ab63-b5137447fa37 service neutron] Transition to ACTIVE for port object efef57db-3376-4eb7-83b9-75c45a34667f will not be triggered until provisioned by entity L2. {{(pid=91829) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 25 17:09:21.958447 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [req-357a5e6d-ddf2-46a6-a5dd-2b0fb056fb26 req-7db128ba-013f-4cc8-ab63-b5137447fa37 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8757892955028', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8757892520933', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8757892521750', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28230801'] for port, after_update {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:09:21.962149 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-29714c98-817b-4459-af55-7db1747da55c tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:09:22.165858 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7db128ba-013f-4cc8-ab63-b5137447fa37 service neutron] Pushing event updated for resources: {'Port': ['ID=efef57db-3376-4eb7-83b9-75c45a34667f,revision_number=2']} {{(pid=91829) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:09:22.174754 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-7db128ba-013f-4cc8-ab63-b5137447fa37 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.213s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:09:22.318948 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.plugins.ml2.managers [req-357a5e6d-ddf2-46a6-a5dd-2b0fb056fb26 req-7db128ba-013f-4cc8-ab63-b5137447fa37 service neutron] Attempting to bind port efef57db-3376-4eb7-83b9-75c45a34667f on host hv-cinder-79049 for vnic_type normal with profile {{(pid=91829) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 25 17:09:22.319282 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.plugins.ml2.managers [req-357a5e6d-ddf2-46a6-a5dd-2b0fb056fb26 req-7db128ba-013f-4cc8-ab63-b5137447fa37 service neutron] Attempting to bind port efef57db-3376-4eb7-83b9-75c45a34667f by drivers openvswitch,hyperv on host hv-cinder-79049 at level 0 using segments [{'id': 'b8ba5240-28ce-40db-a6e6-b4a42435e0b6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 655, 'network_id': 'b351598a-3f6f-4a37-8095-8d9371896ccc'}] {{(pid=91829) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 25 17:09:22.319605 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-357a5e6d-ddf2-46a6-a5dd-2b0fb056fb26 req-7db128ba-013f-4cc8-ab63-b5137447fa37 service neutron] Attempting to bind port efef57db-3376-4eb7-83b9-75c45a34667f on network b351598a-3f6f-4a37-8095-8d9371896ccc {{(pid=91829) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 25 17:09:22.330500 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aa284945-4e0a-45b1-b1fe-25c692600da5 req-0120a6dd-6e06-4a2f-92d7-5911e557365b tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:09:22.331178 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.quota.resource [req-aa284945-4e0a-45b1-b1fe-25c692600da5 req-0120a6dd-6e06-4a2f-92d7-5911e557365b tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Synchronizing usage tracker for tenant:70dac097fff04aed99a4976fa955579b on resource:port {{(pid=91829) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 25 17:09:22.338298 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-357a5e6d-ddf2-46a6-a5dd-2b0fb056fb26 req-7db128ba-013f-4cc8-ab63-b5137447fa37 service neutron] Port efef57db-3376-4eb7-83b9-75c45a34667f on network b351598a-3f6f-4a37-8095-8d9371896ccc not bound, no agent of type Open vSwitch agent registered on host hv-cinder-79049 {{(pid=91829) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 25 17:09:22.338616 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-357a5e6d-ddf2-46a6-a5dd-2b0fb056fb26 req-7db128ba-013f-4cc8-ab63-b5137447fa37 service neutron] Attempting to bind port efef57db-3376-4eb7-83b9-75c45a34667f on network b351598a-3f6f-4a37-8095-8d9371896ccc {{(pid=91829) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 25 17:09:22.351240 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-357a5e6d-ddf2-46a6-a5dd-2b0fb056fb26 req-7db128ba-013f-4cc8-ab63-b5137447fa37 service neutron] Checking agent: {'id': '3a1fdee1-bff0-49fb-b470-e13b95ee1b4d', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-79049', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 25, 16, 56, 32), 'started_at': datetime.datetime(2021, 5, 25, 16, 56, 32), 'heartbeat_timestamp': datetime.datetime(2021, 5, 25, 17, 9, 7), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=91829) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 25 17:09:22.351571 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-357a5e6d-ddf2-46a6-a5dd-2b0fb056fb26 req-7db128ba-013f-4cc8-ab63-b5137447fa37 service neutron] Checking segment: {'id': 'b8ba5240-28ce-40db-a6e6-b4a42435e0b6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 655, 'network_id': 'b351598a-3f6f-4a37-8095-8d9371896ccc'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91829) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 25 17:09:22.351945 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-357a5e6d-ddf2-46a6-a5dd-2b0fb056fb26 req-7db128ba-013f-4cc8-ab63-b5137447fa37 service neutron] Bound using segment: {'id': 'b8ba5240-28ce-40db-a6e6-b4a42435e0b6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 655, 'network_id': 'b351598a-3f6f-4a37-8095-8d9371896ccc'} {{(pid=91829) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 25 17:09:22.352363 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.plugins.ml2.managers [req-357a5e6d-ddf2-46a6-a5dd-2b0fb056fb26 req-7db128ba-013f-4cc8-ab63-b5137447fa37 service neutron] Bound port: efef57db-3376-4eb7-83b9-75c45a34667f, host: hv-cinder-79049, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'b8ba5240-28ce-40db-a6e6-b4a42435e0b6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 655, 'network_id': 'b351598a-3f6f-4a37-8095-8d9371896ccc'}}] {{(pid=91829) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 25 17:09:22.352702 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [req-357a5e6d-ddf2-46a6-a5dd-2b0fb056fb26 req-7db128ba-013f-4cc8-ab63-b5137447fa37 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3832070'] for port, before_update {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:09:22.381756 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-07b8af6c-b4f3-4eea-b98d-b097fef0aa8a req-2fe386ad-2471-421a-93f9-9ee3b362f7b4 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:09:22.383214 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-07b8af6c-b4f3-4eea-b98d-b097fef0aa8a req-2fe386ad-2471-421a-93f9-9ee3b362f7b4 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/ports?device_id=bdaa3d25-adc2-4a52-8a36-66a599b4b6e2 HTTP/1.1" status: 200 len: 946 time: 0.1731029 May 25 17:09:22.383770 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.quota.resource [req-aa284945-4e0a-45b1-b1fe-25c692600da5 req-0120a6dd-6e06-4a2f-92d7-5911e557365b tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Unset dirty status for tenant:70dac097fff04aed99a4976fa955579b on resource:port {{(pid=91829) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 25 17:09:22.384722 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-aa284945-4e0a-45b1-b1fe-25c692600da5 req-0120a6dd-6e06-4a2f-92d7-5911e557365b tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] 10.222.0.62 "GET /v2.0/ports?device_id=2c1b6af6-e585-417b-8583-2d6739261c16 HTTP/1.1" status: 200 len: 943 time: 0.3191924 May 25 17:09:22.512301 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-aa284945-4e0a-45b1-b1fe-25c692600da5 req-78fcbfa6-4f6e-4b75-b2de-0a70f5c4872d tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] 10.222.0.62 "GET /v2.0/security-groups?id=388811ac-c781-471a-a517-2ae8158e9b4a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1020489 May 25 17:09:22.514719 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-07b8af6c-b4f3-4eea-b98d-b097fef0aa8a req-004a16e7-9426-4628-905b-d9ebd095ae5a tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/security-groups?id=4e6b7b77-0833-47dc-be2e-ec9c7c960bb9&fields=id&fields=name HTTP/1.1" status: 200 len: 309 time: 0.1041315 May 25 17:09:22.531250 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.plugins.ml2.db [req-357a5e6d-ddf2-46a6-a5dd-2b0fb056fb26 req-7db128ba-013f-4cc8-ab63-b5137447fa37 service neutron] For port efef57db-3376-4eb7-83b9-75c45a34667f, host hv-cinder-79049, cleared binding levels {{(pid=91829) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 25 17:09:22.534157 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.plugins.ml2.db [req-357a5e6d-ddf2-46a6-a5dd-2b0fb056fb26 req-7db128ba-013f-4cc8-ab63-b5137447fa37 service neutron] For port efef57db-3376-4eb7-83b9-75c45a34667f, host hv-cinder-79049, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79049',level=0,port_id=efef57db-3376-4eb7-83b9-75c45a34667f,segment=NetworkSegment(b8ba5240-28ce-40db-a6e6-b4a42435e0b6),segment_id=b8ba5240-28ce-40db-a6e6-b4a42435e0b6)] {{(pid=91829) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 25 17:09:22.539059 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [req-357a5e6d-ddf2-46a6-a5dd-2b0fb056fb26 req-7db128ba-013f-4cc8-ab63-b5137447fa37 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8757892955028', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8757892520933', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8757892521750', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28230801'] for port, after_update {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:09:22.543924 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-39147570-64f0-440b-a478-00b6abb26226 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:09:22.596491 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-357a5e6d-ddf2-46a6-a5dd-2b0fb056fb26 req-7db128ba-013f-4cc8-ab63-b5137447fa37 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:09:22.596979 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [req-357a5e6d-ddf2-46a6-a5dd-2b0fb056fb26 req-7db128ba-013f-4cc8-ab63-b5137447fa37 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-178712'] for port, before_response {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:09:22.598510 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-357a5e6d-ddf2-46a6-a5dd-2b0fb056fb26 req-7db128ba-013f-4cc8-ab63-b5137447fa37 service neutron] 10.222.0.32 "PUT /v2.0/ports/efef57db-3376-4eb7-83b9-75c45a34667f HTTP/1.1" status: 200 len: 1093 time: 1.3103762 May 25 17:09:22.601433 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '2c1b6af6-e585-417b-8583-2d6739261c16', 'tag': 'efef57db-3376-4eb7-83b9-75c45a34667f'}] {{(pid=91829) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 25 17:09:22.628296 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7db128ba-013f-4cc8-ab63-b5137447fa37 service neutron] Pushing event updated for resources: {'Port': ['ID=efef57db-3376-4eb7-83b9-75c45a34667f,revision_number=3']} {{(pid=91829) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:09:22.634338 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-7db128ba-013f-4cc8-ab63-b5137447fa37 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.090s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:09:22.716166 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-357a5e6d-ddf2-46a6-a5dd-2b0fb056fb26 req-51b67944-0e0e-491b-bfb9-555d8daa865e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:09:22.717725 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-357a5e6d-ddf2-46a6-a5dd-2b0fb056fb26 req-51b67944-0e0e-491b-bfb9-555d8daa865e service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=70dac097fff04aed99a4976fa955579b&device_id=2c1b6af6-e585-417b-8583-2d6739261c16 HTTP/1.1" status: 200 len: 1096 time: 0.0792246 May 25 17:09:22.720296 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '2c1b6af6-e585-417b-8583-2d6739261c16', 'tag': 'efef57db-3376-4eb7-83b9-75c45a34667f', 'status': 'completed', 'code': 200} May 25 17:09:22.800922 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-357a5e6d-ddf2-46a6-a5dd-2b0fb056fb26 req-775a1b34-a64f-4365-b2d3-84eb8f9fb04f service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=efef57db-3376-4eb7-83b9-75c45a34667f HTTP/1.1" status: 200 len: 217 time: 0.0666432 May 25 17:09:22.868534 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-357a5e6d-ddf2-46a6-a5dd-2b0fb056fb26 req-687bb5b2-7e27-4c74-b36a-8724c15d0f1f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:09:22.869966 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-357a5e6d-ddf2-46a6-a5dd-2b0fb056fb26 req-687bb5b2-7e27-4c74-b36a-8724c15d0f1f service neutron] 10.222.0.32 "GET /v2.0/subnets?id=4bbae145-74ed-4fda-b7c0-ae77a3202a83 HTTP/1.1" status: 200 len: 849 time: 0.0593622 May 25 17:09:22.948083 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-357a5e6d-ddf2-46a6-a5dd-2b0fb056fb26 req-0b5207e0-eba2-4851-b7f1-64fa79d666f2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:09:22.949525 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-357a5e6d-ddf2-46a6-a5dd-2b0fb056fb26 req-0b5207e0-eba2-4851-b7f1-64fa79d666f2 service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=b351598a-3f6f-4a37-8095-8d9371896ccc&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0699205 May 25 17:09:23.098253 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-357a5e6d-ddf2-46a6-a5dd-2b0fb056fb26 req-c7262180-20d9-4204-9d62-5e965f4a5fcb service neutron] 10.222.0.32 "GET /v2.0/networks/b351598a-3f6f-4a37-8095-8d9371896ccc?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1297386 May 25 17:09:23.229519 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-357a5e6d-ddf2-46a6-a5dd-2b0fb056fb26 req-8b724039-e6fd-406a-85bf-7df9b3202747 service neutron] 10.222.0.32 "GET /v2.0/networks/b351598a-3f6f-4a37-8095-8d9371896ccc?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1222394 May 25 17:09:23.350235 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dddcd84e-f503-499c-975e-15a341ef3018 req-f82c1d57-c5ea-4c26-af72-d0ebed2fa04f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:09:23.351639 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-dddcd84e-f503-499c-975e-15a341ef3018 req-f82c1d57-c5ea-4c26-af72-d0ebed2fa04f service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=70dac097fff04aed99a4976fa955579b&device_id=2c1b6af6-e585-417b-8583-2d6739261c16 HTTP/1.1" status: 200 len: 1096 time: 0.0688000 May 25 17:09:23.481543 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dddcd84e-f503-499c-975e-15a341ef3018 req-78b82136-91d6-499b-a077-de43f35ffce1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:09:23.483004 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-dddcd84e-f503-499c-975e-15a341ef3018 req-78b82136-91d6-499b-a077-de43f35ffce1 service neutron] 10.222.0.32 "GET /v2.0/networks?id=b351598a-3f6f-4a37-8095-8d9371896ccc HTTP/1.1" status: 200 len: 911 time: 0.1246312 May 25 17:09:23.732158 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-dddcd84e-f503-499c-975e-15a341ef3018 req-6d4d6ed5-459d-41be-97c6-b452dc7d5b9f service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=efef57db-3376-4eb7-83b9-75c45a34667f HTTP/1.1" status: 200 len: 217 time: 0.2425473 May 25 17:09:23.849531 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dddcd84e-f503-499c-975e-15a341ef3018 req-a57870f0-ccd1-4049-a08b-f0b9501f4c8e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:09:23.850982 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-dddcd84e-f503-499c-975e-15a341ef3018 req-a57870f0-ccd1-4049-a08b-f0b9501f4c8e service neutron] 10.222.0.32 "GET /v2.0/subnets?id=4bbae145-74ed-4fda-b7c0-ae77a3202a83 HTTP/1.1" status: 200 len: 849 time: 0.1015005 May 25 17:09:23.926327 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-487aac49-6757-4a24-a7e7-b5bef33d9d04 req-4a895e81-f2fc-4016-b0c4-fe5be49f5dac tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:09:23.927770 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-487aac49-6757-4a24-a7e7-b5bef33d9d04 req-4a895e81-f2fc-4016-b0c4-fe5be49f5dac tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] 10.222.0.62 "GET /v2.0/ports?device_id=2c1b6af6-e585-417b-8583-2d6739261c16 HTTP/1.1" status: 200 len: 943 time: 0.2669618 May 25 17:09:23.938638 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-863275de-4bed-4f17-8513-c015f474e678 req-3c31f86a-bebd-44c9-910c-d2c0fc355567 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:09:23.940772 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-863275de-4bed-4f17-8513-c015f474e678 req-3c31f86a-bebd-44c9-910c-d2c0fc355567 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/ports?device_id=bdaa3d25-adc2-4a52-8a36-66a599b4b6e2 HTTP/1.1" status: 200 len: 946 time: 0.2787144 May 25 17:09:24.033774 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-487aac49-6757-4a24-a7e7-b5bef33d9d04 req-6c4034c3-24ea-474c-bb24-d87750313d63 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] 10.222.0.62 "GET /v2.0/security-groups?id=388811ac-c781-471a-a517-2ae8158e9b4a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0902376 May 25 17:09:24.040828 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-863275de-4bed-4f17-8513-c015f474e678 req-9b18bd3d-c1e8-4a70-9e8c-9966e0741ea1 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/security-groups?id=4e6b7b77-0833-47dc-be2e-ec9c7c960bb9&fields=id&fields=name HTTP/1.1" status: 200 len: 309 time: 0.0781672 May 25 17:09:24.043806 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dddcd84e-f503-499c-975e-15a341ef3018 req-a47399e8-7600-4be3-8be2-837ae0de9a59 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:09:24.045212 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-dddcd84e-f503-499c-975e-15a341ef3018 req-a47399e8-7600-4be3-8be2-837ae0de9a59 service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=b351598a-3f6f-4a37-8095-8d9371896ccc&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.1880686 May 25 17:09:24.178003 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-dddcd84e-f503-499c-975e-15a341ef3018 req-3f0bd921-0d04-4c5a-b843-e04d78e3ef61 service neutron] 10.222.0.32 "GET /v2.0/networks/b351598a-3f6f-4a37-8095-8d9371896ccc?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1256623 May 25 17:09:24.314222 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-dddcd84e-f503-499c-975e-15a341ef3018 req-c0daf1dc-f146-4caa-823a-9b145f0f596a service neutron] 10.222.0.32 "GET /v2.0/networks/b351598a-3f6f-4a37-8095-8d9371896ccc?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1292670 May 25 17:09:25.283446 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-96a87a78-f9ac-49ea-8e9c-6758143111c6 req-1d56a518-3c60-43fe-878a-26d0500fbde3 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:09:25.284813 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-96a87a78-f9ac-49ea-8e9c-6758143111c6 req-1d56a518-3c60-43fe-878a-26d0500fbde3 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] 10.222.0.62 "GET /v2.0/ports?device_id=2c1b6af6-e585-417b-8583-2d6739261c16 HTTP/1.1" status: 200 len: 943 time: 0.1413114 May 25 17:09:25.294168 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4dd98b55-f333-4a3f-b96c-ce4210a5a19f req-265eb863-c03c-48f4-bebd-522bb2e6ac19 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:09:25.295575 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-4dd98b55-f333-4a3f-b96c-ce4210a5a19f req-265eb863-c03c-48f4-bebd-522bb2e6ac19 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/ports?device_id=bdaa3d25-adc2-4a52-8a36-66a599b4b6e2 HTTP/1.1" status: 200 len: 946 time: 0.1209700 May 25 17:09:25.307803 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-a2b625af-bdc9-42df-aa83-ca1d7c9b56b4 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:09:25.363517 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-96a87a78-f9ac-49ea-8e9c-6758143111c6 req-f685e41d-6321-48cb-8619-bbc0f35db5d5 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] 10.222.0.62 "GET /v2.0/security-groups?id=388811ac-c781-471a-a517-2ae8158e9b4a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0670004 May 25 17:09:25.370138 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-4dd98b55-f333-4a3f-b96c-ce4210a5a19f req-4e5f10be-c2e1-4f71-a25d-59128070c56b tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/security-groups?id=4e6b7b77-0833-47dc-be2e-ec9c7c960bb9&fields=id&fields=name HTTP/1.1" status: 200 len: 309 time: 0.0578535 May 25 17:09:26.361483 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.rpc [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Device efef57db-3376-4eb7-83b9-75c45a34667f details requested by agent hyperv_hv-cinder-79049 with host hv-cinder-79049 {{(pid=91831) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 25 17:09:26.499799 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.db [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] For port efef57db-3376-4eb7-83b9-75c45a34667f, host hv-cinder-79049, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79049',level=0,port_id=efef57db-3376-4eb7-83b9-75c45a34667f,segment=NetworkSegment(b8ba5240-28ce-40db-a6e6-b4a42435e0b6),segment_id=b8ba5240-28ce-40db-a6e6-b4a42435e0b6)] {{(pid=91831) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 17:09:26.513956 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.rpc [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Returning: {'device': 'efef57db-3376-4eb7-83b9-75c45a34667f', 'network_id': 'b351598a-3f6f-4a37-8095-8d9371896ccc', 'port_id': 'efef57db-3376-4eb7-83b9-75c45a34667f', 'mac_address': 'fa:16:3e:8e:f0:d7', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 655, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '4bbae145-74ed-4fda-b7c0-ae77a3202a83', 'ip_address': '172.20.0.5'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=91831) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 25 17:09:26.608311 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3832070'] for port, before_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:09:26.611880 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7a06aa30-4c3e-4629-8243-9c715be0b7ec req-a51f22f6-bed6-4bda-9d24-0bc9157a4b0d tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:09:26.613291 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-7a06aa30-4c3e-4629-8243-9c715be0b7ec req-a51f22f6-bed6-4bda-9d24-0bc9157a4b0d tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] 10.222.0.62 "GET /v2.0/ports?device_id=2c1b6af6-e585-417b-8583-2d6739261c16 HTTP/1.1" status: 200 len: 943 time: 0.1410394 May 25 17:09:26.625369 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.notifiers.nova [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id efef57db-3376-4eb7-83b9-75c45a34667f {{(pid=91831) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} May 25 17:09:26.625898 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d38441c0-a396-4ef5-9446-1124eb53e391 req-4617c4ec-40d4-4413-afe7-27045a4ce548 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:09:26.627332 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-d38441c0-a396-4ef5-9446-1124eb53e391 req-4617c4ec-40d4-4413-afe7-27045a4ce548 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/ports?device_id=bdaa3d25-adc2-4a52-8a36-66a599b4b6e2 HTTP/1.1" status: 200 len: 946 time: 0.1189802 May 25 17:09:26.641198 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.db [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] For port efef57db-3376-4eb7-83b9-75c45a34667f, host hv-cinder-79049, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79049',level=0,port_id=efef57db-3376-4eb7-83b9-75c45a34667f,segment=NetworkSegment(b8ba5240-28ce-40db-a6e6-b4a42435e0b6),segment_id=b8ba5240-28ce-40db-a6e6-b4a42435e0b6)] {{(pid=91831) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 17:09:26.645393 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8757892955028', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8757892520933', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8757892521750'] for port, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:09:26.647177 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [None req-0fc2775e-b5b4-4cc1-8594-88543756e6ab None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:09:26.695266 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-7a06aa30-4c3e-4629-8243-9c715be0b7ec req-9567f647-28c7-428d-938e-aa30d5a6a81d tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] 10.222.0.62 "GET /v2.0/security-groups?id=388811ac-c781-471a-a517-2ae8158e9b4a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0669854 May 25 17:09:26.702175 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-d38441c0-a396-4ef5-9446-1124eb53e391 req-261532e2-535b-40c2-ad5f-2fb9fa9110a8 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/security-groups?id=4e6b7b77-0833-47dc-be2e-ec9c7c960bb9&fields=id&fields=name HTTP/1.1" status: 200 len: 309 time: 0.0590124 May 25 17:09:26.712710 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Pushing event updated for resources: {'Port': ['ID=efef57db-3376-4eb7-83b9-75c45a34667f,revision_number=4']} {{(pid=91831) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:09:26.721112 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91831) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:09:26.721454 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91831) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:09:26.721789 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91831) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:09:26.722147 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91831) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:09:26.722476 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91831) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:09:26.722800 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91831) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:09:26.723122 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91831) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:09:26.723441 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91831) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:09:26.723760 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91831) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:09:26.724075 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91831) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:09:26.724391 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91831) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:09:26.724702 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91831) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:09:26.728573 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.081s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:09:27.225235 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.db [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] get_ports_and_sgs() called for port_ids ['efef57db-3376-4eb7-83b9-75c45a34667f'] {{(pid=91831) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 25 17:09:27.708632 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-ade18911-510c-4f9e-a477-0f5b182451d6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:09:27.893994 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:09:27.942379 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1e3b57b7-4b72-4443-9d56-66b5dae39e98 req-0e7648ad-8db9-479f-8606-8793bf3c27ee tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:09:27.943917 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-1e3b57b7-4b72-4443-9d56-66b5dae39e98 req-0e7648ad-8db9-479f-8606-8793bf3c27ee tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] 10.222.0.62 "GET /v2.0/ports?device_id=2c1b6af6-e585-417b-8583-2d6739261c16 HTTP/1.1" status: 200 len: 944 time: 0.1412678 May 25 17:09:27.952639 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b1c63a63-5394-4293-9464-cff5fae73266 req-45c2db8a-6c91-4617-815c-2f196ceb0632 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:09:27.953990 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-b1c63a63-5394-4293-9464-cff5fae73266 req-45c2db8a-6c91-4617-815c-2f196ceb0632 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/ports?device_id=bdaa3d25-adc2-4a52-8a36-66a599b4b6e2 HTTP/1.1" status: 200 len: 946 time: 0.1193109 May 25 17:09:28.026556 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-1e3b57b7-4b72-4443-9d56-66b5dae39e98 req-f3213491-d281-4dc0-aaf5-a49b36cab96c tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] 10.222.0.62 "GET /v2.0/security-groups?id=388811ac-c781-471a-a517-2ae8158e9b4a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0716419 May 25 17:09:28.032768 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-b1c63a63-5394-4293-9464-cff5fae73266 req-e2ff6a9b-f1fe-46b0-92ee-c2df250f44e5 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/security-groups?id=4e6b7b77-0833-47dc-be2e-ec9c7c960bb9&fields=id&fields=name HTTP/1.1" status: 200 len: 309 time: 0.0637853 May 25 17:09:28.640552 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-0a55eb4a-8b57-4233-84d6-6b423b4ed6db None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:09:29.274644 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c304085b-ce50-4e7d-9b88-f2754677eb2d req-40250e85-df7b-449b-af60-a381e83c323c tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:09:29.276004 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-c304085b-ce50-4e7d-9b88-f2754677eb2d req-40250e85-df7b-449b-af60-a381e83c323c tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] 10.222.0.62 "GET /v2.0/ports?device_id=2c1b6af6-e585-417b-8583-2d6739261c16 HTTP/1.1" status: 200 len: 944 time: 0.1455851 May 25 17:09:29.287766 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6a49cc6b-87af-4bd6-bb7e-05cbb358e4d1 req-741b50c8-dbfe-4a10-82fb-7bf8f64ec6b1 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:09:29.289117 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-6a49cc6b-87af-4bd6-bb7e-05cbb358e4d1 req-741b50c8-dbfe-4a10-82fb-7bf8f64ec6b1 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/ports?device_id=bdaa3d25-adc2-4a52-8a36-66a599b4b6e2 HTTP/1.1" status: 200 len: 946 time: 0.1177578 May 25 17:09:29.362578 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-c304085b-ce50-4e7d-9b88-f2754677eb2d req-fb20109f-7106-4e22-be28-b70a40a7908a tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] 10.222.0.62 "GET /v2.0/security-groups?id=388811ac-c781-471a-a517-2ae8158e9b4a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0725234 May 25 17:09:29.367409 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-6a49cc6b-87af-4bd6-bb7e-05cbb358e4d1 req-36d9fa2f-5dc9-4d06-80a8-b9392cb1f70a tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/security-groups?id=4e6b7b77-0833-47dc-be2e-ec9c7c960bb9&fields=id&fields=name HTTP/1.1" status: 200 len: 309 time: 0.0619054 May 25 17:09:30.248460 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-57f11b47-1f51-4191-b7c9-af248a48372c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:09:30.382667 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.rpc [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Device efef57db-3376-4eb7-83b9-75c45a34667f up at agent hyperv_hv-cinder-79049 {{(pid=91831) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 25 17:09:30.453452 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.provisioning_blocks [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Provisioning for port efef57db-3376-4eb7-83b9-75c45a34667f completed by entity L2. {{(pid=91831) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 25 17:09:30.458246 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.provisioning_blocks [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Provisioning complete for port efef57db-3376-4eb7-83b9-75c45a34667f triggered by entity L2. {{(pid=91831) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 17:09:30.459236 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3854128'] for port, provisioning_complete {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:09:30.578773 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3832070'] for port, before_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:09:30.607744 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '2c1b6af6-e585-417b-8583-2d6739261c16', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'efef57db-3376-4eb7-83b9-75c45a34667f'}] {{(pid=91831) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 25 17:09:30.617871 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.db [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] For port efef57db-3376-4eb7-83b9-75c45a34667f, host hv-cinder-79049, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79049',level=0,port_id=efef57db-3376-4eb7-83b9-75c45a34667f,segment=NetworkSegment(b8ba5240-28ce-40db-a6e6-b4a42435e0b6),segment_id=b8ba5240-28ce-40db-a6e6-b4a42435e0b6)] {{(pid=91831) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 17:09:30.622240 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8757892955028', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8757892520933', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8757892521750'] for port, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:09:30.624166 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [None req-36c72504-6892-45fe-ada1-cc78b8e5b707 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:09:30.692745 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Pushing event updated for resources: {'Port': ['ID=efef57db-3376-4eb7-83b9-75c45a34667f,revision_number=5']} {{(pid=91831) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:09:30.695992 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.072s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:09:30.725189 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-54281b23-ad39-4c3a-8a86-9bddf7edeaba req-fa68d43c-3020-42f0-98f0-c129755011c0 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:09:30.726657 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-54281b23-ad39-4c3a-8a86-9bddf7edeaba req-fa68d43c-3020-42f0-98f0-c129755011c0 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] 10.222.0.62 "GET /v2.0/ports?device_id=2c1b6af6-e585-417b-8583-2d6739261c16 HTTP/1.1" status: 200 len: 944 time: 0.2506719 May 25 17:09:30.735174 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bf442310-3957-4efe-adbc-b9e39f654b1b req-372fb78b-f597-4ba0-8288-5cdb64298539 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:09:30.736489 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-bf442310-3957-4efe-adbc-b9e39f654b1b req-372fb78b-f597-4ba0-8288-5cdb64298539 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/ports?device_id=bdaa3d25-adc2-4a52-8a36-66a599b4b6e2 HTTP/1.1" status: 200 len: 946 time: 0.2298255 May 25 17:09:30.804506 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-54281b23-ad39-4c3a-8a86-9bddf7edeaba req-c8de08e1-6d8f-47ac-b6ff-ce50e64760b3 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] 10.222.0.62 "GET /v2.0/security-groups?id=388811ac-c781-471a-a517-2ae8158e9b4a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0670948 May 25 17:09:30.807150 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-bf442310-3957-4efe-adbc-b9e39f654b1b req-8e27636e-0816-43ee-a20c-c1aaec79a47a tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/security-groups?id=4e6b7b77-0833-47dc-be2e-ec9c7c960bb9&fields=id&fields=name HTTP/1.1" status: 200 len: 309 time: 0.0568733 May 25 17:09:30.855880 dv-cinder-790492-4-iscsi neutron-server[91831]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '2c1b6af6-e585-417b-8583-2d6739261c16', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'efef57db-3376-4eb7-83b9-75c45a34667f', 'code': 200} May 25 17:09:31.083493 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-742cd5ef-f34c-4c32-81c3-fd42cd11c0bb req-626dff24-098f-4e52-937c-14b8b0c39f99 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:09:31.084872 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-742cd5ef-f34c-4c32-81c3-fd42cd11c0bb req-626dff24-098f-4e52-937c-14b8b0c39f99 service neutron] 10.222.0.32 "GET /v2.0/ports?device_id=2c1b6af6-e585-417b-8583-2d6739261c16 HTTP/1.1" status: 200 len: 1098 time: 0.0719049 May 25 17:09:31.125446 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-742cd5ef-f34c-4c32-81c3-fd42cd11c0bb req-715c4592-55d0-4831-b869-264fbf9eda61 service neutron] 10.222.0.32 "GET /v2.0/security-groups?id=388811ac-c781-471a-a517-2ae8158e9b4a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0337920 May 25 17:09:32.051399 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-72d9b9f6-bc8c-4ad0-95b8-a65d2e60d828 req-c72e617a-d99c-472e-954a-cfcd8a53084d tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:09:32.052813 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-72d9b9f6-bc8c-4ad0-95b8-a65d2e60d828 req-c72e617a-d99c-472e-954a-cfcd8a53084d tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] 10.222.0.62 "GET /v2.0/ports?device_id=2c1b6af6-e585-417b-8583-2d6739261c16 HTTP/1.1" status: 200 len: 945 time: 0.1424425 May 25 17:09:32.060715 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-944e22cd-44fe-41c2-8ca8-5ee6a9e47b27 req-f6669ad6-3c5a-4d56-9410-002b9511b763 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:09:32.062336 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-944e22cd-44fe-41c2-8ca8-5ee6a9e47b27 req-f6669ad6-3c5a-4d56-9410-002b9511b763 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/ports?device_id=bdaa3d25-adc2-4a52-8a36-66a599b4b6e2 HTTP/1.1" status: 200 len: 946 time: 0.1158590 May 25 17:09:32.131213 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-72d9b9f6-bc8c-4ad0-95b8-a65d2e60d828 req-517e8fad-ba0f-4dac-bb73-abd9eac1ae3a tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] 10.222.0.62 "GET /v2.0/security-groups?id=388811ac-c781-471a-a517-2ae8158e9b4a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0678556 May 25 17:09:32.135414 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-944e22cd-44fe-41c2-8ca8-5ee6a9e47b27 req-c6d465d2-538f-4173-8323-5d45528e65a2 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/security-groups?id=4e6b7b77-0833-47dc-be2e-ec9c7c960bb9&fields=id&fields=name HTTP/1.1" status: 200 len: 309 time: 0.0579464 May 25 17:09:33.390146 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4ab5f7bd-a89b-4a4e-8391-defd990b0c07 req-edcaa2fa-db9e-4fe2-8ab1-71fbdaf20c04 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:09:33.391589 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-4ab5f7bd-a89b-4a4e-8391-defd990b0c07 req-edcaa2fa-db9e-4fe2-8ab1-71fbdaf20c04 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] 10.222.0.62 "GET /v2.0/ports?device_id=2c1b6af6-e585-417b-8583-2d6739261c16 HTTP/1.1" status: 200 len: 945 time: 0.1516349 May 25 17:09:33.403383 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1becbf27-c357-4627-a9d5-7c6b0a8b00a7 req-4dafa50d-4374-4bbd-aacc-14918e04b824 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:09:33.405399 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-1becbf27-c357-4627-a9d5-7c6b0a8b00a7 req-4dafa50d-4374-4bbd-aacc-14918e04b824 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/ports?device_id=bdaa3d25-adc2-4a52-8a36-66a599b4b6e2 HTTP/1.1" status: 200 len: 946 time: 0.1146631 May 25 17:09:33.473172 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-4ab5f7bd-a89b-4a4e-8391-defd990b0c07 req-c23e6600-4996-409f-8916-6d9bd7a7f6e6 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] 10.222.0.62 "GET /v2.0/security-groups?id=388811ac-c781-471a-a517-2ae8158e9b4a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0668452 May 25 17:09:33.477426 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-1becbf27-c357-4627-a9d5-7c6b0a8b00a7 req-0eb44ee1-b86d-4af3-a272-f2fa573f45a8 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/security-groups?id=4e6b7b77-0833-47dc-be2e-ec9c7c960bb9&fields=id&fields=name HTTP/1.1" status: 200 len: 309 time: 0.0587163 May 25 17:09:33.648896 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5c838d6a-7caa-4b84-8ca7-7825934b91e1 req-963f9c54-57d6-4aef-958f-3571297196bf tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:09:33.650242 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-5c838d6a-7caa-4b84-8ca7-7825934b91e1 req-963f9c54-57d6-4aef-958f-3571297196bf tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] 10.222.0.62 "GET /v2.0/ports?device_id=2c1b6af6-e585-417b-8583-2d6739261c16 HTTP/1.1" status: 200 len: 945 time: 0.0813754 May 25 17:09:33.659187 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.wsgi [-] (91829) accepted ('10.222.0.62', 36754) {{(pid=91829) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:09:33.664057 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.v2.base [None req-9115865b-1944-41d5-8f9d-d003d80b0cec tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Request body: {'floatingip': {'port_id': 'efef57db-3376-4eb7-83b9-75c45a34667f'}} {{(pid=91829) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 17:09:33.740950 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-9115865b-1944-41d5-8f9d-d003d80b0cec tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Notify callbacks [] for floatingip, before_update {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:09:34.333180 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-9115865b-1944-41d5-8f9d-d003d80b0cec tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Notify callbacks [] for floatingip, precommit_update {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:09:34.337057 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-9115865b-1944-41d5-8f9d-d003d80b0cec tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-683033'] for floatingip, after_update {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:09:34.388088 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.rpc [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Device bfd709e1-823e-4b01-8a88-fa341f7e700a details requested by agent hyperv_hv-cinder-79049 with host hv-cinder-79049 {{(pid=91831) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 25 17:09:34.527368 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.db [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] For port bfd709e1-823e-4b01-8a88-fa341f7e700a, host hv-cinder-79049, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79049',level=0,port_id=bfd709e1-823e-4b01-8a88-fa341f7e700a,segment=NetworkSegment(a8fb0313-938a-4f5e-8ff4-96df8acd943b),segment_id=a8fb0313-938a-4f5e-8ff4-96df8acd943b)] {{(pid=91831) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 17:09:34.541170 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.rpc [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Returning: {'device': 'bfd709e1-823e-4b01-8a88-fa341f7e700a', 'network_id': 'e5be4c6a-143f-474c-a90b-37180778cefe', 'port_id': 'bfd709e1-823e-4b01-8a88-fa341f7e700a', 'mac_address': 'fa:16:3e:65:f3:f2', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 695, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '6e6b5897-e23d-4281-96cb-a6fdf9b68134', 'ip_address': '172.20.0.12'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=91831) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 25 17:09:34.601800 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3832070'] for port, before_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:09:34.618426 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.notifiers.nova [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Ignoring state change previous_port_status: ACTIVE current_port_status: BUILD port_id bfd709e1-823e-4b01-8a88-fa341f7e700a {{(pid=91831) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} May 25 17:09:34.633886 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.db [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] For port bfd709e1-823e-4b01-8a88-fa341f7e700a, host hv-cinder-79049, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79049',level=0,port_id=bfd709e1-823e-4b01-8a88-fa341f7e700a,segment=NetworkSegment(a8fb0313-938a-4f5e-8ff4-96df8acd943b),segment_id=a8fb0313-938a-4f5e-8ff4-96df8acd943b)] {{(pid=91831) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 17:09:34.639434 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8757892955028', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8757892520933', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8757892521750'] for port, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:09:34.641645 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:09:34.670937 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.db.l3_db [None req-9115865b-1944-41d5-8f9d-d003d80b0cec tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Floating IP d808e4a3-f08f-48d4-9cf7-b6a41597573a associated. External IP: 172.27.2.114, port: efef57db-3376-4eb7-83b9-75c45a34667f. May 25 17:09:34.713192 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Pushing event updated for resources: {'Port': ['ID=bfd709e1-823e-4b01-8a88-fa341f7e700a,revision_number=6']} {{(pid=91831) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:09:34.716871 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.075s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:09:34.741209 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.db [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] get_ports_and_sgs() called for port_ids ['bfd709e1-823e-4b01-8a88-fa341f7e700a'] {{(pid=91831) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 25 17:09:34.841060 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e2c71b5a-be6b-4d3d-9bca-c5a46b3a25ec req-be936562-089b-4627-8baa-6bab07b4207e tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:09:34.842562 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-e2c71b5a-be6b-4d3d-9bca-c5a46b3a25ec req-be936562-089b-4627-8baa-6bab07b4207e tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/ports?device_id=bdaa3d25-adc2-4a52-8a36-66a599b4b6e2 HTTP/1.1" status: 200 len: 946 time: 0.2482586 May 25 17:09:34.953235 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-e2c71b5a-be6b-4d3d-9bca-c5a46b3a25ec req-8c0f1c30-d1f7-42d1-815e-a02f19fbf929 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/security-groups?id=4e6b7b77-0833-47dc-be2e-ec9c7c960bb9&fields=id&fields=name HTTP/1.1" status: 200 len: 309 time: 0.1050088 May 25 17:09:35.078952 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-9115865b-1944-41d5-8f9d-d003d80b0cec tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Router f1e3cf65-0e20-4226-8986-652055868473 has already been hosted by L3 agent a2d427c1-2d07-43e8-afbe-218c9f7d0445 {{(pid=91829) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 25 17:09:35.262690 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-9115865b-1944-41d5-8f9d-d003d80b0cec tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Notify agent at l3_agent.dv-cinder-790492-4-iscsi the message routers_updated {{(pid=91829) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 25 17:09:35.267771 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-9115865b-1944-41d5-8f9d-d003d80b0cec tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-178712'] for floatingip, before_response {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:09:35.272610 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-10420c1a-7e6f-4291-b7fc-58d0eba2fa00 None None] Sync routers for ids ['f1e3cf65-0e20-4226-8986-652055868473'] in dv-cinder-790492-4-iscsi {{(pid=91831) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 25 17:09:35.281881 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.l3_dvrscheduler_db [None req-10420c1a-7e6f-4291-b7fc-58d0eba2fa00 None None] Routers {'f1e3cf65-0e20-4226-8986-652055868473'} bound to L3 agent in host dv-cinder-790492-4-iscsi {{(pid=91831) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 17:09:35.282534 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.l3_hamode_db [None req-10420c1a-7e6f-4291-b7fc-58d0eba2fa00 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-790492-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-05-25T16:50:28Z,description=,heartbeat_timestamp=2021-05-25T17:09:28Z,host='dv-cinder-790492-4-iscsi',id=a2d427c1-2d07-43e8-afbe-218c9f7d0445,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T16:50:28Z,topic='l3_agent')) {'router_ids': ['f1e3cf65-0e20-4226-8986-652055868473'], 'active': True} {{(pid=91831) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 17:09:35.321600 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [None req-9115865b-1944-41d5-8f9d-d003d80b0cec tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] 10.222.0.62 "PUT /v2.0/floatingips/d808e4a3-f08f-48d4-9cf7-b6a41597573a HTTP/1.1" status: 200 len: 991 time: 1.6614022 May 25 17:09:35.322577 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '2c1b6af6-e585-417b-8583-2d6739261c16', 'tag': 'efef57db-3376-4eb7-83b9-75c45a34667f'}] {{(pid=91829) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 25 17:09:35.367949 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '2c1b6af6-e585-417b-8583-2d6739261c16', 'tag': 'efef57db-3376-4eb7-83b9-75c45a34667f', 'status': 'completed', 'code': 200} May 25 17:09:35.465796 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.l3_dvr_db [None req-10420c1a-7e6f-4291-b7fc-58d0eba2fa00 None None] Set router f1e3cf65-0e20-4226-8986-652055868473 gateway port host: dv-cinder-790492-4-iscsi {{(pid=91831) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 17:09:35.468909 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f89a2326-6d1f-415d-9c79-66a5c01990d6 req-530f207e-e117-4c15-a64a-2ad9f9565b78 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:09:35.470425 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-f89a2326-6d1f-415d-9c79-66a5c01990d6 req-530f207e-e117-4c15-a64a-2ad9f9565b78 service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=70dac097fff04aed99a4976fa955579b&device_id=2c1b6af6-e585-417b-8583-2d6739261c16 HTTP/1.1" status: 200 len: 1098 time: 0.0761883 May 25 17:09:35.601901 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f89a2326-6d1f-415d-9c79-66a5c01990d6 req-7c1e5985-627f-4ca7-b34a-aabf305ee46a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:09:35.603350 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-f89a2326-6d1f-415d-9c79-66a5c01990d6 req-7c1e5985-627f-4ca7-b34a-aabf305ee46a service neutron] 10.222.0.32 "GET /v2.0/networks?id=b351598a-3f6f-4a37-8095-8d9371896ccc HTTP/1.1" status: 200 len: 911 time: 0.1253459 May 25 17:09:35.702761 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-f89a2326-6d1f-415d-9c79-66a5c01990d6 req-2cab2f19-aad4-4e6a-a3f8-d3a5ecb9fc6e service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=efef57db-3376-4eb7-83b9-75c45a34667f HTTP/1.1" status: 200 len: 999 time: 0.0923197 May 25 17:09:35.768018 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f89a2326-6d1f-415d-9c79-66a5c01990d6 req-f7b7ae50-2af8-41b2-921c-697edc3d0cb9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:09:35.769450 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-f89a2326-6d1f-415d-9c79-66a5c01990d6 req-f7b7ae50-2af8-41b2-921c-697edc3d0cb9 service neutron] 10.222.0.32 "GET /v2.0/subnets?id=4bbae145-74ed-4fda-b7c0-ae77a3202a83 HTTP/1.1" status: 200 len: 849 time: 0.0597153 May 25 17:09:35.814588 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.l3_hamode_db [None req-10420c1a-7e6f-4291-b7fc-58d0eba2fa00 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'f1e3cf65-0e20-4226-8986-652055868473', 'name': 'tempest-AttachVolumeTestJSON-312968156-router', 'tenant_id': '70dac097fff04aed99a4976fa955579b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'external_fixed_ips': [{'subnet_id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'ip_address': '172.27.2.63'}], 'enable_snat': True}, 'gw_port_id': 'd0e34ea8-e4eb-48d0-812d-3e5358c5b247', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T17:03:07Z', 'updated_at': '2021-05-25T17:03:12Z', 'revision_number': 4, 'project_id': '70dac097fff04aed99a4976fa955579b', 'gw_port': {'id': 'd0e34ea8-e4eb-48d0-812d-3e5358c5b247', 'name': '', 'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'tenant_id': '', 'mac_address': 'fa:16:3e:be:2a:11', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f1e3cf65-0e20-4226-8986-652055868473', 'device_owner': 'network:router_gateway', 'standard_attr_id': 477, 'fixed_ips': [{'subnet_id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'ip_address': '172.27.2.63', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790492-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:03:08Z', 'updated_at': '2021-05-25T17:03:16Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-790492-4-iscsi', '_floatingips': [{'id': 'd808e4a3-f08f-48d4-9cf7-b6a41597573a', 'tenant_id': '70dac097fff04aed99a4976fa955579b', 'floating_ip_address': '172.27.2.114', 'floating_network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'router_id': 'f1e3cf65-0e20-4226-8986-652055868473', 'port_id': 'efef57db-3376-4eb7-83b9-75c45a34667f', 'fixed_ip_address': '172.20.0.5', 'status': 'DOWN', 'standard_attr_id': 573, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'b351598a-3f6f-4a37-8095-8d9371896ccc', 'mac_address': 'fa:16:3e:8e:f0:d7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2c1b6af6-e585-417b-8583-2d6739261c16', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-25T17:09:17Z', 'updated_at': '2021-05-25T17:09:34Z', 'revision_number': 1, 'project_id': '70dac097fff04aed99a4976fa955579b', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '6561ca57-f5fa-4bba-803c-ac716f98a0fb', 'name': '', 'network_id': 'b351598a-3f6f-4a37-8095-8d9371896ccc', 'tenant_id': '70dac097fff04aed99a4976fa955579b', 'mac_address': 'fa:16:3e:2f:70:71', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f1e3cf65-0e20-4226-8986-652055868473', 'device_owner': 'network:router_interface', 'standard_attr_id': 478, 'fixed_ips': [{'subnet_id': '4bbae145-74ed-4fda-b7c0-ae77a3202a83', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790492-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:03:12Z', 'updated_at': '2021-05-25T17:03:18Z', 'revision_number': 5, 'project_id': '70dac097fff04aed99a4976fa955579b', 'subnets': [{'id': '4bbae145-74ed-4fda-b7c0-ae77a3202a83', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-790492-4-iscsi', False) {} {{(pid=91831) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 17:09:35.818291 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-10420c1a-7e6f-4291-b7fc-58d0eba2fa00 None None] Checking router: f1e3cf65-0e20-4226-8986-652055868473 for host: dv-cinder-790492-4-iscsi {{(pid=91831) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 25 17:09:35.826389 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.l3_dvrscheduler_db [None req-10420c1a-7e6f-4291-b7fc-58d0eba2fa00 None None] Routers {'f1e3cf65-0e20-4226-8986-652055868473'} bound to L3 agent in host dv-cinder-790492-4-iscsi {{(pid=91831) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 17:09:35.826986 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.l3_hamode_db [None req-10420c1a-7e6f-4291-b7fc-58d0eba2fa00 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-790492-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-05-25T16:50:28Z,description=,heartbeat_timestamp=2021-05-25T17:09:28Z,host='dv-cinder-790492-4-iscsi',id=a2d427c1-2d07-43e8-afbe-218c9f7d0445,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T16:50:28Z,topic='l3_agent')) {'router_ids': ['f1e3cf65-0e20-4226-8986-652055868473'], 'active': True} {{(pid=91831) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 17:09:35.851021 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f89a2326-6d1f-415d-9c79-66a5c01990d6 req-a6df3ebf-a517-456e-918e-9819f2ba124d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:09:35.852581 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-f89a2326-6d1f-415d-9c79-66a5c01990d6 req-a6df3ebf-a517-456e-918e-9819f2ba124d service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=b351598a-3f6f-4a37-8095-8d9371896ccc&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0765319 May 25 17:09:36.003440 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-f89a2326-6d1f-415d-9c79-66a5c01990d6 req-ae0e7d86-53ef-4a1f-8230-9d137ad0584f service neutron] 10.222.0.32 "GET /v2.0/networks/b351598a-3f6f-4a37-8095-8d9371896ccc?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1328671 May 25 17:09:36.050066 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.l3_dvr_db [None req-10420c1a-7e6f-4291-b7fc-58d0eba2fa00 None None] Set router f1e3cf65-0e20-4226-8986-652055868473 gateway port host: dv-cinder-790492-4-iscsi {{(pid=91831) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 17:09:36.307773 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-f89a2326-6d1f-415d-9c79-66a5c01990d6 req-3415b8d1-cafc-4995-812a-775929e87e9b service neutron] 10.222.0.32 "GET /v2.0/networks/b351598a-3f6f-4a37-8095-8d9371896ccc?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2971506 May 25 17:09:36.320056 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-32868e31-b1ba-4d88-83a1-305a8cc32c86 req-84fd76cf-ef32-4737-b5e3-30b254cdeac8 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:09:36.321534 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-32868e31-b1ba-4d88-83a1-305a8cc32c86 req-84fd76cf-ef32-4737-b5e3-30b254cdeac8 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/ports?device_id=bdaa3d25-adc2-4a52-8a36-66a599b4b6e2 HTTP/1.1" status: 200 len: 945 time: 0.1314178 May 25 17:09:36.369333 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-32868e31-b1ba-4d88-83a1-305a8cc32c86 req-f8cec9a1-749b-408e-bcaf-7a88d2b295c0 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/security-groups?id=4e6b7b77-0833-47dc-be2e-ec9c7c960bb9&fields=id&fields=name HTTP/1.1" status: 200 len: 309 time: 0.0414097 May 25 17:09:36.402670 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.rpc [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Device bfd709e1-823e-4b01-8a88-fa341f7e700a up at agent hyperv_hv-cinder-79049 {{(pid=91831) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 25 17:09:36.450488 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.l3_hamode_db [None req-10420c1a-7e6f-4291-b7fc-58d0eba2fa00 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'f1e3cf65-0e20-4226-8986-652055868473', 'name': 'tempest-AttachVolumeTestJSON-312968156-router', 'tenant_id': '70dac097fff04aed99a4976fa955579b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'external_fixed_ips': [{'subnet_id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'ip_address': '172.27.2.63'}], 'enable_snat': True}, 'gw_port_id': 'd0e34ea8-e4eb-48d0-812d-3e5358c5b247', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T17:03:07Z', 'updated_at': '2021-05-25T17:03:12Z', 'revision_number': 4, 'project_id': '70dac097fff04aed99a4976fa955579b', 'gw_port': {'id': 'd0e34ea8-e4eb-48d0-812d-3e5358c5b247', 'name': '', 'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'tenant_id': '', 'mac_address': 'fa:16:3e:be:2a:11', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f1e3cf65-0e20-4226-8986-652055868473', 'device_owner': 'network:router_gateway', 'standard_attr_id': 477, 'fixed_ips': [{'subnet_id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'ip_address': '172.27.2.63', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790492-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:03:08Z', 'updated_at': '2021-05-25T17:03:16Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-790492-4-iscsi', '_floatingips': [{'id': 'd808e4a3-f08f-48d4-9cf7-b6a41597573a', 'tenant_id': '70dac097fff04aed99a4976fa955579b', 'floating_ip_address': '172.27.2.114', 'floating_network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'router_id': 'f1e3cf65-0e20-4226-8986-652055868473', 'port_id': 'efef57db-3376-4eb7-83b9-75c45a34667f', 'fixed_ip_address': '172.20.0.5', 'status': 'DOWN', 'standard_attr_id': 573, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'b351598a-3f6f-4a37-8095-8d9371896ccc', 'mac_address': 'fa:16:3e:8e:f0:d7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2c1b6af6-e585-417b-8583-2d6739261c16', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-25T17:09:17Z', 'updated_at': '2021-05-25T17:09:34Z', 'revision_number': 1, 'project_id': '70dac097fff04aed99a4976fa955579b', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '6561ca57-f5fa-4bba-803c-ac716f98a0fb', 'name': '', 'network_id': 'b351598a-3f6f-4a37-8095-8d9371896ccc', 'tenant_id': '70dac097fff04aed99a4976fa955579b', 'mac_address': 'fa:16:3e:2f:70:71', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f1e3cf65-0e20-4226-8986-652055868473', 'device_owner': 'network:router_interface', 'standard_attr_id': 478, 'fixed_ips': [{'subnet_id': '4bbae145-74ed-4fda-b7c0-ae77a3202a83', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790492-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:03:12Z', 'updated_at': '2021-05-25T17:03:18Z', 'revision_number': 5, 'project_id': '70dac097fff04aed99a4976fa955579b', 'subnets': [{'id': '4bbae145-74ed-4fda-b7c0-ae77a3202a83', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-790492-4-iscsi', False) {} {{(pid=91831) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 17:09:36.459813 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-10420c1a-7e6f-4291-b7fc-58d0eba2fa00 None None] The sync data for ids ['f1e3cf65-0e20-4226-8986-652055868473'] in dv-cinder-790492-4-iscsi is: [{'id': 'f1e3cf65-0e20-4226-8986-652055868473', 'name': 'tempest-AttachVolumeTestJSON-312968156-router', 'tenant_id': '70dac097fff04aed99a4976fa955579b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'external_fixed_ips': [{'subnet_id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'ip_address': '172.27.2.63'}], 'enable_snat': True}, 'gw_port_id': 'd0e34ea8-e4eb-48d0-812d-3e5358c5b247', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T17:03:07Z', 'updated_at': '2021-05-25T17:03:12Z', 'revision_number': 4, 'project_id': '70dac097fff04aed99a4976fa955579b', 'gw_port': {'id': 'd0e34ea8-e4eb-48d0-812d-3e5358c5b247', 'name': '', 'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'tenant_id': '', 'mac_address': 'fa:16:3e:be:2a:11', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f1e3cf65-0e20-4226-8986-652055868473', 'device_owner': 'network:router_gateway', 'standard_attr_id': 477, 'fixed_ips': [{'subnet_id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'ip_address': '172.27.2.63', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790492-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:03:08Z', 'updated_at': '2021-05-25T17:03:16Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-790492-4-iscsi', '_floatingips': [{'id': 'd808e4a3-f08f-48d4-9cf7-b6a41597573a', 'tenant_id': '70dac097fff04aed99a4976fa955579b', 'floating_ip_address': '172.27.2.114', 'floating_network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'router_id': 'f1e3cf65-0e20-4226-8986-652055868473', 'port_id': 'efef57db-3376-4eb7-83b9-75c45a34667f', 'fixed_ip_address': '172.20.0.5', 'status': 'DOWN', 'standard_attr_id': 573, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'b351598a-3f6f-4a37-8095-8d9371896ccc', 'mac_address': 'fa:16:3e:8e:f0:d7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2c1b6af6-e585-417b-8583-2d6739261c16', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-25T17:09:17Z', 'updated_at': '2021-05-25T17:09:34Z', 'revision_number': 1, 'project_id': '70dac097fff04aed99a4976fa955579b', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '6561ca57-f5fa-4bba-803c-ac716f98a0fb', 'name': '', 'network_id': 'b351598a-3f6f-4a37-8095-8d9371896ccc', 'tenant_id': '70dac097fff04aed99a4976fa955579b', 'mac_address': 'fa:16:3e:2f:70:71', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f1e3cf65-0e20-4226-8986-652055868473', 'device_owner': 'network:router_interface', 'standard_attr_id': 478, 'fixed_ips': [{'subnet_id': '4bbae145-74ed-4fda-b7c0-ae77a3202a83', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790492-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:03:12Z', 'updated_at': '2021-05-25T17:03:18Z', 'revision_number': 5, 'project_id': '70dac097fff04aed99a4976fa955579b', 'subnets': [{'id': '4bbae145-74ed-4fda-b7c0-ae77a3202a83', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=91831) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 25 17:09:36.478143 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.provisioning_blocks [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Provisioning complete for port bfd709e1-823e-4b01-8a88-fa341f7e700a triggered by entity L2. {{(pid=91831) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 17:09:36.478771 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3854128'] for port, provisioning_complete {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:09:36.603064 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:09:36.609557 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3832070'] for port, before_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:09:36.638111 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'bdaa3d25-adc2-4a52-8a36-66a599b4b6e2', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'bfd709e1-823e-4b01-8a88-fa341f7e700a'}] {{(pid=91831) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 25 17:09:36.648294 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.db [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] For port bfd709e1-823e-4b01-8a88-fa341f7e700a, host hv-cinder-79049, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79049',level=0,port_id=bfd709e1-823e-4b01-8a88-fa341f7e700a,segment=NetworkSegment(a8fb0313-938a-4f5e-8ff4-96df8acd943b),segment_id=a8fb0313-938a-4f5e-8ff4-96df8acd943b)] {{(pid=91831) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 17:09:36.653274 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8757892955028', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8757892520933', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8757892521750'] for port, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:09:36.655401 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:09:36.664637 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6f102ccd-288c-4529-97ae-d3c7561ccd7c None None] New status for floating IP d808e4a3-f08f-48d4-9cf7-b6a41597573a: ACTIVE {{(pid=91832) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} May 25 17:09:36.692202 dv-cinder-790492-4-iscsi neutron-server[91831]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'bdaa3d25-adc2-4a52-8a36-66a599b4b6e2', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'bfd709e1-823e-4b01-8a88-fa341f7e700a', 'code': 200} May 25 17:09:36.729257 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Pushing event updated for resources: {'Port': ['ID=bfd709e1-823e-4b01-8a88-fa341f7e700a,revision_number=7']} {{(pid=91831) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:09:36.738441 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.083s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:09:36.866610 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a11d879e-4674-4170-a3e8-148499f58f32 req-2e5c0260-ac33-4d34-b4e0-75bcd39b0a66 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:09:36.868695 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-a11d879e-4674-4170-a3e8-148499f58f32 req-2e5c0260-ac33-4d34-b4e0-75bcd39b0a66 service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=bbb9e99759bc47d08005f3b1e036a6cf&device_id=bdaa3d25-adc2-4a52-8a36-66a599b4b6e2 HTTP/1.1" status: 200 len: 1099 time: 0.0743151 May 25 17:09:37.019808 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a11d879e-4674-4170-a3e8-148499f58f32 req-c7470b25-ec92-407d-ad62-530947ec519e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:09:37.021377 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-a11d879e-4674-4170-a3e8-148499f58f32 req-c7470b25-ec92-407d-ad62-530947ec519e service neutron] 10.222.0.32 "GET /v2.0/networks?id=e5be4c6a-143f-474c-a90b-37180778cefe HTTP/1.1" status: 200 len: 917 time: 0.1327810 May 25 17:09:37.122073 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-a11d879e-4674-4170-a3e8-148499f58f32 req-cbed13f3-f244-48fa-8c11-33bd7c40c3ce service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=bfd709e1-823e-4b01-8a88-fa341f7e700a HTTP/1.1" status: 200 len: 1001 time: 0.0940864 May 25 17:09:37.186678 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a11d879e-4674-4170-a3e8-148499f58f32 req-5d46b94c-73fd-4551-9715-5c5eca22d063 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:09:37.188041 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-a11d879e-4674-4170-a3e8-148499f58f32 req-5d46b94c-73fd-4551-9715-5c5eca22d063 service neutron] 10.222.0.32 "GET /v2.0/subnets?id=6e6b5897-e23d-4281-96cb-a6fdf9b68134 HTTP/1.1" status: 200 len: 855 time: 0.0596762 May 25 17:09:37.264557 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a11d879e-4674-4170-a3e8-148499f58f32 req-5b1c4752-c31d-49d5-be93-ef7f9fed2f60 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:09:37.266004 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-a11d879e-4674-4170-a3e8-148499f58f32 req-5b1c4752-c31d-49d5-be93-ef7f9fed2f60 service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=e5be4c6a-143f-474c-a90b-37180778cefe&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0701821 May 25 17:09:37.401374 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-a11d879e-4674-4170-a3e8-148499f58f32 req-9099066f-1e81-49ac-8a10-2f6441acd852 service neutron] 10.222.0.32 "GET /v2.0/networks/e5be4c6a-143f-474c-a90b-37180778cefe?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1243224 May 25 17:09:37.599456 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-a11d879e-4674-4170-a3e8-148499f58f32 req-0d1eccd8-80ea-48e2-bb01-cd5e7c4c4c59 service neutron] 10.222.0.32 "GET /v2.0/networks/e5be4c6a-143f-474c-a90b-37180778cefe?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1887887 May 25 17:09:37.607745 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d559d58a-f323-482e-abdb-6fa404fb01e0 req-5649dcf1-6ba9-458f-b154-27859a89d39b tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:09:37.609136 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-d559d58a-f323-482e-abdb-6fa404fb01e0 req-5649dcf1-6ba9-458f-b154-27859a89d39b tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/ports?device_id=bdaa3d25-adc2-4a52-8a36-66a599b4b6e2 HTTP/1.1" status: 200 len: 946 time: 0.1247063 May 25 17:09:37.655534 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-d559d58a-f323-482e-abdb-6fa404fb01e0 req-31de5fc3-e458-42c4-96ab-ae2fa3f366f6 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/security-groups?id=4e6b7b77-0833-47dc-be2e-ec9c7c960bb9&fields=id&fields=name HTTP/1.1" status: 200 len: 309 time: 0.0399554 May 25 17:09:38.842234 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3886490a-195b-4913-99d6-890558f2ea43 req-f22dfc5d-f002-48d5-a18a-0b0b02ebc18b tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:09:38.843669 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-3886490a-195b-4913-99d6-890558f2ea43 req-f22dfc5d-f002-48d5-a18a-0b0b02ebc18b tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/ports?device_id=bdaa3d25-adc2-4a52-8a36-66a599b4b6e2 HTTP/1.1" status: 200 len: 946 time: 0.0808415 May 25 17:09:38.885895 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-3886490a-195b-4913-99d6-890558f2ea43 req-edb08671-b712-42b4-bcc4-f6e6565cbf18 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/security-groups?id=4e6b7b77-0833-47dc-be2e-ec9c7c960bb9&fields=id&fields=name HTTP/1.1" status: 200 len: 309 time: 0.0365000 May 25 17:09:40.088607 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d3155eb0-3c34-4ad9-8627-6e266b103b99 req-6134d7ef-2d13-4f36-8827-e8b4cb0fc3f5 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:09:40.090460 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-d3155eb0-3c34-4ad9-8627-6e266b103b99 req-6134d7ef-2d13-4f36-8827-e8b4cb0fc3f5 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/ports?device_id=bdaa3d25-adc2-4a52-8a36-66a599b4b6e2 HTTP/1.1" status: 200 len: 946 time: 0.0853257 May 25 17:09:40.142465 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-d3155eb0-3c34-4ad9-8627-6e266b103b99 req-0f8d3aab-367e-42fb-90f4-252c79ea5ad0 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/security-groups?id=4e6b7b77-0833-47dc-be2e-ec9c7c960bb9&fields=id&fields=name HTTP/1.1" status: 200 len: 309 time: 0.0456772 May 25 17:09:41.368030 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a88724fa-c8e5-47e0-b110-7941b29cf27d req-2dbeb68c-ef39-472a-a07d-11dcba194b43 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:09:41.369477 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-a88724fa-c8e5-47e0-b110-7941b29cf27d req-2dbeb68c-ef39-472a-a07d-11dcba194b43 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/ports?device_id=bdaa3d25-adc2-4a52-8a36-66a599b4b6e2 HTTP/1.1" status: 200 len: 946 time: 0.0920732 May 25 17:09:41.421128 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-a88724fa-c8e5-47e0-b110-7941b29cf27d req-684c05b6-2b2e-4327-bbe9-52f9abcf0b5f tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/security-groups?id=4e6b7b77-0833-47dc-be2e-ec9c7c960bb9&fields=id&fields=name HTTP/1.1" status: 200 len: 309 time: 0.0450168 May 25 17:09:42.624146 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fe738efc-36b7-45e9-bbea-30722a7b5c2f req-69c1cfb8-8949-4f97-ba59-b65f9329908a tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:09:42.625600 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-fe738efc-36b7-45e9-bbea-30722a7b5c2f req-69c1cfb8-8949-4f97-ba59-b65f9329908a tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/ports?device_id=bdaa3d25-adc2-4a52-8a36-66a599b4b6e2 HTTP/1.1" status: 200 len: 946 time: 0.0812311 May 25 17:09:42.680365 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-fe738efc-36b7-45e9-bbea-30722a7b5c2f req-fbe81a54-350b-4e42-84d4-ea0458beb80e tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/security-groups?id=4e6b7b77-0833-47dc-be2e-ec9c7c960bb9&fields=id&fields=name HTTP/1.1" status: 200 len: 309 time: 0.0435011 May 25 17:09:43.890651 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-756a9719-d9f7-4f26-a8b1-10a4baf679f5 req-72face5c-a5a0-47ee-8ffd-023623187c05 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:09:43.892219 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-756a9719-d9f7-4f26-a8b1-10a4baf679f5 req-72face5c-a5a0-47ee-8ffd-023623187c05 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/ports?device_id=bdaa3d25-adc2-4a52-8a36-66a599b4b6e2 HTTP/1.1" status: 200 len: 946 time: 0.0989602 May 25 17:09:43.950752 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-756a9719-d9f7-4f26-a8b1-10a4baf679f5 req-2a54ac51-d6e3-47db-9d61-dc21fe8aae51 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/security-groups?id=4e6b7b77-0833-47dc-be2e-ec9c7c960bb9&fields=id&fields=name HTTP/1.1" status: 200 len: 309 time: 0.0524013 May 25 17:09:45.163772 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f58144b2-8511-4724-b4bd-516caa5b95b9 req-3979f621-1765-48a6-b564-331cd9425862 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:09:45.165226 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-f58144b2-8511-4724-b4bd-516caa5b95b9 req-3979f621-1765-48a6-b564-331cd9425862 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/ports?device_id=bdaa3d25-adc2-4a52-8a36-66a599b4b6e2 HTTP/1.1" status: 200 len: 946 time: 0.0833328 May 25 17:09:45.212484 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-f58144b2-8511-4724-b4bd-516caa5b95b9 req-12af6ef0-81ab-47e9-92be-182a60be6b7d tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/security-groups?id=4e6b7b77-0833-47dc-be2e-ec9c7c960bb9&fields=id&fields=name HTTP/1.1" status: 200 len: 309 time: 0.0409043 May 25 17:09:46.514971 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-585c3800-7177-4d77-ada9-4a6d23e8b664 req-f4501004-797d-4271-9934-e356f875b9c6 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:09:46.516678 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-585c3800-7177-4d77-ada9-4a6d23e8b664 req-f4501004-797d-4271-9934-e356f875b9c6 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/ports?device_id=bdaa3d25-adc2-4a52-8a36-66a599b4b6e2 HTTP/1.1" status: 200 len: 946 time: 0.1903038 May 25 17:09:46.566312 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-585c3800-7177-4d77-ada9-4a6d23e8b664 req-5ee31aa8-6bbd-474e-85db-4ef1772703f9 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/security-groups?id=4e6b7b77-0833-47dc-be2e-ec9c7c960bb9&fields=id&fields=name HTTP/1.1" status: 200 len: 309 time: 0.0443416 May 25 17:09:47.771460 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6d97fa6f-4c97-40ed-920c-b42afd2e8abc req-2e44a219-ce3b-496d-8fee-bdc3e093a267 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:09:47.772919 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-6d97fa6f-4c97-40ed-920c-b42afd2e8abc req-2e44a219-ce3b-496d-8fee-bdc3e093a267 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/ports?device_id=bdaa3d25-adc2-4a52-8a36-66a599b4b6e2 HTTP/1.1" status: 200 len: 946 time: 0.0937216 May 25 17:09:47.822389 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-6d97fa6f-4c97-40ed-920c-b42afd2e8abc req-9f419b48-4c3d-491d-a1f5-e5710a4d3018 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/security-groups?id=4e6b7b77-0833-47dc-be2e-ec9c7c960bb9&fields=id&fields=name HTTP/1.1" status: 200 len: 309 time: 0.0426359 May 25 17:09:49.040247 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4b535846-d728-44a6-a921-0beae8530f4a req-6ed748e7-cb22-4003-bced-e1e00a52aeaf tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:09:49.042428 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-4b535846-d728-44a6-a921-0beae8530f4a req-6ed748e7-cb22-4003-bced-e1e00a52aeaf tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/ports?device_id=bdaa3d25-adc2-4a52-8a36-66a599b4b6e2 HTTP/1.1" status: 200 len: 946 time: 0.0986476 May 25 17:09:49.092147 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-4b535846-d728-44a6-a921-0beae8530f4a req-d69ee79e-2c07-4b12-83cd-d8561bee6004 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/security-groups?id=4e6b7b77-0833-47dc-be2e-ec9c7c960bb9&fields=id&fields=name HTTP/1.1" status: 200 len: 309 time: 0.0434771 May 25 17:09:50.149123 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.db.agents_db [None req-504cb04f-4543-46c1-8db7-349e21db7634 None None] Agent healthcheck: found 6 active agents {{(pid=91832) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} May 25 17:09:50.303118 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4ff7c163-9313-4187-8198-0747ed39840b req-1009f6b3-bb75-4c4b-b406-339f21edd392 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:09:50.304549 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-4ff7c163-9313-4187-8198-0747ed39840b req-1009f6b3-bb75-4c4b-b406-339f21edd392 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/ports?device_id=bdaa3d25-adc2-4a52-8a36-66a599b4b6e2 HTTP/1.1" status: 200 len: 946 time: 0.0952156 May 25 17:09:50.396804 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-4ff7c163-9313-4187-8198-0747ed39840b req-22c8482c-61c7-44d1-ac5b-65b8814bb9c3 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/security-groups?id=4e6b7b77-0833-47dc-be2e-ec9c7c960bb9&fields=id&fields=name HTTP/1.1" status: 200 len: 309 time: 0.0865469 May 25 17:09:50.419179 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4483dc5e-bb31-4447-822b-4769fa543cb7 req-d33e295f-96c7-48b3-84fd-9de7cc2ba6e8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:09:50.421210 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-4483dc5e-bb31-4447-822b-4769fa543cb7 req-d33e295f-96c7-48b3-84fd-9de7cc2ba6e8 service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=bbb9e99759bc47d08005f3b1e036a6cf&device_id=bdaa3d25-adc2-4a52-8a36-66a599b4b6e2 HTTP/1.1" status: 200 len: 1099 time: 0.0884235 May 25 17:09:50.553018 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4483dc5e-bb31-4447-822b-4769fa543cb7 req-4bb27b66-ba81-4074-a0dd-eed227facddd service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:09:50.554506 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-4483dc5e-bb31-4447-822b-4769fa543cb7 req-4bb27b66-ba81-4074-a0dd-eed227facddd service neutron] 10.222.0.32 "GET /v2.0/networks?id=e5be4c6a-143f-474c-a90b-37180778cefe HTTP/1.1" status: 200 len: 917 time: 0.1262493 May 25 17:09:50.657425 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-4483dc5e-bb31-4447-822b-4769fa543cb7 req-c4007332-36ee-4e5e-8f4a-4d3c5a6fe354 service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=bfd709e1-823e-4b01-8a88-fa341f7e700a HTTP/1.1" status: 200 len: 1001 time: 0.0949886 May 25 17:09:50.724412 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4483dc5e-bb31-4447-822b-4769fa543cb7 req-638b73d9-546c-4dfa-9b56-0bc691e05206 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:09:50.725807 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-4483dc5e-bb31-4447-822b-4769fa543cb7 req-638b73d9-546c-4dfa-9b56-0bc691e05206 service neutron] 10.222.0.32 "GET /v2.0/subnets?id=6e6b5897-e23d-4281-96cb-a6fdf9b68134 HTTP/1.1" status: 200 len: 855 time: 0.0591052 May 25 17:09:50.801461 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4483dc5e-bb31-4447-822b-4769fa543cb7 req-50513391-d5d4-48de-80eb-92ed7bb5888f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:09:50.802908 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-4483dc5e-bb31-4447-822b-4769fa543cb7 req-50513391-d5d4-48de-80eb-92ed7bb5888f service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=e5be4c6a-143f-474c-a90b-37180778cefe&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0685413 May 25 17:09:50.934099 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-4483dc5e-bb31-4447-822b-4769fa543cb7 req-0837087d-f5af-4fe2-97f4-e872ebad58ea service neutron] 10.222.0.32 "GET /v2.0/networks/e5be4c6a-143f-474c-a90b-37180778cefe?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1222875 May 25 17:09:51.064861 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-4483dc5e-bb31-4447-822b-4769fa543cb7 req-22f1a50c-4bf6-4370-929d-b043bb92c741 service neutron] 10.222.0.32 "GET /v2.0/networks/e5be4c6a-143f-474c-a90b-37180778cefe?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1239495 May 25 17:09:51.590189 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dc9101a1-141b-47c3-b88a-9a2f377be648 req-4dd4e9bc-f2b7-488a-ae53-c5227eb6f7fe tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:09:51.592187 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-dc9101a1-141b-47c3-b88a-9a2f377be648 req-4dd4e9bc-f2b7-488a-ae53-c5227eb6f7fe tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/ports?device_id=bdaa3d25-adc2-4a52-8a36-66a599b4b6e2 HTTP/1.1" status: 200 len: 946 time: 0.0826740 May 25 17:09:51.636220 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-dc9101a1-141b-47c3-b88a-9a2f377be648 req-0c156f64-088e-4af5-a7d3-0eb2b39fd77e tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/security-groups?id=4e6b7b77-0833-47dc-be2e-ec9c7c960bb9&fields=id&fields=name HTTP/1.1" status: 200 len: 309 time: 0.0384741 May 25 17:09:52.823815 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2460a7c7-faca-4992-ba4b-640b73ef4ac4 req-884554cb-3f17-42ea-9b23-9f49a3375acd tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:09:52.825305 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-2460a7c7-faca-4992-ba4b-640b73ef4ac4 req-884554cb-3f17-42ea-9b23-9f49a3375acd tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/ports?device_id=bdaa3d25-adc2-4a52-8a36-66a599b4b6e2 HTTP/1.1" status: 200 len: 946 time: 0.0780742 May 25 17:09:52.869121 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-2460a7c7-faca-4992-ba4b-640b73ef4ac4 req-343d66b1-21c4-4dab-a29f-4075ca2702aa tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/security-groups?id=4e6b7b77-0833-47dc-be2e-ec9c7c960bb9&fields=id&fields=name HTTP/1.1" status: 200 len: 309 time: 0.0379684 May 25 17:09:54.060116 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1f3eb5ac-3092-4410-95ef-b61d12d3423a req-2ba913b0-a37e-4dbf-adbd-3145dbd76999 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:09:54.061584 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-1f3eb5ac-3092-4410-95ef-b61d12d3423a req-2ba913b0-a37e-4dbf-adbd-3145dbd76999 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/ports?device_id=bdaa3d25-adc2-4a52-8a36-66a599b4b6e2 HTTP/1.1" status: 200 len: 946 time: 0.0842853 May 25 17:09:54.105374 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-1f3eb5ac-3092-4410-95ef-b61d12d3423a req-91b3fb8e-fc2b-4ea8-9756-3e057c21275a tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/security-groups?id=4e6b7b77-0833-47dc-be2e-ec9c7c960bb9&fields=id&fields=name HTTP/1.1" status: 200 len: 309 time: 0.0379798 May 25 17:09:54.543253 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.rpc [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Device bfd709e1-823e-4b01-8a88-fa341f7e700a no longer exists at agent hyperv_hv-cinder-79049 {{(pid=91831) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 25 17:09:54.668238 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3832070'] for port, before_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:09:54.695846 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'bdaa3d25-adc2-4a52-8a36-66a599b4b6e2', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': 'bfd709e1-823e-4b01-8a88-fa341f7e700a'}] {{(pid=91831) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 25 17:09:54.706028 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.db [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] For port bfd709e1-823e-4b01-8a88-fa341f7e700a, host hv-cinder-79049, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79049',level=0,port_id=bfd709e1-823e-4b01-8a88-fa341f7e700a,segment=NetworkSegment(a8fb0313-938a-4f5e-8ff4-96df8acd943b),segment_id=a8fb0313-938a-4f5e-8ff4-96df8acd943b)] {{(pid=91831) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 17:09:54.710327 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8757892955028', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8757892520933', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8757892521750'] for port, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:09:54.712192 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [None req-cb914eaa-ddb9-4396-b361-90af5c1fa3d2 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:09:54.783524 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Pushing event updated for resources: {'Port': ['ID=bfd709e1-823e-4b01-8a88-fa341f7e700a,revision_number=8']} {{(pid=91831) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:09:54.787488 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.075s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:09:54.806280 dv-cinder-790492-4-iscsi neutron-server[91831]: WARNING neutron.notifiers.nova [-] Nova event: {'server_uuid': 'bdaa3d25-adc2-4a52-8a36-66a599b4b6e2', 'name': 'network-vif-unplugged', 'status': 'failed', 'tag': 'bfd709e1-823e-4b01-8a88-fa341f7e700a', 'code': 422} returned with failed status May 25 17:09:55.310154 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-4dd40073-21ea-43aa-98d0-55f8715f8624 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:09:55.554095 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7edf67d8-2ad1-4c02-a7c5-3f1e8f1c5f5c req-4a96848d-5bfd-4c37-b177-c67b6e92c73d tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:09:55.555537 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-7edf67d8-2ad1-4c02-a7c5-3f1e8f1c5f5c req-4a96848d-5bfd-4c37-b177-c67b6e92c73d tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/ports?device_id=bdaa3d25-adc2-4a52-8a36-66a599b4b6e2 HTTP/1.1" status: 200 len: 944 time: 0.1408916 May 25 17:09:55.560687 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-fa1fe780-867f-42e9-8b97-6bf9cf50f2aa req-0e91ba0f-c350-48d8-9d42-09f1176d8e22 service neutron] 10.222.0.62 "GET /v2.0/ports?device_id=bdaa3d25-adc2-4a52-8a36-66a599b4b6e2&fields=id&fields=resource_request HTTP/1.1" status: 200 len: 255 time: 0.1126347 May 25 17:09:55.601731 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-7edf67d8-2ad1-4c02-a7c5-3f1e8f1c5f5c req-11391761-ef08-46cd-8946-6c069e62ea78 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/security-groups?id=4e6b7b77-0833-47dc-be2e-ec9c7c960bb9&fields=id&fields=name HTTP/1.1" status: 200 len: 309 time: 0.0401914 May 25 17:09:56.462265 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fa1fe780-867f-42e9-8b97-6bf9cf50f2aa req-3367f483-747a-4ba4-b2eb-94af8a8b6728 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:09:56.463720 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-fa1fe780-867f-42e9-8b97-6bf9cf50f2aa req-3367f483-747a-4ba4-b2eb-94af8a8b6728 service neutron] 10.222.0.32 "GET /v2.0/ports?device_id=bdaa3d25-adc2-4a52-8a36-66a599b4b6e2&tenant_id=bbb9e99759bc47d08005f3b1e036a6cf HTTP/1.1" status: 200 len: 1097 time: 0.0702267 May 25 17:09:56.647955 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fa1fe780-867f-42e9-8b97-6bf9cf50f2aa req-b5fc26b9-30f6-490d-95da-299ff5dbc40b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:09:56.649556 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-fa1fe780-867f-42e9-8b97-6bf9cf50f2aa req-b5fc26b9-30f6-490d-95da-299ff5dbc40b service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=bbb9e99759bc47d08005f3b1e036a6cf&device_id=bdaa3d25-adc2-4a52-8a36-66a599b4b6e2 HTTP/1.1" status: 200 len: 1097 time: 0.1638739 May 25 17:09:56.840160 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fa1fe780-867f-42e9-8b97-6bf9cf50f2aa req-37256cd1-1bd1-4b5f-871d-80552ea6ae99 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:09:56.841590 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-fa1fe780-867f-42e9-8b97-6bf9cf50f2aa req-37256cd1-1bd1-4b5f-871d-80552ea6ae99 service neutron] 10.222.0.32 "GET /v2.0/networks?id=e5be4c6a-143f-474c-a90b-37180778cefe HTTP/1.1" status: 200 len: 917 time: 0.1845956 May 25 17:09:56.853828 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-241f7170-4d9b-45b9-9ff9-331940484f71 req-94e6f1f3-ff9b-4646-ac36-fa01b99bc87e tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:09:56.855196 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-241f7170-4d9b-45b9-9ff9-331940484f71 req-94e6f1f3-ff9b-4646-ac36-fa01b99bc87e tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/ports?device_id=bdaa3d25-adc2-4a52-8a36-66a599b4b6e2 HTTP/1.1" status: 200 len: 944 time: 0.1304860 May 25 17:09:56.982222 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-241f7170-4d9b-45b9-9ff9-331940484f71 req-2fdbe656-d353-4b68-a178-5dc246ee2e88 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/security-groups?id=4e6b7b77-0833-47dc-be2e-ec9c7c960bb9&fields=id&fields=name HTTP/1.1" status: 200 len: 309 time: 0.0783396 May 25 17:09:56.984029 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-fa1fe780-867f-42e9-8b97-6bf9cf50f2aa req-f19479f3-bc66-4cb7-9227-c75fc3f10fe1 service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=bfd709e1-823e-4b01-8a88-fa341f7e700a HTTP/1.1" status: 200 len: 999 time: 0.1280117 May 25 17:09:57.048500 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fa1fe780-867f-42e9-8b97-6bf9cf50f2aa req-18138439-facc-4d2c-95fc-2929631375d6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:09:57.049843 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-fa1fe780-867f-42e9-8b97-6bf9cf50f2aa req-18138439-facc-4d2c-95fc-2929631375d6 service neutron] 10.222.0.32 "GET /v2.0/subnets?id=6e6b5897-e23d-4281-96cb-a6fdf9b68134 HTTP/1.1" status: 200 len: 855 time: 0.0583103 May 25 17:09:57.123338 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fa1fe780-867f-42e9-8b97-6bf9cf50f2aa req-9368bd49-15f6-40f7-b368-50196daa5dfa service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:09:57.125328 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-fa1fe780-867f-42e9-8b97-6bf9cf50f2aa req-9368bd49-15f6-40f7-b368-50196daa5dfa service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=e5be4c6a-143f-474c-a90b-37180778cefe&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0687335 May 25 17:09:57.255900 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-fa1fe780-867f-42e9-8b97-6bf9cf50f2aa req-38e31c28-b578-4cc1-b07a-c4ecf86e94b1 service neutron] 10.222.0.32 "GET /v2.0/networks/e5be4c6a-143f-474c-a90b-37180778cefe?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1224651 May 25 17:09:57.385047 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-fa1fe780-867f-42e9-8b97-6bf9cf50f2aa req-1db5137c-34ab-4ba7-b654-c001f1fb116f service neutron] 10.222.0.32 "GET /v2.0/networks/e5be4c6a-143f-474c-a90b-37180778cefe?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1225085 May 25 17:09:57.712548 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-a650d0a4-0391-4dae-96a1-e545c8a1e538 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:09:57.899408 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:09:58.180021 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6b6c3a7a-529f-4322-9b68-9846800ce3f2 req-8f65fe94-ca7d-4a57-bd61-37be4ad8cf23 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:09:58.181369 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-6b6c3a7a-529f-4322-9b68-9846800ce3f2 req-8f65fe94-ca7d-4a57-bd61-37be4ad8cf23 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/ports?device_id=bdaa3d25-adc2-4a52-8a36-66a599b4b6e2 HTTP/1.1" status: 200 len: 944 time: 0.0866327 May 25 17:09:58.226519 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-6b6c3a7a-529f-4322-9b68-9846800ce3f2 req-6cd4a950-92ca-4d4c-98f6-240fc8e4c3d6 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/security-groups?id=4e6b7b77-0833-47dc-be2e-ec9c7c960bb9&fields=id&fields=name HTTP/1.1" status: 200 len: 309 time: 0.0387826 May 25 17:09:58.646546 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-0a55eb4a-8b57-4233-84d6-6b423b4ed6db None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:09:59.434870 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3873cfdc-ee2f-4ee7-a132-c34a74ba1fc3 req-1ced7eb2-951f-4189-a1aa-70246be192ee tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:09:59.436304 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-3873cfdc-ee2f-4ee7-a132-c34a74ba1fc3 req-1ced7eb2-951f-4189-a1aa-70246be192ee tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/ports?device_id=bdaa3d25-adc2-4a52-8a36-66a599b4b6e2 HTTP/1.1" status: 200 len: 944 time: 0.0884194 May 25 17:09:59.486385 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-3873cfdc-ee2f-4ee7-a132-c34a74ba1fc3 req-4d4f9f04-9c87-430c-959d-ed4f27cf69b7 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/security-groups?id=4e6b7b77-0833-47dc-be2e-ec9c7c960bb9&fields=id&fields=name HTTP/1.1" status: 200 len: 309 time: 0.0433886 May 25 17:10:00.251813 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-57f11b47-1f51-4191-b7c9-af248a48372c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:10:00.685468 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c341ab99-82d0-4eea-bf4a-586ee9b70d63 req-d67298d1-5fd4-49f3-ae16-6ba865337b2f tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:10:00.687291 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-c341ab99-82d0-4eea-bf4a-586ee9b70d63 req-d67298d1-5fd4-49f3-ae16-6ba865337b2f tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/ports?device_id=bdaa3d25-adc2-4a52-8a36-66a599b4b6e2 HTTP/1.1" status: 200 len: 944 time: 0.0851982 May 25 17:10:00.733951 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-c341ab99-82d0-4eea-bf4a-586ee9b70d63 req-87650535-c840-4155-999b-086916045b4f tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/security-groups?id=4e6b7b77-0833-47dc-be2e-ec9c7c960bb9&fields=id&fields=name HTTP/1.1" status: 200 len: 309 time: 0.0409267 May 25 17:10:01.928074 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-67b465b6-ea97-46d8-9fb9-f343240188a3 req-0b719ff1-74a1-46dc-ac72-2f384f380650 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:10:01.929547 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-67b465b6-ea97-46d8-9fb9-f343240188a3 req-0b719ff1-74a1-46dc-ac72-2f384f380650 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/ports?device_id=bdaa3d25-adc2-4a52-8a36-66a599b4b6e2 HTTP/1.1" status: 200 len: 944 time: 0.0845418 May 25 17:10:01.980954 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-67b465b6-ea97-46d8-9fb9-f343240188a3 req-9dafc268-6637-4e99-819c-71d724e85677 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/security-groups?id=4e6b7b77-0833-47dc-be2e-ec9c7c960bb9&fields=id&fields=name HTTP/1.1" status: 200 len: 309 time: 0.0415552 May 25 17:10:03.173120 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-33201eed-7068-401e-b06d-bf7a6c826b34 req-3fb6c98e-b769-4245-baeb-300ce9fc743f tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:10:03.174751 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-33201eed-7068-401e-b06d-bf7a6c826b34 req-3fb6c98e-b769-4245-baeb-300ce9fc743f tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/ports?device_id=bdaa3d25-adc2-4a52-8a36-66a599b4b6e2 HTTP/1.1" status: 200 len: 944 time: 0.0843952 May 25 17:10:03.220852 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-33201eed-7068-401e-b06d-bf7a6c826b34 req-844d24a2-f3a0-47a6-a3c4-c61243d6361a tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/security-groups?id=4e6b7b77-0833-47dc-be2e-ec9c7c960bb9&fields=id&fields=name HTTP/1.1" status: 200 len: 309 time: 0.0404553 May 25 17:10:04.419533 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c2d22201-94ea-4240-88bc-d2109b34c0dd req-336fca7a-9f97-4d5a-bd95-693efd6ea8ee tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:10:04.421702 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-c2d22201-94ea-4240-88bc-d2109b34c0dd req-336fca7a-9f97-4d5a-bd95-693efd6ea8ee tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/ports?device_id=bdaa3d25-adc2-4a52-8a36-66a599b4b6e2 HTTP/1.1" status: 200 len: 944 time: 0.0866158 May 25 17:10:04.471736 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-c2d22201-94ea-4240-88bc-d2109b34c0dd req-1d34b945-e4e0-47db-8ad5-59d7b81e4259 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/security-groups?id=4e6b7b77-0833-47dc-be2e-ec9c7c960bb9&fields=id&fields=name HTTP/1.1" status: 200 len: 309 time: 0.0422246 May 25 17:10:05.664380 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0de8a08c-f742-4de7-a9ab-b8e4a1bf38df req-e0517f9c-c6c7-44a8-bd4c-0b3f9f3690dd tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:10:05.665840 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-0de8a08c-f742-4de7-a9ab-b8e4a1bf38df req-e0517f9c-c6c7-44a8-bd4c-0b3f9f3690dd tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/ports?device_id=bdaa3d25-adc2-4a52-8a36-66a599b4b6e2 HTTP/1.1" status: 200 len: 944 time: 0.0818989 May 25 17:10:05.716324 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-0de8a08c-f742-4de7-a9ab-b8e4a1bf38df req-de952c6c-49c3-45a4-9a88-e9e691aecb5f tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/security-groups?id=4e6b7b77-0833-47dc-be2e-ec9c7c960bb9&fields=id&fields=name HTTP/1.1" status: 200 len: 309 time: 0.0445008 May 25 17:10:06.584298 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:10:06.907449 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-506ae2d7-e5f7-4f29-b159-d0083af649f1 req-cd143977-3ac9-4000-8859-a71a5a895988 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:10:06.908840 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-506ae2d7-e5f7-4f29-b159-d0083af649f1 req-cd143977-3ac9-4000-8859-a71a5a895988 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/ports?device_id=bdaa3d25-adc2-4a52-8a36-66a599b4b6e2 HTTP/1.1" status: 200 len: 944 time: 0.0820494 May 25 17:10:06.954964 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-506ae2d7-e5f7-4f29-b159-d0083af649f1 req-5f279c87-048a-4934-b3c6-0f35a86419b8 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/security-groups?id=4e6b7b77-0833-47dc-be2e-ec9c7c960bb9&fields=id&fields=name HTTP/1.1" status: 200 len: 309 time: 0.0401063 May 25 17:10:08.153717 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c6eda23f-d6ee-45ea-b6cc-5be31a5dcc89 req-6e1e695a-2360-4d49-93d0-f63b355708d1 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:10:08.155199 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-c6eda23f-d6ee-45ea-b6cc-5be31a5dcc89 req-6e1e695a-2360-4d49-93d0-f63b355708d1 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/ports?device_id=bdaa3d25-adc2-4a52-8a36-66a599b4b6e2 HTTP/1.1" status: 200 len: 944 time: 0.0860484 May 25 17:10:08.294109 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-c6eda23f-d6ee-45ea-b6cc-5be31a5dcc89 req-033f9673-079b-48a6-ac0a-50c08506bbef tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/security-groups?id=4e6b7b77-0833-47dc-be2e-ec9c7c960bb9&fields=id&fields=name HTTP/1.1" status: 200 len: 309 time: 0.1330495 May 25 17:10:09.492296 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c7193422-efc2-4029-b1cf-632d93b525d8 req-4725a858-b9bd-4ff0-b74c-93330dc96ac4 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:10:09.493828 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-c7193422-efc2-4029-b1cf-632d93b525d8 req-4725a858-b9bd-4ff0-b74c-93330dc96ac4 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/ports?device_id=bdaa3d25-adc2-4a52-8a36-66a599b4b6e2 HTTP/1.1" status: 200 len: 944 time: 0.0880530 May 25 17:10:09.543292 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-c7193422-efc2-4029-b1cf-632d93b525d8 req-f0207102-2539-41f4-bba5-f90b842029cc tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/security-groups?id=4e6b7b77-0833-47dc-be2e-ec9c7c960bb9&fields=id&fields=name HTTP/1.1" status: 200 len: 309 time: 0.0430336 May 25 17:10:10.729972 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-62133243-30e6-4641-bced-d23e0aa8bd8e req-98a52c7f-e35f-465d-a66d-eddab6ec05f0 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:10:10.731405 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-62133243-30e6-4641-bced-d23e0aa8bd8e req-98a52c7f-e35f-465d-a66d-eddab6ec05f0 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/ports?device_id=bdaa3d25-adc2-4a52-8a36-66a599b4b6e2 HTTP/1.1" status: 200 len: 944 time: 0.0797336 May 25 17:10:10.774471 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-62133243-30e6-4641-bced-d23e0aa8bd8e req-719ab8ef-087a-4661-83f4-cc760a441a59 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/security-groups?id=4e6b7b77-0833-47dc-be2e-ec9c7c960bb9&fields=id&fields=name HTTP/1.1" status: 200 len: 309 time: 0.0374823 May 25 17:10:11.979238 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bb39eda1-7e2c-418e-b3ad-4482c30d1538 req-c3ffbb6d-33e2-427a-9132-53a65e4613a4 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:10:11.980671 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-bb39eda1-7e2c-418e-b3ad-4482c30d1538 req-c3ffbb6d-33e2-427a-9132-53a65e4613a4 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/ports?device_id=bdaa3d25-adc2-4a52-8a36-66a599b4b6e2 HTTP/1.1" status: 200 len: 944 time: 0.0820880 May 25 17:10:12.024890 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-bb39eda1-7e2c-418e-b3ad-4482c30d1538 req-21fc8fa0-1bb8-493b-9ac1-76363b02442c tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/security-groups?id=4e6b7b77-0833-47dc-be2e-ec9c7c960bb9&fields=id&fields=name HTTP/1.1" status: 200 len: 309 time: 0.0378220 May 25 17:10:13.209522 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7b3b18b4-5e2c-46e7-8f35-835406bdb6e5 req-3bc07183-949f-48e2-9fad-2739f4fc999a tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:10:13.210961 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-7b3b18b4-5e2c-46e7-8f35-835406bdb6e5 req-3bc07183-949f-48e2-9fad-2739f4fc999a tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/ports?device_id=bdaa3d25-adc2-4a52-8a36-66a599b4b6e2 HTTP/1.1" status: 200 len: 944 time: 0.0781972 May 25 17:10:13.254364 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-7b3b18b4-5e2c-46e7-8f35-835406bdb6e5 req-18b234a7-c8fc-4c97-b349-032a94118a21 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/security-groups?id=4e6b7b77-0833-47dc-be2e-ec9c7c960bb9&fields=id&fields=name HTTP/1.1" status: 200 len: 309 time: 0.0377426 May 25 17:10:14.445390 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-83f26635-e915-44b0-8f9f-fb49bdd51db7 req-a7e1778f-d210-4d20-801b-b68381aa4378 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:10:14.446848 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-83f26635-e915-44b0-8f9f-fb49bdd51db7 req-a7e1778f-d210-4d20-801b-b68381aa4378 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/ports?device_id=bdaa3d25-adc2-4a52-8a36-66a599b4b6e2 HTTP/1.1" status: 200 len: 944 time: 0.0838013 May 25 17:10:14.495808 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-83f26635-e915-44b0-8f9f-fb49bdd51db7 req-b457ab38-ba60-4690-bf80-700fdd9787ea tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/security-groups?id=4e6b7b77-0833-47dc-be2e-ec9c7c960bb9&fields=id&fields=name HTTP/1.1" status: 200 len: 309 time: 0.0433927 May 25 17:10:15.685981 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fd108607-2d6a-46d9-8460-46f855a84c0b req-d691e705-82c3-4401-a169-0b7eaa87a2b8 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:10:15.687895 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-fd108607-2d6a-46d9-8460-46f855a84c0b req-d691e705-82c3-4401-a169-0b7eaa87a2b8 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/ports?device_id=bdaa3d25-adc2-4a52-8a36-66a599b4b6e2 HTTP/1.1" status: 200 len: 944 time: 0.0794091 May 25 17:10:15.730875 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-fd108607-2d6a-46d9-8460-46f855a84c0b req-6d2eaddd-5e89-4e19-aa31-e220d3c4c542 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/security-groups?id=4e6b7b77-0833-47dc-be2e-ec9c7c960bb9&fields=id&fields=name HTTP/1.1" status: 200 len: 309 time: 0.0374117 May 25 17:10:16.674571 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.rpc [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Device bfd709e1-823e-4b01-8a88-fa341f7e700a details requested by agent hyperv_hv-cinder-79049 with host hv-cinder-79049 {{(pid=91831) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 25 17:10:16.806462 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.db [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] For port bfd709e1-823e-4b01-8a88-fa341f7e700a, host hv-cinder-79049, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79049',level=0,port_id=bfd709e1-823e-4b01-8a88-fa341f7e700a,segment=NetworkSegment(a8fb0313-938a-4f5e-8ff4-96df8acd943b),segment_id=a8fb0313-938a-4f5e-8ff4-96df8acd943b)] {{(pid=91831) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 17:10:16.819681 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.rpc [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Returning: {'device': 'bfd709e1-823e-4b01-8a88-fa341f7e700a', 'network_id': 'e5be4c6a-143f-474c-a90b-37180778cefe', 'port_id': 'bfd709e1-823e-4b01-8a88-fa341f7e700a', 'mac_address': 'fa:16:3e:65:f3:f2', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 695, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '6e6b5897-e23d-4281-96cb-a6fdf9b68134', 'ip_address': '172.20.0.12'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=91831) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 25 17:10:16.913362 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3832070'] for port, before_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:10:16.924754 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-940e1c6c-c217-49f2-b16d-4ae899ecdedb req-952b99de-9f79-49c2-b997-7a10e963d121 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:10:16.926310 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-940e1c6c-c217-49f2-b16d-4ae899ecdedb req-952b99de-9f79-49c2-b997-7a10e963d121 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/ports?device_id=bdaa3d25-adc2-4a52-8a36-66a599b4b6e2 HTTP/1.1" status: 200 len: 944 time: 0.0867567 May 25 17:10:16.929821 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.notifiers.nova [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id bfd709e1-823e-4b01-8a88-fa341f7e700a {{(pid=91831) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} May 25 17:10:16.945808 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.db [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] For port bfd709e1-823e-4b01-8a88-fa341f7e700a, host hv-cinder-79049, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79049',level=0,port_id=bfd709e1-823e-4b01-8a88-fa341f7e700a,segment=NetworkSegment(a8fb0313-938a-4f5e-8ff4-96df8acd943b),segment_id=a8fb0313-938a-4f5e-8ff4-96df8acd943b)] {{(pid=91831) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 17:10:16.950141 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8757892955028', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8757892520933', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8757892521750'] for port, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:10:16.951621 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:10:16.972220 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-940e1c6c-c217-49f2-b16d-4ae899ecdedb req-3ac3789e-f043-47fe-82d6-05a6154cee12 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/security-groups?id=4e6b7b77-0833-47dc-be2e-ec9c7c960bb9&fields=id&fields=name HTTP/1.1" status: 200 len: 309 time: 0.0401187 May 25 17:10:17.019534 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Pushing event updated for resources: {'Port': ['ID=bfd709e1-823e-4b01-8a88-fa341f7e700a,revision_number=9']} {{(pid=91831) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:10:17.026741 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.075s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:10:17.431627 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.db [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] get_ports_and_sgs() called for port_ids ['bfd709e1-823e-4b01-8a88-fa341f7e700a'] {{(pid=91831) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 25 17:10:18.164032 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e418ec88-da5f-40dc-8c8b-d48e5436eba5 req-4a0b3074-bd9a-4bcb-bcad-a31d4b351648 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:10:18.165488 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-e418ec88-da5f-40dc-8c8b-d48e5436eba5 req-4a0b3074-bd9a-4bcb-bcad-a31d4b351648 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/ports?device_id=bdaa3d25-adc2-4a52-8a36-66a599b4b6e2 HTTP/1.1" status: 200 len: 945 time: 0.0784736 May 25 17:10:18.212427 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-e418ec88-da5f-40dc-8c8b-d48e5436eba5 req-4b409e76-a7a4-4546-ba74-bb5f03eb0add tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/security-groups?id=4e6b7b77-0833-47dc-be2e-ec9c7c960bb9&fields=id&fields=name HTTP/1.1" status: 200 len: 309 time: 0.0413010 May 25 17:10:18.683211 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.rpc [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Device bfd709e1-823e-4b01-8a88-fa341f7e700a up at agent hyperv_hv-cinder-79049 {{(pid=91831) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 25 17:10:18.751409 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.provisioning_blocks [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Provisioning complete for port bfd709e1-823e-4b01-8a88-fa341f7e700a triggered by entity L2. {{(pid=91831) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 17:10:18.751776 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3854128'] for port, provisioning_complete {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:10:18.864860 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3832070'] for port, before_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:10:18.891339 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'bdaa3d25-adc2-4a52-8a36-66a599b4b6e2', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'bfd709e1-823e-4b01-8a88-fa341f7e700a'}] {{(pid=91831) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 25 17:10:18.900667 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.db [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] For port bfd709e1-823e-4b01-8a88-fa341f7e700a, host hv-cinder-79049, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79049',level=0,port_id=bfd709e1-823e-4b01-8a88-fa341f7e700a,segment=NetworkSegment(a8fb0313-938a-4f5e-8ff4-96df8acd943b),segment_id=a8fb0313-938a-4f5e-8ff4-96df8acd943b)] {{(pid=91831) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 17:10:18.904806 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8757892955028', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8757892520933', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8757892521750'] for port, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:10:18.907658 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:10:18.944256 dv-cinder-790492-4-iscsi neutron-server[91831]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'bdaa3d25-adc2-4a52-8a36-66a599b4b6e2', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'bfd709e1-823e-4b01-8a88-fa341f7e700a', 'code': 200} May 25 17:10:18.982702 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Pushing event updated for resources: {'Port': ['ID=bfd709e1-823e-4b01-8a88-fa341f7e700a,revision_number=10']} {{(pid=91831) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:10:18.986222 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.079s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:10:19.172933 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-014872b3-1b4c-40f3-9225-5988bf836b25 req-2894cb35-a804-46f7-94fb-443fc80f1332 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:10:19.174380 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-014872b3-1b4c-40f3-9225-5988bf836b25 req-2894cb35-a804-46f7-94fb-443fc80f1332 service neutron] 10.222.0.32 "GET /v2.0/ports?device_id=bdaa3d25-adc2-4a52-8a36-66a599b4b6e2 HTTP/1.1" status: 200 len: 1100 time: 0.0691073 May 25 17:10:19.214164 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-014872b3-1b4c-40f3-9225-5988bf836b25 req-5a017450-57e0-4d35-99dd-a29a30e71d16 service neutron] 10.222.0.32 "GET /v2.0/security-groups?id=4e6b7b77-0833-47dc-be2e-ec9c7c960bb9&fields=id&fields=name HTTP/1.1" status: 200 len: 309 time: 0.0327673 May 25 17:10:19.403485 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e464b236-b39e-461e-b41c-2170dc8fda02 req-0e121611-163a-48b3-9e87-12ca8054ceaa tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:10:19.404906 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-e464b236-b39e-461e-b41c-2170dc8fda02 req-0e121611-163a-48b3-9e87-12ca8054ceaa tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/ports?device_id=bdaa3d25-adc2-4a52-8a36-66a599b4b6e2 HTTP/1.1" status: 200 len: 947 time: 0.0830550 May 25 17:10:19.450381 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-e464b236-b39e-461e-b41c-2170dc8fda02 req-359fbdc5-6e6f-4d78-9868-e010ed2cfcc8 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/security-groups?id=4e6b7b77-0833-47dc-be2e-ec9c7c960bb9&fields=id&fields=name HTTP/1.1" status: 200 len: 309 time: 0.0391555 May 25 17:10:20.652972 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b114980a-b5f7-4772-b409-c4b8fa5f624d req-b47c3ba5-f2b1-4ed9-bd1e-bd93a61051ac tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:10:20.654478 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-b114980a-b5f7-4772-b409-c4b8fa5f624d req-b47c3ba5-f2b1-4ed9-bd1e-bd93a61051ac tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/ports?device_id=bdaa3d25-adc2-4a52-8a36-66a599b4b6e2 HTTP/1.1" status: 200 len: 947 time: 0.0906279 May 25 17:10:20.705304 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-b114980a-b5f7-4772-b409-c4b8fa5f624d req-9699328a-b851-49f7-82a1-766d0c6a125f tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/security-groups?id=4e6b7b77-0833-47dc-be2e-ec9c7c960bb9&fields=id&fields=name HTTP/1.1" status: 200 len: 309 time: 0.0446014 May 25 17:10:21.900292 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-278238bb-16b8-476e-b4b2-ca3430abbf07 req-6eaa868e-e2e8-4745-8727-a512426c26b4 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:10:21.901772 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-278238bb-16b8-476e-b4b2-ca3430abbf07 req-6eaa868e-e2e8-4745-8727-a512426c26b4 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/ports?device_id=bdaa3d25-adc2-4a52-8a36-66a599b4b6e2 HTTP/1.1" status: 200 len: 947 time: 0.0840125 May 25 17:10:21.946258 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-278238bb-16b8-476e-b4b2-ca3430abbf07 req-583106a3-a090-4887-a1fe-d262f77fda3c tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/security-groups?id=4e6b7b77-0833-47dc-be2e-ec9c7c960bb9&fields=id&fields=name HTTP/1.1" status: 200 len: 309 time: 0.0382955 May 25 17:10:25.313744 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-c88d8d86-8f34-4abc-9a08-33160922c21c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:10:27.148751 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.db.agents_db [None req-504cb04f-4543-46c1-8db7-349e21db7634 None None] Agent healthcheck: found 6 active agents {{(pid=91832) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} May 25 17:10:27.714074 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-e7b4979f-8bae-4623-9133-26ef6c73e8b1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:10:27.898538 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:10:28.646487 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-0a55eb4a-8b57-4233-84d6-6b423b4ed6db None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:10:30.256781 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-57f11b47-1f51-4191-b7c9-af248a48372c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:10:36.577297 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:10:37.822273 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-8dbdae58-b245-4513-8800-154fca0996ad req-35c753a7-8759-4044-92e5-c0c2cae2290c service neutron] 10.222.0.32 "GET /v2.0/ports?device_id=8af1dd48-45a0-4c07-9019-859effb1b06d&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0685530 May 25 17:10:37.915290 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8dbdae58-b245-4513-8800-154fca0996ad req-22ac822f-aa59-4c1e-9c94-c48a86e19640 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:10:37.916708 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-8dbdae58-b245-4513-8800-154fca0996ad req-22ac822f-aa59-4c1e-9c94-c48a86e19640 service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=5397bf60956945c3a2bf43c6b1aa614b&device_id=8af1dd48-45a0-4c07-9019-859effb1b06d HTTP/1.1" status: 200 len: 1098 time: 0.0739846 May 25 17:10:38.078167 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8dbdae58-b245-4513-8800-154fca0996ad req-aeb05643-3875-4ef6-a216-d7ff325b7c9b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:10:38.080043 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-8dbdae58-b245-4513-8800-154fca0996ad req-aeb05643-3875-4ef6-a216-d7ff325b7c9b service neutron] 10.222.0.32 "GET /v2.0/networks?id=17a0e39e-1e1f-4550-b28b-d5ae3bdca362 HTTP/1.1" status: 200 len: 912 time: 0.1254096 May 25 17:10:38.180502 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-8dbdae58-b245-4513-8800-154fca0996ad req-995a3eff-4919-45fb-a37f-047be449e627 service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=0b29d882-4e62-44e0-acc0-5deb97293c57 HTTP/1.1" status: 200 len: 1001 time: 0.0937302 May 25 17:10:38.241951 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8dbdae58-b245-4513-8800-154fca0996ad req-fc8e4168-036d-4ffa-a427-0161123e5a04 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:10:38.243362 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-8dbdae58-b245-4513-8800-154fca0996ad req-fc8e4168-036d-4ffa-a427-0161123e5a04 service neutron] 10.222.0.32 "GET /v2.0/subnets?id=f5599a2e-9942-4423-a1ac-67e9b2650770 HTTP/1.1" status: 200 len: 850 time: 0.0564582 May 25 17:10:38.321715 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8dbdae58-b245-4513-8800-154fca0996ad req-ac18a4d7-a14c-432e-9a2c-8a447ec76e77 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:10:38.323153 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-8dbdae58-b245-4513-8800-154fca0996ad req-ac18a4d7-a14c-432e-9a2c-8a447ec76e77 service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=17a0e39e-1e1f-4550-b28b-d5ae3bdca362&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0720413 May 25 17:10:38.538842 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-8dbdae58-b245-4513-8800-154fca0996ad req-46e62377-c99e-4dfe-b3b5-c17344d04637 service neutron] 10.222.0.32 "GET /v2.0/networks/17a0e39e-1e1f-4550-b28b-d5ae3bdca362?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2060735 May 25 17:10:38.669513 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-8dbdae58-b245-4513-8800-154fca0996ad req-2b0fb221-2cb3-4b9d-a139-747f5f50a775 service neutron] 10.222.0.32 "GET /v2.0/networks/17a0e39e-1e1f-4550-b28b-d5ae3bdca362?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1229854 May 25 17:10:52.339922 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9b969af4-9fbc-4dcd-994c-79749b1241a8 req-54ca3ca7-67cf-4372-bccc-c16ab889aa63 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:10:52.341351 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-9b969af4-9fbc-4dcd-994c-79749b1241a8 req-54ca3ca7-67cf-4372-bccc-c16ab889aa63 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] 10.222.0.62 "GET /v2.0/ports?device_id=8af1dd48-45a0-4c07-9019-859effb1b06d HTTP/1.1" status: 200 len: 945 time: 0.0801902 May 25 17:10:52.385769 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-9b969af4-9fbc-4dcd-994c-79749b1241a8 req-24b7acd0-e01d-47fe-ae8f-b78fb8ef9698 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] 10.222.0.62 "GET /v2.0/security-groups?id=58fab80b-49b2-4bca-89e6-fef7473221ef&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0381291 May 25 17:10:53.575956 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ae8c2bf0-3f47-4817-ba82-836233127fc9 req-377f8b6c-132c-4a40-9528-59489fb54497 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:10:53.577396 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-ae8c2bf0-3f47-4817-ba82-836233127fc9 req-377f8b6c-132c-4a40-9528-59489fb54497 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] 10.222.0.62 "GET /v2.0/ports?device_id=8af1dd48-45a0-4c07-9019-859effb1b06d HTTP/1.1" status: 200 len: 945 time: 0.0851455 May 25 17:10:53.621754 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-ae8c2bf0-3f47-4817-ba82-836233127fc9 req-da159901-2fdc-4705-867a-65fa9d3077d4 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] 10.222.0.62 "GET /v2.0/security-groups?id=58fab80b-49b2-4bca-89e6-fef7473221ef&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0380697 May 25 17:10:54.175866 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-72c7bb21-4cd8-4ceb-98e5-e36b88470b26 req-806e839a-e9c4-4752-a7dd-1821aa6ed7d3 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:10:54.177278 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-72c7bb21-4cd8-4ceb-98e5-e36b88470b26 req-806e839a-e9c4-4752-a7dd-1821aa6ed7d3 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] 10.222.0.32 "GET /v2.0/ports?device_id=8af1dd48-45a0-4c07-9019-859effb1b06d HTTP/1.1" status: 200 len: 945 time: 0.0781772 May 25 17:10:54.314981 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.plugins.ml2.plugin [req-72c7bb21-4cd8-4ceb-98e5-e36b88470b26 req-64445901-7b61-4573-bcbc-2193f4986162 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Deleting port 0b29d882-4e62-44e0-acc0-5deb97293c57 {{(pid=91829) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 25 17:10:54.315525 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [req-72c7bb21-4cd8-4ceb-98e5-e36b88470b26 req-64445901-7b61-4573-bcbc-2193f4986162 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8757892952899'] for port, before_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:10:54.457507 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.plugins.ml2.db [req-72c7bb21-4cd8-4ceb-98e5-e36b88470b26 req-64445901-7b61-4573-bcbc-2193f4986162 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] For port 0b29d882-4e62-44e0-acc0-5deb97293c57, host hv-cinder-79049, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79049',level=0,port_id=0b29d882-4e62-44e0-acc0-5deb97293c57,segment=NetworkSegment(50ed67e9-f8d3-4927-b257-bd17654cce34),segment_id=50ed67e9-f8d3-4927-b257-bd17654cce34)] {{(pid=91829) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 17:10:54.457854 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [req-72c7bb21-4cd8-4ceb-98e5-e36b88470b26 req-64445901-7b61-4573-bcbc-2193f4986162 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-683770'] for port, precommit_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:10:54.794260 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [req-72c7bb21-4cd8-4ceb-98e5-e36b88470b26 req-64445901-7b61-4573-bcbc-2193f4986162 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Notify callbacks [] for floatingip, precommit_update {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:10:54.794967 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [req-72c7bb21-4cd8-4ceb-98e5-e36b88470b26 req-64445901-7b61-4573-bcbc-2193f4986162 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-683033'] for floatingip, after_update {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:10:54.794967 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.db.l3_db [req-72c7bb21-4cd8-4ceb-98e5-e36b88470b26 req-64445901-7b61-4573-bcbc-2193f4986162 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Floating IP c1e3ebd3-1b86-4539-8592-0028e75cf6d4 disassociated. External IP: 172.27.2.164, port: 0b29d882-4e62-44e0-acc0-5deb97293c57. May 25 17:10:54.795237 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.plugins.ml2.plugin [req-72c7bb21-4cd8-4ceb-98e5-e36b88470b26 req-64445901-7b61-4573-bcbc-2193f4986162 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Calling delete_port for 0b29d882-4e62-44e0-acc0-5deb97293c57 owned by compute:nova {{(pid=91829) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 25 17:10:54.837380 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-72a96bc1-882b-4192-9a74-85a852a69da4 req-2e5f4b07-d972-4c80-9145-9798a91c8428 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:10:54.838821 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-72a96bc1-882b-4192-9a74-85a852a69da4 req-2e5f4b07-d972-4c80-9145-9798a91c8428 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] 10.222.0.62 "GET /v2.0/ports?device_id=8af1dd48-45a0-4c07-9019-859effb1b06d HTTP/1.1" status: 200 len: 945 time: 0.1130219 May 25 17:10:54.893435 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-72a96bc1-882b-4192-9a74-85a852a69da4 req-dbdce4bb-adcc-4dcf-97eb-6ceb08169ef9 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] 10.222.0.62 "GET /v2.0/security-groups?id=58fab80b-49b2-4bca-89e6-fef7473221ef&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0488138 May 25 17:10:54.955057 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [req-72c7bb21-4cd8-4ceb-98e5-e36b88470b26 req-64445901-7b61-4573-bcbc-2193f4986162 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8757892955046', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8757892520924', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28230808'] for port, after_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:10:54.960988 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-e1a9164b-b5cd-4005-97e7-5c9727957c07 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:10:55.006516 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-64445901-7b61-4573-bcbc-2193f4986162 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Pushing event deleted for resources: {'Port': ['ID=0b29d882-4e62-44e0-acc0-5deb97293c57,revision_number=None']} {{(pid=91829) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:10:55.015999 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-64445901-7b61-4573-bcbc-2193f4986162 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91829) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:10:55.016393 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-64445901-7b61-4573-bcbc-2193f4986162 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91829) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:10:55.016740 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-64445901-7b61-4573-bcbc-2193f4986162 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91829) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:10:55.017227 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-64445901-7b61-4573-bcbc-2193f4986162 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91829) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:10:55.017512 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-64445901-7b61-4573-bcbc-2193f4986162 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91829) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:10:55.017919 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-64445901-7b61-4573-bcbc-2193f4986162 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91829) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:10:55.018849 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-64445901-7b61-4573-bcbc-2193f4986162 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91829) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:10:55.019281 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-64445901-7b61-4573-bcbc-2193f4986162 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91829) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:10:55.019636 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-64445901-7b61-4573-bcbc-2193f4986162 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91829) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:10:55.019977 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-64445901-7b61-4573-bcbc-2193f4986162 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91829) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:10:55.020401 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-64445901-7b61-4573-bcbc-2193f4986162 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91829) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:10:55.020753 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-64445901-7b61-4573-bcbc-2193f4986162 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91829) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:10:55.024465 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-64445901-7b61-4573-bcbc-2193f4986162 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.064s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:10:55.300072 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.scheduler.l3_agent_scheduler [req-72c7bb21-4cd8-4ceb-98e5-e36b88470b26 req-64445901-7b61-4573-bcbc-2193f4986162 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Router 269c6b7b-91cc-4880-9e6d-b8889bac29f6 has already been hosted by L3 agent a2d427c1-2d07-43e8-afbe-218c9f7d0445 {{(pid=91829) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 25 17:10:55.316117 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-54b14e08-dd83-4c36-b07f-ab9885c51575 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:10:55.488524 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-72c7bb21-4cd8-4ceb-98e5-e36b88470b26 req-64445901-7b61-4573-bcbc-2193f4986162 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Notify agent at l3_agent.dv-cinder-790492-4-iscsi the message routers_updated {{(pid=91829) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 25 17:10:55.498029 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-65ae1941-a1c3-412d-9f4e-3d0d61b71036 None None] Sync routers for ids ['269c6b7b-91cc-4880-9e6d-b8889bac29f6'] in dv-cinder-790492-4-iscsi {{(pid=91831) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 25 17:10:55.507325 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.l3_dvrscheduler_db [None req-65ae1941-a1c3-412d-9f4e-3d0d61b71036 None None] Routers {'269c6b7b-91cc-4880-9e6d-b8889bac29f6'} bound to L3 agent in host dv-cinder-790492-4-iscsi {{(pid=91831) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 17:10:55.508029 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.l3_hamode_db [None req-65ae1941-a1c3-412d-9f4e-3d0d61b71036 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-790492-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-05-25T16:50:28Z,description=,heartbeat_timestamp=2021-05-25T17:10:28Z,host='dv-cinder-790492-4-iscsi',id=a2d427c1-2d07-43e8-afbe-218c9f7d0445,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T16:50:28Z,topic='l3_agent')) {'router_ids': ['269c6b7b-91cc-4880-9e6d-b8889bac29f6'], 'active': True} {{(pid=91831) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 17:10:55.562002 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.l3_dvrscheduler_db [req-72c7bb21-4cd8-4ceb-98e5-e36b88470b26 req-64445901-7b61-4573-bcbc-2193f4986162 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] No DVR routers for this DVR port 0b29d882-4e62-44e0-acc0-5deb97293c57 on host hv-cinder-79049 {{(pid=91829) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 25 17:10:55.564795 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [req-72c7bb21-4cd8-4ceb-98e5-e36b88470b26 req-64445901-7b61-4573-bcbc-2193f4986162 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-178712'] for port, before_response {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:10:55.567534 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '8af1dd48-45a0-4c07-9019-859effb1b06d', 'name': 'network-vif-deleted', 'tag': '0b29d882-4e62-44e0-acc0-5deb97293c57'}] {{(pid=91829) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 25 17:10:55.582872 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-72c7bb21-4cd8-4ceb-98e5-e36b88470b26 req-64445901-7b61-4573-bcbc-2193f4986162 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] 10.222.0.32 "DELETE /v2.0/ports/0b29d882-4e62-44e0-acc0-5deb97293c57 HTTP/1.1" status: 204 len: 173 time: 1.3991466 May 25 17:10:55.620701 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '8af1dd48-45a0-4c07-9019-859effb1b06d', 'name': 'network-vif-deleted', 'tag': '0b29d882-4e62-44e0-acc0-5deb97293c57', 'status': 'completed', 'code': 200} May 25 17:10:55.695238 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.l3_dvr_db [None req-65ae1941-a1c3-412d-9f4e-3d0d61b71036 None None] Set router 269c6b7b-91cc-4880-9e6d-b8889bac29f6 gateway port host: dv-cinder-790492-4-iscsi {{(pid=91831) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 17:10:56.024479 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.l3_hamode_db [None req-65ae1941-a1c3-412d-9f4e-3d0d61b71036 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '269c6b7b-91cc-4880-9e6d-b8889bac29f6', 'name': 'tempest-TestVolumeBootPattern-219116984-router', 'tenant_id': '5397bf60956945c3a2bf43c6b1aa614b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'external_fixed_ips': [{'subnet_id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'ip_address': '172.27.2.227'}], 'enable_snat': True}, 'gw_port_id': '2fef7852-acf7-462f-beee-5679d3df0ad2', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T17:07:09Z', 'updated_at': '2021-05-25T17:07:13Z', 'revision_number': 4, 'project_id': '5397bf60956945c3a2bf43c6b1aa614b', 'gw_port': {'id': '2fef7852-acf7-462f-beee-5679d3df0ad2', 'name': '', 'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'tenant_id': '', 'mac_address': 'fa:16:3e:35:b9:d0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '269c6b7b-91cc-4880-9e6d-b8889bac29f6', 'device_owner': 'network:router_gateway', 'standard_attr_id': 533, 'fixed_ips': [{'subnet_id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'ip_address': '172.27.2.227', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790492-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:07:09Z', 'updated_at': '2021-05-25T17:07:16Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-790492-4-iscsi', '_interfaces': [{'id': '4972e3a9-91eb-48ce-8b7b-b0906822cebf', 'name': '', 'network_id': '17a0e39e-1e1f-4550-b28b-d5ae3bdca362', 'tenant_id': '5397bf60956945c3a2bf43c6b1aa614b', 'mac_address': 'fa:16:3e:ce:fe:1a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '269c6b7b-91cc-4880-9e6d-b8889bac29f6', 'device_owner': 'network:router_interface', 'standard_attr_id': 534, 'fixed_ips': [{'subnet_id': 'f5599a2e-9942-4423-a1ac-67e9b2650770', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790492-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:07:12Z', 'updated_at': '2021-05-25T17:07:20Z', 'revision_number': 5, 'project_id': '5397bf60956945c3a2bf43c6b1aa614b', 'subnets': [{'id': 'f5599a2e-9942-4423-a1ac-67e9b2650770', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-790492-4-iscsi', False) {} {{(pid=91831) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 17:10:56.028820 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-65ae1941-a1c3-412d-9f4e-3d0d61b71036 None None] Checking router: 269c6b7b-91cc-4880-9e6d-b8889bac29f6 for host: dv-cinder-790492-4-iscsi {{(pid=91831) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 25 17:10:56.038934 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.l3_dvrscheduler_db [None req-65ae1941-a1c3-412d-9f4e-3d0d61b71036 None None] Routers {'269c6b7b-91cc-4880-9e6d-b8889bac29f6'} bound to L3 agent in host dv-cinder-790492-4-iscsi {{(pid=91831) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 17:10:56.039807 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.l3_hamode_db [None req-65ae1941-a1c3-412d-9f4e-3d0d61b71036 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-790492-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-05-25T16:50:28Z,description=,heartbeat_timestamp=2021-05-25T17:10:28Z,host='dv-cinder-790492-4-iscsi',id=a2d427c1-2d07-43e8-afbe-218c9f7d0445,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T16:50:28Z,topic='l3_agent')) {'router_ids': ['269c6b7b-91cc-4880-9e6d-b8889bac29f6'], 'active': True} {{(pid=91831) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 17:10:56.055327 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.quota.resource [req-edf82da2-251e-45fa-96a7-fcdd2c39d3bc req-7def9f84-a495-4b81-9a45-c872646450cb tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Synchronizing usage tracker for tenant:5397bf60956945c3a2bf43c6b1aa614b on resource:port {{(pid=91829) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 25 17:10:56.071815 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.quota.resource [req-edf82da2-251e-45fa-96a7-fcdd2c39d3bc req-7def9f84-a495-4b81-9a45-c872646450cb tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Unset dirty status for tenant:5397bf60956945c3a2bf43c6b1aa614b on resource:port {{(pid=91829) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 25 17:10:56.072968 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-edf82da2-251e-45fa-96a7-fcdd2c39d3bc req-7def9f84-a495-4b81-9a45-c872646450cb tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] 10.222.0.62 "GET /v2.0/ports?device_id=8af1dd48-45a0-4c07-9019-859effb1b06d HTTP/1.1" status: 200 len: 210 time: 0.0647600 May 25 17:10:56.223186 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.l3_dvr_db [None req-65ae1941-a1c3-412d-9f4e-3d0d61b71036 None None] Set router 269c6b7b-91cc-4880-9e6d-b8889bac29f6 gateway port host: dv-cinder-790492-4-iscsi {{(pid=91831) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 17:10:56.588538 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.l3_hamode_db [None req-65ae1941-a1c3-412d-9f4e-3d0d61b71036 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '269c6b7b-91cc-4880-9e6d-b8889bac29f6', 'name': 'tempest-TestVolumeBootPattern-219116984-router', 'tenant_id': '5397bf60956945c3a2bf43c6b1aa614b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'external_fixed_ips': [{'subnet_id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'ip_address': '172.27.2.227'}], 'enable_snat': True}, 'gw_port_id': '2fef7852-acf7-462f-beee-5679d3df0ad2', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T17:07:09Z', 'updated_at': '2021-05-25T17:07:13Z', 'revision_number': 4, 'project_id': '5397bf60956945c3a2bf43c6b1aa614b', 'gw_port': {'id': '2fef7852-acf7-462f-beee-5679d3df0ad2', 'name': '', 'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'tenant_id': '', 'mac_address': 'fa:16:3e:35:b9:d0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '269c6b7b-91cc-4880-9e6d-b8889bac29f6', 'device_owner': 'network:router_gateway', 'standard_attr_id': 533, 'fixed_ips': [{'subnet_id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'ip_address': '172.27.2.227', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790492-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:07:09Z', 'updated_at': '2021-05-25T17:07:16Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-790492-4-iscsi', '_interfaces': [{'id': '4972e3a9-91eb-48ce-8b7b-b0906822cebf', 'name': '', 'network_id': '17a0e39e-1e1f-4550-b28b-d5ae3bdca362', 'tenant_id': '5397bf60956945c3a2bf43c6b1aa614b', 'mac_address': 'fa:16:3e:ce:fe:1a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '269c6b7b-91cc-4880-9e6d-b8889bac29f6', 'device_owner': 'network:router_interface', 'standard_attr_id': 534, 'fixed_ips': [{'subnet_id': 'f5599a2e-9942-4423-a1ac-67e9b2650770', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790492-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:07:12Z', 'updated_at': '2021-05-25T17:07:20Z', 'revision_number': 5, 'project_id': '5397bf60956945c3a2bf43c6b1aa614b', 'subnets': [{'id': 'f5599a2e-9942-4423-a1ac-67e9b2650770', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-790492-4-iscsi', False) {} {{(pid=91831) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 17:10:56.592409 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-65ae1941-a1c3-412d-9f4e-3d0d61b71036 None None] The sync data for ids ['269c6b7b-91cc-4880-9e6d-b8889bac29f6'] in dv-cinder-790492-4-iscsi is: [{'id': '269c6b7b-91cc-4880-9e6d-b8889bac29f6', 'name': 'tempest-TestVolumeBootPattern-219116984-router', 'tenant_id': '5397bf60956945c3a2bf43c6b1aa614b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'external_fixed_ips': [{'subnet_id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'ip_address': '172.27.2.227'}], 'enable_snat': True}, 'gw_port_id': '2fef7852-acf7-462f-beee-5679d3df0ad2', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T17:07:09Z', 'updated_at': '2021-05-25T17:07:13Z', 'revision_number': 4, 'project_id': '5397bf60956945c3a2bf43c6b1aa614b', 'gw_port': {'id': '2fef7852-acf7-462f-beee-5679d3df0ad2', 'name': '', 'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'tenant_id': '', 'mac_address': 'fa:16:3e:35:b9:d0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '269c6b7b-91cc-4880-9e6d-b8889bac29f6', 'device_owner': 'network:router_gateway', 'standard_attr_id': 533, 'fixed_ips': [{'subnet_id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'ip_address': '172.27.2.227', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790492-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:07:09Z', 'updated_at': '2021-05-25T17:07:16Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-790492-4-iscsi', '_interfaces': [{'id': '4972e3a9-91eb-48ce-8b7b-b0906822cebf', 'name': '', 'network_id': '17a0e39e-1e1f-4550-b28b-d5ae3bdca362', 'tenant_id': '5397bf60956945c3a2bf43c6b1aa614b', 'mac_address': 'fa:16:3e:ce:fe:1a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '269c6b7b-91cc-4880-9e6d-b8889bac29f6', 'device_owner': 'network:router_interface', 'standard_attr_id': 534, 'fixed_ips': [{'subnet_id': 'f5599a2e-9942-4423-a1ac-67e9b2650770', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790492-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:07:12Z', 'updated_at': '2021-05-25T17:07:20Z', 'revision_number': 5, 'project_id': '5397bf60956945c3a2bf43c6b1aa614b', 'subnets': [{'id': 'f5599a2e-9942-4423-a1ac-67e9b2650770', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=91831) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 25 17:10:56.893793 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f7bcce05-8905-401c-b96a-f3f992d36d09 None None] New status for floating IP c1e3ebd3-1b86-4539-8592-0028e75cf6d4: DOWN {{(pid=91832) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} May 25 17:10:57.569117 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-85044509-cc55-489a-8e61-37042fb035ec req-84e93e11-d8ab-433f-8093-afffc6515b34 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] 10.222.0.62 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-1745610358&fields=id&tenant_id=5397bf60956945c3a2bf43c6b1aa614b HTTP/1.1" status: 200 len: 267 time: 0.0396960 May 25 17:10:57.714822 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-f7bbd178-72c8-40ce-91cb-2fd8bca7b8ae None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:10:57.718086 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-85044509-cc55-489a-8e61-37042fb035ec req-c15ffb50-8568-439e-8a4f-e7c35839e188 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:10:57.719529 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-85044509-cc55-489a-8e61-37042fb035ec req-c15ffb50-8568-439e-8a4f-e7c35839e188 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] 10.222.0.62 "GET /v2.0/networks?id=17a0e39e-1e1f-4550-b28b-d5ae3bdca362 HTTP/1.1" status: 200 len: 811 time: 0.1443238 May 25 17:10:57.733794 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-85044509-cc55-489a-8e61-37042fb035ec req-e8d1fa6c-87f4-4e35-97a8-cf278b60d6e7 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] 10.222.0.62 "GET /v2.0/quotas/5397bf60956945c3a2bf43c6b1aa614b HTTP/1.1" status: 200 len: 375 time: 0.0088112 May 25 17:10:57.816977 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-85044509-cc55-489a-8e61-37042fb035ec req-3dca9b4b-3819-4a29-a301-9d7171e89a21 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] 10.222.0.62 "GET /v2.0/ports?tenant_id=5397bf60956945c3a2bf43c6b1aa614b&fields=id HTTP/1.1" status: 200 len: 348 time: 0.0783927 May 25 17:10:57.874297 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.wsgi [req-85044509-cc55-489a-8e61-37042fb035ec req-7071d7bb-a7f0-4ac7-b7d8-6024522c04ba service neutron] http://10.222.0.62:9696/v2.0/extensions returned with HTTP 200 {{(pid=91829) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} May 25 17:10:57.875294 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-85044509-cc55-489a-8e61-37042fb035ec req-7071d7bb-a7f0-4ac7-b7d8-6024522c04ba service neutron] 10.222.0.62 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 13640 time: 0.0472593 May 25 17:10:57.900850 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:10:58.009309 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-85044509-cc55-489a-8e61-37042fb035ec req-26ac3d72-39e3-4c05-9b80-04abc3f8bbd2 service neutron] 10.222.0.62 "GET /v2.0/networks/17a0e39e-1e1f-4550-b28b-d5ae3bdca362?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1275809 May 25 17:10:58.141330 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-85044509-cc55-489a-8e61-37042fb035ec req-5c59d236-fb00-411a-b3b9-9778e9063bb2 service neutron] 10.222.0.62 "GET /v2.0/networks/17a0e39e-1e1f-4550-b28b-d5ae3bdca362?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1262059 May 25 17:10:58.521399 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-8a948d4d-df7f-4d5c-835b-f80a84a3f1ff req-8e8e1d4d-39ec-459d-8ca9-e439495600ad tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] 10.222.0.62 "GET /v2.0/ports?device_id=6e10cbf6-87b6-452f-80e6-c8bd2ce073db HTTP/1.1" status: 200 len: 210 time: 0.0466297 May 25 17:10:58.647627 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-0a55eb4a-8b57-4233-84d6-6b423b4ed6db None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:10:58.918144 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.rpc [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Device 0b29d882-4e62-44e0-acc0-5deb97293c57 no longer exists at agent hyperv_hv-cinder-79049 {{(pid=91831) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 25 17:10:58.952092 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.plugin [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] No Port match for: 0b29d882-4e62-44e0-acc0-5deb97293c57 {{(pid=91831) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}} May 25 17:10:58.952443 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.rpc [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Device 0b29d882-4e62-44e0-acc0-5deb97293c57 not bound to the agent host hv-cinder-79049 {{(pid=91831) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 25 17:10:59.572499 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-85044509-cc55-489a-8e61-37042fb035ec req-c63b0eb8-22d0-4e7b-8554-3b76daf078f5 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:10:59.574208 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-85044509-cc55-489a-8e61-37042fb035ec req-c63b0eb8-22d0-4e7b-8554-3b76daf078f5 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] 10.222.0.32 "GET /v2.0/networks?id=17a0e39e-1e1f-4550-b28b-d5ae3bdca362 HTTP/1.1" status: 200 len: 811 time: 0.1560230 May 25 17:10:59.624408 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-85044509-cc55-489a-8e61-37042fb035ec req-3bf7d31f-c190-4e55-81e2-56e4c23b0edf tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] 10.222.0.32 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=5397bf60956945c3a2bf43c6b1aa614b HTTP/1.1" status: 200 len: 380 time: 0.0417545 May 25 17:10:59.633559 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.v2.base [req-85044509-cc55-489a-8e61-37042fb035ec req-dad9dda5-54bc-4038-873b-ba15e3db61d2 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Request body: {'port': {'device_id': '6e10cbf6-87b6-452f-80e6-c8bd2ce073db', 'network_id': '17a0e39e-1e1f-4550-b28b-d5ae3bdca362', 'admin_state_up': True, 'tenant_id': '5397bf60956945c3a2bf43c6b1aa614b', 'security_groups': ['58fab80b-49b2-4bca-89e6-fef7473221ef']}} {{(pid=91829) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 17:10:59.745865 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-33b2a78d-efd8-4b49-ae66-9d4e951419ea req-407e09b9-95bc-41c5-a56c-3a25653dd163 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] 10.222.0.62 "GET /v2.0/ports?device_id=6e10cbf6-87b6-452f-80e6-c8bd2ce073db HTTP/1.1" status: 200 len: 210 time: 0.0977361 May 25 17:10:59.816529 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.quota.driver [req-85044509-cc55-489a-8e61-37042fb035ec req-dad9dda5-54bc-4038-873b-ba15e3db61d2 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91829) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 17:10:59.825871 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.quota.driver [req-85044509-cc55-489a-8e61-37042fb035ec req-dad9dda5-54bc-4038-873b-ba15e3db61d2 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Attempting to reserve 1 items for resource port. Total usage: 3; quota limit: 500; headroom:497 {{(pid=91829) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 17:10:59.835004 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-85044509-cc55-489a-8e61-37042fb035ec req-dad9dda5-54bc-4038-873b-ba15e3db61d2 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Made reservation on behalf of 5397bf60956945c3a2bf43c6b1aa614b for: {'port': 1} {{(pid=91829) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 25 17:10:59.838598 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [req-85044509-cc55-489a-8e61-37042fb035ec req-dad9dda5-54bc-4038-873b-ba15e3db61d2 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3832070'] for port, before_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:11:00.001938 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.db_base_plugin_common [req-85044509-cc55-489a-8e61-37042fb035ec req-dad9dda5-54bc-4038-873b-ba15e3db61d2 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Allocated IP 172.20.0.10 (17a0e39e-1e1f-4550-b28b-d5ae3bdca362/f5599a2e-9942-4423-a1ac-67e9b2650770/c68cea2d-169c-4346-87ef-27549285cb6b) {{(pid=91829) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 25 17:11:00.276329 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-57f11b47-1f51-4191-b7c9-af248a48372c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:11:00.322660 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [req-85044509-cc55-489a-8e61-37042fb035ec req-dad9dda5-54bc-4038-873b-ba15e3db61d2 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Notify callbacks [] for port, precommit_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:11:00.338137 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.provisioning_blocks [req-85044509-cc55-489a-8e61-37042fb035ec req-dad9dda5-54bc-4038-873b-ba15e3db61d2 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Transition to ACTIVE for port object c68cea2d-169c-4346-87ef-27549285cb6b will not be triggered until provisioned by entity DHCP. {{(pid=91829) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 25 17:11:00.361493 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [req-85044509-cc55-489a-8e61-37042fb035ec req-dad9dda5-54bc-4038-873b-ba15e3db61d2 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8757892520915', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28230808'] for port, after_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:11:00.368699 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-7db128ba-013f-4cc8-ab63-b5137447fa37 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:11:00.431353 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-85044509-cc55-489a-8e61-37042fb035ec req-dad9dda5-54bc-4038-873b-ba15e3db61d2 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Network 17a0e39e-1e1f-4550-b28b-d5ae3bdca362 is already hosted by enough agents. {{(pid=91829) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 25 17:11:00.434413 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.scheduler.base_scheduler [req-85044509-cc55-489a-8e61-37042fb035ec req-dad9dda5-54bc-4038-873b-ba15e3db61d2 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Resources bound (agent type, host, resource id): {{(pid=91829) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 17:11:00.437392 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.l3_dvrscheduler_db [req-85044509-cc55-489a-8e61-37042fb035ec req-dad9dda5-54bc-4038-873b-ba15e3db61d2 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Received port after_create {{(pid=91829) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 25 17:11:00.486781 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dad9dda5-54bc-4038-873b-ba15e3db61d2 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Pushing event updated for resources: {'Port': ['ID=c68cea2d-169c-4346-87ef-27549285cb6b,revision_number=1']} {{(pid=91829) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:11:00.490560 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-dad9dda5-54bc-4038-873b-ba15e3db61d2 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.122s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:11:00.512471 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-85044509-cc55-489a-8e61-37042fb035ec req-dad9dda5-54bc-4038-873b-ba15e3db61d2 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:11:00.513099 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [req-85044509-cc55-489a-8e61-37042fb035ec req-dad9dda5-54bc-4038-873b-ba15e3db61d2 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-178712'] for port, before_response {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:11:00.538417 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-85044509-cc55-489a-8e61-37042fb035ec req-dad9dda5-54bc-4038-873b-ba15e3db61d2 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] 10.222.0.32 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 0.9085088 May 25 17:11:00.551304 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.v2.base [req-85044509-cc55-489a-8e61-37042fb035ec req-3cedcec2-0b97-4b7a-9f74-a5043d4d0807 service neutron] Request body: {'port': {'device_id': '6e10cbf6-87b6-452f-80e6-c8bd2ce073db', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-79049'}} {{(pid=91829) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 17:11:00.644889 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.provisioning_blocks [None req-36591e12-e5e7-4e71-a041-6715ecd6daa7 None None] Provisioning for port c68cea2d-169c-4346-87ef-27549285cb6b completed by entity DHCP. {{(pid=91831) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 25 17:11:00.649625 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.provisioning_blocks [None req-36591e12-e5e7-4e71-a041-6715ecd6daa7 None None] Provisioning complete for port c68cea2d-169c-4346-87ef-27549285cb6b triggered by entity DHCP. {{(pid=91831) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 17:11:00.650027 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-36591e12-e5e7-4e71-a041-6715ecd6daa7 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3854128'] for port, provisioning_complete {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:11:00.666270 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [req-85044509-cc55-489a-8e61-37042fb035ec req-3cedcec2-0b97-4b7a-9f74-a5043d4d0807 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3832070'] for port, before_update {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:11:00.703840 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.plugin [None req-36591e12-e5e7-4e71-a041-6715ecd6daa7 None None] Port c68cea2d-169c-4346-87ef-27549285cb6b cannot update to ACTIVE because it is not bound. {{(pid=91831) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 25 17:11:00.999126 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e2c1f30a-44f2-44c6-ad6d-f17da9ebd3ab req-b3587ce6-ee51-4657-8c56-d7f0b9c94a24 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:11:00.999718 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.quota.resource [req-e2c1f30a-44f2-44c6-ad6d-f17da9ebd3ab req-b3587ce6-ee51-4657-8c56-d7f0b9c94a24 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Synchronizing usage tracker for tenant:5397bf60956945c3a2bf43c6b1aa614b on resource:port {{(pid=91829) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 25 17:11:01.055747 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.quota.resource [req-e2c1f30a-44f2-44c6-ad6d-f17da9ebd3ab req-b3587ce6-ee51-4657-8c56-d7f0b9c94a24 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Unset dirty status for tenant:5397bf60956945c3a2bf43c6b1aa614b on resource:port {{(pid=91829) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 25 17:11:01.056874 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-e2c1f30a-44f2-44c6-ad6d-f17da9ebd3ab req-b3587ce6-ee51-4657-8c56-d7f0b9c94a24 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] 10.222.0.62 "GET /v2.0/ports?device_id=6e10cbf6-87b6-452f-80e6-c8bd2ce073db HTTP/1.1" status: 200 len: 932 time: 0.1869993 May 25 17:11:01.104562 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.notifiers.nova [req-85044509-cc55-489a-8e61-37042fb035ec req-3cedcec2-0b97-4b7a-9f74-a5043d4d0807 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id c68cea2d-169c-4346-87ef-27549285cb6b {{(pid=91829) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} May 25 17:11:01.115547 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [req-85044509-cc55-489a-8e61-37042fb035ec req-3cedcec2-0b97-4b7a-9f74-a5043d4d0807 service neutron] Notify callbacks [] for port, precommit_update {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:11:01.127169 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-e2c1f30a-44f2-44c6-ad6d-f17da9ebd3ab req-d1f7bdf0-3ab7-4b49-bf99-3f213c841fd4 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] 10.222.0.62 "GET /v2.0/security-groups?id=58fab80b-49b2-4bca-89e6-fef7473221ef&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0594981 May 25 17:11:01.134967 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.provisioning_blocks [req-85044509-cc55-489a-8e61-37042fb035ec req-3cedcec2-0b97-4b7a-9f74-a5043d4d0807 service neutron] Transition to ACTIVE for port object c68cea2d-169c-4346-87ef-27549285cb6b will not be triggered until provisioned by entity L2. {{(pid=91829) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 25 17:11:01.138462 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [req-85044509-cc55-489a-8e61-37042fb035ec req-3cedcec2-0b97-4b7a-9f74-a5043d4d0807 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8757892955028', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8757892520933', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8757892521750', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28230801'] for port, after_update {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:11:01.143106 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-92f34ba3-c69d-41db-b55f-403b855654ab admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:11:01.290102 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3cedcec2-0b97-4b7a-9f74-a5043d4d0807 service neutron] Pushing event updated for resources: {'Port': ['ID=c68cea2d-169c-4346-87ef-27549285cb6b,revision_number=2']} {{(pid=91829) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:11:01.297611 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-3cedcec2-0b97-4b7a-9f74-a5043d4d0807 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.154s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:11:01.375592 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.plugins.ml2.managers [req-85044509-cc55-489a-8e61-37042fb035ec req-3cedcec2-0b97-4b7a-9f74-a5043d4d0807 service neutron] Attempting to bind port c68cea2d-169c-4346-87ef-27549285cb6b on host hv-cinder-79049 for vnic_type normal with profile {{(pid=91829) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 25 17:11:01.375922 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.plugins.ml2.managers [req-85044509-cc55-489a-8e61-37042fb035ec req-3cedcec2-0b97-4b7a-9f74-a5043d4d0807 service neutron] Attempting to bind port c68cea2d-169c-4346-87ef-27549285cb6b by drivers openvswitch,hyperv on host hv-cinder-79049 at level 0 using segments [{'id': '50ed67e9-f8d3-4927-b257-bd17654cce34', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 657, 'network_id': '17a0e39e-1e1f-4550-b28b-d5ae3bdca362'}] {{(pid=91829) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 25 17:11:01.376247 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-85044509-cc55-489a-8e61-37042fb035ec req-3cedcec2-0b97-4b7a-9f74-a5043d4d0807 service neutron] Attempting to bind port c68cea2d-169c-4346-87ef-27549285cb6b on network 17a0e39e-1e1f-4550-b28b-d5ae3bdca362 {{(pid=91829) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 25 17:11:01.380858 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-85044509-cc55-489a-8e61-37042fb035ec req-3cedcec2-0b97-4b7a-9f74-a5043d4d0807 service neutron] Port c68cea2d-169c-4346-87ef-27549285cb6b on network 17a0e39e-1e1f-4550-b28b-d5ae3bdca362 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-79049 {{(pid=91829) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 25 17:11:01.381175 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-85044509-cc55-489a-8e61-37042fb035ec req-3cedcec2-0b97-4b7a-9f74-a5043d4d0807 service neutron] Attempting to bind port c68cea2d-169c-4346-87ef-27549285cb6b on network 17a0e39e-1e1f-4550-b28b-d5ae3bdca362 {{(pid=91829) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 25 17:11:01.386110 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-85044509-cc55-489a-8e61-37042fb035ec req-3cedcec2-0b97-4b7a-9f74-a5043d4d0807 service neutron] Checking agent: {'id': '3a1fdee1-bff0-49fb-b470-e13b95ee1b4d', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-79049', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 25, 16, 56, 32), 'started_at': datetime.datetime(2021, 5, 25, 16, 56, 32), 'heartbeat_timestamp': datetime.datetime(2021, 5, 25, 17, 10, 37), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=91829) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 25 17:11:01.386447 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-85044509-cc55-489a-8e61-37042fb035ec req-3cedcec2-0b97-4b7a-9f74-a5043d4d0807 service neutron] Checking segment: {'id': '50ed67e9-f8d3-4927-b257-bd17654cce34', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 657, 'network_id': '17a0e39e-1e1f-4550-b28b-d5ae3bdca362'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91829) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 25 17:11:01.386832 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-85044509-cc55-489a-8e61-37042fb035ec req-3cedcec2-0b97-4b7a-9f74-a5043d4d0807 service neutron] Bound using segment: {'id': '50ed67e9-f8d3-4927-b257-bd17654cce34', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 657, 'network_id': '17a0e39e-1e1f-4550-b28b-d5ae3bdca362'} {{(pid=91829) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 25 17:11:01.387250 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.plugins.ml2.managers [req-85044509-cc55-489a-8e61-37042fb035ec req-3cedcec2-0b97-4b7a-9f74-a5043d4d0807 service neutron] Bound port: c68cea2d-169c-4346-87ef-27549285cb6b, host: hv-cinder-79049, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '50ed67e9-f8d3-4927-b257-bd17654cce34', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 657, 'network_id': '17a0e39e-1e1f-4550-b28b-d5ae3bdca362'}}] {{(pid=91829) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 25 17:11:01.387594 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [req-85044509-cc55-489a-8e61-37042fb035ec req-3cedcec2-0b97-4b7a-9f74-a5043d4d0807 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3832070'] for port, before_update {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:11:01.478476 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.plugins.ml2.db [req-85044509-cc55-489a-8e61-37042fb035ec req-3cedcec2-0b97-4b7a-9f74-a5043d4d0807 service neutron] For port c68cea2d-169c-4346-87ef-27549285cb6b, host hv-cinder-79049, cleared binding levels {{(pid=91829) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 25 17:11:01.481642 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.plugins.ml2.db [req-85044509-cc55-489a-8e61-37042fb035ec req-3cedcec2-0b97-4b7a-9f74-a5043d4d0807 service neutron] For port c68cea2d-169c-4346-87ef-27549285cb6b, host hv-cinder-79049, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79049',level=0,port_id=c68cea2d-169c-4346-87ef-27549285cb6b,segment=NetworkSegment(50ed67e9-f8d3-4927-b257-bd17654cce34),segment_id=50ed67e9-f8d3-4927-b257-bd17654cce34)] {{(pid=91829) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 25 17:11:01.486683 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [req-85044509-cc55-489a-8e61-37042fb035ec req-3cedcec2-0b97-4b7a-9f74-a5043d4d0807 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8757892955028', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8757892520933', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8757892521750', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28230801'] for port, after_update {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:11:01.491183 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-e87ae4ba-03db-42f4-bb42-f780ea40e6bf tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:11:01.551493 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-85044509-cc55-489a-8e61-37042fb035ec req-3cedcec2-0b97-4b7a-9f74-a5043d4d0807 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:11:01.552121 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [req-85044509-cc55-489a-8e61-37042fb035ec req-3cedcec2-0b97-4b7a-9f74-a5043d4d0807 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-178712'] for port, before_response {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:11:01.553489 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-85044509-cc55-489a-8e61-37042fb035ec req-3cedcec2-0b97-4b7a-9f74-a5043d4d0807 service neutron] 10.222.0.32 "PUT /v2.0/ports/c68cea2d-169c-4346-87ef-27549285cb6b HTTP/1.1" status: 200 len: 1094 time: 1.0070984 May 25 17:11:01.554002 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '6e10cbf6-87b6-452f-80e6-c8bd2ce073db', 'tag': 'c68cea2d-169c-4346-87ef-27549285cb6b'}] {{(pid=91829) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 25 17:11:01.578259 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3cedcec2-0b97-4b7a-9f74-a5043d4d0807 service neutron] Pushing event updated for resources: {'Port': ['ID=c68cea2d-169c-4346-87ef-27549285cb6b,revision_number=3']} {{(pid=91829) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:11:01.583896 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-3cedcec2-0b97-4b7a-9f74-a5043d4d0807 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.093s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:11:01.637412 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '6e10cbf6-87b6-452f-80e6-c8bd2ce073db', 'tag': 'c68cea2d-169c-4346-87ef-27549285cb6b', 'status': 'completed', 'code': 200} May 25 17:11:01.678316 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-85044509-cc55-489a-8e61-37042fb035ec req-e85a9337-d89c-4842-8759-edd04e96da30 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:11:01.679773 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-85044509-cc55-489a-8e61-37042fb035ec req-e85a9337-d89c-4842-8759-edd04e96da30 service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=5397bf60956945c3a2bf43c6b1aa614b&device_id=6e10cbf6-87b6-452f-80e6-c8bd2ce073db HTTP/1.1" status: 200 len: 1097 time: 0.0749185 May 25 17:11:01.751175 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-85044509-cc55-489a-8e61-37042fb035ec req-c083b138-3ff4-4073-ae0e-28938eba19ae service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=c68cea2d-169c-4346-87ef-27549285cb6b HTTP/1.1" status: 200 len: 217 time: 0.0636904 May 25 17:11:01.814531 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-85044509-cc55-489a-8e61-37042fb035ec req-bbb2e8cc-e01e-481c-980c-d8f2dc7c8f57 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:11:01.816552 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-85044509-cc55-489a-8e61-37042fb035ec req-bbb2e8cc-e01e-481c-980c-d8f2dc7c8f57 service neutron] 10.222.0.32 "GET /v2.0/subnets?id=f5599a2e-9942-4423-a1ac-67e9b2650770 HTTP/1.1" status: 200 len: 850 time: 0.0578496 May 25 17:11:01.897587 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-85044509-cc55-489a-8e61-37042fb035ec req-991f695a-b415-49c9-a893-a3cb7aabe9cb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:11:01.899058 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-85044509-cc55-489a-8e61-37042fb035ec req-991f695a-b415-49c9-a893-a3cb7aabe9cb service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=17a0e39e-1e1f-4550-b28b-d5ae3bdca362&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0746307 May 25 17:11:02.121397 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-85044509-cc55-489a-8e61-37042fb035ec req-85e8f344-8ae8-460f-b0ec-3831a20a3fe4 service neutron] 10.222.0.32 "GET /v2.0/networks/17a0e39e-1e1f-4550-b28b-d5ae3bdca362?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2152786 May 25 17:11:02.299366 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-85044509-cc55-489a-8e61-37042fb035ec req-73451f50-f50e-41a7-ac3d-2516504e180f service neutron] 10.222.0.32 "GET /v2.0/networks/17a0e39e-1e1f-4550-b28b-d5ae3bdca362?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1710527 May 25 17:11:02.329931 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4e8efa75-88d8-49fd-86d3-5859ea084493 req-785a5452-18ef-40dd-b74e-21ecfbf85a34 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:11:02.332000 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-4e8efa75-88d8-49fd-86d3-5859ea084493 req-785a5452-18ef-40dd-b74e-21ecfbf85a34 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] 10.222.0.62 "GET /v2.0/ports?device_id=6e10cbf6-87b6-452f-80e6-c8bd2ce073db HTTP/1.1" status: 200 len: 944 time: 0.0966978 May 25 17:11:02.422625 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-4e8efa75-88d8-49fd-86d3-5859ea084493 req-25a53625-d574-4df8-ab0c-f1e06eb8420c tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] 10.222.0.62 "GET /v2.0/security-groups?id=58fab80b-49b2-4bca-89e6-fef7473221ef&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0849490 May 25 17:11:02.446712 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1cf526bb-41cf-4b11-9ed0-ca486a4f70ff req-f04d8a83-939a-4630-af99-30d358c5ebec service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:11:02.448160 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-1cf526bb-41cf-4b11-9ed0-ca486a4f70ff req-f04d8a83-939a-4630-af99-30d358c5ebec service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=5397bf60956945c3a2bf43c6b1aa614b&device_id=6e10cbf6-87b6-452f-80e6-c8bd2ce073db HTTP/1.1" status: 200 len: 1097 time: 0.0822814 May 25 17:11:02.584999 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1cf526bb-41cf-4b11-9ed0-ca486a4f70ff req-06783853-4873-424b-9f51-853eb0cbc042 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:11:02.586456 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-1cf526bb-41cf-4b11-9ed0-ca486a4f70ff req-06783853-4873-424b-9f51-853eb0cbc042 service neutron] 10.222.0.32 "GET /v2.0/networks?id=17a0e39e-1e1f-4550-b28b-d5ae3bdca362 HTTP/1.1" status: 200 len: 912 time: 0.1290309 May 25 17:11:02.657967 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-1cf526bb-41cf-4b11-9ed0-ca486a4f70ff req-adbf4638-ebdd-4cf6-a583-03cd9520a964 service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=c68cea2d-169c-4346-87ef-27549285cb6b HTTP/1.1" status: 200 len: 217 time: 0.0650494 May 25 17:11:02.721413 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1cf526bb-41cf-4b11-9ed0-ca486a4f70ff req-26fb6a9c-4f99-42d9-8407-28f3316650e0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:11:02.722772 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-1cf526bb-41cf-4b11-9ed0-ca486a4f70ff req-26fb6a9c-4f99-42d9-8407-28f3316650e0 service neutron] 10.222.0.32 "GET /v2.0/subnets?id=f5599a2e-9942-4423-a1ac-67e9b2650770 HTTP/1.1" status: 200 len: 850 time: 0.0580418 May 25 17:11:02.798602 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1cf526bb-41cf-4b11-9ed0-ca486a4f70ff req-6f98ef7b-be6f-4938-b324-ca8b59f897ab service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:11:02.800598 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-1cf526bb-41cf-4b11-9ed0-ca486a4f70ff req-6f98ef7b-be6f-4938-b324-ca8b59f897ab service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=17a0e39e-1e1f-4550-b28b-d5ae3bdca362&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0695531 May 25 17:11:02.936365 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-1cf526bb-41cf-4b11-9ed0-ca486a4f70ff req-19e4dea0-3394-41d7-9f34-ee28a449b608 service neutron] 10.222.0.32 "GET /v2.0/networks/17a0e39e-1e1f-4550-b28b-d5ae3bdca362?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1237071 May 25 17:11:03.069815 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-1cf526bb-41cf-4b11-9ed0-ca486a4f70ff req-b73aeb5b-6c4c-409b-b241-1ee741c0263b service neutron] 10.222.0.32 "GET /v2.0/networks/17a0e39e-1e1f-4550-b28b-d5ae3bdca362?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1247211 May 25 17:11:03.610714 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-28a5de6a-76e5-4c75-8594-8c0a09043c6c req-78a26b64-ff8f-4312-9c59-0a87bbcc5eb6 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:11:03.612169 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-28a5de6a-76e5-4c75-8594-8c0a09043c6c req-78a26b64-ff8f-4312-9c59-0a87bbcc5eb6 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] 10.222.0.62 "GET /v2.0/ports?device_id=6e10cbf6-87b6-452f-80e6-c8bd2ce073db HTTP/1.1" status: 200 len: 944 time: 0.0826757 May 25 17:11:03.655629 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-28a5de6a-76e5-4c75-8594-8c0a09043c6c req-77fd31ef-b92e-468b-aa2d-60c63bf81488 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] 10.222.0.62 "GET /v2.0/security-groups?id=58fab80b-49b2-4bca-89e6-fef7473221ef&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0378475 May 25 17:11:04.147109 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.db.agents_db [None req-504cb04f-4543-46c1-8db7-349e21db7634 None None] Agent healthcheck: found 6 active agents {{(pid=91832) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} May 25 17:11:04.837548 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e9e6897f-c9eb-4086-baf7-0e23fd2dd684 req-479ab72c-179f-4586-9da7-6c7b02ca62f0 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:11:04.839023 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-e9e6897f-c9eb-4086-baf7-0e23fd2dd684 req-479ab72c-179f-4586-9da7-6c7b02ca62f0 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] 10.222.0.62 "GET /v2.0/ports?device_id=6e10cbf6-87b6-452f-80e6-c8bd2ce073db HTTP/1.1" status: 200 len: 944 time: 0.0801375 May 25 17:11:04.887064 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-e9e6897f-c9eb-4086-baf7-0e23fd2dd684 req-273af0c2-c237-413e-a7b4-ce42d47e9beb tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] 10.222.0.62 "GET /v2.0/security-groups?id=58fab80b-49b2-4bca-89e6-fef7473221ef&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0423143 May 25 17:11:06.069645 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fd97a0f2-9f71-4178-bc47-efe6fe108111 req-fdb36f8a-f737-4da6-93b0-ce5ff7864428 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:11:06.071115 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-fd97a0f2-9f71-4178-bc47-efe6fe108111 req-fdb36f8a-f737-4da6-93b0-ce5ff7864428 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] 10.222.0.62 "GET /v2.0/ports?device_id=6e10cbf6-87b6-452f-80e6-c8bd2ce073db HTTP/1.1" status: 200 len: 944 time: 0.0801401 May 25 17:11:06.114299 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-fd97a0f2-9f71-4178-bc47-efe6fe108111 req-a42b6247-fa0e-400a-b54b-d6f4e09bdc40 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] 10.222.0.62 "GET /v2.0/security-groups?id=58fab80b-49b2-4bca-89e6-fef7473221ef&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0376017 May 25 17:11:06.581957 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:11:07.301536 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1a08b6d5-c044-4fc6-85cd-53c8e4d4e784 req-f90f1865-ce20-4865-9fa2-838735c342a4 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:11:07.303026 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-1a08b6d5-c044-4fc6-85cd-53c8e4d4e784 req-f90f1865-ce20-4865-9fa2-838735c342a4 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] 10.222.0.62 "GET /v2.0/ports?device_id=6e10cbf6-87b6-452f-80e6-c8bd2ce073db HTTP/1.1" status: 200 len: 944 time: 0.0831444 May 25 17:11:07.347159 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-1a08b6d5-c044-4fc6-85cd-53c8e4d4e784 req-6ab5d9b7-924a-4353-b069-23b99b32182c tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] 10.222.0.62 "GET /v2.0/security-groups?id=58fab80b-49b2-4bca-89e6-fef7473221ef&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0380361 May 25 17:11:08.525058 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a59cbfe7-3b83-4ece-8522-f30c6fdd2fcd req-0cf6f183-ce08-42c5-a6ab-f92fc4eb563e tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:11:08.526510 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-a59cbfe7-3b83-4ece-8522-f30c6fdd2fcd req-0cf6f183-ce08-42c5-a6ab-f92fc4eb563e tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] 10.222.0.62 "GET /v2.0/ports?device_id=6e10cbf6-87b6-452f-80e6-c8bd2ce073db HTTP/1.1" status: 200 len: 944 time: 0.0774584 May 25 17:11:08.570452 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-a59cbfe7-3b83-4ece-8522-f30c6fdd2fcd req-927efd4b-55d2-4256-b5c1-8f5e2a14b11b tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] 10.222.0.62 "GET /v2.0/security-groups?id=58fab80b-49b2-4bca-89e6-fef7473221ef&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0381255 May 25 17:11:09.753577 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e7d1eddc-6636-4e45-9d85-b5ed6966a3f4 req-069bc8d0-ee68-4b56-96df-b95fc513b4bb tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:11:09.755163 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-e7d1eddc-6636-4e45-9d85-b5ed6966a3f4 req-069bc8d0-ee68-4b56-96df-b95fc513b4bb tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] 10.222.0.62 "GET /v2.0/ports?device_id=6e10cbf6-87b6-452f-80e6-c8bd2ce073db HTTP/1.1" status: 200 len: 944 time: 0.0824437 May 25 17:11:09.798285 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-e7d1eddc-6636-4e45-9d85-b5ed6966a3f4 req-be17fd66-bfaf-4d84-a2e6-d2d3afe004ad tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] 10.222.0.62 "GET /v2.0/security-groups?id=58fab80b-49b2-4bca-89e6-fef7473221ef&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0375416 May 25 17:11:10.982446 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6b6024c5-a50f-436b-936f-961086af729c req-fc7b87da-d3e3-45bf-a013-b646795fef5b tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:11:10.983906 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-6b6024c5-a50f-436b-936f-961086af729c req-fc7b87da-d3e3-45bf-a013-b646795fef5b tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] 10.222.0.62 "GET /v2.0/ports?device_id=6e10cbf6-87b6-452f-80e6-c8bd2ce073db HTTP/1.1" status: 200 len: 944 time: 0.0791786 May 25 17:11:10.994128 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.rpc [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Device c68cea2d-169c-4346-87ef-27549285cb6b details requested by agent hyperv_hv-cinder-79049 with host hv-cinder-79049 {{(pid=91831) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 25 17:11:11.028398 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-6b6024c5-a50f-436b-936f-961086af729c req-216f2f77-fa4c-4b92-8a0c-9583848d123b tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] 10.222.0.62 "GET /v2.0/security-groups?id=58fab80b-49b2-4bca-89e6-fef7473221ef&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0388892 May 25 17:11:11.125836 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.db [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] For port c68cea2d-169c-4346-87ef-27549285cb6b, host hv-cinder-79049, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79049',level=0,port_id=c68cea2d-169c-4346-87ef-27549285cb6b,segment=NetworkSegment(50ed67e9-f8d3-4927-b257-bd17654cce34),segment_id=50ed67e9-f8d3-4927-b257-bd17654cce34)] {{(pid=91831) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 17:11:11.139018 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.rpc [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Returning: {'device': 'c68cea2d-169c-4346-87ef-27549285cb6b', 'network_id': '17a0e39e-1e1f-4550-b28b-d5ae3bdca362', 'port_id': 'c68cea2d-169c-4346-87ef-27549285cb6b', 'mac_address': 'fa:16:3e:7a:1d:60', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 657, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'f5599a2e-9942-4423-a1ac-67e9b2650770', 'ip_address': '172.20.0.10'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=91831) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 25 17:11:11.194274 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3832070'] for port, before_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:11:11.210386 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.notifiers.nova [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id c68cea2d-169c-4346-87ef-27549285cb6b {{(pid=91831) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} May 25 17:11:11.225461 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.db [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] For port c68cea2d-169c-4346-87ef-27549285cb6b, host hv-cinder-79049, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79049',level=0,port_id=c68cea2d-169c-4346-87ef-27549285cb6b,segment=NetworkSegment(50ed67e9-f8d3-4927-b257-bd17654cce34),segment_id=50ed67e9-f8d3-4927-b257-bd17654cce34)] {{(pid=91831) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 17:11:11.229237 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8757892955028', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8757892520933', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8757892521750'] for port, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:11:11.231058 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:11:11.297952 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Pushing event updated for resources: {'Port': ['ID=c68cea2d-169c-4346-87ef-27549285cb6b,revision_number=4']} {{(pid=91831) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:11:11.305558 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91831) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:11:11.305900 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91831) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:11:11.306259 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91831) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:11:11.306589 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91831) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:11:11.306913 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91831) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:11:11.307238 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91831) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:11:11.307558 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91831) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:11:11.307878 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91831) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:11:11.308195 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91831) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:11:11.308510 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91831) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:11:11.308823 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91831) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:11:11.309136 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91831) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:11:11.312825 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.082s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:11:11.601629 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.db [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] get_ports_and_sgs() called for port_ids ['c68cea2d-169c-4346-87ef-27549285cb6b'] {{(pid=91831) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 25 17:11:12.338765 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-727aee73-addd-42dc-9444-e83bdf514b25 req-bf6d3b0b-06af-4ab2-a0df-7170da853021 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:11:12.340307 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-727aee73-addd-42dc-9444-e83bdf514b25 req-bf6d3b0b-06af-4ab2-a0df-7170da853021 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] 10.222.0.62 "GET /v2.0/ports?device_id=6e10cbf6-87b6-452f-80e6-c8bd2ce073db HTTP/1.1" status: 200 len: 945 time: 0.2100327 May 25 17:11:12.385136 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-727aee73-addd-42dc-9444-e83bdf514b25 req-4d5afcbe-77e4-4e70-bc8e-e0369fefa997 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] 10.222.0.62 "GET /v2.0/security-groups?id=58fab80b-49b2-4bca-89e6-fef7473221ef&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0391436 May 25 17:11:13.011329 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.rpc [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Device c68cea2d-169c-4346-87ef-27549285cb6b up at agent hyperv_hv-cinder-79049 {{(pid=91831) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 25 17:11:13.077800 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.provisioning_blocks [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Provisioning for port c68cea2d-169c-4346-87ef-27549285cb6b completed by entity L2. {{(pid=91831) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 25 17:11:13.082255 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.provisioning_blocks [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Provisioning complete for port c68cea2d-169c-4346-87ef-27549285cb6b triggered by entity L2. {{(pid=91831) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 17:11:13.082627 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3854128'] for port, provisioning_complete {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:11:13.197184 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3832070'] for port, before_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:11:13.224117 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '6e10cbf6-87b6-452f-80e6-c8bd2ce073db', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'c68cea2d-169c-4346-87ef-27549285cb6b'}] {{(pid=91831) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 25 17:11:13.233714 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.db [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] For port c68cea2d-169c-4346-87ef-27549285cb6b, host hv-cinder-79049, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79049',level=0,port_id=c68cea2d-169c-4346-87ef-27549285cb6b,segment=NetworkSegment(50ed67e9-f8d3-4927-b257-bd17654cce34),segment_id=50ed67e9-f8d3-4927-b257-bd17654cce34)] {{(pid=91831) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 17:11:13.238038 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8757892955028', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8757892520933', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8757892521750'] for port, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:11:13.240435 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:11:13.275169 dv-cinder-790492-4-iscsi neutron-server[91831]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '6e10cbf6-87b6-452f-80e6-c8bd2ce073db', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'c68cea2d-169c-4346-87ef-27549285cb6b', 'code': 200} May 25 17:11:13.310197 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Pushing event updated for resources: {'Port': ['ID=c68cea2d-169c-4346-87ef-27549285cb6b,revision_number=5']} {{(pid=91831) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:11:13.314484 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.074s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:11:13.630577 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b2dcf2dd-7a60-4f6a-a540-86185ad86878 req-3c05f8be-baf5-4d57-8836-0d0d4549b6d0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:11:13.632028 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-b2dcf2dd-7a60-4f6a-a540-86185ad86878 req-3c05f8be-baf5-4d57-8836-0d0d4549b6d0 service neutron] 10.222.0.32 "GET /v2.0/ports?device_id=6e10cbf6-87b6-452f-80e6-c8bd2ce073db HTTP/1.1" status: 200 len: 1099 time: 0.1330533 May 25 17:11:13.640325 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-09077553-30e5-4e8a-803c-618d10570b08 req-38293b23-2025-4b8f-9a87-caaf28613934 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:11:13.641643 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-09077553-30e5-4e8a-803c-618d10570b08 req-38293b23-2025-4b8f-9a87-caaf28613934 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] 10.222.0.62 "GET /v2.0/ports?device_id=6e10cbf6-87b6-452f-80e6-c8bd2ce073db HTTP/1.1" status: 200 len: 946 time: 0.1127355 May 25 17:11:13.704651 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-b2dcf2dd-7a60-4f6a-a540-86185ad86878 req-83b425a6-a2c8-4f8c-97ca-f0c3deb10ffa service neutron] 10.222.0.32 "GET /v2.0/security-groups?id=58fab80b-49b2-4bca-89e6-fef7473221ef&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0620689 May 25 17:11:13.713927 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-09077553-30e5-4e8a-803c-618d10570b08 req-ca0ada78-6cf8-43aa-938c-58bf8cfbc693 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] 10.222.0.62 "GET /v2.0/security-groups?id=58fab80b-49b2-4bca-89e6-fef7473221ef&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0592928 May 25 17:11:14.902999 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2a1e4bd8-dfec-42a1-adeb-586d63897e27 req-a2847b82-a494-4867-90dc-b03082f6cabb tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:11:14.904445 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-2a1e4bd8-dfec-42a1-adeb-586d63897e27 req-a2847b82-a494-4867-90dc-b03082f6cabb tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] 10.222.0.62 "GET /v2.0/ports?device_id=6e10cbf6-87b6-452f-80e6-c8bd2ce073db HTTP/1.1" status: 200 len: 946 time: 0.0824733 May 25 17:11:14.954373 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-2a1e4bd8-dfec-42a1-adeb-586d63897e27 req-84c05b36-f6f3-4bf2-8ac5-10eb1f797311 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] 10.222.0.62 "GET /v2.0/security-groups?id=58fab80b-49b2-4bca-89e6-fef7473221ef&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0436401 May 25 17:11:16.151106 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0116f241-788f-410b-85f8-4e1db7722281 req-a6308fd7-2270-42ce-8ee4-bdd11fe4712a tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:11:16.152577 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-0116f241-788f-410b-85f8-4e1db7722281 req-a6308fd7-2270-42ce-8ee4-bdd11fe4712a tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] 10.222.0.62 "GET /v2.0/ports?device_id=6e10cbf6-87b6-452f-80e6-c8bd2ce073db HTTP/1.1" status: 200 len: 946 time: 0.0849559 May 25 17:11:16.198816 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-0116f241-788f-410b-85f8-4e1db7722281 req-71e33910-c5d7-4877-bfcd-3342130f18fa tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] 10.222.0.62 "GET /v2.0/security-groups?id=58fab80b-49b2-4bca-89e6-fef7473221ef&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0405354 May 25 17:11:16.387626 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-86471ff3-44b0-4d08-aa55-f1a0210138c0 req-23b978dc-1f7d-4bb6-9669-f0366a305b64 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:11:16.389108 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-86471ff3-44b0-4d08-aa55-f1a0210138c0 req-23b978dc-1f7d-4bb6-9669-f0366a305b64 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] 10.222.0.62 "GET /v2.0/ports?device_id=6e10cbf6-87b6-452f-80e6-c8bd2ce073db HTTP/1.1" status: 200 len: 946 time: 0.0817912 May 25 17:11:16.433163 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-86471ff3-44b0-4d08-aa55-f1a0210138c0 req-04e07f67-3d38-4177-929a-8bed2417e2be tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] 10.222.0.62 "GET /v2.0/security-groups?id=58fab80b-49b2-4bca-89e6-fef7473221ef&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0383756 May 25 17:11:16.455696 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.wsgi [-] (91829) accepted ('10.222.0.62', 37240) {{(pid=91829) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:11:16.528782 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7ccf8ce0-6eb1-4cf1-8c64-b3df90acbac6 tempest-TestVolumeBootPattern-1585578645 tempest-TestVolumeBootPattern-1585578645-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:11:16.530251 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [None req-7ccf8ce0-6eb1-4cf1-8c64-b3df90acbac6 tempest-TestVolumeBootPattern-1585578645 tempest-TestVolumeBootPattern-1585578645-project-admin] 10.222.0.62 "GET /v2.0/ports?device_id=6e10cbf6-87b6-452f-80e6-c8bd2ce073db HTTP/1.1" status: 200 len: 1094 time: 0.0735924 May 25 17:11:16.532984 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.wsgi [-] (91829) accepted ('10.222.0.62', 37244) {{(pid=91829) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:11:16.538315 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.v2.base [None req-666f9931-eee4-49b6-9f2e-7f465eb384c1 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Request body: {'floatingip': {'floating_network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'port_id': 'c68cea2d-169c-4346-87ef-27549285cb6b', 'tenant_id': '5397bf60956945c3a2bf43c6b1aa614b', 'fixed_ip_address': '172.20.0.10'}} {{(pid=91829) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 17:11:16.543936 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.quota.driver [None req-666f9931-eee4-49b6-9f2e-7f465eb384c1 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91829) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 17:11:16.547683 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.quota.resource [None req-666f9931-eee4-49b6-9f2e-7f465eb384c1 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Usage tracker for resource:floatingip and tenant:5397bf60956945c3a2bf43c6b1aa614b is out of sync, need to count used quota {{(pid=91829) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 17:11:16.550502 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.quota.resource [None req-666f9931-eee4-49b6-9f2e-7f465eb384c1 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Quota usage for floatingip was recalculated. Used quota:1. {{(pid=91829) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 17:11:16.556605 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.quota.driver [None req-666f9931-eee4-49b6-9f2e-7f465eb384c1 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Attempting to reserve 1 items for resource floatingip. Total usage: 1; quota limit: 50; headroom:49 {{(pid=91829) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 17:11:16.566425 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-666f9931-eee4-49b6-9f2e-7f465eb384c1 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Notify callbacks [] for floatingip, before_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:11:16.703015 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-666f9931-eee4-49b6-9f2e-7f465eb384c1 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3832070'] for port, before_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:11:16.845582 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.db_base_plugin_common [None req-666f9931-eee4-49b6-9f2e-7f465eb384c1 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Allocated IP 172.27.2.75 (4364b6ab-4117-4a92-baeb-f5ee2f45bf74/b947e790-d731-4b63-afc4-4aa112afe0f6/87e0da25-c33f-4251-b133-114e1bc8f03d) {{(pid=91829) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 25 17:11:17.018065 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-666f9931-eee4-49b6-9f2e-7f465eb384c1 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Notify callbacks [] for port, precommit_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:11:17.055229 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-666f9931-eee4-49b6-9f2e-7f465eb384c1 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8757892520915', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28230808'] for port, after_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:11:17.060281 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-3cedcec2-0b97-4b7a-9f74-a5043d4d0807 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:11:17.121807 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-666f9931-eee4-49b6-9f2e-7f465eb384c1 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Network 4364b6ab-4117-4a92-baeb-f5ee2f45bf74 is already hosted by enough agents. {{(pid=91829) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 25 17:11:17.124739 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.scheduler.base_scheduler [None req-666f9931-eee4-49b6-9f2e-7f465eb384c1 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Resources bound (agent type, host, resource id): {{(pid=91829) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 17:11:17.128220 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.l3_dvrscheduler_db [None req-666f9931-eee4-49b6-9f2e-7f465eb384c1 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Received port after_create {{(pid=91829) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 25 17:11:17.167693 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-666f9931-eee4-49b6-9f2e-7f465eb384c1 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Pushing event updated for resources: {'Port': ['ID=87e0da25-c33f-4251-b133-114e1bc8f03d,revision_number=1']} {{(pid=91829) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:11:17.176061 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-666f9931-eee4-49b6-9f2e-7f465eb384c1 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.116s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:11:17.570067 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-666f9931-eee4-49b6-9f2e-7f465eb384c1 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Notify callbacks [] for floatingip, precommit_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:11:17.744422 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-666f9931-eee4-49b6-9f2e-7f465eb384c1 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3832070'] for port, before_update {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:11:17.951313 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-666f9931-eee4-49b6-9f2e-7f465eb384c1 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Notify callbacks [] for port, precommit_update {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:11:17.954710 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-666f9931-eee4-49b6-9f2e-7f465eb384c1 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8757892955028', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8757892520933', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8757892521750', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28230801'] for port, after_update {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:11:17.959230 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-64445901-7b61-4573-bcbc-2193f4986162 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:11:18.075028 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-666f9931-eee4-49b6-9f2e-7f465eb384c1 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Pushing event updated for resources: {'Port': ['ID=87e0da25-c33f-4251-b133-114e1bc8f03d,revision_number=2']} {{(pid=91829) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:11:18.078958 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-666f9931-eee4-49b6-9f2e-7f465eb384c1 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.120s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:11:18.081577 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-666f9931-eee4-49b6-9f2e-7f465eb384c1 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-683033'] for floatingip, after_update {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:11:18.253693 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.db.l3_db [None req-666f9931-eee4-49b6-9f2e-7f465eb384c1 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Floating IP 29e0fa6c-2b2a-4eff-85c0-77fa15ffbdec associated. External IP: 172.27.2.75, port: c68cea2d-169c-4346-87ef-27549285cb6b. May 25 17:11:18.612264 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-666f9931-eee4-49b6-9f2e-7f465eb384c1 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Router 269c6b7b-91cc-4880-9e6d-b8889bac29f6 has already been hosted by L3 agent a2d427c1-2d07-43e8-afbe-218c9f7d0445 {{(pid=91829) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 25 17:11:18.787499 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-666f9931-eee4-49b6-9f2e-7f465eb384c1 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Notify agent at l3_agent.dv-cinder-790492-4-iscsi the message routers_updated {{(pid=91829) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 25 17:11:18.797267 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fe873289-ea4a-49f1-a105-0a39155129ae None None] Sync routers for ids ['269c6b7b-91cc-4880-9e6d-b8889bac29f6'] in dv-cinder-790492-4-iscsi {{(pid=91831) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 25 17:11:18.806594 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fe873289-ea4a-49f1-a105-0a39155129ae None None] Routers {'269c6b7b-91cc-4880-9e6d-b8889bac29f6'} bound to L3 agent in host dv-cinder-790492-4-iscsi {{(pid=91831) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 17:11:18.807220 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.l3_hamode_db [None req-fe873289-ea4a-49f1-a105-0a39155129ae None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-790492-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-05-25T16:50:28Z,description=,heartbeat_timestamp=2021-05-25T17:10:58Z,host='dv-cinder-790492-4-iscsi',id=a2d427c1-2d07-43e8-afbe-218c9f7d0445,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T16:50:28Z,topic='l3_agent')) {'router_ids': ['269c6b7b-91cc-4880-9e6d-b8889bac29f6'], 'active': True} {{(pid=91831) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 17:11:18.812817 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-666f9931-eee4-49b6-9f2e-7f465eb384c1 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-178712'] for floatingip, before_response {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:11:18.870676 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [None req-666f9931-eee4-49b6-9f2e-7f465eb384c1 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] 10.222.0.62 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 996 time: 2.3364129 May 25 17:11:18.871292 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '6e10cbf6-87b6-452f-80e6-c8bd2ce073db', 'tag': 'c68cea2d-169c-4346-87ef-27549285cb6b'}] {{(pid=91829) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 25 17:11:18.922520 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '6e10cbf6-87b6-452f-80e6-c8bd2ce073db', 'tag': 'c68cea2d-169c-4346-87ef-27549285cb6b', 'status': 'completed', 'code': 200} May 25 17:11:18.992992 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.l3_dvr_db [None req-fe873289-ea4a-49f1-a105-0a39155129ae None None] Set router 269c6b7b-91cc-4880-9e6d-b8889bac29f6 gateway port host: dv-cinder-790492-4-iscsi {{(pid=91831) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 17:11:19.013405 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8ca48adc-5366-4934-842f-a237dcd893df req-1577593c-ba2f-4bb2-9055-6ad8ab67a259 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:11:19.014947 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-8ca48adc-5366-4934-842f-a237dcd893df req-1577593c-ba2f-4bb2-9055-6ad8ab67a259 service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=5397bf60956945c3a2bf43c6b1aa614b&device_id=6e10cbf6-87b6-452f-80e6-c8bd2ce073db HTTP/1.1" status: 200 len: 1099 time: 0.0709782 May 25 17:11:19.148378 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8ca48adc-5366-4934-842f-a237dcd893df req-2ee6e16d-b1a3-422d-b437-14198bde3e01 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:11:19.149716 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-8ca48adc-5366-4934-842f-a237dcd893df req-2ee6e16d-b1a3-422d-b437-14198bde3e01 service neutron] 10.222.0.32 "GET /v2.0/networks?id=17a0e39e-1e1f-4550-b28b-d5ae3bdca362 HTTP/1.1" status: 200 len: 912 time: 0.1272397 May 25 17:11:19.365656 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-8ca48adc-5366-4934-842f-a237dcd893df req-b659992a-b2bc-40ff-b46c-aacccc2c7eb3 service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=c68cea2d-169c-4346-87ef-27549285cb6b HTTP/1.1" status: 200 len: 999 time: 0.2083230 May 25 17:11:19.382633 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.l3_hamode_db [None req-fe873289-ea4a-49f1-a105-0a39155129ae None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '269c6b7b-91cc-4880-9e6d-b8889bac29f6', 'name': 'tempest-TestVolumeBootPattern-219116984-router', 'tenant_id': '5397bf60956945c3a2bf43c6b1aa614b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'external_fixed_ips': [{'subnet_id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'ip_address': '172.27.2.227'}], 'enable_snat': True}, 'gw_port_id': '2fef7852-acf7-462f-beee-5679d3df0ad2', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T17:07:09Z', 'updated_at': '2021-05-25T17:07:13Z', 'revision_number': 4, 'project_id': '5397bf60956945c3a2bf43c6b1aa614b', 'gw_port': {'id': '2fef7852-acf7-462f-beee-5679d3df0ad2', 'name': '', 'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'tenant_id': '', 'mac_address': 'fa:16:3e:35:b9:d0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '269c6b7b-91cc-4880-9e6d-b8889bac29f6', 'device_owner': 'network:router_gateway', 'standard_attr_id': 533, 'fixed_ips': [{'subnet_id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'ip_address': '172.27.2.227', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790492-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:07:09Z', 'updated_at': '2021-05-25T17:07:16Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-790492-4-iscsi', '_floatingips': [{'id': '29e0fa6c-2b2a-4eff-85c0-77fa15ffbdec', 'tenant_id': '5397bf60956945c3a2bf43c6b1aa614b', 'floating_ip_address': '172.27.2.75', 'floating_network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'router_id': '269c6b7b-91cc-4880-9e6d-b8889bac29f6', 'port_id': 'c68cea2d-169c-4346-87ef-27549285cb6b', 'fixed_ip_address': '172.20.0.10', 'status': 'DOWN', 'standard_attr_id': 577, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '17a0e39e-1e1f-4550-b28b-d5ae3bdca362', 'mac_address': 'fa:16:3e:7a:1d:60', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6e10cbf6-87b6-452f-80e6-c8bd2ce073db', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-25T17:11:17Z', 'updated_at': '2021-05-25T17:11:17Z', 'revision_number': 0, 'project_id': '5397bf60956945c3a2bf43c6b1aa614b', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '4972e3a9-91eb-48ce-8b7b-b0906822cebf', 'name': '', 'network_id': '17a0e39e-1e1f-4550-b28b-d5ae3bdca362', 'tenant_id': '5397bf60956945c3a2bf43c6b1aa614b', 'mac_address': 'fa:16:3e:ce:fe:1a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '269c6b7b-91cc-4880-9e6d-b8889bac29f6', 'device_owner': 'network:router_interface', 'standard_attr_id': 534, 'fixed_ips': [{'subnet_id': 'f5599a2e-9942-4423-a1ac-67e9b2650770', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790492-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:07:12Z', 'updated_at': '2021-05-25T17:07:20Z', 'revision_number': 5, 'project_id': '5397bf60956945c3a2bf43c6b1aa614b', 'subnets': [{'id': 'f5599a2e-9942-4423-a1ac-67e9b2650770', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-790492-4-iscsi', False) {} {{(pid=91831) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 17:11:19.387041 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fe873289-ea4a-49f1-a105-0a39155129ae None None] Checking router: 269c6b7b-91cc-4880-9e6d-b8889bac29f6 for host: dv-cinder-790492-4-iscsi {{(pid=91831) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 25 17:11:19.397625 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fe873289-ea4a-49f1-a105-0a39155129ae None None] Routers {'269c6b7b-91cc-4880-9e6d-b8889bac29f6'} bound to L3 agent in host dv-cinder-790492-4-iscsi {{(pid=91831) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 17:11:19.398294 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.l3_hamode_db [None req-fe873289-ea4a-49f1-a105-0a39155129ae None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-790492-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-05-25T16:50:28Z,description=,heartbeat_timestamp=2021-05-25T17:10:58Z,host='dv-cinder-790492-4-iscsi',id=a2d427c1-2d07-43e8-afbe-218c9f7d0445,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T16:50:28Z,topic='l3_agent')) {'router_ids': ['269c6b7b-91cc-4880-9e6d-b8889bac29f6'], 'active': True} {{(pid=91831) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 17:11:19.458719 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8ca48adc-5366-4934-842f-a237dcd893df req-4447fb4d-7101-4331-96b2-015f185e73bb service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:11:19.460170 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-8ca48adc-5366-4934-842f-a237dcd893df req-4447fb4d-7101-4331-96b2-015f185e73bb service neutron] 10.222.0.32 "GET /v2.0/subnets?id=f5599a2e-9942-4423-a1ac-67e9b2650770 HTTP/1.1" status: 200 len: 850 time: 0.0880525 May 25 17:11:19.534931 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8ca48adc-5366-4934-842f-a237dcd893df req-467ebe04-f9ce-41d7-aad8-75f3a70a155b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:11:19.536896 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-8ca48adc-5366-4934-842f-a237dcd893df req-467ebe04-f9ce-41d7-aad8-75f3a70a155b service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=17a0e39e-1e1f-4550-b28b-d5ae3bdca362&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0701203 May 25 17:11:19.584703 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.l3_dvr_db [None req-fe873289-ea4a-49f1-a105-0a39155129ae None None] Set router 269c6b7b-91cc-4880-9e6d-b8889bac29f6 gateway port host: dv-cinder-790492-4-iscsi {{(pid=91831) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 17:11:19.667260 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-8ca48adc-5366-4934-842f-a237dcd893df req-84f34039-6a6f-410f-a2dd-939329fece89 service neutron] 10.222.0.32 "GET /v2.0/networks/17a0e39e-1e1f-4550-b28b-d5ae3bdca362?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1232510 May 25 17:11:19.800583 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-8ca48adc-5366-4934-842f-a237dcd893df req-75e78489-bccb-4722-b550-f02de631ac3a service neutron] 10.222.0.32 "GET /v2.0/networks/17a0e39e-1e1f-4550-b28b-d5ae3bdca362?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1265774 May 25 17:11:19.937746 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.l3_hamode_db [None req-fe873289-ea4a-49f1-a105-0a39155129ae None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '269c6b7b-91cc-4880-9e6d-b8889bac29f6', 'name': 'tempest-TestVolumeBootPattern-219116984-router', 'tenant_id': '5397bf60956945c3a2bf43c6b1aa614b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'external_fixed_ips': [{'subnet_id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'ip_address': '172.27.2.227'}], 'enable_snat': True}, 'gw_port_id': '2fef7852-acf7-462f-beee-5679d3df0ad2', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T17:07:09Z', 'updated_at': '2021-05-25T17:07:13Z', 'revision_number': 4, 'project_id': '5397bf60956945c3a2bf43c6b1aa614b', 'gw_port': {'id': '2fef7852-acf7-462f-beee-5679d3df0ad2', 'name': '', 'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'tenant_id': '', 'mac_address': 'fa:16:3e:35:b9:d0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '269c6b7b-91cc-4880-9e6d-b8889bac29f6', 'device_owner': 'network:router_gateway', 'standard_attr_id': 533, 'fixed_ips': [{'subnet_id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'ip_address': '172.27.2.227', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790492-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:07:09Z', 'updated_at': '2021-05-25T17:07:16Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-790492-4-iscsi', '_floatingips': [{'id': '29e0fa6c-2b2a-4eff-85c0-77fa15ffbdec', 'tenant_id': '5397bf60956945c3a2bf43c6b1aa614b', 'floating_ip_address': '172.27.2.75', 'floating_network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'router_id': '269c6b7b-91cc-4880-9e6d-b8889bac29f6', 'port_id': 'c68cea2d-169c-4346-87ef-27549285cb6b', 'fixed_ip_address': '172.20.0.10', 'status': 'DOWN', 'standard_attr_id': 577, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '17a0e39e-1e1f-4550-b28b-d5ae3bdca362', 'mac_address': 'fa:16:3e:7a:1d:60', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6e10cbf6-87b6-452f-80e6-c8bd2ce073db', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-25T17:11:17Z', 'updated_at': '2021-05-25T17:11:17Z', 'revision_number': 0, 'project_id': '5397bf60956945c3a2bf43c6b1aa614b', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '4972e3a9-91eb-48ce-8b7b-b0906822cebf', 'name': '', 'network_id': '17a0e39e-1e1f-4550-b28b-d5ae3bdca362', 'tenant_id': '5397bf60956945c3a2bf43c6b1aa614b', 'mac_address': 'fa:16:3e:ce:fe:1a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '269c6b7b-91cc-4880-9e6d-b8889bac29f6', 'device_owner': 'network:router_interface', 'standard_attr_id': 534, 'fixed_ips': [{'subnet_id': 'f5599a2e-9942-4423-a1ac-67e9b2650770', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790492-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:07:12Z', 'updated_at': '2021-05-25T17:07:20Z', 'revision_number': 5, 'project_id': '5397bf60956945c3a2bf43c6b1aa614b', 'subnets': [{'id': 'f5599a2e-9942-4423-a1ac-67e9b2650770', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-790492-4-iscsi', False) {} {{(pid=91831) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 17:11:19.941924 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fe873289-ea4a-49f1-a105-0a39155129ae None None] The sync data for ids ['269c6b7b-91cc-4880-9e6d-b8889bac29f6'] in dv-cinder-790492-4-iscsi is: [{'id': '269c6b7b-91cc-4880-9e6d-b8889bac29f6', 'name': 'tempest-TestVolumeBootPattern-219116984-router', 'tenant_id': '5397bf60956945c3a2bf43c6b1aa614b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'external_fixed_ips': [{'subnet_id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'ip_address': '172.27.2.227'}], 'enable_snat': True}, 'gw_port_id': '2fef7852-acf7-462f-beee-5679d3df0ad2', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T17:07:09Z', 'updated_at': '2021-05-25T17:07:13Z', 'revision_number': 4, 'project_id': '5397bf60956945c3a2bf43c6b1aa614b', 'gw_port': {'id': '2fef7852-acf7-462f-beee-5679d3df0ad2', 'name': '', 'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'tenant_id': '', 'mac_address': 'fa:16:3e:35:b9:d0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '269c6b7b-91cc-4880-9e6d-b8889bac29f6', 'device_owner': 'network:router_gateway', 'standard_attr_id': 533, 'fixed_ips': [{'subnet_id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'ip_address': '172.27.2.227', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790492-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:07:09Z', 'updated_at': '2021-05-25T17:07:16Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-790492-4-iscsi', '_floatingips': [{'id': '29e0fa6c-2b2a-4eff-85c0-77fa15ffbdec', 'tenant_id': '5397bf60956945c3a2bf43c6b1aa614b', 'floating_ip_address': '172.27.2.75', 'floating_network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'router_id': '269c6b7b-91cc-4880-9e6d-b8889bac29f6', 'port_id': 'c68cea2d-169c-4346-87ef-27549285cb6b', 'fixed_ip_address': '172.20.0.10', 'status': 'DOWN', 'standard_attr_id': 577, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '17a0e39e-1e1f-4550-b28b-d5ae3bdca362', 'mac_address': 'fa:16:3e:7a:1d:60', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6e10cbf6-87b6-452f-80e6-c8bd2ce073db', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-25T17:11:17Z', 'updated_at': '2021-05-25T17:11:17Z', 'revision_number': 0, 'project_id': '5397bf60956945c3a2bf43c6b1aa614b', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '4972e3a9-91eb-48ce-8b7b-b0906822cebf', 'name': '', 'network_id': '17a0e39e-1e1f-4550-b28b-d5ae3bdca362', 'tenant_id': '5397bf60956945c3a2bf43c6b1aa614b', 'mac_address': 'fa:16:3e:ce:fe:1a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '269c6b7b-91cc-4880-9e6d-b8889bac29f6', 'device_owner': 'network:router_interface', 'standard_attr_id': 534, 'fixed_ips': [{'subnet_id': 'f5599a2e-9942-4423-a1ac-67e9b2650770', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790492-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:07:12Z', 'updated_at': '2021-05-25T17:07:20Z', 'revision_number': 5, 'project_id': '5397bf60956945c3a2bf43c6b1aa614b', 'subnets': [{'id': 'f5599a2e-9942-4423-a1ac-67e9b2650770', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=91831) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 25 17:11:20.112481 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f7d78420-7427-4a03-ac23-e7893ce70c90 None None] New status for floating IP 29e0fa6c-2b2a-4eff-85c0-77fa15ffbdec: ACTIVE {{(pid=91832) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} May 25 17:11:25.318140 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-9a8b4800-3182-41d4-bfbc-a65dbceeea74 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:11:27.717695 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-303a29ce-f7ff-4b6c-a492-892fc68cde34 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:11:27.902865 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:11:28.651338 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-0a55eb4a-8b57-4233-84d6-6b423b4ed6db None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:11:30.058947 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5b319968-598b-4f71-8149-a6e99784d02e req-0f533935-dd2a-4e54-8cde-5fb46d81f80d tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:11:30.060401 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-5b319968-598b-4f71-8149-a6e99784d02e req-0f533935-dd2a-4e54-8cde-5fb46d81f80d tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/ports?device_id=bdaa3d25-adc2-4a52-8a36-66a599b4b6e2 HTTP/1.1" status: 200 len: 947 time: 0.0843177 May 25 17:11:30.103784 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-5b319968-598b-4f71-8149-a6e99784d02e req-92d27d1a-2a4e-4674-87d8-6cc0fcf2959d tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/security-groups?id=4e6b7b77-0833-47dc-be2e-ec9c7c960bb9&fields=id&fields=name HTTP/1.1" status: 200 len: 309 time: 0.0375412 May 25 17:11:30.257814 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-57f11b47-1f51-4191-b7c9-af248a48372c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:11:31.292637 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a3aeda4e-f95d-4d28-97be-7239b0efdc1b req-04446039-ac6d-47a2-9316-3f4feec91aec tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:11:31.294073 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-a3aeda4e-f95d-4d28-97be-7239b0efdc1b req-04446039-ac6d-47a2-9316-3f4feec91aec tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/ports?device_id=bdaa3d25-adc2-4a52-8a36-66a599b4b6e2 HTTP/1.1" status: 200 len: 947 time: 0.0776892 May 25 17:11:31.338292 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-a3aeda4e-f95d-4d28-97be-7239b0efdc1b req-8cff9389-8900-4663-a442-ab18ea0231e0 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/security-groups?id=4e6b7b77-0833-47dc-be2e-ec9c7c960bb9&fields=id&fields=name HTTP/1.1" status: 200 len: 309 time: 0.0384412 May 25 17:11:31.971380 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-31c7c74e-b5b6-46f8-a461-11fb32b3932e req-f1a6ad69-a1d3-4bfa-bbab-9d968cd62c2a tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:11:31.972777 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-31c7c74e-b5b6-46f8-a461-11fb32b3932e req-f1a6ad69-a1d3-4bfa-bbab-9d968cd62c2a tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.32 "GET /v2.0/ports?device_id=bdaa3d25-adc2-4a52-8a36-66a599b4b6e2 HTTP/1.1" status: 200 len: 947 time: 0.0831814 May 25 17:11:32.105525 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.plugins.ml2.plugin [req-31c7c74e-b5b6-46f8-a461-11fb32b3932e req-107b27dd-f094-475b-a82a-b90f6491002e tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Deleting port bfd709e1-823e-4b01-8a88-fa341f7e700a {{(pid=91829) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 25 17:11:32.105855 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [req-31c7c74e-b5b6-46f8-a461-11fb32b3932e req-107b27dd-f094-475b-a82a-b90f6491002e tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8757892952899'] for port, before_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:11:32.234344 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.plugins.ml2.db [req-31c7c74e-b5b6-46f8-a461-11fb32b3932e req-107b27dd-f094-475b-a82a-b90f6491002e tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] For port bfd709e1-823e-4b01-8a88-fa341f7e700a, host hv-cinder-79049, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79049',level=0,port_id=bfd709e1-823e-4b01-8a88-fa341f7e700a,segment=NetworkSegment(a8fb0313-938a-4f5e-8ff4-96df8acd943b),segment_id=a8fb0313-938a-4f5e-8ff4-96df8acd943b)] {{(pid=91829) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 17:11:32.234603 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [req-31c7c74e-b5b6-46f8-a461-11fb32b3932e req-107b27dd-f094-475b-a82a-b90f6491002e tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-683770'] for port, precommit_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:11:32.571320 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [req-31c7c74e-b5b6-46f8-a461-11fb32b3932e req-107b27dd-f094-475b-a82a-b90f6491002e tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Notify callbacks [] for floatingip, precommit_update {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:11:32.572034 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [req-31c7c74e-b5b6-46f8-a461-11fb32b3932e req-107b27dd-f094-475b-a82a-b90f6491002e tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-683033'] for floatingip, after_update {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:11:32.572034 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.db.l3_db [req-31c7c74e-b5b6-46f8-a461-11fb32b3932e req-107b27dd-f094-475b-a82a-b90f6491002e tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Floating IP d6475a43-aed3-4465-ad40-e19d12dbd869 disassociated. External IP: 172.27.2.15, port: bfd709e1-823e-4b01-8a88-fa341f7e700a. May 25 17:11:32.572295 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.plugins.ml2.plugin [req-31c7c74e-b5b6-46f8-a461-11fb32b3932e req-107b27dd-f094-475b-a82a-b90f6491002e tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Calling delete_port for bfd709e1-823e-4b01-8a88-fa341f7e700a owned by compute:nova {{(pid=91829) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 25 17:11:32.604963 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7bda8481-6144-4bdb-8d71-87a87b8892c6 req-f526b5d7-f48b-49ab-b7c2-a93695c6a3b5 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:11:32.606477 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-7bda8481-6144-4bdb-8d71-87a87b8892c6 req-f526b5d7-f48b-49ab-b7c2-a93695c6a3b5 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/ports?device_id=bdaa3d25-adc2-4a52-8a36-66a599b4b6e2 HTTP/1.1" status: 200 len: 947 time: 0.1314385 May 25 17:11:32.663712 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-7bda8481-6144-4bdb-8d71-87a87b8892c6 req-4c9ba041-39c5-4a41-929f-587aaedeb21a tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/security-groups?id=4e6b7b77-0833-47dc-be2e-ec9c7c960bb9&fields=id&fields=name HTTP/1.1" status: 200 len: 309 time: 0.0510330 May 25 17:11:32.736366 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [req-31c7c74e-b5b6-46f8-a461-11fb32b3932e req-107b27dd-f094-475b-a82a-b90f6491002e tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8757892955046', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8757892520924', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28230808'] for port, after_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:11:32.742199 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-6a324333-237c-4c25-b6ff-2f9f9c3c2a98 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:11:32.891586 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-107b27dd-f094-475b-a82a-b90f6491002e tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Pushing event deleted for resources: {'Port': ['ID=bfd709e1-823e-4b01-8a88-fa341f7e700a,revision_number=None']} {{(pid=91829) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:11:32.895609 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-107b27dd-f094-475b-a82a-b90f6491002e tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.153s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:11:33.080643 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.scheduler.l3_agent_scheduler [req-31c7c74e-b5b6-46f8-a461-11fb32b3932e req-107b27dd-f094-475b-a82a-b90f6491002e tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Router d2ed6ef9-f77a-4b7a-b152-3e1b9c85e1ad has already been hosted by L3 agent a2d427c1-2d07-43e8-afbe-218c9f7d0445 {{(pid=91829) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 25 17:11:33.263409 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-31c7c74e-b5b6-46f8-a461-11fb32b3932e req-107b27dd-f094-475b-a82a-b90f6491002e tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Notify agent at l3_agent.dv-cinder-790492-4-iscsi the message routers_updated {{(pid=91829) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 25 17:11:33.273314 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-edd3b536-4997-4b08-91f6-50e92e111122 None None] Sync routers for ids ['d2ed6ef9-f77a-4b7a-b152-3e1b9c85e1ad'] in dv-cinder-790492-4-iscsi {{(pid=91831) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 25 17:11:33.283604 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.l3_dvrscheduler_db [None req-edd3b536-4997-4b08-91f6-50e92e111122 None None] Routers {'d2ed6ef9-f77a-4b7a-b152-3e1b9c85e1ad'} bound to L3 agent in host dv-cinder-790492-4-iscsi {{(pid=91831) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 17:11:33.284245 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.l3_hamode_db [None req-edd3b536-4997-4b08-91f6-50e92e111122 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-790492-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-05-25T16:50:28Z,description=,heartbeat_timestamp=2021-05-25T17:11:28Z,host='dv-cinder-790492-4-iscsi',id=a2d427c1-2d07-43e8-afbe-218c9f7d0445,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T16:50:28Z,topic='l3_agent')) {'router_ids': ['d2ed6ef9-f77a-4b7a-b152-3e1b9c85e1ad'], 'active': True} {{(pid=91831) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 17:11:33.341180 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.l3_dvrscheduler_db [req-31c7c74e-b5b6-46f8-a461-11fb32b3932e req-107b27dd-f094-475b-a82a-b90f6491002e tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] No DVR routers for this DVR port bfd709e1-823e-4b01-8a88-fa341f7e700a on host hv-cinder-79049 {{(pid=91829) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 25 17:11:33.344138 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [req-31c7c74e-b5b6-46f8-a461-11fb32b3932e req-107b27dd-f094-475b-a82a-b90f6491002e tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-178712'] for port, before_response {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:11:33.347092 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'bdaa3d25-adc2-4a52-8a36-66a599b4b6e2', 'name': 'network-vif-deleted', 'tag': 'bfd709e1-823e-4b01-8a88-fa341f7e700a'}] {{(pid=91829) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 25 17:11:33.365330 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-31c7c74e-b5b6-46f8-a461-11fb32b3932e req-107b27dd-f094-475b-a82a-b90f6491002e tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.32 "DELETE /v2.0/ports/bfd709e1-823e-4b01-8a88-fa341f7e700a HTTP/1.1" status: 204 len: 173 time: 1.3865056 May 25 17:11:33.396403 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'bdaa3d25-adc2-4a52-8a36-66a599b4b6e2', 'name': 'network-vif-deleted', 'tag': 'bfd709e1-823e-4b01-8a88-fa341f7e700a', 'status': 'completed', 'code': 200} May 25 17:11:33.496067 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.l3_dvr_db [None req-edd3b536-4997-4b08-91f6-50e92e111122 None None] Set router d2ed6ef9-f77a-4b7a-b152-3e1b9c85e1ad gateway port host: dv-cinder-790492-4-iscsi {{(pid=91831) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 17:11:33.817174 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.l3_hamode_db [None req-edd3b536-4997-4b08-91f6-50e92e111122 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd2ed6ef9-f77a-4b7a-b152-3e1b9c85e1ad', 'name': 'tempest-AttachVolumeShelveTestJSON-437778030-router', 'tenant_id': 'bbb9e99759bc47d08005f3b1e036a6cf', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'external_fixed_ips': [{'subnet_id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'ip_address': '172.27.2.253'}], 'enable_snat': True}, 'gw_port_id': '3bc942c3-5854-4018-b3fb-5071bf6c70c6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T17:00:14Z', 'updated_at': '2021-05-25T17:00:25Z', 'revision_number': 4, 'project_id': 'bbb9e99759bc47d08005f3b1e036a6cf', 'gw_port': {'id': '3bc942c3-5854-4018-b3fb-5071bf6c70c6', 'name': '', 'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'tenant_id': '', 'mac_address': 'fa:16:3e:da:a2:c4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd2ed6ef9-f77a-4b7a-b152-3e1b9c85e1ad', 'device_owner': 'network:router_gateway', 'standard_attr_id': 294, 'fixed_ips': [{'subnet_id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'ip_address': '172.27.2.253', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790492-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:00:16Z', 'updated_at': '2021-05-25T17:00:27Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-790492-4-iscsi', '_interfaces': [{'id': '735e7c1b-31b2-48e2-b2b7-538c31dbffb6', 'name': '', 'network_id': 'e5be4c6a-143f-474c-a90b-37180778cefe', 'tenant_id': 'bbb9e99759bc47d08005f3b1e036a6cf', 'mac_address': 'fa:16:3e:9a:dc:e1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd2ed6ef9-f77a-4b7a-b152-3e1b9c85e1ad', 'device_owner': 'network:router_interface', 'standard_attr_id': 319, 'fixed_ips': [{'subnet_id': '6e6b5897-e23d-4281-96cb-a6fdf9b68134', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790492-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:00:21Z', 'updated_at': '2021-05-25T17:00:33Z', 'revision_number': 5, 'project_id': 'bbb9e99759bc47d08005f3b1e036a6cf', 'subnets': [{'id': '6e6b5897-e23d-4281-96cb-a6fdf9b68134', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-790492-4-iscsi', False) {} {{(pid=91831) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 17:11:33.820945 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-edd3b536-4997-4b08-91f6-50e92e111122 None None] Checking router: d2ed6ef9-f77a-4b7a-b152-3e1b9c85e1ad for host: dv-cinder-790492-4-iscsi {{(pid=91831) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 25 17:11:33.829186 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.l3_dvrscheduler_db [None req-edd3b536-4997-4b08-91f6-50e92e111122 None None] Routers {'d2ed6ef9-f77a-4b7a-b152-3e1b9c85e1ad'} bound to L3 agent in host dv-cinder-790492-4-iscsi {{(pid=91831) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 17:11:33.829789 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.l3_hamode_db [None req-edd3b536-4997-4b08-91f6-50e92e111122 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-790492-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-05-25T16:50:28Z,description=,heartbeat_timestamp=2021-05-25T17:11:28Z,host='dv-cinder-790492-4-iscsi',id=a2d427c1-2d07-43e8-afbe-218c9f7d0445,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T16:50:28Z,topic='l3_agent')) {'router_ids': ['d2ed6ef9-f77a-4b7a-b152-3e1b9c85e1ad'], 'active': True} {{(pid=91831) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 17:11:33.834831 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.quota.resource [req-906300b0-d0cc-43ab-9e35-b1e325b2bd80 req-b7505758-8588-43c7-9cb4-aff03cb8e0e2 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Synchronizing usage tracker for tenant:bbb9e99759bc47d08005f3b1e036a6cf on resource:port {{(pid=91829) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 25 17:11:33.851268 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.quota.resource [req-906300b0-d0cc-43ab-9e35-b1e325b2bd80 req-b7505758-8588-43c7-9cb4-aff03cb8e0e2 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Unset dirty status for tenant:bbb9e99759bc47d08005f3b1e036a6cf on resource:port {{(pid=91829) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 25 17:11:33.852440 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-906300b0-d0cc-43ab-9e35-b1e325b2bd80 req-b7505758-8588-43c7-9cb4-aff03cb8e0e2 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/ports?device_id=bdaa3d25-adc2-4a52-8a36-66a599b4b6e2 HTTP/1.1" status: 200 len: 210 time: 0.0589094 May 25 17:11:34.052562 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.l3_dvr_db [None req-edd3b536-4997-4b08-91f6-50e92e111122 None None] Set router d2ed6ef9-f77a-4b7a-b152-3e1b9c85e1ad gateway port host: dv-cinder-790492-4-iscsi {{(pid=91831) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 17:11:34.373461 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.l3_hamode_db [None req-edd3b536-4997-4b08-91f6-50e92e111122 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd2ed6ef9-f77a-4b7a-b152-3e1b9c85e1ad', 'name': 'tempest-AttachVolumeShelveTestJSON-437778030-router', 'tenant_id': 'bbb9e99759bc47d08005f3b1e036a6cf', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'external_fixed_ips': [{'subnet_id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'ip_address': '172.27.2.253'}], 'enable_snat': True}, 'gw_port_id': '3bc942c3-5854-4018-b3fb-5071bf6c70c6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T17:00:14Z', 'updated_at': '2021-05-25T17:00:25Z', 'revision_number': 4, 'project_id': 'bbb9e99759bc47d08005f3b1e036a6cf', 'gw_port': {'id': '3bc942c3-5854-4018-b3fb-5071bf6c70c6', 'name': '', 'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'tenant_id': '', 'mac_address': 'fa:16:3e:da:a2:c4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd2ed6ef9-f77a-4b7a-b152-3e1b9c85e1ad', 'device_owner': 'network:router_gateway', 'standard_attr_id': 294, 'fixed_ips': [{'subnet_id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'ip_address': '172.27.2.253', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790492-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:00:16Z', 'updated_at': '2021-05-25T17:00:27Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-790492-4-iscsi', '_interfaces': [{'id': '735e7c1b-31b2-48e2-b2b7-538c31dbffb6', 'name': '', 'network_id': 'e5be4c6a-143f-474c-a90b-37180778cefe', 'tenant_id': 'bbb9e99759bc47d08005f3b1e036a6cf', 'mac_address': 'fa:16:3e:9a:dc:e1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd2ed6ef9-f77a-4b7a-b152-3e1b9c85e1ad', 'device_owner': 'network:router_interface', 'standard_attr_id': 319, 'fixed_ips': [{'subnet_id': '6e6b5897-e23d-4281-96cb-a6fdf9b68134', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790492-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:00:21Z', 'updated_at': '2021-05-25T17:00:33Z', 'revision_number': 5, 'project_id': 'bbb9e99759bc47d08005f3b1e036a6cf', 'subnets': [{'id': '6e6b5897-e23d-4281-96cb-a6fdf9b68134', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-790492-4-iscsi', False) {} {{(pid=91831) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 17:11:34.377408 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-edd3b536-4997-4b08-91f6-50e92e111122 None None] The sync data for ids ['d2ed6ef9-f77a-4b7a-b152-3e1b9c85e1ad'] in dv-cinder-790492-4-iscsi is: [{'id': 'd2ed6ef9-f77a-4b7a-b152-3e1b9c85e1ad', 'name': 'tempest-AttachVolumeShelveTestJSON-437778030-router', 'tenant_id': 'bbb9e99759bc47d08005f3b1e036a6cf', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'external_fixed_ips': [{'subnet_id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'ip_address': '172.27.2.253'}], 'enable_snat': True}, 'gw_port_id': '3bc942c3-5854-4018-b3fb-5071bf6c70c6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T17:00:14Z', 'updated_at': '2021-05-25T17:00:25Z', 'revision_number': 4, 'project_id': 'bbb9e99759bc47d08005f3b1e036a6cf', 'gw_port': {'id': '3bc942c3-5854-4018-b3fb-5071bf6c70c6', 'name': '', 'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'tenant_id': '', 'mac_address': 'fa:16:3e:da:a2:c4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd2ed6ef9-f77a-4b7a-b152-3e1b9c85e1ad', 'device_owner': 'network:router_gateway', 'standard_attr_id': 294, 'fixed_ips': [{'subnet_id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'ip_address': '172.27.2.253', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790492-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:00:16Z', 'updated_at': '2021-05-25T17:00:27Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-790492-4-iscsi', '_interfaces': [{'id': '735e7c1b-31b2-48e2-b2b7-538c31dbffb6', 'name': '', 'network_id': 'e5be4c6a-143f-474c-a90b-37180778cefe', 'tenant_id': 'bbb9e99759bc47d08005f3b1e036a6cf', 'mac_address': 'fa:16:3e:9a:dc:e1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd2ed6ef9-f77a-4b7a-b152-3e1b9c85e1ad', 'device_owner': 'network:router_interface', 'standard_attr_id': 319, 'fixed_ips': [{'subnet_id': '6e6b5897-e23d-4281-96cb-a6fdf9b68134', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790492-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:00:21Z', 'updated_at': '2021-05-25T17:00:33Z', 'revision_number': 5, 'project_id': 'bbb9e99759bc47d08005f3b1e036a6cf', 'subnets': [{'id': '6e6b5897-e23d-4281-96cb-a6fdf9b68134', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=91831) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 25 17:11:34.576031 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e3eec878-03f5-4caa-808a-71ffa7c7a1fd None None] New status for floating IP d6475a43-aed3-4465-ad40-e19d12dbd869: DOWN {{(pid=91832) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} May 25 17:11:34.978072 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.wsgi [-] (91829) accepted ('10.222.0.62', 37350) {{(pid=91829) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:11:35.044956 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-beabd5b7-bd93-4551-8cd5-0f85961d0673 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Notify callbacks [] for security_group, before_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:11:35.072421 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-beabd5b7-bd93-4551-8cd5-0f85961d0673 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Notify callbacks [] for security_group, precommit_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:11:35.116040 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.rpc [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Device bfd709e1-823e-4b01-8a88-fa341f7e700a no longer exists at agent hyperv_hv-cinder-79049 {{(pid=91831) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 25 17:11:35.126565 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-beabd5b7-bd93-4551-8cd5-0f85961d0673 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-640836'] for security_group, after_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:11:35.134974 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-9ad395c2-b196-45fe-b0e6-d497011ad004 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:11:35.147475 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-beabd5b7-bd93-4551-8cd5-0f85961d0673 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=4e6b7b77-0833-47dc-be2e-ec9c7c960bb9,revision_number=None']} {{(pid=91829) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:11:35.150986 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-beabd5b7-bd93-4551-8cd5-0f85961d0673 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.016s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:11:35.159258 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.plugin [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] No Port match for: bfd709e1-823e-4b01-8a88-fa341f7e700a {{(pid=91831) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}} May 25 17:11:35.159630 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.rpc [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Device bfd709e1-823e-4b01-8a88-fa341f7e700a not bound to the agent host hv-cinder-79049 {{(pid=91831) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 25 17:11:35.161689 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-beabd5b7-bd93-4551-8cd5-0f85961d0673 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Notify callbacks [] for security_group, before_response {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:11:35.162865 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [None req-beabd5b7-bd93-4551-8cd5-0f85961d0673 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "DELETE /v2.0/security-groups/4e6b7b77-0833-47dc-be2e-ec9c7c960bb9 HTTP/1.1" status: 204 len: 168 time: 0.1838009 May 25 17:11:35.165675 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.wsgi [-] (91829) accepted ('10.222.0.62', 37356) {{(pid=91829) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:11:35.181779 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.api.v2.resource [None req-173858fa-a191-4e9d-bbdd-7c8feacc9211 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] show failed (client error): The resource could not be found. May 25 17:11:35.182962 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [None req-173858fa-a191-4e9d-bbdd-7c8feacc9211 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "GET /v2.0/security-groups/4e6b7b77-0833-47dc-be2e-ec9c7c960bb9 HTTP/1.1" status: 404 len: 347 time: 0.0163748 May 25 17:11:35.188806 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.wsgi [-] (91829) accepted ('10.222.0.62', 37362) {{(pid=91829) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:11:35.412495 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.plugins.ml2.plugin [None req-9de44286-af01-4191-a6fd-0f6ae841798e tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Deleting port f18a74f7-36aa-484b-b8c1-4df0ed9b9127 {{(pid=91829) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 25 17:11:35.413100 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-9de44286-af01-4191-a6fd-0f6ae841798e tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8757892952899'] for port, before_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:11:35.539712 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-9de44286-af01-4191-a6fd-0f6ae841798e tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-683770'] for port, precommit_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:11:35.540185 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-9de44286-af01-4191-a6fd-0f6ae841798e tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:11:35.666784 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.plugins.ml2.plugin [None req-9de44286-af01-4191-a6fd-0f6ae841798e tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Calling delete_port for f18a74f7-36aa-484b-b8c1-4df0ed9b9127 owned by network:floatingip {{(pid=91829) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 25 17:11:35.781680 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-9de44286-af01-4191-a6fd-0f6ae841798e tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8757892955046', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8757892520924', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28230808'] for port, after_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:11:35.785857 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-a6bb6379-3969-400c-a15b-808aca021783 tempest-VolumesSnapshotTestJSON-991813121 tempest-VolumesSnapshotTestJSON-991813121-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:11:35.831410 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9de44286-af01-4191-a6fd-0f6ae841798e tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Pushing event deleted for resources: {'Port': ['ID=f18a74f7-36aa-484b-b8c1-4df0ed9b9127,revision_number=None']} {{(pid=91829) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:11:35.858033 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-9de44286-af01-4191-a6fd-0f6ae841798e tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.072s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:11:35.921134 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-9de44286-af01-4191-a6fd-0f6ae841798e tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Notify callbacks [] for floatingip, after_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:11:35.938004 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-9de44286-af01-4191-a6fd-0f6ae841798e tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-178712'] for floatingip, before_response {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:11:35.939111 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [None req-9de44286-af01-4191-a6fd-0f6ae841798e tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] 10.222.0.62 "DELETE /v2.0/floatingips/d6475a43-aed3-4465-ad40-e19d12dbd869 HTTP/1.1" status: 204 len: 168 time: 0.7494221 May 25 17:11:36.591441 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:11:38.580661 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-3b5ceb45-a022-40a4-a7e9-25f0f871f2db req-8ab148df-7743-47f6-ac11-4ff0233fb4c0 service neutron] 10.222.0.32 "GET /v2.0/ports?device_id=2c1b6af6-e585-417b-8583-2d6739261c16&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.1740766 May 25 17:11:38.674709 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3b5ceb45-a022-40a4-a7e9-25f0f871f2db req-2f71a1ff-f875-4ac6-84db-3bfbdb55e8a6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:11:38.676345 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-3b5ceb45-a022-40a4-a7e9-25f0f871f2db req-2f71a1ff-f875-4ac6-84db-3bfbdb55e8a6 service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=70dac097fff04aed99a4976fa955579b&device_id=2c1b6af6-e585-417b-8583-2d6739261c16 HTTP/1.1" status: 200 len: 1098 time: 0.0712192 May 25 17:11:38.733147 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.wsgi [-] (91830) accepted ('10.222.0.62', 37406) {{(pid=91830) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:11:38.821485 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3b5ceb45-a022-40a4-a7e9-25f0f871f2db req-9bf1dab3-5265-487c-acee-2e8d827d9bb5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:11:38.822956 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-3b5ceb45-a022-40a4-a7e9-25f0f871f2db req-9bf1dab3-5265-487c-acee-2e8d827d9bb5 service neutron] 10.222.0.32 "GET /v2.0/networks?id=b351598a-3f6f-4a37-8095-8d9371896ccc HTTP/1.1" status: 200 len: 911 time: 0.1266243 May 25 17:11:38.945631 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-3b5ceb45-a022-40a4-a7e9-25f0f871f2db req-a252a8f7-29ad-4eef-a0fd-1e7c7b666d0f service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=efef57db-3376-4eb7-83b9-75c45a34667f HTTP/1.1" status: 200 len: 1001 time: 0.1136570 May 25 17:11:39.018565 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3b5ceb45-a022-40a4-a7e9-25f0f871f2db req-556a54b6-357e-4db1-8894-de4d77099da0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:11:39.020886 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-3b5ceb45-a022-40a4-a7e9-25f0f871f2db req-556a54b6-357e-4db1-8894-de4d77099da0 service neutron] 10.222.0.32 "GET /v2.0/subnets?id=4bbae145-74ed-4fda-b7c0-ae77a3202a83 HTTP/1.1" status: 200 len: 849 time: 0.0680907 May 25 17:11:39.097052 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3b5ceb45-a022-40a4-a7e9-25f0f871f2db req-ec84b640-1279-4771-bdd0-e84b2fb16732 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:11:39.098612 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-3b5ceb45-a022-40a4-a7e9-25f0f871f2db req-ec84b640-1279-4771-bdd0-e84b2fb16732 service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=b351598a-3f6f-4a37-8095-8d9371896ccc&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0707154 May 25 17:11:39.236914 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-3b5ceb45-a022-40a4-a7e9-25f0f871f2db req-8c1c72ef-176a-4e30-827c-88a95419aa1b service neutron] 10.222.0.32 "GET /v2.0/networks/b351598a-3f6f-4a37-8095-8d9371896ccc?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1313572 May 25 17:11:39.378761 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-3b5ceb45-a022-40a4-a7e9-25f0f871f2db req-f1625db1-580e-47ae-81ba-84a2bce4395b service neutron] 10.222.0.32 "GET /v2.0/networks/b351598a-3f6f-4a37-8095-8d9371896ccc?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1349831 May 25 17:11:39.472148 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-37e0437b-5377-4a60-bdbd-493eeb2e94f7 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-679979'] for router_interface, before_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:11:39.992505 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.plugins.ml2.plugin [None req-37e0437b-5377-4a60-bdbd-493eeb2e94f7 admin admin] Deleting port 735e7c1b-31b2-48e2-b2b7-538c31dbffb6 {{(pid=91830) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 25 17:11:39.993176 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-37e0437b-5377-4a60-bdbd-493eeb2e94f7 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8757892952899'] for port, before_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:11:40.119431 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.plugins.ml2.db [None req-37e0437b-5377-4a60-bdbd-493eeb2e94f7 admin admin] For port 735e7c1b-31b2-48e2-b2b7-538c31dbffb6, host dv-cinder-790492-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-790492-4-iscsi',level=0,port_id=735e7c1b-31b2-48e2-b2b7-538c31dbffb6,segment=NetworkSegment(a8fb0313-938a-4f5e-8ff4-96df8acd943b),segment_id=a8fb0313-938a-4f5e-8ff4-96df8acd943b)] {{(pid=91830) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 17:11:40.119786 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-37e0437b-5377-4a60-bdbd-493eeb2e94f7 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-683770'] for port, precommit_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:11:40.243429 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-46b4d668-f04d-476b-85e9-ca6d4ad703fa req-da3b15f2-2566-4322-b0f8-26cdc293b719 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:11:40.244060 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.plugins.ml2.plugin [None req-37e0437b-5377-4a60-bdbd-493eeb2e94f7 admin admin] Calling delete_port for 735e7c1b-31b2-48e2-b2b7-538c31dbffb6 owned by network:router_interface {{(pid=91830) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 25 17:11:40.244880 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-46b4d668-f04d-476b-85e9-ca6d4ad703fa req-da3b15f2-2566-4322-b0f8-26cdc293b719 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] 10.222.0.62 "GET /v2.0/ports?device_id=2c1b6af6-e585-417b-8583-2d6739261c16 HTTP/1.1" status: 200 len: 945 time: 0.0835114 May 25 17:11:40.293826 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-46b4d668-f04d-476b-85e9-ca6d4ad703fa req-0a4710cb-f374-4124-b901-03f7aa9cb882 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] 10.222.0.62 "GET /v2.0/security-groups?id=388811ac-c781-471a-a517-2ae8158e9b4a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0429614 May 25 17:11:40.527436 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-37e0437b-5377-4a60-bdbd-493eeb2e94f7 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8757892955046', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8757892520924', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-27483019'] for port, after_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:11:40.530925 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-9b02b2d9-912a-48a3-8db5-d56339cd92ae admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:11:40.578418 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-37e0437b-5377-4a60-bdbd-493eeb2e94f7 admin admin] Pushing event deleted for resources: {'Port': ['ID=735e7c1b-31b2-48e2-b2b7-538c31dbffb6,revision_number=None']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:11:40.619487 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-37e0437b-5377-4a60-bdbd-493eeb2e94f7 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91830) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:11:40.619870 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-37e0437b-5377-4a60-bdbd-493eeb2e94f7 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91830) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:11:40.620240 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-37e0437b-5377-4a60-bdbd-493eeb2e94f7 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91830) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:11:40.620606 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-37e0437b-5377-4a60-bdbd-493eeb2e94f7 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91830) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:11:40.620965 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-37e0437b-5377-4a60-bdbd-493eeb2e94f7 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91830) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:11:40.621326 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-37e0437b-5377-4a60-bdbd-493eeb2e94f7 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91830) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:11:40.621680 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-37e0437b-5377-4a60-bdbd-493eeb2e94f7 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91830) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:11:40.622065 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-37e0437b-5377-4a60-bdbd-493eeb2e94f7 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91830) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:11:40.622422 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-37e0437b-5377-4a60-bdbd-493eeb2e94f7 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91830) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:11:40.622773 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-37e0437b-5377-4a60-bdbd-493eeb2e94f7 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91830) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:11:40.623130 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-37e0437b-5377-4a60-bdbd-493eeb2e94f7 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91830) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:11:40.623477 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-37e0437b-5377-4a60-bdbd-493eeb2e94f7 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91830) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:11:40.652115 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-37e0437b-5377-4a60-bdbd-493eeb2e94f7 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.121s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:11:40.854746 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-37e0437b-5377-4a60-bdbd-493eeb2e94f7 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-551393', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-682171'] for router_interface, after_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:11:41.145833 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.db.agents_db [None req-504cb04f-4543-46c1-8db7-349e21db7634 None None] Agent healthcheck: found 6 active agents {{(pid=91832) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} May 25 17:11:41.310377 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-37e0437b-5377-4a60-bdbd-493eeb2e94f7 admin admin] Router d2ed6ef9-f77a-4b7a-b152-3e1b9c85e1ad has already been hosted by L3 agent a2d427c1-2d07-43e8-afbe-218c9f7d0445 {{(pid=91830) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 25 17:11:41.480111 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-800270c7-5be4-404d-a49c-7ade672341cb req-6a223662-75cc-46fa-93f0-42a4fcf20b6a tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:11:41.481347 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-800270c7-5be4-404d-a49c-7ade672341cb req-6a223662-75cc-46fa-93f0-42a4fcf20b6a tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] 10.222.0.62 "GET /v2.0/ports?device_id=2c1b6af6-e585-417b-8583-2d6739261c16 HTTP/1.1" status: 200 len: 945 time: 0.0788143 May 25 17:11:41.489888 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-37e0437b-5377-4a60-bdbd-493eeb2e94f7 admin admin] Notify agent at l3_agent.dv-cinder-790492-4-iscsi the message routers_updated {{(pid=91830) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 25 17:11:41.498829 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1b3ce750-e86b-4aef-9cf0-f23f1a33f2b6 None None] Sync routers for ids ['d2ed6ef9-f77a-4b7a-b152-3e1b9c85e1ad'] in dv-cinder-790492-4-iscsi {{(pid=91831) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 25 17:11:41.505412 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [None req-37e0437b-5377-4a60-bdbd-493eeb2e94f7 admin admin] 10.222.0.62 "PUT /v2.0/routers/d2ed6ef9-f77a-4b7a-b152-3e1b9c85e1ad/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 2.7683806 May 25 17:11:41.505722 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.wsgi [-] (91829) accepted ('10.222.0.62', 37430) {{(pid=91829) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:11:41.509026 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1b3ce750-e86b-4aef-9cf0-f23f1a33f2b6 None None] Routers {'d2ed6ef9-f77a-4b7a-b152-3e1b9c85e1ad'} bound to L3 agent in host dv-cinder-790492-4-iscsi {{(pid=91831) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 17:11:41.509723 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.l3_hamode_db [None req-1b3ce750-e86b-4aef-9cf0-f23f1a33f2b6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-790492-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-05-25T16:50:28Z,description=,heartbeat_timestamp=2021-05-25T17:11:28Z,host='dv-cinder-790492-4-iscsi',id=a2d427c1-2d07-43e8-afbe-218c9f7d0445,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T16:50:28Z,topic='l3_agent')) {'router_ids': ['d2ed6ef9-f77a-4b7a-b152-3e1b9c85e1ad'], 'active': True} {{(pid=91831) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 17:11:41.606960 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-800270c7-5be4-404d-a49c-7ade672341cb req-11368f4c-b9be-49a0-85ea-71c724e2e86b tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] 10.222.0.62 "GET /v2.0/security-groups?id=388811ac-c781-471a-a517-2ae8158e9b4a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1197011 May 25 17:11:41.697494 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.l3_dvr_db [None req-1b3ce750-e86b-4aef-9cf0-f23f1a33f2b6 None None] Set router d2ed6ef9-f77a-4b7a-b152-3e1b9c85e1ad gateway port host: dv-cinder-790492-4-iscsi {{(pid=91831) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 17:11:41.704544 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-4208a983-6ef4-4395-b425-55e5bcfeeae4 admin admin] Notify callbacks [] for router, before_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:11:41.876702 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-4208a983-6ef4-4395-b425-55e5bcfeeae4 admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:11:41.948163 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.plugins.ml2.plugin [None req-4208a983-6ef4-4395-b425-55e5bcfeeae4 admin admin] Deleting port 3bc942c3-5854-4018-b3fb-5071bf6c70c6 {{(pid=91829) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 25 17:11:41.948502 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-4208a983-6ef4-4395-b425-55e5bcfeeae4 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8757892952899'] for port, before_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:11:41.974536 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.l3_hamode_db [None req-1b3ce750-e86b-4aef-9cf0-f23f1a33f2b6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd2ed6ef9-f77a-4b7a-b152-3e1b9c85e1ad', 'name': 'tempest-AttachVolumeShelveTestJSON-437778030-router', 'tenant_id': 'bbb9e99759bc47d08005f3b1e036a6cf', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'external_fixed_ips': [{'subnet_id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'ip_address': '172.27.2.253'}], 'enable_snat': True}, 'gw_port_id': '3bc942c3-5854-4018-b3fb-5071bf6c70c6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T17:00:14Z', 'updated_at': '2021-05-25T17:11:40Z', 'revision_number': 5, 'project_id': 'bbb9e99759bc47d08005f3b1e036a6cf', 'gw_port': {'id': '3bc942c3-5854-4018-b3fb-5071bf6c70c6', 'name': '', 'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'tenant_id': '', 'mac_address': 'fa:16:3e:da:a2:c4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd2ed6ef9-f77a-4b7a-b152-3e1b9c85e1ad', 'device_owner': 'network:router_gateway', 'standard_attr_id': 294, 'fixed_ips': [{'subnet_id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'ip_address': '172.27.2.253', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790492-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:00:16Z', 'updated_at': '2021-05-25T17:00:27Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-790492-4-iscsi'}], 'dv-cinder-790492-4-iscsi', False) {} {{(pid=91831) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 17:11:41.978449 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1b3ce750-e86b-4aef-9cf0-f23f1a33f2b6 None None] Checking router: d2ed6ef9-f77a-4b7a-b152-3e1b9c85e1ad for host: dv-cinder-790492-4-iscsi {{(pid=91831) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 25 17:11:41.986754 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1b3ce750-e86b-4aef-9cf0-f23f1a33f2b6 None None] Routers {'d2ed6ef9-f77a-4b7a-b152-3e1b9c85e1ad'} bound to L3 agent in host dv-cinder-790492-4-iscsi {{(pid=91831) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 17:11:41.987354 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.l3_hamode_db [None req-1b3ce750-e86b-4aef-9cf0-f23f1a33f2b6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-790492-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-05-25T16:50:28Z,description=,heartbeat_timestamp=2021-05-25T17:11:28Z,host='dv-cinder-790492-4-iscsi',id=a2d427c1-2d07-43e8-afbe-218c9f7d0445,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T16:50:28Z,topic='l3_agent')) {'router_ids': ['d2ed6ef9-f77a-4b7a-b152-3e1b9c85e1ad'], 'active': True} {{(pid=91831) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 17:11:42.144167 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.l3_dvr_db [None req-1b3ce750-e86b-4aef-9cf0-f23f1a33f2b6 None None] Set router d2ed6ef9-f77a-4b7a-b152-3e1b9c85e1ad gateway port host: None {{(pid=91831) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 17:11:42.174871 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.plugins.ml2.db [None req-4208a983-6ef4-4395-b425-55e5bcfeeae4 admin admin] For port 3bc942c3-5854-4018-b3fb-5071bf6c70c6, host dv-cinder-790492-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-790492-4-iscsi',level=0,port_id=3bc942c3-5854-4018-b3fb-5071bf6c70c6,segment=NetworkSegment(414a8468-1d66-4792-9e81-d8ac5ccf1512),segment_id=414a8468-1d66-4792-9e81-d8ac5ccf1512)] {{(pid=91829) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 17:11:42.175261 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-4208a983-6ef4-4395-b425-55e5bcfeeae4 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-683770'] for port, precommit_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:11:42.252905 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.l3_hamode_db [None req-1b3ce750-e86b-4aef-9cf0-f23f1a33f2b6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd2ed6ef9-f77a-4b7a-b152-3e1b9c85e1ad', 'name': 'tempest-AttachVolumeShelveTestJSON-437778030-router', 'tenant_id': 'bbb9e99759bc47d08005f3b1e036a6cf', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T17:00:14Z', 'updated_at': '2021-05-25T17:11:41Z', 'revision_number': 6, 'project_id': 'bbb9e99759bc47d08005f3b1e036a6cf', 'gw_port_host': None}], 'dv-cinder-790492-4-iscsi', False) {} {{(pid=91831) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 17:11:42.257160 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1b3ce750-e86b-4aef-9cf0-f23f1a33f2b6 None None] The sync data for ids ['d2ed6ef9-f77a-4b7a-b152-3e1b9c85e1ad'] in dv-cinder-790492-4-iscsi is: [{'id': 'd2ed6ef9-f77a-4b7a-b152-3e1b9c85e1ad', 'name': 'tempest-AttachVolumeShelveTestJSON-437778030-router', 'tenant_id': 'bbb9e99759bc47d08005f3b1e036a6cf', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T17:00:14Z', 'updated_at': '2021-05-25T17:11:41Z', 'revision_number': 6, 'project_id': 'bbb9e99759bc47d08005f3b1e036a6cf', 'gw_port_host': None}] {{(pid=91831) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 25 17:11:42.300459 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.plugins.ml2.plugin [None req-4208a983-6ef4-4395-b425-55e5bcfeeae4 admin admin] Calling delete_port for 3bc942c3-5854-4018-b3fb-5071bf6c70c6 owned by network:router_gateway {{(pid=91829) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 25 17:11:42.438062 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-4208a983-6ef4-4395-b425-55e5bcfeeae4 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8757892955046', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8757892520924', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28230808'] for port, after_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:11:42.442569 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:11:42.486033 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4208a983-6ef4-4395-b425-55e5bcfeeae4 admin admin] Pushing event deleted for resources: {'Port': ['ID=3bc942c3-5854-4018-b3fb-5071bf6c70c6,revision_number=None']} {{(pid=91829) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:11:42.488625 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-4208a983-6ef4-4395-b425-55e5bcfeeae4 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.046s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:11:42.628333 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-4208a983-6ef4-4395-b425-55e5bcfeeae4 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-683062'] for router_gateway, after_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:11:42.856782 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-4208a983-6ef4-4395-b425-55e5bcfeeae4 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-684987', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-31024'] for router, precommit_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:11:42.862824 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-4208a983-6ef4-4395-b425-55e5bcfeeae4 admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:11:42.903129 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-4208a983-6ef4-4395-b425-55e5bcfeeae4 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-685959'] for router, after_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:11:42.903524 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-4208a983-6ef4-4395-b425-55e5bcfeeae4 admin admin] Fanout notify agent at l3_agent the message router_deleted on router d2ed6ef9-f77a-4b7a-b152-3e1b9c85e1ad {{(pid=91829) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}} May 25 17:11:42.918249 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f546d812-074b-4c7c-ac71-224bb2f342c2 req-f18f9156-faa2-43fd-b479-049c629d2f2b tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:11:42.919675 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-f546d812-074b-4c7c-ac71-224bb2f342c2 req-f18f9156-faa2-43fd-b479-049c629d2f2b tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] 10.222.0.32 "GET /v2.0/ports?device_id=2c1b6af6-e585-417b-8583-2d6739261c16 HTTP/1.1" status: 200 len: 945 time: 0.3529153 May 25 17:11:42.970235 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-39f87247-f77d-4d31-acae-ca85df93c65b req-0b2d6046-7434-4e5c-81a4-470165a84e0c tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:11:42.971547 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-39f87247-f77d-4d31-acae-ca85df93c65b req-0b2d6046-7434-4e5c-81a4-470165a84e0c tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] 10.222.0.62 "GET /v2.0/ports?device_id=2c1b6af6-e585-417b-8583-2d6739261c16 HTTP/1.1" status: 200 len: 945 time: 0.2281415 May 25 17:11:42.979641 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-4208a983-6ef4-4395-b425-55e5bcfeeae4 admin admin] Notify callbacks [] for router, before_response {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:11:42.980709 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [None req-4208a983-6ef4-4395-b425-55e5bcfeeae4 admin admin] 10.222.0.62 "DELETE /v2.0/routers/d2ed6ef9-f77a-4b7a-b152-3e1b9c85e1ad HTTP/1.1" status: 204 len: 168 time: 1.4740527 May 25 17:11:42.983720 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.wsgi [-] (91830) accepted ('10.222.0.62', 37436) {{(pid=91830) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:11:43.046988 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-39f87247-f77d-4d31-acae-ca85df93c65b req-72776474-b071-4a22-9bb5-16a3a0d5af45 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] 10.222.0.62 "GET /v2.0/security-groups?id=388811ac-c781-471a-a517-2ae8158e9b4a&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0651155 May 25 17:11:43.062316 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.db_base_plugin_v2 [None req-579a3494-9093-417d-baa6-7fddb0f1ef83 admin admin] Deleting subnet 6e6b5897-e23d-4281-96cb-a6fdf9b68134 {{(pid=91830) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}} May 25 17:11:43.065496 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-579a3494-9093-417d-baa6-7fddb0f1ef83 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:11:43.121873 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.plugins.ml2.plugin [req-f546d812-074b-4c7c-ac71-224bb2f342c2 req-2c673ebe-2b06-40a3-9818-0d65375007f9 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Deleting port efef57db-3376-4eb7-83b9-75c45a34667f {{(pid=91829) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 25 17:11:43.122356 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [req-f546d812-074b-4c7c-ac71-224bb2f342c2 req-2c673ebe-2b06-40a3-9818-0d65375007f9 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8757892952899'] for port, before_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:11:43.135556 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-579a3494-9093-417d-baa6-7fddb0f1ef83 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-28085025'] for subnet, precommit_delete_associations {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:11:43.226268 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-579a3494-9093-417d-baa6-7fddb0f1ef83 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3856586'] for subnet, precommit_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:11:43.273997 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.plugins.ml2.db [req-f546d812-074b-4c7c-ac71-224bb2f342c2 req-2c673ebe-2b06-40a3-9818-0d65375007f9 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] For port efef57db-3376-4eb7-83b9-75c45a34667f, host hv-cinder-79049, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79049',level=0,port_id=efef57db-3376-4eb7-83b9-75c45a34667f,segment=NetworkSegment(b8ba5240-28ce-40db-a6e6-b4a42435e0b6),segment_id=b8ba5240-28ce-40db-a6e6-b4a42435e0b6)] {{(pid=91829) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 17:11:43.274362 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [req-f546d812-074b-4c7c-ac71-224bb2f342c2 req-2c673ebe-2b06-40a3-9818-0d65375007f9 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-683770'] for port, precommit_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:11:43.487328 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-579a3494-9093-417d-baa6-7fddb0f1ef83 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3857535', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55886', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-28085112', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1152740'] for subnet, after_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:11:43.492160 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-1d10e9ef-9020-45e3-9b32-e13cf29b5ac1 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:11:43.529053 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-579a3494-9093-417d-baa6-7fddb0f1ef83 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-551373'] for subnet, before_response {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:11:43.531557 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-579a3494-9093-417d-baa6-7fddb0f1ef83 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=6e6b5897-e23d-4281-96cb-a6fdf9b68134,revision_number=None']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:11:43.534356 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b47fc41c-9038-439e-889b-ebd0c8b7a0ea None None] Network e5be4c6a-143f-474c-a90b-37180778cefe requested from dv-cinder-790492-4-iscsi {{(pid=91831) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} May 25 17:11:43.534804 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-579a3494-9093-417d-baa6-7fddb0f1ef83 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.042s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:11:43.541592 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [None req-579a3494-9093-417d-baa6-7fddb0f1ef83 admin admin] 10.222.0.62 "DELETE /v2.0/subnets/6e6b5897-e23d-4281-96cb-a6fdf9b68134 HTTP/1.1" status: 204 len: 168 time: 0.5568123 May 25 17:11:43.542225 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.wsgi [-] (91830) accepted ('10.222.0.62', 37440) {{(pid=91830) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:11:43.655330 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-0935f172-8e49-445a-962d-f389193256be admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3867326'] for network, before_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:11:43.691372 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [req-f546d812-074b-4c7c-ac71-224bb2f342c2 req-2c673ebe-2b06-40a3-9818-0d65375007f9 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Notify callbacks [] for floatingip, precommit_update {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:11:43.693016 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [req-f546d812-074b-4c7c-ac71-224bb2f342c2 req-2c673ebe-2b06-40a3-9818-0d65375007f9 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-683033'] for floatingip, after_update {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:11:43.693016 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.db.l3_db [req-f546d812-074b-4c7c-ac71-224bb2f342c2 req-2c673ebe-2b06-40a3-9818-0d65375007f9 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Floating IP d808e4a3-f08f-48d4-9cf7-b6a41597573a disassociated. External IP: 172.27.2.114, port: efef57db-3376-4eb7-83b9-75c45a34667f. May 25 17:11:43.693016 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.plugins.ml2.plugin [req-f546d812-074b-4c7c-ac71-224bb2f342c2 req-2c673ebe-2b06-40a3-9818-0d65375007f9 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Calling delete_port for efef57db-3376-4eb7-83b9-75c45a34667f owned by compute:nova {{(pid=91829) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 25 17:11:43.734621 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.plugins.ml2.plugin [None req-0935f172-8e49-445a-962d-f389193256be admin admin] Deleting port e97f6ad1-cca3-4f59-93f4-fd63428d51f2 {{(pid=91830) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 25 17:11:43.735150 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-0935f172-8e49-445a-962d-f389193256be admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8757892952899'] for port, before_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:11:43.821606 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [req-f546d812-074b-4c7c-ac71-224bb2f342c2 req-2c673ebe-2b06-40a3-9818-0d65375007f9 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8757892955046', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8757892520924', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28230808'] for port, after_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:11:43.827932 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-39147570-64f0-440b-a478-00b6abb26226 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:11:43.845177 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.plugins.ml2.db [None req-0935f172-8e49-445a-962d-f389193256be admin admin] For port e97f6ad1-cca3-4f59-93f4-fd63428d51f2, host dv-cinder-790492-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-790492-4-iscsi',level=0,port_id=e97f6ad1-cca3-4f59-93f4-fd63428d51f2,segment=NetworkSegment(a8fb0313-938a-4f5e-8ff4-96df8acd943b),segment_id=a8fb0313-938a-4f5e-8ff4-96df8acd943b)] {{(pid=91830) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 17:11:43.845900 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-0935f172-8e49-445a-962d-f389193256be admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-683770'] for port, precommit_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:11:43.847210 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-bee0fcf3-c708-48a3-8f17-fbaac5b64195 None None] DHCP port deletion for e5be4c6a-143f-474c-a90b-37180778cefe request from dv-cinder-790492-4-iscsi {{(pid=91831) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} May 25 17:11:43.872642 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2c673ebe-2b06-40a3-9818-0d65375007f9 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Pushing event deleted for resources: {'Port': ['ID=efef57db-3376-4eb7-83b9-75c45a34667f,revision_number=None']} {{(pid=91829) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:11:43.876802 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-2c673ebe-2b06-40a3-9818-0d65375007f9 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.049s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:11:43.917074 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.plugin [None req-bee0fcf3-c708-48a3-8f17-fbaac5b64195 None None] Deleting port e97f6ad1-cca3-4f59-93f4-fd63428d51f2 {{(pid=91831) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 25 17:11:43.917451 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-bee0fcf3-c708-48a3-8f17-fbaac5b64195 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8757892952899'] for port, before_delete {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:11:43.979530 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.plugins.ml2.plugin [None req-0935f172-8e49-445a-962d-f389193256be admin admin] Calling delete_port for e97f6ad1-cca3-4f59-93f4-fd63428d51f2 owned by network:dhcp {{(pid=91830) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 25 17:11:44.014719 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.db [None req-bee0fcf3-c708-48a3-8f17-fbaac5b64195 None None] For port e97f6ad1-cca3-4f59-93f4-fd63428d51f2, host dv-cinder-790492-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-790492-4-iscsi',level=0,port_id=e97f6ad1-cca3-4f59-93f4-fd63428d51f2,segment=NetworkSegment(a8fb0313-938a-4f5e-8ff4-96df8acd943b),segment_id=a8fb0313-938a-4f5e-8ff4-96df8acd943b)] {{(pid=91831) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 17:11:44.015111 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-bee0fcf3-c708-48a3-8f17-fbaac5b64195 None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-683770'] for port, precommit_delete {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:11:44.040788 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-0935f172-8e49-445a-962d-f389193256be admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8757892955046', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8757892520924', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-27483019'] for port, after_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:11:44.044916 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-146df38b-64da-4e53-b6c1-a7086a376d50 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:11:44.096485 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0935f172-8e49-445a-962d-f389193256be admin admin] Pushing event deleted for resources: {'Port': ['ID=e97f6ad1-cca3-4f59-93f4-fd63428d51f2,revision_number=None']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:11:44.100933 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-0935f172-8e49-445a-962d-f389193256be admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.056s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:11:44.101836 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0935f172-8e49-445a-962d-f389193256be admin admin] No DVR routers for this DVR port e97f6ad1-cca3-4f59-93f4-fd63428d51f2 on host dv-cinder-790492-4-iscsi {{(pid=91830) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 25 17:11:44.104534 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.scheduler.l3_agent_scheduler [req-f546d812-074b-4c7c-ac71-224bb2f342c2 req-2c673ebe-2b06-40a3-9818-0d65375007f9 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Router f1e3cf65-0e20-4226-8986-652055868473 has already been hosted by L3 agent a2d427c1-2d07-43e8-afbe-218c9f7d0445 {{(pid=91829) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 25 17:11:44.123096 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.rpc [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Device 735e7c1b-31b2-48e2-b2b7-538c31dbffb6 no longer exists at agent ovs-agent-dv-cinder-790492-4-iscsi {{(pid=91831) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 25 17:11:44.220290 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.plugin [None req-bee0fcf3-c708-48a3-8f17-fbaac5b64195 None None] Calling delete_port for e97f6ad1-cca3-4f59-93f4-fd63428d51f2 owned by network:dhcp {{(pid=91831) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 25 17:11:44.223387 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.plugin [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] No Port match for: 735e7c1b-31b2-48e2-b2b7-538c31dbffb6 {{(pid=91831) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}} May 25 17:11:44.223731 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.rpc [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Device 735e7c1b-31b2-48e2-b2b7-538c31dbffb6 not bound to the agent host dv-cinder-790492-4-iscsi {{(pid=91831) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 25 17:11:44.224147 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.rpc [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Device 3bc942c3-5854-4018-b3fb-5071bf6c70c6 no longer exists at agent ovs-agent-dv-cinder-790492-4-iscsi {{(pid=91831) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 25 17:11:44.255939 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-ba480290-00ca-463b-bb74-84a93b126aa3 req-eee32d74-0d16-4f4a-ae30-925fdf3232e2 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] 10.222.0.62 "GET /v2.0/ports?device_id=2c1b6af6-e585-417b-8583-2d6739261c16 HTTP/1.1" status: 200 len: 210 time: 0.0523744 May 25 17:11:44.261511 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.plugin [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] No Port match for: 3bc942c3-5854-4018-b3fb-5071bf6c70c6 {{(pid=91831) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}} May 25 17:11:44.261865 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.rpc [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Device 3bc942c3-5854-4018-b3fb-5071bf6c70c6 not bound to the agent host dv-cinder-790492-4-iscsi {{(pid=91831) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 25 17:11:44.262324 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.rpc [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Device e97f6ad1-cca3-4f59-93f4-fd63428d51f2 no longer exists at agent ovs-agent-dv-cinder-790492-4-iscsi {{(pid=91831) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 25 17:11:44.319686 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.plugin [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] No Port match for: e97f6ad1-cca3-4f59-93f4-fd63428d51f2 {{(pid=91831) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}} May 25 17:11:44.320044 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.rpc [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Device e97f6ad1-cca3-4f59-93f4-fd63428d51f2 not bound to the agent host dv-cinder-790492-4-iscsi {{(pid=91831) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 25 17:11:44.338914 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-0935f172-8e49-445a-962d-f389193256be admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3858245', 'neutron.services.segments.db._delete_segments_for_network-8757892982492'] for network, precommit_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:11:44.353156 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.services.segments.db [None req-0935f172-8e49-445a-962d-f389193256be admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['e5be4c6a-143f-474c-a90b-37180778cefe']}} {{(pid=91830) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 17:11:44.366381 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.services.segments.db [None req-0935f172-8e49-445a-962d-f389193256be admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'a8fb0313-938a-4f5e-8ff4-96df8acd943b') {'for_net_delete': True} {{(pid=91830) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 17:11:44.366675 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.services.segments.db [None req-0935f172-8e49-445a-962d-f389193256be admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'a8fb0313-938a-4f5e-8ff4-96df8acd943b') {} {{(pid=91830) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 17:11:44.375266 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-f546d812-074b-4c7c-ac71-224bb2f342c2 req-2c673ebe-2b06-40a3-9818-0d65375007f9 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Notify agent at l3_agent.dv-cinder-790492-4-iscsi the message routers_updated {{(pid=91829) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 25 17:11:44.377200 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-bee0fcf3-c708-48a3-8f17-fbaac5b64195 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8757892955046', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8757892520924'] for port, after_delete {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:11:44.384319 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:11:44.384640 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-0935f172-8e49-445a-962d-f389193256be admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8757892991389', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-28085034'] for segment, before_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:11:44.385362 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-354e0517-7a66-47a8-830d-a280f0a03e87 None None] Sync routers for ids ['f1e3cf65-0e20-4226-8986-652055868473'] in dv-cinder-790492-4-iscsi {{(pid=91832) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 25 17:11:44.398630 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.db.l3_dvrscheduler_db [None req-354e0517-7a66-47a8-830d-a280f0a03e87 None None] Routers {'f1e3cf65-0e20-4226-8986-652055868473'} bound to L3 agent in host dv-cinder-790492-4-iscsi {{(pid=91832) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 17:11:44.399940 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.db.l3_hamode_db [None req-354e0517-7a66-47a8-830d-a280f0a03e87 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-790492-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-05-25T16:50:28Z,description=,heartbeat_timestamp=2021-05-25T17:11:28Z,host='dv-cinder-790492-4-iscsi',id=a2d427c1-2d07-43e8-afbe-218c9f7d0445,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T16:50:28Z,topic='l3_agent')) {'router_ids': ['f1e3cf65-0e20-4226-8986-652055868473'], 'active': True} {{(pid=91832) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 17:11:44.403688 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-0935f172-8e49-445a-962d-f389193256be admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3809789'] for segment, precommit_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:11:44.414083 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-0935f172-8e49-445a-962d-f389193256be admin admin] Releasing vlan 695 on physical network physnet1 to pool {{(pid=91830) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 25 17:11:44.415007 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-0935f172-8e49-445a-962d-f389193256be admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3809789', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-27483102'] for segment, after_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:11:44.433980 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bee0fcf3-c708-48a3-8f17-fbaac5b64195 None None] No DVR routers for this DVR port e97f6ad1-cca3-4f59-93f4-fd63428d51f2 on host dv-cinder-790492-4-iscsi {{(pid=91831) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 25 17:11:44.441881 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bee0fcf3-c708-48a3-8f17-fbaac5b64195 None None] Pushing event deleted for resources: {'Port': ['ID=e97f6ad1-cca3-4f59-93f4-fd63428d51f2,revision_number=None']} {{(pid=91831) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:11:44.447963 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [None req-bee0fcf3-c708-48a3-8f17-fbaac5b64195 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.063s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:11:44.503195 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.l3_dvrscheduler_db [req-f546d812-074b-4c7c-ac71-224bb2f342c2 req-2c673ebe-2b06-40a3-9818-0d65375007f9 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] No DVR routers for this DVR port efef57db-3376-4eb7-83b9-75c45a34667f on host hv-cinder-79049 {{(pid=91829) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 25 17:11:44.506397 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [req-f546d812-074b-4c7c-ac71-224bb2f342c2 req-2c673ebe-2b06-40a3-9818-0d65375007f9 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-178712'] for port, before_response {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:11:44.509276 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '2c1b6af6-e585-417b-8583-2d6739261c16', 'name': 'network-vif-deleted', 'tag': 'efef57db-3376-4eb7-83b9-75c45a34667f'}] {{(pid=91829) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 25 17:11:44.510921 dv-cinder-790492-4-iscsi neutron-server[91830]: Traceback (most recent call last): May 25 17:11:44.510921 dv-cinder-790492-4-iscsi neutron-server[91830]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 25 17:11:44.510921 dv-cinder-790492-4-iscsi neutron-server[91830]: timer() May 25 17:11:44.510921 dv-cinder-790492-4-iscsi neutron-server[91830]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 25 17:11:44.510921 dv-cinder-790492-4-iscsi neutron-server[91830]: cb(*args, **kw) May 25 17:11:44.510921 dv-cinder-790492-4-iscsi neutron-server[91830]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper May 25 17:11:44.510921 dv-cinder-790492-4-iscsi neutron-server[91830]: return func(*args, **kwargs) May 25 17:11:44.510921 dv-cinder-790492-4-iscsi neutron-server[91830]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 25 17:11:44.510921 dv-cinder-790492-4-iscsi neutron-server[91830]: self._notify() May 25 17:11:44.510921 dv-cinder-790492-4-iscsi neutron-server[91830]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 25 17:11:44.510921 dv-cinder-790492-4-iscsi neutron-server[91830]: self.callback(batched_events) May 25 17:11:44.510921 dv-cinder-790492-4-iscsi neutron-server[91830]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 25 17:11:44.510921 dv-cinder-790492-4-iscsi neutron-server[91830]: event.method(event) May 25 17:11:44.510921 dv-cinder-790492-4-iscsi neutron-server[91830]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 25 17:11:44.510921 dv-cinder-790492-4-iscsi neutron-server[91830]: aggregate_id = self._get_aggregate_id(event.segment_id) May 25 17:11:44.510921 dv-cinder-790492-4-iscsi neutron-server[91830]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 25 17:11:44.510921 dv-cinder-790492-4-iscsi neutron-server[91830]: aggregate_uuid = self.p_client.list_aggregates( May 25 17:11:44.510921 dv-cinder-790492-4-iscsi neutron-server[91830]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 25 17:11:44.510921 dv-cinder-790492-4-iscsi neutron-server[91830]: return f(self, *a, **k) May 25 17:11:44.510921 dv-cinder-790492-4-iscsi neutron-server[91830]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 25 17:11:44.510921 dv-cinder-790492-4-iscsi neutron-server[91830]: return self._get(url).json() May 25 17:11:44.510921 dv-cinder-790492-4-iscsi neutron-server[91830]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 25 17:11:44.510921 dv-cinder-790492-4-iscsi neutron-server[91830]: return self._client.get(url, endpoint_filter=self._ks_filter, May 25 17:11:44.510921 dv-cinder-790492-4-iscsi neutron-server[91830]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 25 17:11:44.510921 dv-cinder-790492-4-iscsi neutron-server[91830]: return self.request(url, 'GET', **kwargs) May 25 17:11:44.510921 dv-cinder-790492-4-iscsi neutron-server[91830]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 25 17:11:44.510921 dv-cinder-790492-4-iscsi neutron-server[91830]: base_url = self.get_endpoint(auth, allow=allow, May 25 17:11:44.510921 dv-cinder-790492-4-iscsi neutron-server[91830]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 25 17:11:44.510921 dv-cinder-790492-4-iscsi neutron-server[91830]: auth = self._auth_required(auth, 'determine endpoint URL') May 25 17:11:44.510921 dv-cinder-790492-4-iscsi neutron-server[91830]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 25 17:11:44.510921 dv-cinder-790492-4-iscsi neutron-server[91830]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 25 17:11:44.510921 dv-cinder-790492-4-iscsi neutron-server[91830]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 25 17:11:44.532537 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-f546d812-074b-4c7c-ac71-224bb2f342c2 req-2c673ebe-2b06-40a3-9818-0d65375007f9 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] 10.222.0.32 "DELETE /v2.0/ports/efef57db-3376-4eb7-83b9-75c45a34667f HTTP/1.1" status: 204 len: 173 time: 1.6032476 May 25 17:11:44.534909 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-0935f172-8e49-445a-962d-f389193256be admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3858252', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-640806', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-551400', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-683051'] for network, after_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:11:44.543539 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:11:44.569321 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-0935f172-8e49-445a-962d-f389193256be admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-551373'] for network, before_response {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:11:44.569559 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '2c1b6af6-e585-417b-8583-2d6739261c16', 'name': 'network-vif-deleted', 'tag': 'efef57db-3376-4eb7-83b9-75c45a34667f', 'status': 'completed', 'code': 200} May 25 17:11:44.570517 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0935f172-8e49-445a-962d-f389193256be admin admin] Pushing event deleted for resources: {'Network': ['ID=e5be4c6a-143f-474c-a90b-37180778cefe,revision_number=None']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:11:44.573817 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-0935f172-8e49-445a-962d-f389193256be admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.034s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:11:44.582355 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [None req-0935f172-8e49-445a-962d-f389193256be admin admin] 10.222.0.62 "DELETE /v2.0/networks/e5be4c6a-143f-474c-a90b-37180778cefe HTTP/1.1" status: 204 len: 168 time: 1.0391083 May 25 17:11:44.668758 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.db.l3_dvr_db [None req-354e0517-7a66-47a8-830d-a280f0a03e87 None None] Set router f1e3cf65-0e20-4226-8986-652055868473 gateway port host: dv-cinder-790492-4-iscsi {{(pid=91832) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 17:11:44.720212 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.wsgi [-] (91830) accepted ('10.222.0.62', 37452) {{(pid=91830) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:11:44.772364 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [None req-d88bb694-ce18-42f2-a8e4-7f20fdc219d4 admin admin] 10.222.0.62 "GET /v2.0/security-groups?tenant_id=bbb9e99759bc47d08005f3b1e036a6cf&name=default HTTP/1.1" status: 200 len: 2979 time: 0.0508442 May 25 17:11:44.774734 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.wsgi [-] (91830) accepted ('10.222.0.62', 37456) {{(pid=91830) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:11:44.837681 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-328eb12f-de38-451a-882c-05ac91d91362 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:11:44.863201 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-328eb12f-de38-451a-882c-05ac91d91362 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:11:44.918822 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-328eb12f-de38-451a-882c-05ac91d91362 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-640836'] for security_group, after_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:11:44.923574 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-65006d0a-56e5-462f-8c67-631176b0c003 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:11:44.936558 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-328eb12f-de38-451a-882c-05ac91d91362 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=61ec5b7f-e7c8-409c-8549-534927e1a78e,revision_number=None']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:11:44.938907 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-328eb12f-de38-451a-882c-05ac91d91362 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.015s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:11:44.944003 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-328eb12f-de38-451a-882c-05ac91d91362 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:11:44.947470 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [None req-328eb12f-de38-451a-882c-05ac91d91362 admin admin] 10.222.0.62 "DELETE /v2.0/security-groups/61ec5b7f-e7c8-409c-8549-534927e1a78e HTTP/1.1" status: 204 len: 168 time: 0.1694961 May 25 17:11:44.992105 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.db.l3_hamode_db [None req-354e0517-7a66-47a8-830d-a280f0a03e87 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'f1e3cf65-0e20-4226-8986-652055868473', 'name': 'tempest-AttachVolumeTestJSON-312968156-router', 'tenant_id': '70dac097fff04aed99a4976fa955579b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'external_fixed_ips': [{'subnet_id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'ip_address': '172.27.2.63'}], 'enable_snat': True}, 'gw_port_id': 'd0e34ea8-e4eb-48d0-812d-3e5358c5b247', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T17:03:07Z', 'updated_at': '2021-05-25T17:03:12Z', 'revision_number': 4, 'project_id': '70dac097fff04aed99a4976fa955579b', 'gw_port': {'id': 'd0e34ea8-e4eb-48d0-812d-3e5358c5b247', 'name': '', 'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'tenant_id': '', 'mac_address': 'fa:16:3e:be:2a:11', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f1e3cf65-0e20-4226-8986-652055868473', 'device_owner': 'network:router_gateway', 'standard_attr_id': 477, 'fixed_ips': [{'subnet_id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'ip_address': '172.27.2.63', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790492-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:03:08Z', 'updated_at': '2021-05-25T17:03:16Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-790492-4-iscsi', '_interfaces': [{'id': '6561ca57-f5fa-4bba-803c-ac716f98a0fb', 'name': '', 'network_id': 'b351598a-3f6f-4a37-8095-8d9371896ccc', 'tenant_id': '70dac097fff04aed99a4976fa955579b', 'mac_address': 'fa:16:3e:2f:70:71', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f1e3cf65-0e20-4226-8986-652055868473', 'device_owner': 'network:router_interface', 'standard_attr_id': 478, 'fixed_ips': [{'subnet_id': '4bbae145-74ed-4fda-b7c0-ae77a3202a83', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790492-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:03:12Z', 'updated_at': '2021-05-25T17:03:18Z', 'revision_number': 5, 'project_id': '70dac097fff04aed99a4976fa955579b', 'subnets': [{'id': '4bbae145-74ed-4fda-b7c0-ae77a3202a83', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-790492-4-iscsi', False) {} {{(pid=91832) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 17:11:44.995902 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-354e0517-7a66-47a8-830d-a280f0a03e87 None None] Checking router: f1e3cf65-0e20-4226-8986-652055868473 for host: dv-cinder-790492-4-iscsi {{(pid=91832) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 25 17:11:45.004624 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.db.l3_dvrscheduler_db [None req-354e0517-7a66-47a8-830d-a280f0a03e87 None None] Routers {'f1e3cf65-0e20-4226-8986-652055868473'} bound to L3 agent in host dv-cinder-790492-4-iscsi {{(pid=91832) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 17:11:45.005247 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.db.l3_hamode_db [None req-354e0517-7a66-47a8-830d-a280f0a03e87 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-790492-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-05-25T16:50:28Z,description=,heartbeat_timestamp=2021-05-25T17:11:28Z,host='dv-cinder-790492-4-iscsi',id=a2d427c1-2d07-43e8-afbe-218c9f7d0445,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T16:50:28Z,topic='l3_agent')) {'router_ids': ['f1e3cf65-0e20-4226-8986-652055868473'], 'active': True} {{(pid=91832) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 17:11:45.194254 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.db.l3_dvr_db [None req-354e0517-7a66-47a8-830d-a280f0a03e87 None None] Set router f1e3cf65-0e20-4226-8986-652055868473 gateway port host: dv-cinder-790492-4-iscsi {{(pid=91832) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 17:11:45.410879 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.wsgi [-] (91829) accepted ('10.222.0.62', 37474) {{(pid=91829) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:11:45.480519 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-bf838e2e-5f69-4990-8c1b-8dbf7cc1b62a tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Notify callbacks [] for security_group, before_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:11:45.510588 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-bf838e2e-5f69-4990-8c1b-8dbf7cc1b62a tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Notify callbacks [] for security_group, precommit_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:11:45.514028 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.db.l3_hamode_db [None req-354e0517-7a66-47a8-830d-a280f0a03e87 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'f1e3cf65-0e20-4226-8986-652055868473', 'name': 'tempest-AttachVolumeTestJSON-312968156-router', 'tenant_id': '70dac097fff04aed99a4976fa955579b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'external_fixed_ips': [{'subnet_id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'ip_address': '172.27.2.63'}], 'enable_snat': True}, 'gw_port_id': 'd0e34ea8-e4eb-48d0-812d-3e5358c5b247', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T17:03:07Z', 'updated_at': '2021-05-25T17:03:12Z', 'revision_number': 4, 'project_id': '70dac097fff04aed99a4976fa955579b', 'gw_port': {'id': 'd0e34ea8-e4eb-48d0-812d-3e5358c5b247', 'name': '', 'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'tenant_id': '', 'mac_address': 'fa:16:3e:be:2a:11', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f1e3cf65-0e20-4226-8986-652055868473', 'device_owner': 'network:router_gateway', 'standard_attr_id': 477, 'fixed_ips': [{'subnet_id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'ip_address': '172.27.2.63', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790492-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:03:08Z', 'updated_at': '2021-05-25T17:03:16Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-790492-4-iscsi', '_interfaces': [{'id': '6561ca57-f5fa-4bba-803c-ac716f98a0fb', 'name': '', 'network_id': 'b351598a-3f6f-4a37-8095-8d9371896ccc', 'tenant_id': '70dac097fff04aed99a4976fa955579b', 'mac_address': 'fa:16:3e:2f:70:71', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f1e3cf65-0e20-4226-8986-652055868473', 'device_owner': 'network:router_interface', 'standard_attr_id': 478, 'fixed_ips': [{'subnet_id': '4bbae145-74ed-4fda-b7c0-ae77a3202a83', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790492-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:03:12Z', 'updated_at': '2021-05-25T17:03:18Z', 'revision_number': 5, 'project_id': '70dac097fff04aed99a4976fa955579b', 'subnets': [{'id': '4bbae145-74ed-4fda-b7c0-ae77a3202a83', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-790492-4-iscsi', False) {} {{(pid=91832) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 17:11:45.517853 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-354e0517-7a66-47a8-830d-a280f0a03e87 None None] The sync data for ids ['f1e3cf65-0e20-4226-8986-652055868473'] in dv-cinder-790492-4-iscsi is: [{'id': 'f1e3cf65-0e20-4226-8986-652055868473', 'name': 'tempest-AttachVolumeTestJSON-312968156-router', 'tenant_id': '70dac097fff04aed99a4976fa955579b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'external_fixed_ips': [{'subnet_id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'ip_address': '172.27.2.63'}], 'enable_snat': True}, 'gw_port_id': 'd0e34ea8-e4eb-48d0-812d-3e5358c5b247', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T17:03:07Z', 'updated_at': '2021-05-25T17:03:12Z', 'revision_number': 4, 'project_id': '70dac097fff04aed99a4976fa955579b', 'gw_port': {'id': 'd0e34ea8-e4eb-48d0-812d-3e5358c5b247', 'name': '', 'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'tenant_id': '', 'mac_address': 'fa:16:3e:be:2a:11', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f1e3cf65-0e20-4226-8986-652055868473', 'device_owner': 'network:router_gateway', 'standard_attr_id': 477, 'fixed_ips': [{'subnet_id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'ip_address': '172.27.2.63', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790492-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:03:08Z', 'updated_at': '2021-05-25T17:03:16Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-790492-4-iscsi', '_interfaces': [{'id': '6561ca57-f5fa-4bba-803c-ac716f98a0fb', 'name': '', 'network_id': 'b351598a-3f6f-4a37-8095-8d9371896ccc', 'tenant_id': '70dac097fff04aed99a4976fa955579b', 'mac_address': 'fa:16:3e:2f:70:71', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f1e3cf65-0e20-4226-8986-652055868473', 'device_owner': 'network:router_interface', 'standard_attr_id': 478, 'fixed_ips': [{'subnet_id': '4bbae145-74ed-4fda-b7c0-ae77a3202a83', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790492-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:03:12Z', 'updated_at': '2021-05-25T17:03:18Z', 'revision_number': 5, 'project_id': '70dac097fff04aed99a4976fa955579b', 'subnets': [{'id': '4bbae145-74ed-4fda-b7c0-ae77a3202a83', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=91832) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 25 17:11:45.576948 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-bf838e2e-5f69-4990-8c1b-8dbf7cc1b62a tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-640836'] for security_group, after_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:11:45.582969 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-097be494-e01f-41b4-83f1-8d2162c5d575 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:11:45.599786 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf838e2e-5f69-4990-8c1b-8dbf7cc1b62a tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=388811ac-c781-471a-a517-2ae8158e9b4a,revision_number=None']} {{(pid=91829) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:11:45.603319 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-bf838e2e-5f69-4990-8c1b-8dbf7cc1b62a tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.021s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:11:45.611832 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-bf838e2e-5f69-4990-8c1b-8dbf7cc1b62a tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Notify callbacks [] for security_group, before_response {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:11:45.613078 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [None req-bf838e2e-5f69-4990-8c1b-8dbf7cc1b62a tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] 10.222.0.62 "DELETE /v2.0/security-groups/388811ac-c781-471a-a517-2ae8158e9b4a HTTP/1.1" status: 204 len: 168 time: 0.2012122 May 25 17:11:45.615881 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.wsgi [-] (91829) accepted ('10.222.0.62', 37484) {{(pid=91829) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:11:45.637153 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.api.v2.resource [None req-8e04ed38-e4f6-424b-b1b4-fb939b1adda7 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] show failed (client error): The resource could not be found. May 25 17:11:45.638536 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [None req-8e04ed38-e4f6-424b-b1b4-fb939b1adda7 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] 10.222.0.62 "GET /v2.0/security-groups/388811ac-c781-471a-a517-2ae8158e9b4a HTTP/1.1" status: 404 len: 347 time: 0.0217669 May 25 17:11:45.641367 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.wsgi [-] (91829) accepted ('10.222.0.62', 37490) {{(pid=91829) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:11:45.782380 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ad851d21-6b21-495b-8abd-05b8fcc744f1 None None] New status for floating IP d808e4a3-f08f-48d4-9cf7-b6a41597573a: DOWN {{(pid=91831) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} May 25 17:11:45.870936 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.plugins.ml2.plugin [None req-115444b7-d7a0-4fcc-b940-ac0e95605b67 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Deleting port c3a854e5-7742-4a38-807f-bdcb08805240 {{(pid=91829) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 25 17:11:45.871290 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-115444b7-d7a0-4fcc-b940-ac0e95605b67 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8757892952899'] for port, before_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:11:46.003688 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-115444b7-d7a0-4fcc-b940-ac0e95605b67 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-683770'] for port, precommit_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:11:46.004100 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-115444b7-d7a0-4fcc-b940-ac0e95605b67 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:11:46.136325 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.plugins.ml2.plugin [None req-115444b7-d7a0-4fcc-b940-ac0e95605b67 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Calling delete_port for c3a854e5-7742-4a38-807f-bdcb08805240 owned by network:floatingip {{(pid=91829) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 25 17:11:46.247283 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-115444b7-d7a0-4fcc-b940-ac0e95605b67 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8757892955046', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8757892520924', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28230808'] for port, after_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:11:46.251052 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-8237fa25-e7a9-42a8-a6c5-7c6ac670ef33 tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:11:46.292635 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-115444b7-d7a0-4fcc-b940-ac0e95605b67 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Pushing event deleted for resources: {'Port': ['ID=c3a854e5-7742-4a38-807f-bdcb08805240,revision_number=None']} {{(pid=91829) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:11:46.296232 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-115444b7-d7a0-4fcc-b940-ac0e95605b67 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.045s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:11:46.486121 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-115444b7-d7a0-4fcc-b940-ac0e95605b67 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Notify callbacks [] for floatingip, after_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:11:46.499638 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-115444b7-d7a0-4fcc-b940-ac0e95605b67 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-178712'] for floatingip, before_response {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:11:46.503575 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [None req-115444b7-d7a0-4fcc-b940-ac0e95605b67 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] 10.222.0.62 "DELETE /v2.0/floatingips/d808e4a3-f08f-48d4-9cf7-b6a41597573a HTTP/1.1" status: 204 len: 168 time: 0.8585207 May 25 17:11:46.687811 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.wsgi [-] (91829) accepted ('10.222.0.62', 37518) {{(pid=91829) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:11:46.803429 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-82fa8911-86a6-4477-acdc-2f9a865716e1 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:11:46.818420 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.quota.driver [None req-82fa8911-86a6-4477-acdc-2f9a865716e1 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91829) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 17:11:46.822247 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.quota.resource [None req-82fa8911-86a6-4477-acdc-2f9a865716e1 admin admin] Usage tracker for resource:security_group_rule and tenant:b5dc3b6aece94fe8b01e964faaec6cd7 is out of sync, need to count used quota {{(pid=91829) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 17:11:46.825085 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.quota.resource [None req-82fa8911-86a6-4477-acdc-2f9a865716e1 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91829) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 17:11:46.830704 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.quota.driver [None req-82fa8911-86a6-4477-acdc-2f9a865716e1 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91829) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 17:11:46.913473 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-82fa8911-86a6-4477-acdc-2f9a865716e1 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:11:46.917005 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-82fa8911-86a6-4477-acdc-2f9a865716e1 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-640836'] for security_group, after_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:11:46.925647 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-e09f82d9-6a65-47c8-a32f-7d33de56463b tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:11:46.967557 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [None req-82fa8911-86a6-4477-acdc-2f9a865716e1 admin admin] 10.222.0.62 "GET /v2.0/security-groups?tenant_id=b5dc3b6aece94fe8b01e964faaec6cd7&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2784615 May 25 17:11:46.968482 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-82fa8911-86a6-4477-acdc-2f9a865716e1 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=995cf275-2d03-4338-bfba-7a6386041aff,revision_number=1']} {{(pid=91829) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:11:46.970958 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.wsgi [-] (91830) accepted ('10.222.0.62', 37524) {{(pid=91830) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:11:46.971441 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-82fa8911-86a6-4477-acdc-2f9a865716e1 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.046s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:11:47.033126 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-48f41fb5-04c3-41ff-83ae-1b00f0538f34 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:11:47.062005 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-48f41fb5-04c3-41ff-83ae-1b00f0538f34 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:11:47.113516 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-48f41fb5-04c3-41ff-83ae-1b00f0538f34 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-640836'] for security_group, after_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:11:47.117107 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-deb58874-c29a-42e4-a2ef-29435e4a2ec2 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:11:47.131259 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-48f41fb5-04c3-41ff-83ae-1b00f0538f34 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=995cf275-2d03-4338-bfba-7a6386041aff,revision_number=None']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:11:47.135062 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-48f41fb5-04c3-41ff-83ae-1b00f0538f34 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.018s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:11:47.139327 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-48f41fb5-04c3-41ff-83ae-1b00f0538f34 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:11:47.140721 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [None req-48f41fb5-04c3-41ff-83ae-1b00f0538f34 admin admin] 10.222.0.62 "DELETE /v2.0/security-groups/995cf275-2d03-4338-bfba-7a6386041aff HTTP/1.1" status: 204 len: 168 time: 0.1676853 May 25 17:11:47.155468 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.rpc [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Device efef57db-3376-4eb7-83b9-75c45a34667f no longer exists at agent hyperv_hv-cinder-79049 {{(pid=91831) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 25 17:11:47.190548 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.plugin [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] No Port match for: efef57db-3376-4eb7-83b9-75c45a34667f {{(pid=91831) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}} May 25 17:11:47.190894 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.rpc [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Device efef57db-3376-4eb7-83b9-75c45a34667f not bound to the agent host hv-cinder-79049 {{(pid=91831) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 25 17:11:47.422757 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.wsgi [-] (91830) accepted ('10.222.0.62', 37532) {{(pid=91830) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:11:47.441428 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-9a362923-ea01-4d10-b99c-6a40fa6fd0dd admin admin] Notify callbacks [] for security_group, before_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:11:47.458365 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.quota.driver [None req-9a362923-ea01-4d10-b99c-6a40fa6fd0dd admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91830) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 17:11:47.462253 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [None req-9a362923-ea01-4d10-b99c-6a40fa6fd0dd admin admin] Usage tracker for resource:security_group_rule and tenant:fc9310572f274e85abfb91941e332e5a is out of sync, need to count used quota {{(pid=91830) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 17:11:47.465057 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [None req-9a362923-ea01-4d10-b99c-6a40fa6fd0dd admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91830) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 17:11:47.470870 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.quota.driver [None req-9a362923-ea01-4d10-b99c-6a40fa6fd0dd admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91830) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 17:11:47.552206 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-9a362923-ea01-4d10-b99c-6a40fa6fd0dd admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:11:47.555990 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-9a362923-ea01-4d10-b99c-6a40fa6fd0dd admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-640836'] for security_group, after_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:11:47.564010 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-a6bdf409-711a-4746-84a2-516ea30594c6 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:11:47.603514 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [None req-9a362923-ea01-4d10-b99c-6a40fa6fd0dd admin admin] 10.222.0.62 "GET /v2.0/security-groups?tenant_id=fc9310572f274e85abfb91941e332e5a&name=default HTTP/1.1" status: 200 len: 2979 time: 0.1796830 May 25 17:11:47.605201 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9a362923-ea01-4d10-b99c-6a40fa6fd0dd admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=fe128495-8ff2-4aff-9962-4fbdc7debe4e,revision_number=1']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:11:47.606646 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.wsgi [-] (91829) accepted ('10.222.0.62', 37536) {{(pid=91829) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:11:47.608330 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-9a362923-ea01-4d10-b99c-6a40fa6fd0dd admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.044s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:11:47.671971 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-d916400d-dcd1-413f-93c4-8079b5898301 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:11:47.697046 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-d916400d-dcd1-413f-93c4-8079b5898301 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:11:47.750399 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-d916400d-dcd1-413f-93c4-8079b5898301 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-640836'] for security_group, after_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:11:47.755428 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-b6d5efd3-68c2-46c8-9870-223580602311 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:11:47.767393 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d916400d-dcd1-413f-93c4-8079b5898301 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=fe128495-8ff2-4aff-9962-4fbdc7debe4e,revision_number=None']} {{(pid=91829) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:11:47.770760 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-d916400d-dcd1-413f-93c4-8079b5898301 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.015s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:11:47.778441 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-d916400d-dcd1-413f-93c4-8079b5898301 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:11:47.779825 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [None req-d916400d-dcd1-413f-93c4-8079b5898301 admin admin] 10.222.0.62 "DELETE /v2.0/security-groups/fe128495-8ff2-4aff-9962-4fbdc7debe4e HTTP/1.1" status: 204 len: 168 time: 0.1721172 May 25 17:11:50.572114 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.wsgi [-] (91829) accepted ('10.222.0.62', 37680) {{(pid=91829) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:11:51.000551 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.wsgi [-] (91830) accepted ('10.222.0.62', 37700) {{(pid=91830) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:11:51.119260 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-c02a2973-60c7-4475-b7f3-23c1823288a4 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:11:51.133823 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.quota.driver [None req-c02a2973-60c7-4475-b7f3-23c1823288a4 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91830) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 17:11:51.137601 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [None req-c02a2973-60c7-4475-b7f3-23c1823288a4 admin admin] Usage tracker for resource:security_group_rule and tenant:779ff67fe9fb49a6ad8fa1b7e9c56088 is out of sync, need to count used quota {{(pid=91830) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 17:11:51.140380 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [None req-c02a2973-60c7-4475-b7f3-23c1823288a4 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91830) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 17:11:51.146602 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.quota.driver [None req-c02a2973-60c7-4475-b7f3-23c1823288a4 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91830) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 17:11:51.229867 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-c02a2973-60c7-4475-b7f3-23c1823288a4 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:11:51.234268 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-c02a2973-60c7-4475-b7f3-23c1823288a4 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-640836'] for security_group, after_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:11:51.246435 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-bbd78dfd-6772-4d2e-9534-2ecc1ec6d31d admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:11:51.285972 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [None req-c02a2973-60c7-4475-b7f3-23c1823288a4 admin admin] 10.222.0.62 "GET /v2.0/security-groups?tenant_id=779ff67fe9fb49a6ad8fa1b7e9c56088&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2842939 May 25 17:11:51.287633 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c02a2973-60c7-4475-b7f3-23c1823288a4 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=45df4e9a-f1c9-4de7-a6a2-9f41a5738ebe,revision_number=1']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:11:51.289930 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.wsgi [-] (91830) accepted ('10.222.0.62', 37706) {{(pid=91830) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:11:51.290435 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-6c8f7318-dd65-4c6e-890e-d09277438530 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-679979'] for router_interface, before_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:11:51.292711 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-c02a2973-60c7-4475-b7f3-23c1823288a4 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.046s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:11:51.349874 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-55bef877-72b7-41dd-ae68-f526f610c8ab admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:11:51.375566 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-55bef877-72b7-41dd-ae68-f526f610c8ab admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:11:51.427108 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-55bef877-72b7-41dd-ae68-f526f610c8ab admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-640836'] for security_group, after_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:11:51.432081 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-4addf58e-a8f2-4693-aef1-f5fd4d672848 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:11:51.446490 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-55bef877-72b7-41dd-ae68-f526f610c8ab admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=45df4e9a-f1c9-4de7-a6a2-9f41a5738ebe,revision_number=None']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:11:51.449415 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-55bef877-72b7-41dd-ae68-f526f610c8ab admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.017s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:11:51.454450 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-55bef877-72b7-41dd-ae68-f526f610c8ab admin admin] Notify callbacks [] for security_group, before_response {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:11:51.457647 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [None req-55bef877-72b7-41dd-ae68-f526f610c8ab admin admin] 10.222.0.62 "DELETE /v2.0/security-groups/45df4e9a-f1c9-4de7-a6a2-9f41a5738ebe HTTP/1.1" status: 204 len: 168 time: 0.1667867 May 25 17:11:51.716365 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.plugins.ml2.plugin [None req-6c8f7318-dd65-4c6e-890e-d09277438530 admin admin] Deleting port 6561ca57-f5fa-4bba-803c-ac716f98a0fb {{(pid=91829) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 25 17:11:51.716911 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-6c8f7318-dd65-4c6e-890e-d09277438530 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8757892952899'] for port, before_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:11:51.740629 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.wsgi [-] (91830) accepted ('10.222.0.62', 37714) {{(pid=91830) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:11:51.758591 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-eee219aa-ce8c-4f75-b85e-7560049da413 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:11:51.773648 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.quota.driver [None req-eee219aa-ce8c-4f75-b85e-7560049da413 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91830) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 17:11:51.778777 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [None req-eee219aa-ce8c-4f75-b85e-7560049da413 admin admin] Usage tracker for resource:security_group_rule and tenant:42c6322d69f64b7cbebf6e42303a0c36 is out of sync, need to count used quota {{(pid=91830) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 17:11:51.781573 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [None req-eee219aa-ce8c-4f75-b85e-7560049da413 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91830) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 17:11:51.787269 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.quota.driver [None req-eee219aa-ce8c-4f75-b85e-7560049da413 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91830) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 17:11:51.836441 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.plugins.ml2.db [None req-6c8f7318-dd65-4c6e-890e-d09277438530 admin admin] For port 6561ca57-f5fa-4bba-803c-ac716f98a0fb, host dv-cinder-790492-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-790492-4-iscsi',level=0,port_id=6561ca57-f5fa-4bba-803c-ac716f98a0fb,segment=NetworkSegment(b8ba5240-28ce-40db-a6e6-b4a42435e0b6),segment_id=b8ba5240-28ce-40db-a6e6-b4a42435e0b6)] {{(pid=91829) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 17:11:51.836825 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-6c8f7318-dd65-4c6e-890e-d09277438530 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-683770'] for port, precommit_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:11:51.874024 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-eee219aa-ce8c-4f75-b85e-7560049da413 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:11:51.877638 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-eee219aa-ce8c-4f75-b85e-7560049da413 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-640836'] for security_group, after_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:11:51.885129 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-78a114a0-2333-413d-a2dc-177cccc3d0f8 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:11:51.929250 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eee219aa-ce8c-4f75-b85e-7560049da413 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=f4ad31f7-57f3-4c7b-9ed3-c8209fba899b,revision_number=1']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:11:51.933659 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [None req-eee219aa-ce8c-4f75-b85e-7560049da413 admin admin] 10.222.0.62 "GET /v2.0/security-groups?tenant_id=42c6322d69f64b7cbebf6e42303a0c36&name=default HTTP/1.1" status: 200 len: 2979 time: 0.1919820 May 25 17:11:51.934634 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-eee219aa-ce8c-4f75-b85e-7560049da413 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.050s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:11:51.936286 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.wsgi [-] (91830) accepted ('10.222.0.62', 37718) {{(pid=91830) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:11:52.003033 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-e40fe5a2-30a8-4b58-878f-3e7b748af96a admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:11:52.031967 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-e40fe5a2-30a8-4b58-878f-3e7b748af96a admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:11:52.070043 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.plugins.ml2.plugin [None req-6c8f7318-dd65-4c6e-890e-d09277438530 admin admin] Calling delete_port for 6561ca57-f5fa-4bba-803c-ac716f98a0fb owned by network:router_interface {{(pid=91829) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 25 17:11:52.085427 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-e40fe5a2-30a8-4b58-878f-3e7b748af96a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-640836'] for security_group, after_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:11:52.090339 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-328eb12f-de38-451a-882c-05ac91d91362 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:11:52.102927 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e40fe5a2-30a8-4b58-878f-3e7b748af96a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=f4ad31f7-57f3-4c7b-9ed3-c8209fba899b,revision_number=None']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:11:52.105845 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-e40fe5a2-30a8-4b58-878f-3e7b748af96a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.016s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:11:52.107070 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-e40fe5a2-30a8-4b58-878f-3e7b748af96a admin admin] Notify callbacks [] for security_group, before_response {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:11:52.108145 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [None req-e40fe5a2-30a8-4b58-878f-3e7b748af96a admin admin] 10.222.0.62 "DELETE /v2.0/security-groups/f4ad31f7-57f3-4c7b-9ed3-c8209fba899b HTTP/1.1" status: 204 len: 168 time: 0.1709797 May 25 17:11:52.227041 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-6c8f7318-dd65-4c6e-890e-d09277438530 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8757892955046', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8757892520924', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28230808'] for port, after_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:11:52.232544 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-81a851f4-d95e-4ce6-b494-26edcd907e37 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:11:52.278723 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6c8f7318-dd65-4c6e-890e-d09277438530 admin admin] Pushing event deleted for resources: {'Port': ['ID=6561ca57-f5fa-4bba-803c-ac716f98a0fb,revision_number=None']} {{(pid=91829) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:11:52.280886 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-6c8f7318-dd65-4c6e-890e-d09277438530 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.049s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:11:52.553398 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-6c8f7318-dd65-4c6e-890e-d09277438530 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-551393', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-682171'] for router_interface, after_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:11:52.919207 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-6c8f7318-dd65-4c6e-890e-d09277438530 admin admin] Router f1e3cf65-0e20-4226-8986-652055868473 has already been hosted by L3 agent a2d427c1-2d07-43e8-afbe-218c9f7d0445 {{(pid=91829) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 25 17:11:53.098829 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-6c8f7318-dd65-4c6e-890e-d09277438530 admin admin] Notify agent at l3_agent.dv-cinder-790492-4-iscsi the message routers_updated {{(pid=91829) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 25 17:11:53.107005 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b4cc4d5a-a873-4b69-9ff2-b161c4e42f66 None None] Sync routers for ids ['f1e3cf65-0e20-4226-8986-652055868473'] in dv-cinder-790492-4-iscsi {{(pid=91832) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 25 17:11:53.114431 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [None req-6c8f7318-dd65-4c6e-890e-d09277438530 admin admin] 10.222.0.62 "PUT /v2.0/routers/f1e3cf65-0e20-4226-8986-652055868473/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 2.5389431 May 25 17:11:53.114824 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.wsgi [-] (91830) accepted ('10.222.0.62', 37748) {{(pid=91830) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:11:53.117353 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b4cc4d5a-a873-4b69-9ff2-b161c4e42f66 None None] Routers {'f1e3cf65-0e20-4226-8986-652055868473'} bound to L3 agent in host dv-cinder-790492-4-iscsi {{(pid=91832) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 17:11:53.118033 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.db.l3_hamode_db [None req-b4cc4d5a-a873-4b69-9ff2-b161c4e42f66 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-790492-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-05-25T16:50:28Z,description=,heartbeat_timestamp=2021-05-25T17:11:28Z,host='dv-cinder-790492-4-iscsi',id=a2d427c1-2d07-43e8-afbe-218c9f7d0445,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T16:50:28Z,topic='l3_agent')) {'router_ids': ['f1e3cf65-0e20-4226-8986-652055868473'], 'active': True} {{(pid=91832) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 17:11:53.297270 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-a63216ef-009a-43b8-9f43-a6c151337bad admin admin] Notify callbacks [] for router, before_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:11:53.309439 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.db.l3_dvr_db [None req-b4cc4d5a-a873-4b69-9ff2-b161c4e42f66 None None] Set router f1e3cf65-0e20-4226-8986-652055868473 gateway port host: dv-cinder-790492-4-iscsi {{(pid=91832) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 17:11:53.480292 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-a63216ef-009a-43b8-9f43-a6c151337bad admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:11:53.554666 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.plugins.ml2.plugin [None req-a63216ef-009a-43b8-9f43-a6c151337bad admin admin] Deleting port d0e34ea8-e4eb-48d0-812d-3e5358c5b247 {{(pid=91830) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 25 17:11:53.555280 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-a63216ef-009a-43b8-9f43-a6c151337bad admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8757892952899'] for port, before_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:11:53.631437 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.db.l3_hamode_db [None req-b4cc4d5a-a873-4b69-9ff2-b161c4e42f66 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'f1e3cf65-0e20-4226-8986-652055868473', 'name': 'tempest-AttachVolumeTestJSON-312968156-router', 'tenant_id': '70dac097fff04aed99a4976fa955579b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'external_fixed_ips': [{'subnet_id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'ip_address': '172.27.2.63'}], 'enable_snat': True}, 'gw_port_id': 'd0e34ea8-e4eb-48d0-812d-3e5358c5b247', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T17:03:07Z', 'updated_at': '2021-05-25T17:11:52Z', 'revision_number': 5, 'project_id': '70dac097fff04aed99a4976fa955579b', 'gw_port': {'id': 'd0e34ea8-e4eb-48d0-812d-3e5358c5b247', 'name': '', 'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'tenant_id': '', 'mac_address': 'fa:16:3e:be:2a:11', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f1e3cf65-0e20-4226-8986-652055868473', 'device_owner': 'network:router_gateway', 'standard_attr_id': 477, 'fixed_ips': [{'subnet_id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'ip_address': '172.27.2.63', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790492-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:03:08Z', 'updated_at': '2021-05-25T17:03:16Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-790492-4-iscsi'}], 'dv-cinder-790492-4-iscsi', False) {} {{(pid=91832) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 17:11:53.635370 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b4cc4d5a-a873-4b69-9ff2-b161c4e42f66 None None] Checking router: f1e3cf65-0e20-4226-8986-652055868473 for host: dv-cinder-790492-4-iscsi {{(pid=91832) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 25 17:11:53.643678 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b4cc4d5a-a873-4b69-9ff2-b161c4e42f66 None None] Routers {'f1e3cf65-0e20-4226-8986-652055868473'} bound to L3 agent in host dv-cinder-790492-4-iscsi {{(pid=91832) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 17:11:53.644299 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.db.l3_hamode_db [None req-b4cc4d5a-a873-4b69-9ff2-b161c4e42f66 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-790492-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-05-25T16:50:28Z,description=,heartbeat_timestamp=2021-05-25T17:11:28Z,host='dv-cinder-790492-4-iscsi',id=a2d427c1-2d07-43e8-afbe-218c9f7d0445,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T16:50:28Z,topic='l3_agent')) {'router_ids': ['f1e3cf65-0e20-4226-8986-652055868473'], 'active': True} {{(pid=91832) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 17:11:53.688951 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.plugins.ml2.db [None req-a63216ef-009a-43b8-9f43-a6c151337bad admin admin] For port d0e34ea8-e4eb-48d0-812d-3e5358c5b247, host dv-cinder-790492-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-790492-4-iscsi',level=0,port_id=d0e34ea8-e4eb-48d0-812d-3e5358c5b247,segment=NetworkSegment(414a8468-1d66-4792-9e81-d8ac5ccf1512),segment_id=414a8468-1d66-4792-9e81-d8ac5ccf1512)] {{(pid=91830) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 17:11:53.689429 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-a63216ef-009a-43b8-9f43-a6c151337bad admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-683770'] for port, precommit_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:11:53.800251 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.db.l3_dvr_db [None req-b4cc4d5a-a873-4b69-9ff2-b161c4e42f66 None None] Set router f1e3cf65-0e20-4226-8986-652055868473 gateway port host: None {{(pid=91832) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 17:11:53.907689 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.db.l3_hamode_db [None req-b4cc4d5a-a873-4b69-9ff2-b161c4e42f66 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'f1e3cf65-0e20-4226-8986-652055868473', 'name': 'tempest-AttachVolumeTestJSON-312968156-router', 'tenant_id': '70dac097fff04aed99a4976fa955579b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T17:03:07Z', 'updated_at': '2021-05-25T17:11:53Z', 'revision_number': 6, 'project_id': '70dac097fff04aed99a4976fa955579b', 'gw_port_host': None}], 'dv-cinder-790492-4-iscsi', False) {} {{(pid=91832) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 17:11:53.912239 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b4cc4d5a-a873-4b69-9ff2-b161c4e42f66 None None] The sync data for ids ['f1e3cf65-0e20-4226-8986-652055868473'] in dv-cinder-790492-4-iscsi is: [{'id': 'f1e3cf65-0e20-4226-8986-652055868473', 'name': 'tempest-AttachVolumeTestJSON-312968156-router', 'tenant_id': '70dac097fff04aed99a4976fa955579b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T17:03:07Z', 'updated_at': '2021-05-25T17:11:53Z', 'revision_number': 6, 'project_id': '70dac097fff04aed99a4976fa955579b', 'gw_port_host': None}] {{(pid=91832) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 25 17:11:53.926016 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.plugins.ml2.plugin [None req-a63216ef-009a-43b8-9f43-a6c151337bad admin admin] Calling delete_port for d0e34ea8-e4eb-48d0-812d-3e5358c5b247 owned by network:router_gateway {{(pid=91830) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 25 17:11:54.071999 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-a63216ef-009a-43b8-9f43-a6c151337bad admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8757892955046', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8757892520924', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-27483019'] for port, after_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:11:54.076978 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-fe569bd0-4673-4308-99d9-afc2ff7aafe3 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:11:54.122694 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a63216ef-009a-43b8-9f43-a6c151337bad admin admin] Pushing event deleted for resources: {'Port': ['ID=d0e34ea8-e4eb-48d0-812d-3e5358c5b247,revision_number=None']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:11:54.125742 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-a63216ef-009a-43b8-9f43-a6c151337bad admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.049s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:11:54.218909 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-a63216ef-009a-43b8-9f43-a6c151337bad admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-683062'] for router_gateway, after_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:11:54.418412 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.rpc [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Device 6561ca57-f5fa-4bba-803c-ac716f98a0fb no longer exists at agent ovs-agent-dv-cinder-790492-4-iscsi {{(pid=91831) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 25 17:11:54.429949 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-a63216ef-009a-43b8-9f43-a6c151337bad admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-684987', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-31024'] for router, precommit_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:11:54.432240 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-a63216ef-009a-43b8-9f43-a6c151337bad admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:11:54.454408 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.plugin [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] No Port match for: 6561ca57-f5fa-4bba-803c-ac716f98a0fb {{(pid=91831) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}} May 25 17:11:54.454734 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.rpc [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Device 6561ca57-f5fa-4bba-803c-ac716f98a0fb not bound to the agent host dv-cinder-790492-4-iscsi {{(pid=91831) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 25 17:11:54.461566 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-a63216ef-009a-43b8-9f43-a6c151337bad admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-685959'] for router, after_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:11:54.462126 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-a63216ef-009a-43b8-9f43-a6c151337bad admin admin] Fanout notify agent at l3_agent the message router_deleted on router f1e3cf65-0e20-4226-8986-652055868473 {{(pid=91830) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}} May 25 17:11:54.474681 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-a63216ef-009a-43b8-9f43-a6c151337bad admin admin] Notify callbacks [] for router, before_response {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:11:54.475790 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [None req-a63216ef-009a-43b8-9f43-a6c151337bad admin admin] 10.222.0.62 "DELETE /v2.0/routers/f1e3cf65-0e20-4226-8986-652055868473 HTTP/1.1" status: 204 len: 168 time: 1.3599305 May 25 17:11:54.478809 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.wsgi [-] (91830) accepted ('10.222.0.62', 37774) {{(pid=91830) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:11:54.537938 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.db_base_plugin_v2 [None req-2c78a283-4fe9-4429-9e73-0e9681f5eae8 admin admin] Deleting subnet 4bbae145-74ed-4fda-b7c0-ae77a3202a83 {{(pid=91830) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}} May 25 17:11:54.540729 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-2c78a283-4fe9-4429-9e73-0e9681f5eae8 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:11:54.588392 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-2c78a283-4fe9-4429-9e73-0e9681f5eae8 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-28085025'] for subnet, precommit_delete_associations {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:11:54.667077 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-2c78a283-4fe9-4429-9e73-0e9681f5eae8 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3856586'] for subnet, precommit_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:11:54.923932 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-2c78a283-4fe9-4429-9e73-0e9681f5eae8 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3857535', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55886', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-28085112', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1152740'] for subnet, after_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:11:54.928063 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:11:54.968473 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2c78a283-4fe9-4429-9e73-0e9681f5eae8 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=4bbae145-74ed-4fda-b7c0-ae77a3202a83,revision_number=None']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:11:54.972058 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-2c78a283-4fe9-4429-9e73-0e9681f5eae8 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.044s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:11:54.973251 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-2c78a283-4fe9-4429-9e73-0e9681f5eae8 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-551373'] for subnet, before_response {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:11:54.979357 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [None req-2c78a283-4fe9-4429-9e73-0e9681f5eae8 admin admin] 10.222.0.62 "DELETE /v2.0/subnets/4bbae145-74ed-4fda-b7c0-ae77a3202a83 HTTP/1.1" status: 204 len: 168 time: 0.4995806 May 25 17:11:54.980377 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b57c26d1-5abe-42be-a4db-319de750420c None None] Network b351598a-3f6f-4a37-8095-8d9371896ccc requested from dv-cinder-790492-4-iscsi {{(pid=91831) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} May 25 17:11:54.981706 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.wsgi [-] (91830) accepted ('10.222.0.62', 37778) {{(pid=91830) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:11:55.093571 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-29ae2bd1-e009-4964-856e-4f466056fe97 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3867326'] for network, before_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:11:55.169862 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.plugins.ml2.plugin [None req-29ae2bd1-e009-4964-856e-4f466056fe97 admin admin] Deleting port ccbdad71-4af5-49d2-8788-764f277b297e {{(pid=91830) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 25 17:11:55.170608 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-29ae2bd1-e009-4964-856e-4f466056fe97 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8757892952899'] for port, before_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:11:55.258664 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-69f5aba3-a3df-4674-8291-310b0f175da9 None None] DHCP port deletion for b351598a-3f6f-4a37-8095-8d9371896ccc request from dv-cinder-790492-4-iscsi {{(pid=91831) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} May 25 17:11:55.279367 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.plugins.ml2.db [None req-29ae2bd1-e009-4964-856e-4f466056fe97 admin admin] For port ccbdad71-4af5-49d2-8788-764f277b297e, host dv-cinder-790492-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-790492-4-iscsi',level=0,port_id=ccbdad71-4af5-49d2-8788-764f277b297e,segment=NetworkSegment(b8ba5240-28ce-40db-a6e6-b4a42435e0b6),segment_id=b8ba5240-28ce-40db-a6e6-b4a42435e0b6)] {{(pid=91830) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 17:11:55.279750 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-29ae2bd1-e009-4964-856e-4f466056fe97 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-683770'] for port, precommit_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:11:55.330209 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-c29f9f82-d21f-456a-ad5b-415a1e34b0da None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:11:55.336655 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.plugin [None req-69f5aba3-a3df-4674-8291-310b0f175da9 None None] Deleting port ccbdad71-4af5-49d2-8788-764f277b297e {{(pid=91831) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 25 17:11:55.337020 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-69f5aba3-a3df-4674-8291-310b0f175da9 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8757892952899'] for port, before_delete {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:11:55.440778 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.db [None req-69f5aba3-a3df-4674-8291-310b0f175da9 None None] For port ccbdad71-4af5-49d2-8788-764f277b297e, host dv-cinder-790492-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-790492-4-iscsi',level=0,port_id=ccbdad71-4af5-49d2-8788-764f277b297e,segment=NetworkSegment(b8ba5240-28ce-40db-a6e6-b4a42435e0b6),segment_id=b8ba5240-28ce-40db-a6e6-b4a42435e0b6)] {{(pid=91831) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 17:11:55.441519 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-69f5aba3-a3df-4674-8291-310b0f175da9 None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-683770'] for port, precommit_delete {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:11:55.512260 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.plugins.ml2.plugin [None req-29ae2bd1-e009-4964-856e-4f466056fe97 admin admin] Calling delete_port for ccbdad71-4af5-49d2-8788-764f277b297e owned by network:dhcp {{(pid=91830) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 25 17:11:55.562184 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-29ae2bd1-e009-4964-856e-4f466056fe97 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8757892955046', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8757892520924', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-27483019'] for port, after_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:11:55.568747 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-e455943a-168b-4563-be26-6d358cd2868d admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:11:55.570353 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.plugin [None req-69f5aba3-a3df-4674-8291-310b0f175da9 None None] Calling delete_port for ccbdad71-4af5-49d2-8788-764f277b297e owned by network:dhcp {{(pid=91831) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 25 17:11:55.613536 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-69f5aba3-a3df-4674-8291-310b0f175da9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8757892955046', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8757892520924'] for port, after_delete {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:11:55.614707 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-29ae2bd1-e009-4964-856e-4f466056fe97 admin admin] Pushing event deleted for resources: {'Port': ['ID=ccbdad71-4af5-49d2-8788-764f277b297e,revision_number=None']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:11:55.617950 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-29ae2bd1-e009-4964-856e-4f466056fe97 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.049s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:11:55.618205 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [None req-bee0fcf3-c708-48a3-8f17-fbaac5b64195 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:11:55.618648 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.l3_dvrscheduler_db [None req-29ae2bd1-e009-4964-856e-4f466056fe97 admin admin] No DVR routers for this DVR port ccbdad71-4af5-49d2-8788-764f277b297e on host dv-cinder-790492-4-iscsi {{(pid=91830) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 25 17:11:55.665210 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-69f5aba3-a3df-4674-8291-310b0f175da9 None None] Pushing event deleted for resources: {'Port': ['ID=ccbdad71-4af5-49d2-8788-764f277b297e,revision_number=None']} {{(pid=91831) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:11:55.667567 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [None req-69f5aba3-a3df-4674-8291-310b0f175da9 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.049s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:11:55.668566 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.l3_dvrscheduler_db [None req-69f5aba3-a3df-4674-8291-310b0f175da9 None None] No DVR routers for this DVR port ccbdad71-4af5-49d2-8788-764f277b297e on host dv-cinder-790492-4-iscsi {{(pid=91831) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 25 17:11:55.751933 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-29ae2bd1-e009-4964-856e-4f466056fe97 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3858245', 'neutron.services.segments.db._delete_segments_for_network-8757892982492'] for network, precommit_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:11:55.764966 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.services.segments.db [None req-29ae2bd1-e009-4964-856e-4f466056fe97 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['b351598a-3f6f-4a37-8095-8d9371896ccc']}} {{(pid=91830) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 17:11:55.777177 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.services.segments.db [None req-29ae2bd1-e009-4964-856e-4f466056fe97 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'b8ba5240-28ce-40db-a6e6-b4a42435e0b6') {'for_net_delete': True} {{(pid=91830) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 17:11:55.777473 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.services.segments.db [None req-29ae2bd1-e009-4964-856e-4f466056fe97 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'b8ba5240-28ce-40db-a6e6-b4a42435e0b6') {} {{(pid=91830) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 17:11:55.788487 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-29ae2bd1-e009-4964-856e-4f466056fe97 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8757892991389', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-28085034'] for segment, before_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:11:55.804967 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-29ae2bd1-e009-4964-856e-4f466056fe97 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3809789'] for segment, precommit_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:11:55.811519 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-29ae2bd1-e009-4964-856e-4f466056fe97 admin admin] Releasing vlan 655 on physical network physnet1 to pool {{(pid=91830) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 25 17:11:55.811954 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-29ae2bd1-e009-4964-856e-4f466056fe97 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3809789', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-27483102'] for segment, after_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:11:55.826031 dv-cinder-790492-4-iscsi neutron-server[91830]: Traceback (most recent call last): May 25 17:11:55.826031 dv-cinder-790492-4-iscsi neutron-server[91830]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 25 17:11:55.826031 dv-cinder-790492-4-iscsi neutron-server[91830]: timer() May 25 17:11:55.826031 dv-cinder-790492-4-iscsi neutron-server[91830]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 25 17:11:55.826031 dv-cinder-790492-4-iscsi neutron-server[91830]: cb(*args, **kw) May 25 17:11:55.826031 dv-cinder-790492-4-iscsi neutron-server[91830]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper May 25 17:11:55.826031 dv-cinder-790492-4-iscsi neutron-server[91830]: return func(*args, **kwargs) May 25 17:11:55.826031 dv-cinder-790492-4-iscsi neutron-server[91830]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 25 17:11:55.826031 dv-cinder-790492-4-iscsi neutron-server[91830]: self._notify() May 25 17:11:55.826031 dv-cinder-790492-4-iscsi neutron-server[91830]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 25 17:11:55.826031 dv-cinder-790492-4-iscsi neutron-server[91830]: self.callback(batched_events) May 25 17:11:55.826031 dv-cinder-790492-4-iscsi neutron-server[91830]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 25 17:11:55.826031 dv-cinder-790492-4-iscsi neutron-server[91830]: event.method(event) May 25 17:11:55.826031 dv-cinder-790492-4-iscsi neutron-server[91830]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 25 17:11:55.826031 dv-cinder-790492-4-iscsi neutron-server[91830]: aggregate_id = self._get_aggregate_id(event.segment_id) May 25 17:11:55.826031 dv-cinder-790492-4-iscsi neutron-server[91830]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 25 17:11:55.826031 dv-cinder-790492-4-iscsi neutron-server[91830]: aggregate_uuid = self.p_client.list_aggregates( May 25 17:11:55.826031 dv-cinder-790492-4-iscsi neutron-server[91830]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 25 17:11:55.826031 dv-cinder-790492-4-iscsi neutron-server[91830]: return f(self, *a, **k) May 25 17:11:55.826031 dv-cinder-790492-4-iscsi neutron-server[91830]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 25 17:11:55.826031 dv-cinder-790492-4-iscsi neutron-server[91830]: return self._get(url).json() May 25 17:11:55.826031 dv-cinder-790492-4-iscsi neutron-server[91830]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 25 17:11:55.826031 dv-cinder-790492-4-iscsi neutron-server[91830]: return self._client.get(url, endpoint_filter=self._ks_filter, May 25 17:11:55.826031 dv-cinder-790492-4-iscsi neutron-server[91830]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 25 17:11:55.826031 dv-cinder-790492-4-iscsi neutron-server[91830]: return self.request(url, 'GET', **kwargs) May 25 17:11:55.826031 dv-cinder-790492-4-iscsi neutron-server[91830]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 25 17:11:55.826031 dv-cinder-790492-4-iscsi neutron-server[91830]: base_url = self.get_endpoint(auth, allow=allow, May 25 17:11:55.826031 dv-cinder-790492-4-iscsi neutron-server[91830]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 25 17:11:55.826031 dv-cinder-790492-4-iscsi neutron-server[91830]: auth = self._auth_required(auth, 'determine endpoint URL') May 25 17:11:55.826031 dv-cinder-790492-4-iscsi neutron-server[91830]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 25 17:11:55.826031 dv-cinder-790492-4-iscsi neutron-server[91830]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 25 17:11:55.826031 dv-cinder-790492-4-iscsi neutron-server[91830]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 25 17:11:55.904353 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-29ae2bd1-e009-4964-856e-4f466056fe97 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3858252', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-640806', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-551400', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-683051'] for network, after_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:11:55.908878 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-29ae2bd1-e009-4964-856e-4f466056fe97 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-551373'] for network, before_response {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:11:55.913277 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-9b5e3892-80f0-40db-b382-6554e70a1ecc admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:11:55.933739 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-29ae2bd1-e009-4964-856e-4f466056fe97 admin admin] Pushing event deleted for resources: {'Network': ['ID=b351598a-3f6f-4a37-8095-8d9371896ccc,revision_number=None']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:11:55.935909 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-29ae2bd1-e009-4964-856e-4f466056fe97 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.023s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:11:55.946275 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [None req-29ae2bd1-e009-4964-856e-4f466056fe97 admin admin] 10.222.0.62 "DELETE /v2.0/networks/b351598a-3f6f-4a37-8095-8d9371896ccc HTTP/1.1" status: 204 len: 168 time: 0.9635224 May 25 17:11:56.074301 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.rpc [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Device ccbdad71-4af5-49d2-8788-764f277b297e no longer exists at agent ovs-agent-dv-cinder-790492-4-iscsi {{(pid=91831) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 25 17:11:56.109447 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.plugin [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] No Port match for: ccbdad71-4af5-49d2-8788-764f277b297e {{(pid=91831) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}} May 25 17:11:56.109801 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.rpc [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Device ccbdad71-4af5-49d2-8788-764f277b297e not bound to the agent host dv-cinder-790492-4-iscsi {{(pid=91831) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 25 17:11:56.110313 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.rpc [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Device d0e34ea8-e4eb-48d0-812d-3e5358c5b247 no longer exists at agent ovs-agent-dv-cinder-790492-4-iscsi {{(pid=91831) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 25 17:11:56.123100 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.wsgi [-] (91830) accepted ('10.222.0.62', 37790) {{(pid=91830) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:11:56.143765 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.plugin [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] No Port match for: d0e34ea8-e4eb-48d0-812d-3e5358c5b247 {{(pid=91831) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}} May 25 17:11:56.144117 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.rpc [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Device d0e34ea8-e4eb-48d0-812d-3e5358c5b247 not bound to the agent host dv-cinder-790492-4-iscsi {{(pid=91831) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 25 17:11:56.172661 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [None req-3811c4d5-3d45-4e26-9079-c5f9385c42ed admin admin] 10.222.0.62 "GET /v2.0/security-groups?tenant_id=70dac097fff04aed99a4976fa955579b&name=default HTTP/1.1" status: 200 len: 2979 time: 0.0482528 May 25 17:11:56.174910 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.wsgi [-] (91830) accepted ('10.222.0.62', 37794) {{(pid=91830) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:11:56.232893 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-5d43264a-3402-446c-adb9-9358b19db7b1 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:11:56.258437 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-5d43264a-3402-446c-adb9-9358b19db7b1 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:11:56.312339 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-5d43264a-3402-446c-adb9-9358b19db7b1 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-640836'] for security_group, after_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:11:56.317799 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-f2816692-bd2c-42ac-8443-cfc33d95cafc admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.001s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:11:56.332188 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5d43264a-3402-446c-adb9-9358b19db7b1 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=4fa291c6-377c-43b1-9dfb-6af266e140cd,revision_number=None']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:11:56.335680 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-5d43264a-3402-446c-adb9-9358b19db7b1 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.018s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:11:56.337611 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-5d43264a-3402-446c-adb9-9358b19db7b1 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:11:56.341051 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [None req-5d43264a-3402-446c-adb9-9358b19db7b1 admin admin] 10.222.0.62 "DELETE /v2.0/security-groups/4fa291c6-377c-43b1-9dfb-6af266e140cd HTTP/1.1" status: 204 len: 168 time: 0.1629584 May 25 17:11:57.719472 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-bf3f0a62-37b1-47a9-a38e-8c1a201001fe None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:11:57.731516 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.wsgi [-] (91830) accepted ('10.222.0.62', 37850) {{(pid=91830) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:11:57.850087 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-34fe0dbc-2c9b-42fe-bb67-e731952ac1bd admin admin] Notify callbacks [] for security_group, before_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:11:57.864119 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.quota.driver [None req-34fe0dbc-2c9b-42fe-bb67-e731952ac1bd admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91830) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 17:11:57.867890 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [None req-34fe0dbc-2c9b-42fe-bb67-e731952ac1bd admin admin] Usage tracker for resource:security_group_rule and tenant:c3ed60857083467e87dddfbf4de5cdd2 is out of sync, need to count used quota {{(pid=91830) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 17:11:57.870673 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [None req-34fe0dbc-2c9b-42fe-bb67-e731952ac1bd admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91830) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 17:11:57.876477 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.quota.driver [None req-34fe0dbc-2c9b-42fe-bb67-e731952ac1bd admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91830) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 17:11:57.905571 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:11:57.966451 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-34fe0dbc-2c9b-42fe-bb67-e731952ac1bd admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:11:57.969981 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-34fe0dbc-2c9b-42fe-bb67-e731952ac1bd admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-640836'] for security_group, after_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:11:57.978967 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-98e4b1c2-d2ab-4b65-8bea-702864ab27c8 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:11:58.021231 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.wsgi [-] (91829) accepted ('10.222.0.62', 37858) {{(pid=91829) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:11:58.021692 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [None req-34fe0dbc-2c9b-42fe-bb67-e731952ac1bd admin admin] 10.222.0.62 "GET /v2.0/security-groups?tenant_id=c3ed60857083467e87dddfbf4de5cdd2&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2887735 May 25 17:11:58.023309 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-34fe0dbc-2c9b-42fe-bb67-e731952ac1bd admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=fa2a04f8-ad04-4fd7-afa0-d6d1b5d8a5aa,revision_number=1']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:11:58.026368 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-34fe0dbc-2c9b-42fe-bb67-e731952ac1bd admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.047s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:11:58.084290 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-821fab7e-d038-4b7a-a539-27cd8e447392 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:11:58.109355 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-821fab7e-d038-4b7a-a539-27cd8e447392 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:11:58.158586 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-821fab7e-d038-4b7a-a539-27cd8e447392 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-640836'] for security_group, after_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:11:58.162964 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-74b37ef9-a91f-4321-9a8e-326e7e007923 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:11:58.173524 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-821fab7e-d038-4b7a-a539-27cd8e447392 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=fa2a04f8-ad04-4fd7-afa0-d6d1b5d8a5aa,revision_number=None']} {{(pid=91829) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:11:58.183730 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-821fab7e-d038-4b7a-a539-27cd8e447392 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91829) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:11:58.184103 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-821fab7e-d038-4b7a-a539-27cd8e447392 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91829) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:11:58.184465 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-821fab7e-d038-4b7a-a539-27cd8e447392 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91829) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:11:58.184825 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-821fab7e-d038-4b7a-a539-27cd8e447392 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91829) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:11:58.185179 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-821fab7e-d038-4b7a-a539-27cd8e447392 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91829) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:11:58.185534 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-821fab7e-d038-4b7a-a539-27cd8e447392 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91829) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:11:58.185885 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-821fab7e-d038-4b7a-a539-27cd8e447392 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91829) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:11:58.186266 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-821fab7e-d038-4b7a-a539-27cd8e447392 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91829) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:11:58.186615 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-821fab7e-d038-4b7a-a539-27cd8e447392 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91829) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:11:58.186968 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-821fab7e-d038-4b7a-a539-27cd8e447392 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91829) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:11:58.187332 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-821fab7e-d038-4b7a-a539-27cd8e447392 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91829) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:11:58.187678 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-821fab7e-d038-4b7a-a539-27cd8e447392 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91829) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:11:58.190162 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-821fab7e-d038-4b7a-a539-27cd8e447392 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:11:58.191512 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [None req-821fab7e-d038-4b7a-a539-27cd8e447392 admin admin] 10.222.0.62 "DELETE /v2.0/security-groups/fa2a04f8-ad04-4fd7-afa0-d6d1b5d8a5aa HTTP/1.1" status: 204 len: 168 time: 0.1692233 May 25 17:11:58.192489 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-821fab7e-d038-4b7a-a539-27cd8e447392 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.030s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:11:58.654982 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-0a55eb4a-8b57-4233-84d6-6b423b4ed6db None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:11:58.839009 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.wsgi [-] (91829) accepted ('10.222.0.62', 37884) {{(pid=91829) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:11:58.942580 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.v2.base [None req-778c1f3d-2a6a-4c8d-82cc-034223e7f723 admin admin] Request body: {'network': {'name': 'tempest-VolumesActionsTest-794504957-network', 'tenant_id': 'd491039ebcdc426e877032235dbbdbf7'}} {{(pid=91829) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 17:11:58.947271 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.quota.driver [None req-778c1f3d-2a6a-4c8d-82cc-034223e7f723 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91829) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 17:11:58.952197 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.quota.resource [None req-778c1f3d-2a6a-4c8d-82cc-034223e7f723 admin admin] Usage tracker for resource:network and tenant:d491039ebcdc426e877032235dbbdbf7 is out of sync, need to count used quota {{(pid=91829) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 17:11:58.955651 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.quota.resource [None req-778c1f3d-2a6a-4c8d-82cc-034223e7f723 admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=91829) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 17:11:58.963910 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.quota.driver [None req-778c1f3d-2a6a-4c8d-82cc-034223e7f723 admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91829) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 17:11:58.973103 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-778c1f3d-2a6a-4c8d-82cc-034223e7f723 admin admin] Made reservation on behalf of d491039ebcdc426e877032235dbbdbf7 for: {'network': 1} {{(pid=91829) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 25 17:11:58.976379 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-778c1f3d-2a6a-4c8d-82cc-034223e7f723 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-3832077'] for network, before_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:11:58.988877 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-778c1f3d-2a6a-4c8d-82cc-034223e7f723 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:11:59.002986 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.quota.driver [None req-778c1f3d-2a6a-4c8d-82cc-034223e7f723 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91829) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 17:11:59.006726 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.quota.resource [None req-778c1f3d-2a6a-4c8d-82cc-034223e7f723 admin admin] Usage tracker for resource:security_group_rule and tenant:d491039ebcdc426e877032235dbbdbf7 is out of sync, need to count used quota {{(pid=91829) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 17:11:59.009398 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.quota.resource [None req-778c1f3d-2a6a-4c8d-82cc-034223e7f723 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91829) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 17:11:59.014930 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.quota.driver [None req-778c1f3d-2a6a-4c8d-82cc-034223e7f723 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91829) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 17:11:59.098102 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-778c1f3d-2a6a-4c8d-82cc-034223e7f723 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:11:59.102477 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-778c1f3d-2a6a-4c8d-82cc-034223e7f723 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-640836'] for security_group, after_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:11:59.106245 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-cc85d2eb-73b6-49b4-a694-9bd774f59904 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:11:59.129361 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-778c1f3d-2a6a-4c8d-82cc-034223e7f723 admin admin] vlan segment allocate from pool success with {'vlan_id': 680, 'physical_network': 'physnet1'} {{(pid=91829) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 25 17:11:59.144916 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-778c1f3d-2a6a-4c8d-82cc-034223e7f723 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=3109a65d-2718-4675-807d-e5cc77ca98f0,revision_number=1']} {{(pid=91829) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:11:59.149514 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-778c1f3d-2a6a-4c8d-82cc-034223e7f723 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.043s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:11:59.150454 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-778c1f3d-2a6a-4c8d-82cc-034223e7f723 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3809789'] for segment, precommit_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:11:59.150787 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.db.segments_db [None req-778c1f3d-2a6a-4c8d-82cc-034223e7f723 admin admin] Added segment ef74e0cd-a636-40f4-b93e-7649b7caa7b1 of type vlan for network e5e74be9-3ef2-41e8-8f60-c3eb000e2613 May 25 17:11:59.176347 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-778c1f3d-2a6a-4c8d-82cc-034223e7f723 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8757892541013'] for network, precommit_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:11:59.204091 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-778c1f3d-2a6a-4c8d-82cc-034223e7f723 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-640806', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-551400'] for network, after_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:11:59.205348 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-778c1f3d-2a6a-4c8d-82cc-034223e7f723 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:11:59.205932 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-778c1f3d-2a6a-4c8d-82cc-034223e7f723 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-551373'] for network, before_response {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:11:59.210926 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-6a324333-237c-4c25-b6ff-2f9f9c3c2a98 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:11:59.305975 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [None req-778c1f3d-2a6a-4c8d-82cc-034223e7f723 admin admin] 10.222.0.62 "POST /v2.0/networks HTTP/1.1" status: 201 len: 881 time: 0.4658418 May 25 17:11:59.308752 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-778c1f3d-2a6a-4c8d-82cc-034223e7f723 admin admin] Pushing event updated for resources: {'Network': ['ID=e5e74be9-3ef2-41e8-8f60-c3eb000e2613,revision_number=1']} {{(pid=91829) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:11:59.308941 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.wsgi [-] (91830) accepted ('10.222.0.62', 37890) {{(pid=91830) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:11:59.311438 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-778c1f3d-2a6a-4c8d-82cc-034223e7f723 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.101s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:11:59.315111 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.v2.base [None req-c5d42a5f-d1ab-4357-9555-020f74bf0acc admin admin] Request body: {'subnet': {'network_id': 'e5e74be9-3ef2-41e8-8f60-c3eb000e2613', 'cidr': '172.20.0.0/28', 'name': 'tempest-VolumesActionsTest-794504957-subnet', 'tenant_id': 'd491039ebcdc426e877032235dbbdbf7', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=91830) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 17:11:59.320717 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.rpc [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Network e5e74be9-3ef2-41e8-8f60-c3eb000e2613 details requested by agent ovs-agent-dv-cinder-790492-4-iscsi with host dv-cinder-790492-4-iscsi {{(pid=91831) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 25 17:11:59.322599 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.quota.driver [None req-c5d42a5f-d1ab-4357-9555-020f74bf0acc admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91830) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 17:11:59.326632 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [None req-c5d42a5f-d1ab-4357-9555-020f74bf0acc admin admin] Usage tracker for resource:subnet and tenant:d491039ebcdc426e877032235dbbdbf7 is out of sync, need to count used quota {{(pid=91830) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 17:11:59.329456 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [None req-c5d42a5f-d1ab-4357-9555-020f74bf0acc admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=91830) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 17:11:59.335890 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.quota.driver [None req-c5d42a5f-d1ab-4357-9555-020f74bf0acc admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91830) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 17:11:59.347166 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-c5d42a5f-d1ab-4357-9555-020f74bf0acc admin admin] Made reservation on behalf of d491039ebcdc426e877032235dbbdbf7 for: {'subnet': 1} {{(pid=91830) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 25 17:11:59.349595 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-c5d42a5f-d1ab-4357-9555-020f74bf0acc admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1152763'] for subnet, before_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:11:59.735176 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-c5d42a5f-d1ab-4357-9555-020f74bf0acc admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55886', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-28085051', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-1152749'] for subnet, after_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:11:59.740164 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:11:59.814589 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c5d42a5f-d1ab-4357-9555-020f74bf0acc admin admin] Pushing event updated for resources: {'Subnet': ['ID=02a42c15-5565-457f-98d9-b038a23d1d2b,revision_number=0']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:11:59.818759 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-c5d42a5f-d1ab-4357-9555-020f74bf0acc admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.079s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:11:59.824644 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c5d42a5f-d1ab-4357-9555-020f74bf0acc admin admin] Checking segment: {'id': 'ef74e0cd-a636-40f4-b93e-7649b7caa7b1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 680, 'network_id': 'e5e74be9-3ef2-41e8-8f60-c3eb000e2613'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91830) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 25 17:11:59.824991 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c5d42a5f-d1ab-4357-9555-020f74bf0acc admin admin] Network hostable DHCP agents. Network: e5e74be9-3ef2-41e8-8f60-c3eb000e2613, hostable agents: ['8d7401c6-8951-4f2b-ace4-208761782bfc'], hosted agents: [] {{(pid=91830) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 25 17:11:59.841460 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c5d42a5f-d1ab-4357-9555-020f74bf0acc admin admin] Network e5e74be9-3ef2-41e8-8f60-c3eb000e2613 is scheduled to be hosted by DHCP agent 8d7401c6-8951-4f2b-ace4-208761782bfc with binding_index 1 {{(pid=91830) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 25 17:11:59.850653 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.scheduler.base_scheduler [None req-c5d42a5f-d1ab-4357-9555-020f74bf0acc admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-790492-4-iscsi, e5e74be9-3ef2-41e8-8f60-c3eb000e2613) {{(pid=91830) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 17:11:59.858670 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a716b8fb-ec69-4c45-b86a-b1b45071e501 None None] Network e5e74be9-3ef2-41e8-8f60-c3eb000e2613 requested from dv-cinder-790492-4-iscsi {{(pid=91831) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} May 25 17:11:59.867489 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c5d42a5f-d1ab-4357-9555-020f74bf0acc admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=91830) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:11:59.867489 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-c5d42a5f-d1ab-4357-9555-020f74bf0acc admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-551373'] for subnet, before_response {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:11:59.891698 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [None req-c5d42a5f-d1ab-4357-9555-020f74bf0acc admin admin] 10.222.0.62 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 845 time: 0.5815907 May 25 17:12:00.047910 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-df0ff65e-fdd9-4152-9c36-d620cdd8ab9f None None] Network e5e74be9-3ef2-41e8-8f60-c3eb000e2613 requested from dv-cinder-790492-4-iscsi {{(pid=91831) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} May 25 17:12:00.259395 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-57f11b47-1f51-4191-b7c9-af248a48372c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:12:00.400578 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.wsgi [-] (91830) accepted ('10.222.0.62', 37910) {{(pid=91830) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:12:00.406323 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.v2.base [None req-fb46c2ec-3f5d-4096-9fe0-bc0aae1851ca admin admin] Request body: {'network': {'name': 'tempest-VolumesActionsTest-1980364272-network', 'tenant_id': 'f6d12e366fa24a279bba93e23a53a126'}} {{(pid=91830) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 17:12:00.410850 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.quota.driver [None req-fb46c2ec-3f5d-4096-9fe0-bc0aae1851ca admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91830) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 17:12:00.414622 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [None req-fb46c2ec-3f5d-4096-9fe0-bc0aae1851ca admin admin] Usage tracker for resource:network and tenant:f6d12e366fa24a279bba93e23a53a126 is out of sync, need to count used quota {{(pid=91830) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 17:12:00.417537 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [None req-fb46c2ec-3f5d-4096-9fe0-bc0aae1851ca admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=91830) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 17:12:00.423366 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.quota.driver [None req-fb46c2ec-3f5d-4096-9fe0-bc0aae1851ca admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91830) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 17:12:00.433784 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-fb46c2ec-3f5d-4096-9fe0-bc0aae1851ca admin admin] Made reservation on behalf of f6d12e366fa24a279bba93e23a53a126 for: {'network': 1} {{(pid=91830) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 25 17:12:00.436029 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-fb46c2ec-3f5d-4096-9fe0-bc0aae1851ca admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-3832077'] for network, before_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:12:00.448566 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-fb46c2ec-3f5d-4096-9fe0-bc0aae1851ca admin admin] Notify callbacks [] for security_group, before_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:12:00.463024 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.quota.driver [None req-fb46c2ec-3f5d-4096-9fe0-bc0aae1851ca admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91830) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 17:12:00.466699 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [None req-fb46c2ec-3f5d-4096-9fe0-bc0aae1851ca admin admin] Usage tracker for resource:security_group_rule and tenant:f6d12e366fa24a279bba93e23a53a126 is out of sync, need to count used quota {{(pid=91830) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 17:12:00.469406 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [None req-fb46c2ec-3f5d-4096-9fe0-bc0aae1851ca admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91830) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 17:12:00.475621 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.quota.driver [None req-fb46c2ec-3f5d-4096-9fe0-bc0aae1851ca admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91830) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 17:12:00.557390 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-fb46c2ec-3f5d-4096-9fe0-bc0aae1851ca admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:12:00.561963 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-fb46c2ec-3f5d-4096-9fe0-bc0aae1851ca admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-640836'] for security_group, after_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:12:00.565652 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-5d43264a-3402-446c-adb9-9358b19db7b1 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:12:00.589374 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-fb46c2ec-3f5d-4096-9fe0-bc0aae1851ca admin admin] vlan segment allocate from pool success with {'vlan_id': 671, 'physical_network': 'physnet1'} {{(pid=91830) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 25 17:12:00.601589 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fb46c2ec-3f5d-4096-9fe0-bc0aae1851ca admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=78372c2e-737d-4601-8365-8a077c221b57,revision_number=1']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:12:00.605487 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-fb46c2ec-3f5d-4096-9fe0-bc0aae1851ca admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.040s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:12:00.606429 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-fb46c2ec-3f5d-4096-9fe0-bc0aae1851ca admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3809789'] for segment, precommit_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:12:00.606761 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.db.segments_db [None req-fb46c2ec-3f5d-4096-9fe0-bc0aae1851ca admin admin] Added segment 8f259292-dab8-4aad-ae10-e73a06c46278 of type vlan for network 938901d3-9a57-436a-a691-e8a575ba6b4e May 25 17:12:00.635942 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-fb46c2ec-3f5d-4096-9fe0-bc0aae1851ca admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8757892541013'] for network, precommit_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:12:00.664045 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-fb46c2ec-3f5d-4096-9fe0-bc0aae1851ca admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-640806', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-551400'] for network, after_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:12:00.665361 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-fb46c2ec-3f5d-4096-9fe0-bc0aae1851ca admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91830) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:12:00.665949 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-fb46c2ec-3f5d-4096-9fe0-bc0aae1851ca admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-551373'] for network, before_response {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:12:00.669122 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-e3c6847d-62e9-4952-9b33-3c2837c5eec8 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:12:00.768174 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fb46c2ec-3f5d-4096-9fe0-bc0aae1851ca admin admin] Pushing event updated for resources: {'Network': ['ID=938901d3-9a57-436a-a691-e8a575ba6b4e,revision_number=1']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:12:00.771145 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [None req-fb46c2ec-3f5d-4096-9fe0-bc0aae1851ca admin admin] 10.222.0.62 "POST /v2.0/networks HTTP/1.1" status: 201 len: 882 time: 0.3695633 May 25 17:12:00.772094 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-fb46c2ec-3f5d-4096-9fe0-bc0aae1851ca admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.103s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:12:00.774124 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.wsgi [-] (91830) accepted ('10.222.0.62', 37914) {{(pid=91830) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:12:00.778552 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.rpc [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Network 938901d3-9a57-436a-a691-e8a575ba6b4e details requested by agent ovs-agent-dv-cinder-790492-4-iscsi with host dv-cinder-790492-4-iscsi {{(pid=91831) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 25 17:12:00.779646 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.v2.base [None req-21cc64b9-d152-4564-b07f-ada371548401 admin admin] Request body: {'subnet': {'network_id': '938901d3-9a57-436a-a691-e8a575ba6b4e', 'cidr': '172.20.0.0/28', 'name': 'tempest-VolumesActionsTest-1980364272-subnet', 'tenant_id': 'f6d12e366fa24a279bba93e23a53a126', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=91830) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 17:12:00.784440 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.quota.driver [None req-21cc64b9-d152-4564-b07f-ada371548401 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91830) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 17:12:00.788821 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [None req-21cc64b9-d152-4564-b07f-ada371548401 admin admin] Usage tracker for resource:subnet and tenant:f6d12e366fa24a279bba93e23a53a126 is out of sync, need to count used quota {{(pid=91830) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 17:12:00.791677 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [None req-21cc64b9-d152-4564-b07f-ada371548401 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=91830) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 17:12:00.797742 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.quota.driver [None req-21cc64b9-d152-4564-b07f-ada371548401 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91830) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 17:12:00.808484 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-21cc64b9-d152-4564-b07f-ada371548401 admin admin] Made reservation on behalf of f6d12e366fa24a279bba93e23a53a126 for: {'subnet': 1} {{(pid=91830) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 25 17:12:00.810764 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-21cc64b9-d152-4564-b07f-ada371548401 admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1152763'] for subnet, before_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:12:01.297369 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-21cc64b9-d152-4564-b07f-ada371548401 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55886', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-28085051', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-1152749'] for subnet, after_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:12:01.302634 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-b073e810-41a0-4dac-87ee-37fac75de922 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:12:01.376383 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-21cc64b9-d152-4564-b07f-ada371548401 admin admin] Pushing event updated for resources: {'Subnet': ['ID=71756d93-baf5-4449-8027-6de172acf5b2,revision_number=0']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:12:01.380619 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-21cc64b9-d152-4564-b07f-ada371548401 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.078s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:12:01.386269 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-21cc64b9-d152-4564-b07f-ada371548401 admin admin] Checking segment: {'id': '8f259292-dab8-4aad-ae10-e73a06c46278', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 671, 'network_id': '938901d3-9a57-436a-a691-e8a575ba6b4e'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91830) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 25 17:12:01.386629 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-21cc64b9-d152-4564-b07f-ada371548401 admin admin] Network hostable DHCP agents. Network: 938901d3-9a57-436a-a691-e8a575ba6b4e, hostable agents: ['8d7401c6-8951-4f2b-ace4-208761782bfc'], hosted agents: [] {{(pid=91830) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 25 17:12:01.402988 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-21cc64b9-d152-4564-b07f-ada371548401 admin admin] Network 938901d3-9a57-436a-a691-e8a575ba6b4e is scheduled to be hosted by DHCP agent 8d7401c6-8951-4f2b-ace4-208761782bfc with binding_index 1 {{(pid=91830) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 25 17:12:01.412741 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.scheduler.base_scheduler [None req-21cc64b9-d152-4564-b07f-ada371548401 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-790492-4-iscsi, 938901d3-9a57-436a-a691-e8a575ba6b4e) {{(pid=91830) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 17:12:01.423083 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-21cc64b9-d152-4564-b07f-ada371548401 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=91830) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:12:01.423232 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-24f3e7dc-8622-42b8-a03a-0639002da582 None None] Network 938901d3-9a57-436a-a691-e8a575ba6b4e requested from dv-cinder-790492-4-iscsi {{(pid=91831) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} May 25 17:12:01.423896 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-21cc64b9-d152-4564-b07f-ada371548401 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-551373'] for subnet, before_response {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:12:01.449952 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [None req-21cc64b9-d152-4564-b07f-ada371548401 admin admin] 10.222.0.62 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 846 time: 0.6715341 May 25 17:12:01.622400 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-380fc546-9d1b-4414-8c33-d16f7c4d3b3b None None] Network 938901d3-9a57-436a-a691-e8a575ba6b4e requested from dv-cinder-790492-4-iscsi {{(pid=91831) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} May 25 17:12:04.149874 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.wsgi [-] (91830) accepted ('10.222.0.62', 37968) {{(pid=91830) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:12:04.264637 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-1a6405ae-c916-448d-b29f-a905abdebe97 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:12:04.278483 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.quota.driver [None req-1a6405ae-c916-448d-b29f-a905abdebe97 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91830) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 17:12:04.282188 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [None req-1a6405ae-c916-448d-b29f-a905abdebe97 admin admin] Usage tracker for resource:security_group_rule and tenant:140de04f05ae457687089f04e4daeea2 is out of sync, need to count used quota {{(pid=91830) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 17:12:04.284924 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [None req-1a6405ae-c916-448d-b29f-a905abdebe97 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91830) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 17:12:04.290585 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.quota.driver [None req-1a6405ae-c916-448d-b29f-a905abdebe97 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91830) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 17:12:04.372834 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-1a6405ae-c916-448d-b29f-a905abdebe97 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:12:04.376461 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-1a6405ae-c916-448d-b29f-a905abdebe97 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-640836'] for security_group, after_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:12:04.385281 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-fb46c2ec-3f5d-4096-9fe0-bc0aae1851ca admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:12:04.428280 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [None req-1a6405ae-c916-448d-b29f-a905abdebe97 admin admin] 10.222.0.62 "GET /v2.0/security-groups?tenant_id=140de04f05ae457687089f04e4daeea2&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2771180 May 25 17:12:04.428885 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1a6405ae-c916-448d-b29f-a905abdebe97 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=7caea369-9bb8-4d4b-9383-40a1964aa3de,revision_number=1']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:12:04.431510 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.wsgi [-] (91829) accepted ('10.222.0.62', 37974) {{(pid=91829) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:12:04.432003 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-1a6405ae-c916-448d-b29f-a905abdebe97 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.047s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:12:04.585465 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-aa721266-203c-4f31-a7b9-b56690779ed9 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:12:04.610862 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-aa721266-203c-4f31-a7b9-b56690779ed9 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:12:04.661498 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-aa721266-203c-4f31-a7b9-b56690779ed9 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-640836'] for security_group, after_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:12:04.666214 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-a65d5483-6daa-497a-b18c-7fac2d0f79f5 tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:12:04.679365 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aa721266-203c-4f31-a7b9-b56690779ed9 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=7caea369-9bb8-4d4b-9383-40a1964aa3de,revision_number=None']} {{(pid=91829) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:12:04.681538 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-aa721266-203c-4f31-a7b9-b56690779ed9 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.015s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:12:04.683733 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-aa721266-203c-4f31-a7b9-b56690779ed9 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:12:04.684846 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [None req-aa721266-203c-4f31-a7b9-b56690779ed9 admin admin] 10.222.0.62 "DELETE /v2.0/security-groups/7caea369-9bb8-4d4b-9383-40a1964aa3de HTTP/1.1" status: 204 len: 168 time: 0.2519035 May 25 17:12:04.973885 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.wsgi [-] (91830) accepted ('10.222.0.62', 37986) {{(pid=91830) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:12:04.991860 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-d5dcf11a-7a44-4915-81a2-0e5fec74fada admin admin] Notify callbacks [] for security_group, before_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:12:05.006458 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.quota.driver [None req-d5dcf11a-7a44-4915-81a2-0e5fec74fada admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91830) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 17:12:05.010782 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [None req-d5dcf11a-7a44-4915-81a2-0e5fec74fada admin admin] Usage tracker for resource:security_group_rule and tenant:dcc11152e4bf4361894b0a704c5a8300 is out of sync, need to count used quota {{(pid=91830) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 17:12:05.013864 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [None req-d5dcf11a-7a44-4915-81a2-0e5fec74fada admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91830) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 17:12:05.020679 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.quota.driver [None req-d5dcf11a-7a44-4915-81a2-0e5fec74fada admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91830) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 17:12:05.115944 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-d5dcf11a-7a44-4915-81a2-0e5fec74fada admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:12:05.121017 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-d5dcf11a-7a44-4915-81a2-0e5fec74fada admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-640836'] for security_group, after_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:12:05.131548 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-c02a2973-60c7-4475-b7f3-23c1823288a4 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:12:05.170157 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [None req-d5dcf11a-7a44-4915-81a2-0e5fec74fada admin admin] 10.222.0.62 "GET /v2.0/security-groups?tenant_id=dcc11152e4bf4361894b0a704c5a8300&name=default HTTP/1.1" status: 200 len: 2979 time: 0.1951566 May 25 17:12:05.173585 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.wsgi [-] (91829) accepted ('10.222.0.62', 37994) {{(pid=91829) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:12:05.175729 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d5dcf11a-7a44-4915-81a2-0e5fec74fada admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=5e7f32ec-670c-4afc-9020-d8c1410317e2,revision_number=1']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:12:05.178977 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-d5dcf11a-7a44-4915-81a2-0e5fec74fada admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.048s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:12:05.234851 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-7c2a0824-568b-4240-b437-93ce66fb61a0 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:12:05.261021 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-7c2a0824-568b-4240-b437-93ce66fb61a0 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:12:05.317389 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-7c2a0824-568b-4240-b437-93ce66fb61a0 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-640836'] for security_group, after_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:12:05.321374 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-aa721266-203c-4f31-a7b9-b56690779ed9 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:12:05.334775 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7c2a0824-568b-4240-b437-93ce66fb61a0 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=5e7f32ec-670c-4afc-9020-d8c1410317e2,revision_number=None']} {{(pid=91829) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:12:05.337548 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-7c2a0824-568b-4240-b437-93ce66fb61a0 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.016s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:12:05.341166 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-7c2a0824-568b-4240-b437-93ce66fb61a0 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:12:05.342483 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [None req-7c2a0824-568b-4240-b437-93ce66fb61a0 admin admin] 10.222.0.62 "DELETE /v2.0/security-groups/5e7f32ec-670c-4afc-9020-d8c1410317e2 HTTP/1.1" status: 204 len: 168 time: 0.1674538 May 25 17:12:06.584482 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:12:14.732498 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.wsgi [-] (91829) accepted ('10.222.0.62', 38172) {{(pid=91829) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:12:14.851663 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-99315054-cec4-47a2-b845-8ee605417982 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:12:14.866145 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.quota.driver [None req-99315054-cec4-47a2-b845-8ee605417982 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91829) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 17:12:14.869815 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.quota.resource [None req-99315054-cec4-47a2-b845-8ee605417982 admin admin] Usage tracker for resource:security_group_rule and tenant:e29cca2308f146389d226c3b8e37ba7a is out of sync, need to count used quota {{(pid=91829) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 17:12:14.872538 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.quota.resource [None req-99315054-cec4-47a2-b845-8ee605417982 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91829) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 17:12:14.878179 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.quota.driver [None req-99315054-cec4-47a2-b845-8ee605417982 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91829) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 17:12:14.962666 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-99315054-cec4-47a2-b845-8ee605417982 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:12:14.966386 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-99315054-cec4-47a2-b845-8ee605417982 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-640836'] for security_group, after_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:12:14.974731 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-7c2a0824-568b-4240-b437-93ce66fb61a0 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:12:15.013454 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [None req-99315054-cec4-47a2-b845-8ee605417982 admin admin] 10.222.0.62 "GET /v2.0/security-groups?tenant_id=e29cca2308f146389d226c3b8e37ba7a&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2798886 May 25 17:12:15.015046 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-99315054-cec4-47a2-b845-8ee605417982 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=d0a351c0-e723-4a2b-8a25-e7cfd2435e33,revision_number=1']} {{(pid=91829) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:12:15.016056 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.wsgi [-] (91830) accepted ('10.222.0.62', 38178) {{(pid=91830) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:12:15.018195 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-99315054-cec4-47a2-b845-8ee605417982 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.044s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:12:15.081097 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-e45503b1-5227-4bee-b016-500a85e2559d admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:12:15.107543 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-e45503b1-5227-4bee-b016-500a85e2559d admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:12:15.159317 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-e45503b1-5227-4bee-b016-500a85e2559d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-640836'] for security_group, after_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:12:15.163499 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-aac7a8a3-a79b-4fc5-aa33-65b6e9872b0b admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:12:15.177472 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e45503b1-5227-4bee-b016-500a85e2559d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d0a351c0-e723-4a2b-8a25-e7cfd2435e33,revision_number=None']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:12:15.187996 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-e45503b1-5227-4bee-b016-500a85e2559d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.025s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:12:15.190123 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-e45503b1-5227-4bee-b016-500a85e2559d admin admin] Notify callbacks [] for security_group, before_response {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:12:15.193778 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [None req-e45503b1-5227-4bee-b016-500a85e2559d admin admin] 10.222.0.62 "DELETE /v2.0/security-groups/d0a351c0-e723-4a2b-8a25-e7cfd2435e33 HTTP/1.1" status: 204 len: 168 time: 0.1742256 May 25 17:12:15.481998 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.wsgi [-] (91830) accepted ('10.222.0.62', 38194) {{(pid=91830) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:12:15.499379 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-48cbb150-7114-4ded-b753-0c637bea2bc2 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:12:15.516844 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.quota.driver [None req-48cbb150-7114-4ded-b753-0c637bea2bc2 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91830) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 17:12:15.521201 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [None req-48cbb150-7114-4ded-b753-0c637bea2bc2 admin admin] Usage tracker for resource:security_group_rule and tenant:8845945e78ee46839a850f11a884f203 is out of sync, need to count used quota {{(pid=91830) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 17:12:15.524562 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [None req-48cbb150-7114-4ded-b753-0c637bea2bc2 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91830) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 17:12:15.530289 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.quota.driver [None req-48cbb150-7114-4ded-b753-0c637bea2bc2 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91830) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 17:12:15.616703 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-48cbb150-7114-4ded-b753-0c637bea2bc2 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:12:15.620484 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-48cbb150-7114-4ded-b753-0c637bea2bc2 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-640836'] for security_group, after_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:12:15.628569 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-f9a7ca17-9e08-4d4d-9191-afc293892f56 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:12:15.668730 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [None req-48cbb150-7114-4ded-b753-0c637bea2bc2 admin admin] 10.222.0.62 "GET /v2.0/security-groups?tenant_id=8845945e78ee46839a850f11a884f203&name=default HTTP/1.1" status: 200 len: 2979 time: 0.1856415 May 25 17:12:15.670389 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-48cbb150-7114-4ded-b753-0c637bea2bc2 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=c8781727-ea6e-4072-ae32-18fe7c539d0b,revision_number=1']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:12:15.671584 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.wsgi [-] (91829) accepted ('10.222.0.62', 38200) {{(pid=91829) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:12:15.673418 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-48cbb150-7114-4ded-b753-0c637bea2bc2 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.045s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:12:15.734719 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-db87121e-69ee-4650-990a-c630789977b8 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:12:15.760398 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-db87121e-69ee-4650-990a-c630789977b8 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:12:15.811434 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-db87121e-69ee-4650-990a-c630789977b8 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-640836'] for security_group, after_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:12:15.815586 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-e5e9c981-b9f9-4d94-8858-c94b44ab6b03 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:12:15.828641 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-db87121e-69ee-4650-990a-c630789977b8 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=c8781727-ea6e-4072-ae32-18fe7c539d0b,revision_number=None']} {{(pid=91829) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:12:15.831469 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-db87121e-69ee-4650-990a-c630789977b8 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.016s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:12:15.841557 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-db87121e-69ee-4650-990a-c630789977b8 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:12:15.845513 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [None req-db87121e-69ee-4650-990a-c630789977b8 admin admin] 10.222.0.62 "DELETE /v2.0/security-groups/c8781727-ea6e-4072-ae32-18fe7c539d0b HTTP/1.1" status: 204 len: 168 time: 0.1700327 May 25 17:12:16.197289 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.wsgi [-] (91829) accepted ('10.222.0.62', 38218) {{(pid=91829) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:12:16.215528 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-526ade83-6697-4179-b284-06d91c8991be admin admin] Notify callbacks [] for security_group, before_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:12:16.231919 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.quota.driver [None req-526ade83-6697-4179-b284-06d91c8991be admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91829) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 17:12:16.235787 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.quota.resource [None req-526ade83-6697-4179-b284-06d91c8991be admin admin] Usage tracker for resource:security_group_rule and tenant:fdc1941338fd412098254ffcacdf9673 is out of sync, need to count used quota {{(pid=91829) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 17:12:16.238605 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.quota.resource [None req-526ade83-6697-4179-b284-06d91c8991be admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91829) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 17:12:16.244320 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.quota.driver [None req-526ade83-6697-4179-b284-06d91c8991be admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91829) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 17:12:16.330350 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-526ade83-6697-4179-b284-06d91c8991be admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:12:16.335130 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-526ade83-6697-4179-b284-06d91c8991be admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-640836'] for security_group, after_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:12:16.343622 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-bf838e2e-5f69-4990-8c1b-8dbf7cc1b62a tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:12:16.383677 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [None req-526ade83-6697-4179-b284-06d91c8991be admin admin] 10.222.0.62 "GET /v2.0/security-groups?tenant_id=fdc1941338fd412098254ffcacdf9673&name=default HTTP/1.1" status: 200 len: 2979 time: 0.1852648 May 25 17:12:16.385423 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-526ade83-6697-4179-b284-06d91c8991be admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=674e5f33-2b3d-4e7c-9ebd-e41d0d1b544d,revision_number=1']} {{(pid=91829) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:12:16.385594 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.wsgi [-] (91830) accepted ('10.222.0.62', 38226) {{(pid=91830) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:12:16.389392 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-526ade83-6697-4179-b284-06d91c8991be admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.045s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:12:16.453150 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-806bfc8d-aa31-4b61-aeb1-49f969d7c7bc admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:12:16.479464 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-806bfc8d-aa31-4b61-aeb1-49f969d7c7bc admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:12:16.532790 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-806bfc8d-aa31-4b61-aeb1-49f969d7c7bc admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-640836'] for security_group, after_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:12:16.537873 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-5fe90d83-5ca9-4a41-9403-3f89bb2bc2e7 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:12:16.551577 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-806bfc8d-aa31-4b61-aeb1-49f969d7c7bc admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=674e5f33-2b3d-4e7c-9ebd-e41d0d1b544d,revision_number=None']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:12:16.554017 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-806bfc8d-aa31-4b61-aeb1-49f969d7c7bc admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.016s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:12:16.562510 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-806bfc8d-aa31-4b61-aeb1-49f969d7c7bc admin admin] Notify callbacks [] for security_group, before_response {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:12:16.563689 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [None req-806bfc8d-aa31-4b61-aeb1-49f969d7c7bc admin admin] 10.222.0.62 "DELETE /v2.0/security-groups/674e5f33-2b3d-4e7c-9ebd-e41d0d1b544d HTTP/1.1" status: 204 len: 168 time: 0.1772497 May 25 17:12:17.272704 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.wsgi [-] (91830) accepted ('10.222.0.62', 38250) {{(pid=91830) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:12:17.374602 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.v2.base [None req-e285178b-37d8-462f-b014-0fb97b4e46ab admin admin] Request body: {'network': {'name': 'tempest-VolumesActionsTest-1612671893-network', 'tenant_id': 'f183c0c6666645e9ab8c3635833569c4'}} {{(pid=91830) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 17:12:17.380468 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.quota.driver [None req-e285178b-37d8-462f-b014-0fb97b4e46ab admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91830) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 17:12:17.384396 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [None req-e285178b-37d8-462f-b014-0fb97b4e46ab admin admin] Usage tracker for resource:network and tenant:f183c0c6666645e9ab8c3635833569c4 is out of sync, need to count used quota {{(pid=91830) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 17:12:17.387279 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [None req-e285178b-37d8-462f-b014-0fb97b4e46ab admin admin] Quota usage for network was recalculated. Used quota:0. {{(pid=91830) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 17:12:17.396624 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.quota.driver [None req-e285178b-37d8-462f-b014-0fb97b4e46ab admin admin] Attempting to reserve 1 items for resource network. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91830) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 17:12:17.406902 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-e285178b-37d8-462f-b014-0fb97b4e46ab admin admin] Made reservation on behalf of f183c0c6666645e9ab8c3635833569c4 for: {'network': 1} {{(pid=91830) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 25 17:12:17.409282 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-e285178b-37d8-462f-b014-0fb97b4e46ab admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_net-3832077'] for network, before_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:12:17.421769 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-e285178b-37d8-462f-b014-0fb97b4e46ab admin admin] Notify callbacks [] for security_group, before_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:12:17.437074 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.quota.driver [None req-e285178b-37d8-462f-b014-0fb97b4e46ab admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91830) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 17:12:17.440890 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [None req-e285178b-37d8-462f-b014-0fb97b4e46ab admin admin] Usage tracker for resource:security_group_rule and tenant:f183c0c6666645e9ab8c3635833569c4 is out of sync, need to count used quota {{(pid=91830) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 17:12:17.444021 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [None req-e285178b-37d8-462f-b014-0fb97b4e46ab admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91830) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 17:12:17.449670 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.quota.driver [None req-e285178b-37d8-462f-b014-0fb97b4e46ab admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91830) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 17:12:17.535370 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-e285178b-37d8-462f-b014-0fb97b4e46ab admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:12:17.539586 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-e285178b-37d8-462f-b014-0fb97b4e46ab admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-640836'] for security_group, after_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:12:17.543761 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-eee219aa-ce8c-4f75-b85e-7560049da413 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:12:17.570880 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-e285178b-37d8-462f-b014-0fb97b4e46ab admin admin] vlan segment allocate from pool success with {'vlan_id': 675, 'physical_network': 'physnet1'} {{(pid=91830) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} May 25 17:12:17.584155 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e285178b-37d8-462f-b014-0fb97b4e46ab admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=af408198-1a2b-4ca3-aa88-275037ef85c5,revision_number=1']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:12:17.591847 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-e285178b-37d8-462f-b014-0fb97b4e46ab admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.044s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:12:17.595020 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-e285178b-37d8-462f-b014-0fb97b4e46ab admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3809789'] for segment, precommit_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:12:17.595309 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.db.segments_db [None req-e285178b-37d8-462f-b014-0fb97b4e46ab admin admin] Added segment e67ad559-7746-4ca1-858c-5806ab2906f0 of type vlan for network 1c289a65-8084-4eb2-85f5-ce070ae5d349 May 25 17:12:17.624324 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-e285178b-37d8-462f-b014-0fb97b4e46ab admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8757892541013'] for network, precommit_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:12:17.654443 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-e285178b-37d8-462f-b014-0fb97b4e46ab admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-640806', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-551400'] for network, after_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:12:17.655769 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e285178b-37d8-462f-b014-0fb97b4e46ab admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91830) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:12:17.656350 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-e285178b-37d8-462f-b014-0fb97b4e46ab admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-551373'] for network, before_response {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:12:17.660945 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:12:17.675375 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.wsgi [-] (91829) accepted ('10.222.0.62', 38266) {{(pid=91829) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:12:17.741634 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.db_base_plugin_v2 [None req-5c6ad507-ced4-4bd8-b2a5-d43b4149d2b7 admin admin] Deleting subnet 02a42c15-5565-457f-98d9-b038a23d1d2b {{(pid=91829) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}} May 25 17:12:17.744760 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-5c6ad507-ced4-4bd8-b2a5-d43b4149d2b7 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:12:17.760784 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [None req-e285178b-37d8-462f-b014-0fb97b4e46ab admin admin] 10.222.0.62 "POST /v2.0/networks HTTP/1.1" status: 201 len: 882 time: 0.4869885 May 25 17:12:17.761648 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e285178b-37d8-462f-b014-0fb97b4e46ab admin admin] Pushing event updated for resources: {'Network': ['ID=1c289a65-8084-4eb2-85f5-ce070ae5d349,revision_number=1']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:12:17.763821 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.wsgi [-] (91830) accepted ('10.222.0.62', 38270) {{(pid=91830) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:12:17.766611 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-e285178b-37d8-462f-b014-0fb97b4e46ab admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.106s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:12:17.771378 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.v2.base [None req-1a71fb0a-4a65-4e62-975b-7c6e874df1d4 admin admin] Request body: {'subnet': {'network_id': '1c289a65-8084-4eb2-85f5-ce070ae5d349', 'cidr': '172.20.0.0/28', 'name': 'tempest-VolumesActionsTest-1612671893-subnet', 'tenant_id': 'f183c0c6666645e9ab8c3635833569c4', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=91830) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 17:12:17.774046 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.rpc [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Network 1c289a65-8084-4eb2-85f5-ce070ae5d349 details requested by agent ovs-agent-dv-cinder-790492-4-iscsi with host dv-cinder-790492-4-iscsi {{(pid=91831) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:232}} May 25 17:12:17.775737 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.quota.driver [None req-1a71fb0a-4a65-4e62-975b-7c6e874df1d4 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91830) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 17:12:17.779546 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [None req-1a71fb0a-4a65-4e62-975b-7c6e874df1d4 admin admin] Usage tracker for resource:subnet and tenant:f183c0c6666645e9ab8c3635833569c4 is out of sync, need to count used quota {{(pid=91830) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 17:12:17.782443 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [None req-1a71fb0a-4a65-4e62-975b-7c6e874df1d4 admin admin] Quota usage for subnet was recalculated. Used quota:0. {{(pid=91830) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 17:12:17.789280 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.quota.driver [None req-1a71fb0a-4a65-4e62-975b-7c6e874df1d4 admin admin] Attempting to reserve 1 items for resource subnet. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91830) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 17:12:17.798521 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-5c6ad507-ced4-4bd8-b2a5-d43b4149d2b7 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-28283188'] for subnet, precommit_delete_associations {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:12:17.800175 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-1a71fb0a-4a65-4e62-975b-7c6e874df1d4 admin admin] Made reservation on behalf of f183c0c6666645e9ab8c3635833569c4 for: {'subnet': 1} {{(pid=91830) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 25 17:12:17.802605 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-1a71fb0a-4a65-4e62-975b-7c6e874df1d4 admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-1152763'] for subnet, before_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:12:17.860246 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-5c6ad507-ced4-4bd8-b2a5-d43b4149d2b7 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3856586'] for subnet, precommit_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:12:18.115876 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-5c6ad507-ced4-4bd8-b2a5-d43b4149d2b7 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3857535', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55886', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-27333739', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-28266126'] for subnet, after_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:12:18.120531 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-5c3cc1d8-141d-43e0-96b3-8ae6ba63f413 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:12:18.146111 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.db.agents_db [None req-504cb04f-4543-46c1-8db7-349e21db7634 None None] Agent healthcheck: found 6 active agents {{(pid=91832) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} May 25 17:12:18.161010 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-5c6ad507-ced4-4bd8-b2a5-d43b4149d2b7 admin admin] Notify callbacks [] for subnet, before_response {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:12:18.164717 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5c6ad507-ced4-4bd8-b2a5-d43b4149d2b7 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=02a42c15-5565-457f-98d9-b038a23d1d2b,revision_number=None']} {{(pid=91829) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:12:18.167400 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-5c6ad507-ced4-4bd8-b2a5-d43b4149d2b7 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.047s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:12:18.174333 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [None req-5c6ad507-ced4-4bd8-b2a5-d43b4149d2b7 admin admin] 10.222.0.62 "DELETE /v2.0/subnets/02a42c15-5565-457f-98d9-b038a23d1d2b HTTP/1.1" status: 204 len: 168 time: 0.4979186 May 25 17:12:18.176876 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.wsgi [-] (91829) accepted ('10.222.0.62', 38274) {{(pid=91829) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:12:18.193004 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-1a71fb0a-4a65-4e62-975b-7c6e874df1d4 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55886', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-28085051', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-1152749'] for subnet, after_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:12:18.198067 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:12:18.267501 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1a71fb0a-4a65-4e62-975b-7c6e874df1d4 admin admin] Pushing event updated for resources: {'Subnet': ['ID=1173229b-93b2-414d-aeb1-c1d1f24bf6d6,revision_number=0']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:12:18.270943 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-1a71fb0a-4a65-4e62-975b-7c6e874df1d4 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.073s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:12:18.276764 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1a71fb0a-4a65-4e62-975b-7c6e874df1d4 admin admin] Checking segment: {'id': 'e67ad559-7746-4ca1-858c-5806ab2906f0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 675, 'network_id': '1c289a65-8084-4eb2-85f5-ce070ae5d349'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91830) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 25 17:12:18.277116 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1a71fb0a-4a65-4e62-975b-7c6e874df1d4 admin admin] Network hostable DHCP agents. Network: 1c289a65-8084-4eb2-85f5-ce070ae5d349, hostable agents: ['8d7401c6-8951-4f2b-ace4-208761782bfc'], hosted agents: [] {{(pid=91830) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} May 25 17:12:18.284955 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-c5c4aa7a-25ef-48b6-9d8f-9eae72729bf7 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3867326'] for network, before_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:12:18.294380 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1a71fb0a-4a65-4e62-975b-7c6e874df1d4 admin admin] Network 1c289a65-8084-4eb2-85f5-ce070ae5d349 is scheduled to be hosted by DHCP agent 8d7401c6-8951-4f2b-ace4-208761782bfc with binding_index 1 {{(pid=91830) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} May 25 17:12:18.303958 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.scheduler.base_scheduler [None req-1a71fb0a-4a65-4e62-975b-7c6e874df1d4 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-790492-4-iscsi, 1c289a65-8084-4eb2-85f5-ce070ae5d349) {{(pid=91830) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 17:12:18.312216 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1a71fb0a-4a65-4e62-975b-7c6e874df1d4 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=91830) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:12:18.312831 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-1a71fb0a-4a65-4e62-975b-7c6e874df1d4 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-551373'] for subnet, before_response {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:12:18.313496 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8c6701bb-fa24-4e09-85ca-51ed4fbbc175 None None] Network 1c289a65-8084-4eb2-85f5-ce070ae5d349 requested from dv-cinder-790492-4-iscsi {{(pid=91831) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} May 25 17:12:18.337944 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [None req-1a71fb0a-4a65-4e62-975b-7c6e874df1d4 admin admin] 10.222.0.62 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 846 time: 0.5694649 May 25 17:12:18.412112 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-c5c4aa7a-25ef-48b6-9d8f-9eae72729bf7 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3858245', 'neutron.services.segments.db._delete_segments_for_network-8757892982492'] for network, precommit_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:12:18.424735 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.services.segments.db [None req-c5c4aa7a-25ef-48b6-9d8f-9eae72729bf7 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['e5e74be9-3ef2-41e8-8f60-c3eb000e2613']}} {{(pid=91829) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 17:12:18.438813 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.services.segments.db [None req-c5c4aa7a-25ef-48b6-9d8f-9eae72729bf7 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'ef74e0cd-a636-40f4-b93e-7649b7caa7b1') {'for_net_delete': True} {{(pid=91829) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 17:12:18.439158 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.services.segments.db [None req-c5c4aa7a-25ef-48b6-9d8f-9eae72729bf7 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'ef74e0cd-a636-40f4-b93e-7649b7caa7b1') {} {{(pid=91829) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 17:12:18.451380 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-c5c4aa7a-25ef-48b6-9d8f-9eae72729bf7 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8757892991389', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-28283199'] for segment, before_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:12:18.467056 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-c5c4aa7a-25ef-48b6-9d8f-9eae72729bf7 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3809789'] for segment, precommit_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:12:18.473199 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-c5c4aa7a-25ef-48b6-9d8f-9eae72729bf7 admin admin] Releasing vlan 680 on physical network physnet1 to pool {{(pid=91829) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 25 17:12:18.473584 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-c5c4aa7a-25ef-48b6-9d8f-9eae72729bf7 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3809789', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-28230861'] for segment, after_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:12:18.486597 dv-cinder-790492-4-iscsi neutron-server[91829]: Traceback (most recent call last): May 25 17:12:18.486597 dv-cinder-790492-4-iscsi neutron-server[91829]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 25 17:12:18.486597 dv-cinder-790492-4-iscsi neutron-server[91829]: timer() May 25 17:12:18.486597 dv-cinder-790492-4-iscsi neutron-server[91829]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 25 17:12:18.486597 dv-cinder-790492-4-iscsi neutron-server[91829]: cb(*args, **kw) May 25 17:12:18.486597 dv-cinder-790492-4-iscsi neutron-server[91829]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper May 25 17:12:18.486597 dv-cinder-790492-4-iscsi neutron-server[91829]: return func(*args, **kwargs) May 25 17:12:18.486597 dv-cinder-790492-4-iscsi neutron-server[91829]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 25 17:12:18.486597 dv-cinder-790492-4-iscsi neutron-server[91829]: self._notify() May 25 17:12:18.486597 dv-cinder-790492-4-iscsi neutron-server[91829]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 25 17:12:18.486597 dv-cinder-790492-4-iscsi neutron-server[91829]: self.callback(batched_events) May 25 17:12:18.486597 dv-cinder-790492-4-iscsi neutron-server[91829]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 25 17:12:18.486597 dv-cinder-790492-4-iscsi neutron-server[91829]: event.method(event) May 25 17:12:18.486597 dv-cinder-790492-4-iscsi neutron-server[91829]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 25 17:12:18.486597 dv-cinder-790492-4-iscsi neutron-server[91829]: aggregate_id = self._get_aggregate_id(event.segment_id) May 25 17:12:18.486597 dv-cinder-790492-4-iscsi neutron-server[91829]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 25 17:12:18.486597 dv-cinder-790492-4-iscsi neutron-server[91829]: aggregate_uuid = self.p_client.list_aggregates( May 25 17:12:18.486597 dv-cinder-790492-4-iscsi neutron-server[91829]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 25 17:12:18.486597 dv-cinder-790492-4-iscsi neutron-server[91829]: return f(self, *a, **k) May 25 17:12:18.486597 dv-cinder-790492-4-iscsi neutron-server[91829]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 25 17:12:18.486597 dv-cinder-790492-4-iscsi neutron-server[91829]: return self._get(url).json() May 25 17:12:18.486597 dv-cinder-790492-4-iscsi neutron-server[91829]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 25 17:12:18.486597 dv-cinder-790492-4-iscsi neutron-server[91829]: return self._client.get(url, endpoint_filter=self._ks_filter, May 25 17:12:18.486597 dv-cinder-790492-4-iscsi neutron-server[91829]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 25 17:12:18.486597 dv-cinder-790492-4-iscsi neutron-server[91829]: return self.request(url, 'GET', **kwargs) May 25 17:12:18.486597 dv-cinder-790492-4-iscsi neutron-server[91829]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 25 17:12:18.486597 dv-cinder-790492-4-iscsi neutron-server[91829]: base_url = self.get_endpoint(auth, allow=allow, May 25 17:12:18.486597 dv-cinder-790492-4-iscsi neutron-server[91829]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 25 17:12:18.486597 dv-cinder-790492-4-iscsi neutron-server[91829]: auth = self._auth_required(auth, 'determine endpoint URL') May 25 17:12:18.486597 dv-cinder-790492-4-iscsi neutron-server[91829]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 25 17:12:18.486597 dv-cinder-790492-4-iscsi neutron-server[91829]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 25 17:12:18.486597 dv-cinder-790492-4-iscsi neutron-server[91829]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 25 17:12:18.507553 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-bd99f492-3ffe-41ad-b909-d65a884e6d20 None None] Network 1c289a65-8084-4eb2-85f5-ce070ae5d349 requested from dv-cinder-790492-4-iscsi {{(pid=91831) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} May 25 17:12:18.568160 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-c5c4aa7a-25ef-48b6-9d8f-9eae72729bf7 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3858252', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-640806', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-551400', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-683051'] for network, after_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:12:18.574250 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-c5c4aa7a-25ef-48b6-9d8f-9eae72729bf7 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-551373'] for network, before_response {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:12:18.578053 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-0c7e99cc-35d6-493b-a6ef-f8f30799d078 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:12:18.596112 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c5c4aa7a-25ef-48b6-9d8f-9eae72729bf7 admin admin] Pushing event deleted for resources: {'Network': ['ID=e5e74be9-3ef2-41e8-8f60-c3eb000e2613,revision_number=None']} {{(pid=91829) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:12:18.598668 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-c5c4aa7a-25ef-48b6-9d8f-9eae72729bf7 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.021s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:12:18.600747 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [None req-c5c4aa7a-25ef-48b6-9d8f-9eae72729bf7 admin admin] 10.222.0.62 "DELETE /v2.0/networks/e5e74be9-3ef2-41e8-8f60-c3eb000e2613 HTTP/1.1" status: 204 len: 168 time: 0.4224498 May 25 17:12:18.603457 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.wsgi [-] (91829) accepted ('10.222.0.62', 38284) {{(pid=91829) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:12:18.662281 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.db_base_plugin_v2 [None req-8706edc4-8c85-4896-9c8a-dd6cd4858d3f admin admin] Deleting subnet 71756d93-baf5-4449-8027-6de172acf5b2 {{(pid=91829) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}} May 25 17:12:18.665734 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-8706edc4-8c85-4896-9c8a-dd6cd4858d3f admin admin] Notify callbacks [] for subnet, before_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:12:18.718437 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-8706edc4-8c85-4896-9c8a-dd6cd4858d3f admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-28283188'] for subnet, precommit_delete_associations {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:12:18.773680 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-8706edc4-8c85-4896-9c8a-dd6cd4858d3f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3856586'] for subnet, precommit_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:12:19.138638 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-8706edc4-8c85-4896-9c8a-dd6cd4858d3f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3857535', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55886', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-27333739', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-28266126'] for subnet, after_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:12:19.143213 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-5f0deea3-760d-479c-ad89-c97d55347b3a admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:12:19.178158 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8706edc4-8c85-4896-9c8a-dd6cd4858d3f admin admin] Pushing event deleted for resources: {'Subnet': ['ID=71756d93-baf5-4449-8027-6de172acf5b2,revision_number=None']} {{(pid=91829) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:12:19.180055 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-8706edc4-8c85-4896-9c8a-dd6cd4858d3f admin admin] Notify callbacks [] for subnet, before_response {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:12:19.182478 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-8706edc4-8c85-4896-9c8a-dd6cd4858d3f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.039s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:12:19.186536 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [None req-8706edc4-8c85-4896-9c8a-dd6cd4858d3f admin admin] 10.222.0.62 "DELETE /v2.0/subnets/71756d93-baf5-4449-8027-6de172acf5b2 HTTP/1.1" status: 204 len: 168 time: 0.5819798 May 25 17:12:19.188999 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.wsgi [-] (91829) accepted ('10.222.0.62', 38292) {{(pid=91829) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:12:19.294027 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-418d3ea0-1d8e-4a73-8cbd-d0f385124040 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3867326'] for network, before_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:12:19.417468 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-418d3ea0-1d8e-4a73-8cbd-d0f385124040 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3858245', 'neutron.services.segments.db._delete_segments_for_network-8757892982492'] for network, precommit_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:12:19.430482 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.services.segments.db [None req-418d3ea0-1d8e-4a73-8cbd-d0f385124040 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['938901d3-9a57-436a-a691-e8a575ba6b4e']}} {{(pid=91829) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 17:12:19.442285 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.services.segments.db [None req-418d3ea0-1d8e-4a73-8cbd-d0f385124040 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '8f259292-dab8-4aad-ae10-e73a06c46278') {'for_net_delete': True} {{(pid=91829) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 17:12:19.442582 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.services.segments.db [None req-418d3ea0-1d8e-4a73-8cbd-d0f385124040 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '8f259292-dab8-4aad-ae10-e73a06c46278') {} {{(pid=91829) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 17:12:19.454219 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-418d3ea0-1d8e-4a73-8cbd-d0f385124040 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8757892991389', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-28283199'] for segment, before_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:12:19.470314 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-418d3ea0-1d8e-4a73-8cbd-d0f385124040 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3809789'] for segment, precommit_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:12:19.476852 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-418d3ea0-1d8e-4a73-8cbd-d0f385124040 admin admin] Releasing vlan 671 on physical network physnet1 to pool {{(pid=91829) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 25 17:12:19.477234 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-418d3ea0-1d8e-4a73-8cbd-d0f385124040 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3809789', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-28230861'] for segment, after_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:12:19.490321 dv-cinder-790492-4-iscsi neutron-server[91829]: Traceback (most recent call last): May 25 17:12:19.490321 dv-cinder-790492-4-iscsi neutron-server[91829]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 25 17:12:19.490321 dv-cinder-790492-4-iscsi neutron-server[91829]: timer() May 25 17:12:19.490321 dv-cinder-790492-4-iscsi neutron-server[91829]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 25 17:12:19.490321 dv-cinder-790492-4-iscsi neutron-server[91829]: cb(*args, **kw) May 25 17:12:19.490321 dv-cinder-790492-4-iscsi neutron-server[91829]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper May 25 17:12:19.490321 dv-cinder-790492-4-iscsi neutron-server[91829]: return func(*args, **kwargs) May 25 17:12:19.490321 dv-cinder-790492-4-iscsi neutron-server[91829]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 25 17:12:19.490321 dv-cinder-790492-4-iscsi neutron-server[91829]: self._notify() May 25 17:12:19.490321 dv-cinder-790492-4-iscsi neutron-server[91829]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 25 17:12:19.490321 dv-cinder-790492-4-iscsi neutron-server[91829]: self.callback(batched_events) May 25 17:12:19.490321 dv-cinder-790492-4-iscsi neutron-server[91829]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 25 17:12:19.490321 dv-cinder-790492-4-iscsi neutron-server[91829]: event.method(event) May 25 17:12:19.490321 dv-cinder-790492-4-iscsi neutron-server[91829]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 25 17:12:19.490321 dv-cinder-790492-4-iscsi neutron-server[91829]: aggregate_id = self._get_aggregate_id(event.segment_id) May 25 17:12:19.490321 dv-cinder-790492-4-iscsi neutron-server[91829]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 25 17:12:19.490321 dv-cinder-790492-4-iscsi neutron-server[91829]: aggregate_uuid = self.p_client.list_aggregates( May 25 17:12:19.490321 dv-cinder-790492-4-iscsi neutron-server[91829]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 25 17:12:19.490321 dv-cinder-790492-4-iscsi neutron-server[91829]: return f(self, *a, **k) May 25 17:12:19.490321 dv-cinder-790492-4-iscsi neutron-server[91829]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 25 17:12:19.490321 dv-cinder-790492-4-iscsi neutron-server[91829]: return self._get(url).json() May 25 17:12:19.490321 dv-cinder-790492-4-iscsi neutron-server[91829]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 25 17:12:19.490321 dv-cinder-790492-4-iscsi neutron-server[91829]: return self._client.get(url, endpoint_filter=self._ks_filter, May 25 17:12:19.490321 dv-cinder-790492-4-iscsi neutron-server[91829]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 25 17:12:19.490321 dv-cinder-790492-4-iscsi neutron-server[91829]: return self.request(url, 'GET', **kwargs) May 25 17:12:19.490321 dv-cinder-790492-4-iscsi neutron-server[91829]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 25 17:12:19.490321 dv-cinder-790492-4-iscsi neutron-server[91829]: base_url = self.get_endpoint(auth, allow=allow, May 25 17:12:19.490321 dv-cinder-790492-4-iscsi neutron-server[91829]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 25 17:12:19.490321 dv-cinder-790492-4-iscsi neutron-server[91829]: auth = self._auth_required(auth, 'determine endpoint URL') May 25 17:12:19.490321 dv-cinder-790492-4-iscsi neutron-server[91829]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 25 17:12:19.490321 dv-cinder-790492-4-iscsi neutron-server[91829]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 25 17:12:19.490321 dv-cinder-790492-4-iscsi neutron-server[91829]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 25 17:12:19.565411 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-418d3ea0-1d8e-4a73-8cbd-d0f385124040 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3858252', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-640806', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-551400', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-683051'] for network, after_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:12:19.569702 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:12:19.582179 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-418d3ea0-1d8e-4a73-8cbd-d0f385124040 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-551373'] for network, before_response {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:12:19.591290 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-418d3ea0-1d8e-4a73-8cbd-d0f385124040 admin admin] Pushing event deleted for resources: {'Network': ['ID=938901d3-9a57-436a-a691-e8a575ba6b4e,revision_number=None']} {{(pid=91829) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:12:19.594013 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [None req-418d3ea0-1d8e-4a73-8cbd-d0f385124040 admin admin] 10.222.0.62 "DELETE /v2.0/networks/938901d3-9a57-436a-a691-e8a575ba6b4e HTTP/1.1" status: 204 len: 168 time: 0.4040985 May 25 17:12:19.594954 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-418d3ea0-1d8e-4a73-8cbd-d0f385124040 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.026s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:12:19.710412 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.wsgi [-] (91830) accepted ('10.222.0.62', 38300) {{(pid=91830) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:12:19.759144 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [None req-384625fd-e150-4e2e-b2b1-713982bba659 admin admin] 10.222.0.62 "GET /v2.0/security-groups?tenant_id=d491039ebcdc426e877032235dbbdbf7&name=default HTTP/1.1" status: 200 len: 2979 time: 0.0474918 May 25 17:12:19.761586 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.wsgi [-] (91830) accepted ('10.222.0.62', 38304) {{(pid=91830) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:12:19.822156 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-c710aa0e-8f21-44c5-a7c8-39c7f77a6ae6 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:12:19.847119 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-c710aa0e-8f21-44c5-a7c8-39c7f77a6ae6 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:12:19.900926 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-c710aa0e-8f21-44c5-a7c8-39c7f77a6ae6 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-640836'] for security_group, after_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:12:19.904824 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-035a371f-9d66-47a8-9b06-9feef1fbd693 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:12:19.916413 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c710aa0e-8f21-44c5-a7c8-39c7f77a6ae6 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=3109a65d-2718-4675-807d-e5cc77ca98f0,revision_number=None']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:12:19.920314 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-c710aa0e-8f21-44c5-a7c8-39c7f77a6ae6 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.016s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:12:19.923992 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-c710aa0e-8f21-44c5-a7c8-39c7f77a6ae6 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:12:19.925089 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [None req-c710aa0e-8f21-44c5-a7c8-39c7f77a6ae6 admin admin] 10.222.0.62 "DELETE /v2.0/security-groups/3109a65d-2718-4675-807d-e5cc77ca98f0 HTTP/1.1" status: 204 len: 168 time: 0.1626108 May 25 17:12:20.274811 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.wsgi [-] (91830) accepted ('10.222.0.62', 38322) {{(pid=91830) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:12:20.330584 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [None req-91fc4f82-86fd-4728-9019-321b003ab621 admin admin] 10.222.0.62 "GET /v2.0/security-groups?tenant_id=f6d12e366fa24a279bba93e23a53a126&name=default HTTP/1.1" status: 200 len: 2979 time: 0.0544555 May 25 17:12:20.332836 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.wsgi [-] (91830) accepted ('10.222.0.62', 38330) {{(pid=91830) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:12:20.398016 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-59a1cb35-afd4-4e7b-950b-63dc2e8835fc admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:12:20.431053 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-59a1cb35-afd4-4e7b-950b-63dc2e8835fc admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:12:20.449190 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5a45453c-de1f-4303-81d5-84458389a5fd req-27825aec-8ed7-4755-8e5f-355caf9fc20c tempest-VolumesActionsTest-484617325 tempest-VolumesActionsTest-484617325-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:12:20.450762 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-5a45453c-de1f-4303-81d5-84458389a5fd req-27825aec-8ed7-4755-8e5f-355caf9fc20c tempest-VolumesActionsTest-484617325 tempest-VolumesActionsTest-484617325-project] 10.222.0.62 "GET /v2.0/networks?id=1c289a65-8084-4eb2-85f5-ce070ae5d349 HTTP/1.1" status: 200 len: 809 time: 0.1542366 May 25 17:12:20.467017 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-5a45453c-de1f-4303-81d5-84458389a5fd req-1a6d28ba-6d8b-47e2-ad04-c1c6b22610b7 tempest-VolumesActionsTest-484617325 tempest-VolumesActionsTest-484617325-project] 10.222.0.62 "GET /v2.0/quotas/f183c0c6666645e9ab8c3635833569c4 HTTP/1.1" status: 200 len: 375 time: 0.0103674 May 25 17:12:20.520380 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-5a45453c-de1f-4303-81d5-84458389a5fd req-96fae2c3-3b25-4561-a63e-52d97d37b0ba tempest-VolumesActionsTest-484617325 tempest-VolumesActionsTest-484617325-project] 10.222.0.62 "GET /v2.0/ports?tenant_id=f183c0c6666645e9ab8c3635833569c4&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0479445 May 25 17:12:20.568420 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-59a1cb35-afd4-4e7b-950b-63dc2e8835fc admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-640836'] for security_group, after_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:12:20.572607 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-806bfc8d-aa31-4b61-aeb1-49f969d7c7bc admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:12:20.583560 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-59a1cb35-afd4-4e7b-950b-63dc2e8835fc admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=78372c2e-737d-4601-8365-8a077c221b57,revision_number=None']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:12:20.587142 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-59a1cb35-afd4-4e7b-950b-63dc2e8835fc admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.015s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:12:20.590370 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-59a1cb35-afd4-4e7b-950b-63dc2e8835fc admin admin] Notify callbacks [] for security_group, before_response {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:12:20.592395 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [None req-59a1cb35-afd4-4e7b-950b-63dc2e8835fc admin admin] 10.222.0.62 "DELETE /v2.0/security-groups/78372c2e-737d-4601-8365-8a077c221b57 HTTP/1.1" status: 204 len: 168 time: 0.2586298 May 25 17:12:20.657549 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-5a45453c-de1f-4303-81d5-84458389a5fd req-87722459-29ad-478b-9b32-7abaa92c85c4 service neutron] 10.222.0.62 "GET /v2.0/networks/1c289a65-8084-4eb2-85f5-ce070ae5d349?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1303563 May 25 17:12:20.801201 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-5a45453c-de1f-4303-81d5-84458389a5fd req-9ecf97f4-8140-406d-9db6-1393801988aa service neutron] 10.222.0.62 "GET /v2.0/networks/1c289a65-8084-4eb2-85f5-ce070ae5d349?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1373327 May 25 17:12:20.977805 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-04ed8941-0dc2-481f-a0e3-b66dfc99cb0c req-dee4e164-987a-49fb-b888-f7dbaa541c38 tempest-VolumesActionsTest-484617325 tempest-VolumesActionsTest-484617325-project] 10.222.0.62 "GET /v2.0/ports?device_id=d32c84a4-1fb0-464f-96d2-b6839434a1a4 HTTP/1.1" status: 200 len: 210 time: 0.0431595 May 25 17:12:22.086533 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-00468dbc-1dd2-490b-97e9-a6ca111f2c9c req-77e33936-8ff8-4ff1-b041-553c5d40df27 tempest-VolumesActionsTest-484617325 tempest-VolumesActionsTest-484617325-project] 10.222.0.62 "GET /v2.0/ports?device_id=d32c84a4-1fb0-464f-96d2-b6839434a1a4 HTTP/1.1" status: 200 len: 210 time: 0.0470927 May 25 17:12:23.129592 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5a45453c-de1f-4303-81d5-84458389a5fd req-e2c8641c-173f-4eb9-b029-eb4777357a73 tempest-VolumesActionsTest-484617325 tempest-VolumesActionsTest-484617325-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:12:23.131029 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-5a45453c-de1f-4303-81d5-84458389a5fd req-e2c8641c-173f-4eb9-b029-eb4777357a73 tempest-VolumesActionsTest-484617325 tempest-VolumesActionsTest-484617325-project] 10.222.0.32 "GET /v2.0/networks?id=1c289a65-8084-4eb2-85f5-ce070ae5d349 HTTP/1.1" status: 200 len: 809 time: 0.1515861 May 25 17:12:23.143660 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.v2.base [req-5a45453c-de1f-4303-81d5-84458389a5fd req-2cb61e29-355b-4d24-9e2e-618b8ed89c1e tempest-VolumesActionsTest-484617325 tempest-VolumesActionsTest-484617325-project] Request body: {'port': {'device_id': 'd32c84a4-1fb0-464f-96d2-b6839434a1a4', 'network_id': '1c289a65-8084-4eb2-85f5-ce070ae5d349', 'admin_state_up': True, 'tenant_id': 'f183c0c6666645e9ab8c3635833569c4'}} {{(pid=91829) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 17:12:23.367676 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-6a3d3818-26a8-470b-8e66-e061870f5306 req-650d7991-0676-4ba8-8b27-14f66b3cc9d3 tempest-VolumesActionsTest-484617325 tempest-VolumesActionsTest-484617325-project] 10.222.0.62 "GET /v2.0/ports?device_id=d32c84a4-1fb0-464f-96d2-b6839434a1a4 HTTP/1.1" status: 200 len: 210 time: 0.1535938 May 25 17:12:23.422681 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.quota.driver [req-5a45453c-de1f-4303-81d5-84458389a5fd req-2cb61e29-355b-4d24-9e2e-618b8ed89c1e tempest-VolumesActionsTest-484617325 tempest-VolumesActionsTest-484617325-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91829) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 17:12:23.426707 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.quota.resource [req-5a45453c-de1f-4303-81d5-84458389a5fd req-2cb61e29-355b-4d24-9e2e-618b8ed89c1e tempest-VolumesActionsTest-484617325 tempest-VolumesActionsTest-484617325-project] Usage tracker for resource:port and tenant:f183c0c6666645e9ab8c3635833569c4 is out of sync, need to count used quota {{(pid=91829) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 17:12:23.430068 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.quota.resource [req-5a45453c-de1f-4303-81d5-84458389a5fd req-2cb61e29-355b-4d24-9e2e-618b8ed89c1e tempest-VolumesActionsTest-484617325 tempest-VolumesActionsTest-484617325-project] Quota usage for port was recalculated. Used quota:0. {{(pid=91829) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 17:12:23.435687 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.quota.driver [req-5a45453c-de1f-4303-81d5-84458389a5fd req-2cb61e29-355b-4d24-9e2e-618b8ed89c1e tempest-VolumesActionsTest-484617325 tempest-VolumesActionsTest-484617325-project] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=91829) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 17:12:23.445427 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-5a45453c-de1f-4303-81d5-84458389a5fd req-2cb61e29-355b-4d24-9e2e-618b8ed89c1e tempest-VolumesActionsTest-484617325 tempest-VolumesActionsTest-484617325-project] Made reservation on behalf of f183c0c6666645e9ab8c3635833569c4 for: {'port': 1} {{(pid=91829) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 25 17:12:23.448816 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [req-5a45453c-de1f-4303-81d5-84458389a5fd req-2cb61e29-355b-4d24-9e2e-618b8ed89c1e tempest-VolumesActionsTest-484617325 tempest-VolumesActionsTest-484617325-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3832070'] for port, before_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:12:23.608954 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.db_base_plugin_common [req-5a45453c-de1f-4303-81d5-84458389a5fd req-2cb61e29-355b-4d24-9e2e-618b8ed89c1e tempest-VolumesActionsTest-484617325 tempest-VolumesActionsTest-484617325-project] Allocated IP 172.20.0.10 (1c289a65-8084-4eb2-85f5-ce070ae5d349/1173229b-93b2-414d-aeb1-c1d1f24bf6d6/c224c371-d72c-40eb-bc42-093f368d5b7b) {{(pid=91829) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 25 17:12:23.813384 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [req-5a45453c-de1f-4303-81d5-84458389a5fd req-2cb61e29-355b-4d24-9e2e-618b8ed89c1e tempest-VolumesActionsTest-484617325 tempest-VolumesActionsTest-484617325-project] Notify callbacks [] for port, precommit_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:12:23.843742 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [req-5a45453c-de1f-4303-81d5-84458389a5fd req-2cb61e29-355b-4d24-9e2e-618b8ed89c1e tempest-VolumesActionsTest-484617325 tempest-VolumesActionsTest-484617325-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8757892520915', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28230808'] for port, after_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:12:23.849646 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-81a851f4-d95e-4ce6-b494-26edcd907e37 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:12:23.916684 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-5a45453c-de1f-4303-81d5-84458389a5fd req-2cb61e29-355b-4d24-9e2e-618b8ed89c1e tempest-VolumesActionsTest-484617325 tempest-VolumesActionsTest-484617325-project] Network 1c289a65-8084-4eb2-85f5-ce070ae5d349 is already hosted by enough agents. {{(pid=91829) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 25 17:12:23.919519 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.scheduler.base_scheduler [req-5a45453c-de1f-4303-81d5-84458389a5fd req-2cb61e29-355b-4d24-9e2e-618b8ed89c1e tempest-VolumesActionsTest-484617325 tempest-VolumesActionsTest-484617325-project] Resources bound (agent type, host, resource id): {{(pid=91829) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 17:12:23.923382 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.l3_dvrscheduler_db [req-5a45453c-de1f-4303-81d5-84458389a5fd req-2cb61e29-355b-4d24-9e2e-618b8ed89c1e tempest-VolumesActionsTest-484617325 tempest-VolumesActionsTest-484617325-project] Received port after_create {{(pid=91829) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 25 17:12:23.958064 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2cb61e29-355b-4d24-9e2e-618b8ed89c1e tempest-VolumesActionsTest-484617325 tempest-VolumesActionsTest-484617325-project] Pushing event updated for resources: {'Port': ['ID=c224c371-d72c-40eb-bc42-093f368d5b7b,revision_number=1']} {{(pid=91829) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:12:23.964943 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-2cb61e29-355b-4d24-9e2e-618b8ed89c1e tempest-VolumesActionsTest-484617325 tempest-VolumesActionsTest-484617325-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.115s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:12:23.997624 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5a45453c-de1f-4303-81d5-84458389a5fd req-2cb61e29-355b-4d24-9e2e-618b8ed89c1e tempest-VolumesActionsTest-484617325 tempest-VolumesActionsTest-484617325-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:12:23.998249 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [req-5a45453c-de1f-4303-81d5-84458389a5fd req-2cb61e29-355b-4d24-9e2e-618b8ed89c1e tempest-VolumesActionsTest-484617325 tempest-VolumesActionsTest-484617325-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-178712'] for port, before_response {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:12:24.024967 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-5a45453c-de1f-4303-81d5-84458389a5fd req-2cb61e29-355b-4d24-9e2e-618b8ed89c1e tempest-VolumesActionsTest-484617325 tempest-VolumesActionsTest-484617325-project] 10.222.0.32 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 0.8843696 May 25 17:12:24.040911 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.v2.base [req-5a45453c-de1f-4303-81d5-84458389a5fd req-390bb69f-6fa3-4b6c-adab-0db79209c348 service neutron] Request body: {'port': {'device_id': 'd32c84a4-1fb0-464f-96d2-b6839434a1a4', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-79049'}} {{(pid=91829) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 17:12:24.156342 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [req-5a45453c-de1f-4303-81d5-84458389a5fd req-390bb69f-6fa3-4b6c-adab-0db79209c348 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3832070'] for port, before_update {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:12:24.539577 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.notifiers.nova [req-5a45453c-de1f-4303-81d5-84458389a5fd req-390bb69f-6fa3-4b6c-adab-0db79209c348 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id c224c371-d72c-40eb-bc42-093f368d5b7b {{(pid=91829) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} May 25 17:12:24.549363 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [req-5a45453c-de1f-4303-81d5-84458389a5fd req-390bb69f-6fa3-4b6c-adab-0db79209c348 service neutron] Notify callbacks [] for port, precommit_update {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:12:24.572263 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.provisioning_blocks [req-5a45453c-de1f-4303-81d5-84458389a5fd req-390bb69f-6fa3-4b6c-adab-0db79209c348 service neutron] Transition to ACTIVE for port object c224c371-d72c-40eb-bc42-093f368d5b7b will not be triggered until provisioned by entity L2. {{(pid=91829) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 25 17:12:24.577220 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [req-5a45453c-de1f-4303-81d5-84458389a5fd req-390bb69f-6fa3-4b6c-adab-0db79209c348 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8757892955028', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8757892520933', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8757892521750', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28230801'] for port, after_update {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:12:24.582110 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-9de44286-af01-4191-a6fd-0f6ae841798e tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:12:24.628501 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cd6e0ccc-ee4c-4aa7-8985-f7afab7b6ab5 req-159ae473-8c10-4a82-a2af-89aeb4254323 tempest-VolumesActionsTest-484617325 tempest-VolumesActionsTest-484617325-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:12:24.629189 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.quota.resource [req-cd6e0ccc-ee4c-4aa7-8985-f7afab7b6ab5 req-159ae473-8c10-4a82-a2af-89aeb4254323 tempest-VolumesActionsTest-484617325 tempest-VolumesActionsTest-484617325-project] Synchronizing usage tracker for tenant:f183c0c6666645e9ab8c3635833569c4 on resource:port {{(pid=91829) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 25 17:12:24.753229 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-390bb69f-6fa3-4b6c-adab-0db79209c348 service neutron] Pushing event updated for resources: {'Port': ['ID=c224c371-d72c-40eb-bc42-093f368d5b7b,revision_number=2']} {{(pid=91829) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:12:24.756245 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-390bb69f-6fa3-4b6c-adab-0db79209c348 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.174s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:12:24.763971 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.quota.resource [req-cd6e0ccc-ee4c-4aa7-8985-f7afab7b6ab5 req-159ae473-8c10-4a82-a2af-89aeb4254323 tempest-VolumesActionsTest-484617325 tempest-VolumesActionsTest-484617325-project] Unset dirty status for tenant:f183c0c6666645e9ab8c3635833569c4 on resource:port {{(pid=91829) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 25 17:12:24.765419 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-cd6e0ccc-ee4c-4aa7-8985-f7afab7b6ab5 req-159ae473-8c10-4a82-a2af-89aeb4254323 tempest-VolumesActionsTest-484617325 tempest-VolumesActionsTest-484617325-project] 10.222.0.62 "GET /v2.0/ports?device_id=d32c84a4-1fb0-464f-96d2-b6839434a1a4 HTTP/1.1" status: 200 len: 932 time: 0.2857056 May 25 17:12:24.864852 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-cd6e0ccc-ee4c-4aa7-8985-f7afab7b6ab5 req-7b5465c6-0088-4a28-8577-ab246d5dc937 tempest-VolumesActionsTest-484617325 tempest-VolumesActionsTest-484617325-project] 10.222.0.62 "GET /v2.0/security-groups?id=af408198-1a2b-4ca3-aa88-275037ef85c5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0932095 May 25 17:12:24.871762 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.plugins.ml2.managers [req-5a45453c-de1f-4303-81d5-84458389a5fd req-390bb69f-6fa3-4b6c-adab-0db79209c348 service neutron] Attempting to bind port c224c371-d72c-40eb-bc42-093f368d5b7b on host hv-cinder-79049 for vnic_type normal with profile {{(pid=91829) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 25 17:12:24.872103 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.plugins.ml2.managers [req-5a45453c-de1f-4303-81d5-84458389a5fd req-390bb69f-6fa3-4b6c-adab-0db79209c348 service neutron] Attempting to bind port c224c371-d72c-40eb-bc42-093f368d5b7b by drivers openvswitch,hyperv on host hv-cinder-79049 at level 0 using segments [{'id': 'e67ad559-7746-4ca1-858c-5806ab2906f0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 675, 'network_id': '1c289a65-8084-4eb2-85f5-ce070ae5d349'}] {{(pid=91829) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 25 17:12:24.872434 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5a45453c-de1f-4303-81d5-84458389a5fd req-390bb69f-6fa3-4b6c-adab-0db79209c348 service neutron] Attempting to bind port c224c371-d72c-40eb-bc42-093f368d5b7b on network 1c289a65-8084-4eb2-85f5-ce070ae5d349 {{(pid=91829) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 25 17:12:24.877005 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5a45453c-de1f-4303-81d5-84458389a5fd req-390bb69f-6fa3-4b6c-adab-0db79209c348 service neutron] Port c224c371-d72c-40eb-bc42-093f368d5b7b on network 1c289a65-8084-4eb2-85f5-ce070ae5d349 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-79049 {{(pid=91829) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 25 17:12:24.877478 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5a45453c-de1f-4303-81d5-84458389a5fd req-390bb69f-6fa3-4b6c-adab-0db79209c348 service neutron] Attempting to bind port c224c371-d72c-40eb-bc42-093f368d5b7b on network 1c289a65-8084-4eb2-85f5-ce070ae5d349 {{(pid=91829) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 25 17:12:24.882627 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5a45453c-de1f-4303-81d5-84458389a5fd req-390bb69f-6fa3-4b6c-adab-0db79209c348 service neutron] Checking agent: {'id': '3a1fdee1-bff0-49fb-b470-e13b95ee1b4d', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-79049', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 25, 16, 56, 32), 'started_at': datetime.datetime(2021, 5, 25, 16, 56, 32), 'heartbeat_timestamp': datetime.datetime(2021, 5, 25, 17, 12, 7), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=91829) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 25 17:12:24.882968 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5a45453c-de1f-4303-81d5-84458389a5fd req-390bb69f-6fa3-4b6c-adab-0db79209c348 service neutron] Checking segment: {'id': 'e67ad559-7746-4ca1-858c-5806ab2906f0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 675, 'network_id': '1c289a65-8084-4eb2-85f5-ce070ae5d349'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91829) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 25 17:12:24.883455 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5a45453c-de1f-4303-81d5-84458389a5fd req-390bb69f-6fa3-4b6c-adab-0db79209c348 service neutron] Bound using segment: {'id': 'e67ad559-7746-4ca1-858c-5806ab2906f0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 675, 'network_id': '1c289a65-8084-4eb2-85f5-ce070ae5d349'} {{(pid=91829) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 25 17:12:24.883936 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.plugins.ml2.managers [req-5a45453c-de1f-4303-81d5-84458389a5fd req-390bb69f-6fa3-4b6c-adab-0db79209c348 service neutron] Bound port: c224c371-d72c-40eb-bc42-093f368d5b7b, host: hv-cinder-79049, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'e67ad559-7746-4ca1-858c-5806ab2906f0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 675, 'network_id': '1c289a65-8084-4eb2-85f5-ce070ae5d349'}}] {{(pid=91829) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 25 17:12:24.884313 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [req-5a45453c-de1f-4303-81d5-84458389a5fd req-390bb69f-6fa3-4b6c-adab-0db79209c348 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3832070'] for port, before_update {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:12:24.978007 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.plugins.ml2.db [req-5a45453c-de1f-4303-81d5-84458389a5fd req-390bb69f-6fa3-4b6c-adab-0db79209c348 service neutron] For port c224c371-d72c-40eb-bc42-093f368d5b7b, host hv-cinder-79049, cleared binding levels {{(pid=91829) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 25 17:12:24.981226 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.plugins.ml2.db [req-5a45453c-de1f-4303-81d5-84458389a5fd req-390bb69f-6fa3-4b6c-adab-0db79209c348 service neutron] For port c224c371-d72c-40eb-bc42-093f368d5b7b, host hv-cinder-79049, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79049',level=0,port_id=c224c371-d72c-40eb-bc42-093f368d5b7b,segment=NetworkSegment(e67ad559-7746-4ca1-858c-5806ab2906f0),segment_id=e67ad559-7746-4ca1-858c-5806ab2906f0)] {{(pid=91829) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 25 17:12:24.985532 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [req-5a45453c-de1f-4303-81d5-84458389a5fd req-390bb69f-6fa3-4b6c-adab-0db79209c348 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8757892955028', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8757892520933', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8757892521750', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28230801'] for port, after_update {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:12:24.989953 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-666f9931-eee4-49b6-9f2e-7f465eb384c1 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:12:25.043791 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5a45453c-de1f-4303-81d5-84458389a5fd req-390bb69f-6fa3-4b6c-adab-0db79209c348 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:12:25.044391 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [req-5a45453c-de1f-4303-81d5-84458389a5fd req-390bb69f-6fa3-4b6c-adab-0db79209c348 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-178712'] for port, before_response {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:12:25.045733 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-5a45453c-de1f-4303-81d5-84458389a5fd req-390bb69f-6fa3-4b6c-adab-0db79209c348 service neutron] 10.222.0.32 "PUT /v2.0/ports/c224c371-d72c-40eb-bc42-093f368d5b7b HTTP/1.1" status: 200 len: 1094 time: 1.0133541 May 25 17:12:25.046243 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'd32c84a4-1fb0-464f-96d2-b6839434a1a4', 'tag': 'c224c371-d72c-40eb-bc42-093f368d5b7b'}] {{(pid=91829) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 25 17:12:25.067296 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-390bb69f-6fa3-4b6c-adab-0db79209c348 service neutron] Pushing event updated for resources: {'Port': ['ID=c224c371-d72c-40eb-bc42-093f368d5b7b,revision_number=3']} {{(pid=91829) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:12:25.070442 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-390bb69f-6fa3-4b6c-adab-0db79209c348 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.081s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:12:25.118167 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'd32c84a4-1fb0-464f-96d2-b6839434a1a4', 'tag': 'c224c371-d72c-40eb-bc42-093f368d5b7b', 'status': 'completed', 'code': 200} May 25 17:12:25.160237 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5a45453c-de1f-4303-81d5-84458389a5fd req-d5277c03-d8f8-4b3d-bc14-4b9907cc441a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:12:25.161717 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-5a45453c-de1f-4303-81d5-84458389a5fd req-d5277c03-d8f8-4b3d-bc14-4b9907cc441a service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=f183c0c6666645e9ab8c3635833569c4&device_id=d32c84a4-1fb0-464f-96d2-b6839434a1a4 HTTP/1.1" status: 200 len: 1097 time: 0.0792420 May 25 17:12:25.230667 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-5a45453c-de1f-4303-81d5-84458389a5fd req-484ac869-2b47-45f9-a7ab-06f7505f7681 service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=c224c371-d72c-40eb-bc42-093f368d5b7b HTTP/1.1" status: 200 len: 217 time: 0.0608039 May 25 17:12:25.336199 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-f0ecb793-93f5-49ab-8af3-e9ff43c534e1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:12:25.403031 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5a45453c-de1f-4303-81d5-84458389a5fd req-67f4caa3-394c-4aa9-8e9a-6890a4720134 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:12:25.404374 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-5a45453c-de1f-4303-81d5-84458389a5fd req-67f4caa3-394c-4aa9-8e9a-6890a4720134 service neutron] 10.222.0.32 "GET /v2.0/subnets?id=1173229b-93b2-414d-aeb1-c1d1f24bf6d6 HTTP/1.1" status: 200 len: 849 time: 0.1665051 May 25 17:12:25.452113 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-5a45453c-de1f-4303-81d5-84458389a5fd req-aebe35bf-e6c1-4f11-9ecf-adeccbb9c93c service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=1c289a65-8084-4eb2-85f5-ce070ae5d349&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0406985 May 25 17:12:25.586920 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-5a45453c-de1f-4303-81d5-84458389a5fd req-0f3b5de1-75ab-4f84-b06b-6d1b4590dc0b service neutron] 10.222.0.32 "GET /v2.0/networks/1c289a65-8084-4eb2-85f5-ce070ae5d349?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1273909 May 25 17:12:25.737671 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-5a45453c-de1f-4303-81d5-84458389a5fd req-4491613b-6b1c-4e76-8b42-2a07ec49242f service neutron] 10.222.0.32 "GET /v2.0/networks/1c289a65-8084-4eb2-85f5-ce070ae5d349?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1439588 May 25 17:12:25.860211 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cbeb6fdf-b507-4da7-ad15-399897ea7220 req-7f61ca1e-8b66-4fae-9d7a-2f162b12b974 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:12:25.861661 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-cbeb6fdf-b507-4da7-ad15-399897ea7220 req-7f61ca1e-8b66-4fae-9d7a-2f162b12b974 service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=f183c0c6666645e9ab8c3635833569c4&device_id=d32c84a4-1fb0-464f-96d2-b6839434a1a4 HTTP/1.1" status: 200 len: 1097 time: 0.0748866 May 25 17:12:26.047743 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cbeb6fdf-b507-4da7-ad15-399897ea7220 req-be13cc05-b89b-4630-9956-21f9cf4a5243 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:12:26.049342 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-cbeb6fdf-b507-4da7-ad15-399897ea7220 req-be13cc05-b89b-4630-9956-21f9cf4a5243 service neutron] 10.222.0.32 "GET /v2.0/networks?id=1c289a65-8084-4eb2-85f5-ce070ae5d349 HTTP/1.1" status: 200 len: 910 time: 0.1809244 May 25 17:12:26.129364 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-cbeb6fdf-b507-4da7-ad15-399897ea7220 req-466307a2-5131-4db8-bb97-7dd6d150fa8e service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=c224c371-d72c-40eb-bc42-093f368d5b7b HTTP/1.1" status: 200 len: 217 time: 0.0714550 May 25 17:12:26.177166 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fdf2cc55-f51e-433f-a047-92e6efacf149 req-2bba4010-2fc8-4db9-b437-bbb7de62c6e1 tempest-VolumesActionsTest-484617325 tempest-VolumesActionsTest-484617325-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:12:26.179154 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-fdf2cc55-f51e-433f-a047-92e6efacf149 req-2bba4010-2fc8-4db9-b437-bbb7de62c6e1 tempest-VolumesActionsTest-484617325 tempest-VolumesActionsTest-484617325-project] 10.222.0.62 "GET /v2.0/ports?device_id=d32c84a4-1fb0-464f-96d2-b6839434a1a4 HTTP/1.1" status: 200 len: 944 time: 0.2069597 May 25 17:12:26.231202 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cbeb6fdf-b507-4da7-ad15-399897ea7220 req-59abc820-eaab-4529-9fde-dd02c3e4d3b5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:12:26.232566 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-cbeb6fdf-b507-4da7-ad15-399897ea7220 req-59abc820-eaab-4529-9fde-dd02c3e4d3b5 service neutron] 10.222.0.32 "GET /v2.0/subnets?id=1173229b-93b2-414d-aeb1-c1d1f24bf6d6 HTTP/1.1" status: 200 len: 849 time: 0.0946701 May 25 17:12:26.243694 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-fdf2cc55-f51e-433f-a047-92e6efacf149 req-5a6af604-06eb-4e75-8f3e-2e66fb416e02 tempest-VolumesActionsTest-484617325 tempest-VolumesActionsTest-484617325-project] 10.222.0.62 "GET /v2.0/security-groups?id=af408198-1a2b-4ca3-aa88-275037ef85c5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0582337 May 25 17:12:26.283242 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-cbeb6fdf-b507-4da7-ad15-399897ea7220 req-c9db23e8-4d3f-4b08-a856-7544454cfaf9 service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=1c289a65-8084-4eb2-85f5-ce070ae5d349&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0430615 May 25 17:12:26.422935 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-cbeb6fdf-b507-4da7-ad15-399897ea7220 req-274eaf4e-dddc-4e64-9f37-4fa3c151c54d service neutron] 10.222.0.32 "GET /v2.0/networks/1c289a65-8084-4eb2-85f5-ce070ae5d349?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1323330 May 25 17:12:26.556367 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-cbeb6fdf-b507-4da7-ad15-399897ea7220 req-1ea35734-7061-454c-9c5b-1ccad66b4f5e service neutron] 10.222.0.32 "GET /v2.0/networks/1c289a65-8084-4eb2-85f5-ce070ae5d349?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1253085 May 25 17:12:27.457500 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bd780c52-1ffe-48ff-89c7-bfe8a18426b6 req-f018c2da-0898-4913-9ad4-59b433118085 tempest-VolumesActionsTest-484617325 tempest-VolumesActionsTest-484617325-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:12:27.458906 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-bd780c52-1ffe-48ff-89c7-bfe8a18426b6 req-f018c2da-0898-4913-9ad4-59b433118085 tempest-VolumesActionsTest-484617325 tempest-VolumesActionsTest-484617325-project] 10.222.0.62 "GET /v2.0/ports?device_id=d32c84a4-1fb0-464f-96d2-b6839434a1a4 HTTP/1.1" status: 200 len: 944 time: 0.0917754 May 25 17:12:27.504589 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-bd780c52-1ffe-48ff-89c7-bfe8a18426b6 req-1e2e0527-a0a9-4785-baf1-77ddd6408360 tempest-VolumesActionsTest-484617325 tempest-VolumesActionsTest-484617325-project] 10.222.0.62 "GET /v2.0/security-groups?id=af408198-1a2b-4ca3-aa88-275037ef85c5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0378742 May 25 17:12:27.720189 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-abd41c32-cd82-40e2-aecc-2b1c1ad088fd None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:12:27.908653 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:12:28.659519 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-0a55eb4a-8b57-4233-84d6-6b423b4ed6db None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:12:28.702284 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7ef82d46-b05c-4dee-b341-a72c08632588 req-6075211d-f7c0-4584-8ad6-c2a3c6e1c21c tempest-VolumesActionsTest-484617325 tempest-VolumesActionsTest-484617325-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:12:28.703754 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-7ef82d46-b05c-4dee-b341-a72c08632588 req-6075211d-f7c0-4584-8ad6-c2a3c6e1c21c tempest-VolumesActionsTest-484617325 tempest-VolumesActionsTest-484617325-project] 10.222.0.62 "GET /v2.0/ports?device_id=d32c84a4-1fb0-464f-96d2-b6839434a1a4 HTTP/1.1" status: 200 len: 944 time: 0.0909736 May 25 17:12:28.752221 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-7ef82d46-b05c-4dee-b341-a72c08632588 req-fcd48797-7c8f-4902-9029-8533a6640930 tempest-VolumesActionsTest-484617325 tempest-VolumesActionsTest-484617325-project] 10.222.0.62 "GET /v2.0/security-groups?id=af408198-1a2b-4ca3-aa88-275037ef85c5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0424862 May 25 17:12:29.428279 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.rpc [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Device c224c371-d72c-40eb-bc42-093f368d5b7b details requested by agent hyperv_hv-cinder-79049 with host hv-cinder-79049 {{(pid=91831) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 25 17:12:29.561591 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.db [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] For port c224c371-d72c-40eb-bc42-093f368d5b7b, host hv-cinder-79049, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79049',level=0,port_id=c224c371-d72c-40eb-bc42-093f368d5b7b,segment=NetworkSegment(e67ad559-7746-4ca1-858c-5806ab2906f0),segment_id=e67ad559-7746-4ca1-858c-5806ab2906f0)] {{(pid=91831) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 17:12:29.575448 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.rpc [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Returning: {'device': 'c224c371-d72c-40eb-bc42-093f368d5b7b', 'network_id': '1c289a65-8084-4eb2-85f5-ce070ae5d349', 'port_id': 'c224c371-d72c-40eb-bc42-093f368d5b7b', 'mac_address': 'fa:16:3e:6a:81:fd', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 675, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '1173229b-93b2-414d-aeb1-c1d1f24bf6d6', 'ip_address': '172.20.0.10'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=91831) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 25 17:12:29.631129 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3832070'] for port, before_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:12:29.647681 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.notifiers.nova [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id c224c371-d72c-40eb-bc42-093f368d5b7b {{(pid=91831) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} May 25 17:12:29.662237 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.db [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] For port c224c371-d72c-40eb-bc42-093f368d5b7b, host hv-cinder-79049, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79049',level=0,port_id=c224c371-d72c-40eb-bc42-093f368d5b7b,segment=NetworkSegment(e67ad559-7746-4ca1-858c-5806ab2906f0),segment_id=e67ad559-7746-4ca1-858c-5806ab2906f0)] {{(pid=91831) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 17:12:29.666090 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8757892955028', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8757892520933', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8757892521750'] for port, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:12:29.667757 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:12:29.731905 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Pushing event updated for resources: {'Port': ['ID=c224c371-d72c-40eb-bc42-093f368d5b7b,revision_number=4']} {{(pid=91831) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:12:29.738822 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91831) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:12:29.739163 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91831) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:12:29.739491 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91831) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:12:29.739815 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91831) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:12:29.740138 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91831) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:12:29.740455 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91831) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:12:29.740770 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91831) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:12:29.741088 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91831) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:12:29.741929 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91831) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:12:29.742258 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91831) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:12:29.742568 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91831) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:12:29.742876 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91831) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:12:29.746657 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.079s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:12:29.936492 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d6c6c16f-37d3-41a8-931c-a0779ae3b9a5 req-331173e1-3430-441f-8cfb-f0964fa92f70 tempest-VolumesActionsTest-484617325 tempest-VolumesActionsTest-484617325-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:12:29.937985 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-d6c6c16f-37d3-41a8-931c-a0779ae3b9a5 req-331173e1-3430-441f-8cfb-f0964fa92f70 tempest-VolumesActionsTest-484617325 tempest-VolumesActionsTest-484617325-project] 10.222.0.62 "GET /v2.0/ports?device_id=d32c84a4-1fb0-464f-96d2-b6839434a1a4 HTTP/1.1" status: 200 len: 945 time: 0.0826333 May 25 17:12:29.990631 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-d6c6c16f-37d3-41a8-931c-a0779ae3b9a5 req-188bd6e7-a7ab-41a2-8234-6a076d8de8de tempest-VolumesActionsTest-484617325 tempest-VolumesActionsTest-484617325-project] 10.222.0.62 "GET /v2.0/security-groups?id=af408198-1a2b-4ca3-aa88-275037ef85c5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0464203 May 25 17:12:30.047289 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.db [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] get_ports_and_sgs() called for port_ids ['c224c371-d72c-40eb-bc42-093f368d5b7b'] {{(pid=91831) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 25 17:12:30.260515 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-57f11b47-1f51-4191-b7c9-af248a48372c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:12:31.176443 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ff143fd6-3e6e-4224-8196-ec9be53a6ca5 req-a6e135ed-fd07-446a-ac3d-d49eac39b076 tempest-VolumesActionsTest-484617325 tempest-VolumesActionsTest-484617325-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:12:31.177964 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-ff143fd6-3e6e-4224-8196-ec9be53a6ca5 req-a6e135ed-fd07-446a-ac3d-d49eac39b076 tempest-VolumesActionsTest-484617325 tempest-VolumesActionsTest-484617325-project] 10.222.0.62 "GET /v2.0/ports?device_id=d32c84a4-1fb0-464f-96d2-b6839434a1a4 HTTP/1.1" status: 200 len: 945 time: 0.0811172 May 25 17:12:31.227769 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-ff143fd6-3e6e-4224-8196-ec9be53a6ca5 req-44b09e59-04a4-4a42-9844-1e6107b46197 tempest-VolumesActionsTest-484617325 tempest-VolumesActionsTest-484617325-project] 10.222.0.62 "GET /v2.0/security-groups?id=af408198-1a2b-4ca3-aa88-275037ef85c5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0433710 May 25 17:12:31.439049 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.rpc [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Device c224c371-d72c-40eb-bc42-093f368d5b7b up at agent hyperv_hv-cinder-79049 {{(pid=91831) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 25 17:12:31.511106 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.provisioning_blocks [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Provisioning for port c224c371-d72c-40eb-bc42-093f368d5b7b completed by entity L2. {{(pid=91831) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 25 17:12:31.515694 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.provisioning_blocks [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Provisioning complete for port c224c371-d72c-40eb-bc42-093f368d5b7b triggered by entity L2. {{(pid=91831) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 17:12:31.516074 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3854128'] for port, provisioning_complete {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:12:31.631469 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3832070'] for port, before_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:12:31.658600 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'd32c84a4-1fb0-464f-96d2-b6839434a1a4', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'c224c371-d72c-40eb-bc42-093f368d5b7b'}] {{(pid=91831) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 25 17:12:31.667913 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.db [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] For port c224c371-d72c-40eb-bc42-093f368d5b7b, host hv-cinder-79049, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79049',level=0,port_id=c224c371-d72c-40eb-bc42-093f368d5b7b,segment=NetworkSegment(e67ad559-7746-4ca1-858c-5806ab2906f0),segment_id=e67ad559-7746-4ca1-858c-5806ab2906f0)] {{(pid=91831) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 17:12:31.671949 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8757892955028', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8757892520933', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8757892521750'] for port, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:12:31.673763 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:12:31.708754 dv-cinder-790492-4-iscsi neutron-server[91831]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'd32c84a4-1fb0-464f-96d2-b6839434a1a4', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'c224c371-d72c-40eb-bc42-093f368d5b7b', 'code': 200} May 25 17:12:31.744057 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Pushing event updated for resources: {'Port': ['ID=c224c371-d72c-40eb-bc42-093f368d5b7b,revision_number=5']} {{(pid=91831) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:12:31.747072 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.073s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:12:32.028344 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e8896673-d7e2-4b91-9063-db058ff1262c req-576df7cc-2479-46fc-aef9-21a5f2391929 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:12:32.029803 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-e8896673-d7e2-4b91-9063-db058ff1262c req-576df7cc-2479-46fc-aef9-21a5f2391929 service neutron] 10.222.0.32 "GET /v2.0/ports?device_id=d32c84a4-1fb0-464f-96d2-b6839434a1a4 HTTP/1.1" status: 200 len: 1099 time: 0.1724880 May 25 17:12:32.071425 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-e8896673-d7e2-4b91-9063-db058ff1262c req-d11fb55e-16a0-4817-a4f3-9b9cb587ff0e service neutron] 10.222.0.32 "GET /v2.0/security-groups?id=af408198-1a2b-4ca3-aa88-275037ef85c5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0343947 May 25 17:12:32.411640 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ca673139-e836-4a6d-b0ce-bb90906a9b74 req-72221734-0b96-42c5-9210-286bfe371989 tempest-VolumesActionsTest-484617325 tempest-VolumesActionsTest-484617325-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:12:32.413078 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-ca673139-e836-4a6d-b0ce-bb90906a9b74 req-72221734-0b96-42c5-9210-286bfe371989 tempest-VolumesActionsTest-484617325 tempest-VolumesActionsTest-484617325-project] 10.222.0.62 "GET /v2.0/ports?device_id=d32c84a4-1fb0-464f-96d2-b6839434a1a4 HTTP/1.1" status: 200 len: 946 time: 0.0799708 May 25 17:12:32.459317 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-ca673139-e836-4a6d-b0ce-bb90906a9b74 req-dcaf9964-9837-443c-9304-913ee2bf6e76 tempest-VolumesActionsTest-484617325 tempest-VolumesActionsTest-484617325-project] 10.222.0.62 "GET /v2.0/security-groups?id=af408198-1a2b-4ca3-aa88-275037ef85c5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0395825 May 25 17:12:32.605696 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.wsgi [-] (91830) accepted ('10.222.0.62', 38480) {{(pid=91830) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:12:32.720181 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-d114be6d-5324-4ed0-a0b1-100338a0c851 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:12:32.735644 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.quota.driver [None req-d114be6d-5324-4ed0-a0b1-100338a0c851 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91830) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 17:12:32.739459 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [None req-d114be6d-5324-4ed0-a0b1-100338a0c851 admin admin] Usage tracker for resource:security_group_rule and tenant:533081f8dbf64773ab24a3575cdd16d9 is out of sync, need to count used quota {{(pid=91830) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 17:12:32.742262 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [None req-d114be6d-5324-4ed0-a0b1-100338a0c851 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91830) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 17:12:32.748007 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.quota.driver [None req-d114be6d-5324-4ed0-a0b1-100338a0c851 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91830) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 17:12:32.831716 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-d114be6d-5324-4ed0-a0b1-100338a0c851 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:12:32.836058 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-d114be6d-5324-4ed0-a0b1-100338a0c851 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-640836'] for security_group, after_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:12:32.842720 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-1240c444-afc7-4ead-aa90-36e375b99d36 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:12:32.881408 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d114be6d-5324-4ed0-a0b1-100338a0c851 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=addb8e33-f623-4d27-a2c4-16528e4053a4,revision_number=1']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:12:32.890037 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.wsgi [-] (91829) accepted ('10.222.0.62', 38486) {{(pid=91829) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:12:32.890171 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [None req-d114be6d-5324-4ed0-a0b1-100338a0c851 admin admin] 10.222.0.62 "GET /v2.0/security-groups?tenant_id=533081f8dbf64773ab24a3575cdd16d9&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2827315 May 25 17:12:32.890518 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-d114be6d-5324-4ed0-a0b1-100338a0c851 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.048s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:12:32.952364 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-88b0f137-fb9f-496e-a63e-4b66611d3a62 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:12:32.977855 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-88b0f137-fb9f-496e-a63e-4b66611d3a62 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:12:33.030742 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-88b0f137-fb9f-496e-a63e-4b66611d3a62 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-640836'] for security_group, after_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:12:33.034518 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-dde0790a-a464-4dbc-9b26-14bb74ea3e5e admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:12:33.045300 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-88b0f137-fb9f-496e-a63e-4b66611d3a62 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=addb8e33-f623-4d27-a2c4-16528e4053a4,revision_number=None']} {{(pid=91829) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:12:33.047695 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-88b0f137-fb9f-496e-a63e-4b66611d3a62 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.013s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:12:33.052965 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-88b0f137-fb9f-496e-a63e-4b66611d3a62 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:12:33.054218 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [None req-88b0f137-fb9f-496e-a63e-4b66611d3a62 admin admin] 10.222.0.62 "DELETE /v2.0/security-groups/addb8e33-f623-4d27-a2c4-16528e4053a4 HTTP/1.1" status: 204 len: 168 time: 0.1631966 May 25 17:12:33.346326 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.wsgi [-] (91829) accepted ('10.222.0.62', 38494) {{(pid=91829) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:12:33.363711 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-a3910046-ba3f-4c3f-a3fe-3bfb60634858 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:12:33.377970 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.quota.driver [None req-a3910046-ba3f-4c3f-a3fe-3bfb60634858 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91829) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 17:12:33.381697 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.quota.resource [None req-a3910046-ba3f-4c3f-a3fe-3bfb60634858 admin admin] Usage tracker for resource:security_group_rule and tenant:ba7a47acd70c41d3884c3408bec75047 is out of sync, need to count used quota {{(pid=91829) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 17:12:33.385125 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.quota.resource [None req-a3910046-ba3f-4c3f-a3fe-3bfb60634858 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91829) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 17:12:33.390740 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.quota.driver [None req-a3910046-ba3f-4c3f-a3fe-3bfb60634858 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91829) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 17:12:33.472537 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-a3910046-ba3f-4c3f-a3fe-3bfb60634858 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:12:33.476809 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-a3910046-ba3f-4c3f-a3fe-3bfb60634858 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-640836'] for security_group, after_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:12:33.483399 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-0134ceee-449f-4518-be91-29097295a9b9 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:12:33.525343 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a3910046-ba3f-4c3f-a3fe-3bfb60634858 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=08199cb1-19d7-437c-aeca-87ff514de41f,revision_number=1']} {{(pid=91829) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:12:33.528422 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-a3910046-ba3f-4c3f-a3fe-3bfb60634858 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.045s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:12:33.533499 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [None req-a3910046-ba3f-4c3f-a3fe-3bfb60634858 admin admin] 10.222.0.62 "GET /v2.0/security-groups?tenant_id=ba7a47acd70c41d3884c3408bec75047&name=default HTTP/1.1" status: 200 len: 2979 time: 0.1836743 May 25 17:12:33.534427 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.wsgi [-] (91829) accepted ('10.222.0.62', 38500) {{(pid=91829) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:12:33.639631 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-7372184d-5d29-41ab-9b40-24d4a9d36f66 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:12:33.669261 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-7372184d-5d29-41ab-9b40-24d4a9d36f66 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:12:33.718722 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3e9fa891-2d7e-4b3b-98c4-0a25a091ba15 req-8a396a51-ddc7-4ae9-9682-9ab64f33e22c tempest-VolumesActionsTest-484617325 tempest-VolumesActionsTest-484617325-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:12:33.720166 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-3e9fa891-2d7e-4b3b-98c4-0a25a091ba15 req-8a396a51-ddc7-4ae9-9682-9ab64f33e22c tempest-VolumesActionsTest-484617325 tempest-VolumesActionsTest-484617325-project] 10.222.0.62 "GET /v2.0/ports?device_id=d32c84a4-1fb0-464f-96d2-b6839434a1a4 HTTP/1.1" status: 200 len: 946 time: 0.1463065 May 25 17:12:33.758092 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-7372184d-5d29-41ab-9b40-24d4a9d36f66 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-640836'] for security_group, after_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:12:33.765169 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-75f911c3-ef6f-423e-9efc-d3127ae10e53 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:12:33.780743 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-3e9fa891-2d7e-4b3b-98c4-0a25a091ba15 req-b7039d2c-0ca6-43fc-a233-9757d4c91fe2 tempest-VolumesActionsTest-484617325 tempest-VolumesActionsTest-484617325-project] 10.222.0.62 "GET /v2.0/security-groups?id=af408198-1a2b-4ca3-aa88-275037ef85c5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0549998 May 25 17:12:33.781411 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7372184d-5d29-41ab-9b40-24d4a9d36f66 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=08199cb1-19d7-437c-aeca-87ff514de41f,revision_number=None']} {{(pid=91829) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:12:33.783631 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-7372184d-5d29-41ab-9b40-24d4a9d36f66 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.019s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:12:33.789206 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-7372184d-5d29-41ab-9b40-24d4a9d36f66 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:12:33.790774 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [None req-7372184d-5d29-41ab-9b40-24d4a9d36f66 admin admin] 10.222.0.62 "DELETE /v2.0/security-groups/08199cb1-19d7-437c-aeca-87ff514de41f HTTP/1.1" status: 204 len: 168 time: 0.2557752 May 25 17:12:34.827635 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dd7c0193-3df3-4bd7-bb87-7aed7f39968f req-b9fcc650-a24d-4856-ac33-6efecff55880 tempest-VolumesActionsTest-484617325 tempest-VolumesActionsTest-484617325-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:12:34.829088 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-dd7c0193-3df3-4bd7-bb87-7aed7f39968f req-b9fcc650-a24d-4856-ac33-6efecff55880 tempest-VolumesActionsTest-484617325 tempest-VolumesActionsTest-484617325-project] 10.222.0.62 "GET /v2.0/ports?device_id=d32c84a4-1fb0-464f-96d2-b6839434a1a4 HTTP/1.1" status: 200 len: 946 time: 0.0855145 May 25 17:12:34.879022 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-dd7c0193-3df3-4bd7-bb87-7aed7f39968f req-79e9532a-2967-47a9-b87a-8ce9b25d71d8 tempest-VolumesActionsTest-484617325 tempest-VolumesActionsTest-484617325-project] 10.222.0.62 "GET /v2.0/security-groups?id=af408198-1a2b-4ca3-aa88-275037ef85c5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0442371 May 25 17:12:34.949333 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.wsgi [-] (91830) accepted ('10.222.0.62', 38544) {{(pid=91830) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:12:35.064569 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-bfee81d5-91e2-47db-bc81-43cf456fb866 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:12:35.082877 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.quota.driver [None req-bfee81d5-91e2-47db-bc81-43cf456fb866 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91830) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 17:12:35.086571 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [None req-bfee81d5-91e2-47db-bc81-43cf456fb866 admin admin] Usage tracker for resource:security_group_rule and tenant:047db3f62c5e456ab5047665cdd46365 is out of sync, need to count used quota {{(pid=91830) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 17:12:35.089497 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [None req-bfee81d5-91e2-47db-bc81-43cf456fb866 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91830) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 17:12:35.095163 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.quota.driver [None req-bfee81d5-91e2-47db-bc81-43cf456fb866 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91830) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 17:12:35.180112 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-bfee81d5-91e2-47db-bc81-43cf456fb866 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:12:35.183837 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-bfee81d5-91e2-47db-bc81-43cf456fb866 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-640836'] for security_group, after_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:12:35.192444 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-48bec47a-852b-405a-93ca-2e9b2ad23ed5 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:12:35.231129 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [None req-bfee81d5-91e2-47db-bc81-43cf456fb866 admin admin] 10.222.0.62 "GET /v2.0/security-groups?tenant_id=047db3f62c5e456ab5047665cdd46365&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2807450 May 25 17:12:35.232742 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bfee81d5-91e2-47db-bc81-43cf456fb866 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=c05721f3-d3f2-4b7d-9557-138c08bffa05,revision_number=1']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:12:35.233810 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.wsgi [-] (91829) accepted ('10.222.0.62', 38550) {{(pid=91829) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:12:35.235821 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-bfee81d5-91e2-47db-bc81-43cf456fb866 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.044s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:12:35.291493 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-23fe0671-9ab0-4e71-8f3f-6f579ba8d750 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:12:35.317322 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-23fe0671-9ab0-4e71-8f3f-6f579ba8d750 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:12:35.367927 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-23fe0671-9ab0-4e71-8f3f-6f579ba8d750 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-640836'] for security_group, after_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:12:35.372538 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-a3910046-ba3f-4c3f-a3fe-3bfb60634858 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:12:35.384782 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-23fe0671-9ab0-4e71-8f3f-6f579ba8d750 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=c05721f3-d3f2-4b7d-9557-138c08bffa05,revision_number=None']} {{(pid=91829) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:12:35.388547 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-23fe0671-9ab0-4e71-8f3f-6f579ba8d750 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.016s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:12:35.389374 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-23fe0671-9ab0-4e71-8f3f-6f579ba8d750 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:12:35.392259 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [None req-23fe0671-9ab0-4e71-8f3f-6f579ba8d750 admin admin] 10.222.0.62 "DELETE /v2.0/security-groups/c05721f3-d3f2-4b7d-9557-138c08bffa05 HTTP/1.1" status: 204 len: 168 time: 0.1556530 May 25 17:12:36.076010 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ce16f695-49af-45ba-b411-26207224a565 req-2e2e528d-c2f9-4c06-9618-6495aa3a8a31 tempest-VolumesActionsTest-484617325 tempest-VolumesActionsTest-484617325-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:12:36.077488 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-ce16f695-49af-45ba-b411-26207224a565 req-2e2e528d-c2f9-4c06-9618-6495aa3a8a31 tempest-VolumesActionsTest-484617325 tempest-VolumesActionsTest-484617325-project] 10.222.0.62 "GET /v2.0/ports?device_id=d32c84a4-1fb0-464f-96d2-b6839434a1a4 HTTP/1.1" status: 200 len: 946 time: 0.0849452 May 25 17:12:36.126243 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-ce16f695-49af-45ba-b411-26207224a565 req-6437688a-cf69-4bcf-8d7e-03a237a84753 tempest-VolumesActionsTest-484617325 tempest-VolumesActionsTest-484617325-project] 10.222.0.62 "GET /v2.0/security-groups?id=af408198-1a2b-4ca3-aa88-275037ef85c5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0428333 May 25 17:12:36.528120 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b57d03ea-aa68-47ff-8766-7b5eb4154e24 req-1ee2a836-f559-42bb-ac40-5ff7c086a9c0 tempest-VolumesActionsTest-484617325 tempest-VolumesActionsTest-484617325-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:12:36.529565 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-b57d03ea-aa68-47ff-8766-7b5eb4154e24 req-1ee2a836-f559-42bb-ac40-5ff7c086a9c0 tempest-VolumesActionsTest-484617325 tempest-VolumesActionsTest-484617325-project] 10.222.0.32 "GET /v2.0/ports?device_id=d32c84a4-1fb0-464f-96d2-b6839434a1a4 HTTP/1.1" status: 200 len: 946 time: 0.0779626 May 25 17:12:36.599501 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:12:36.670757 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.plugins.ml2.plugin [req-b57d03ea-aa68-47ff-8766-7b5eb4154e24 req-ec4aef9e-46c9-4a16-865c-b19c4e28541d tempest-VolumesActionsTest-484617325 tempest-VolumesActionsTest-484617325-project] Deleting port c224c371-d72c-40eb-bc42-093f368d5b7b {{(pid=91829) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 25 17:12:36.671010 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [req-b57d03ea-aa68-47ff-8766-7b5eb4154e24 req-ec4aef9e-46c9-4a16-865c-b19c4e28541d tempest-VolumesActionsTest-484617325 tempest-VolumesActionsTest-484617325-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8757892952899'] for port, before_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:12:36.708486 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.wsgi [-] (91830) accepted ('10.222.0.62', 38596) {{(pid=91830) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:12:36.803280 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.plugins.ml2.db [req-b57d03ea-aa68-47ff-8766-7b5eb4154e24 req-ec4aef9e-46c9-4a16-865c-b19c4e28541d tempest-VolumesActionsTest-484617325 tempest-VolumesActionsTest-484617325-project] For port c224c371-d72c-40eb-bc42-093f368d5b7b, host hv-cinder-79049, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79049',level=0,port_id=c224c371-d72c-40eb-bc42-093f368d5b7b,segment=NetworkSegment(e67ad559-7746-4ca1-858c-5806ab2906f0),segment_id=e67ad559-7746-4ca1-858c-5806ab2906f0)] {{(pid=91829) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 17:12:36.803640 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [req-b57d03ea-aa68-47ff-8766-7b5eb4154e24 req-ec4aef9e-46c9-4a16-865c-b19c4e28541d tempest-VolumesActionsTest-484617325 tempest-VolumesActionsTest-484617325-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-683770'] for port, precommit_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:12:36.827760 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-60ffbf40-2518-4c43-be32-932670a713b5 admin admin] Notify callbacks [] for security_group, before_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:12:36.842699 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.quota.driver [None req-60ffbf40-2518-4c43-be32-932670a713b5 admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91830) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 17:12:36.846438 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [None req-60ffbf40-2518-4c43-be32-932670a713b5 admin admin] Usage tracker for resource:security_group_rule and tenant:ad849255971f410180c72d7797af3dd7 is out of sync, need to count used quota {{(pid=91830) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 17:12:36.849212 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [None req-60ffbf40-2518-4c43-be32-932670a713b5 admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91830) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 17:12:36.855633 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.quota.driver [None req-60ffbf40-2518-4c43-be32-932670a713b5 admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91830) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 17:12:36.930680 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.plugins.ml2.plugin [req-b57d03ea-aa68-47ff-8766-7b5eb4154e24 req-ec4aef9e-46c9-4a16-865c-b19c4e28541d tempest-VolumesActionsTest-484617325 tempest-VolumesActionsTest-484617325-project] Calling delete_port for c224c371-d72c-40eb-bc42-093f368d5b7b owned by compute:nova {{(pid=91829) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 25 17:12:36.939160 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-60ffbf40-2518-4c43-be32-932670a713b5 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:12:36.943313 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-60ffbf40-2518-4c43-be32-932670a713b5 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-640836'] for security_group, after_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:12:36.951906 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-89825042-3af1-497a-8b02-53f00c1f4bbb admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:12:36.996720 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [None req-60ffbf40-2518-4c43-be32-932670a713b5 admin admin] 10.222.0.62 "GET /v2.0/security-groups?tenant_id=ad849255971f410180c72d7797af3dd7&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2871447 May 25 17:12:36.998395 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-60ffbf40-2518-4c43-be32-932670a713b5 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=39b43a65-b8f8-4737-bb01-9115a092ae80,revision_number=1']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:12:37.000659 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.wsgi [-] (91830) accepted ('10.222.0.62', 38602) {{(pid=91830) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:12:37.004509 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-60ffbf40-2518-4c43-be32-932670a713b5 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.053s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:12:37.046670 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [req-b57d03ea-aa68-47ff-8766-7b5eb4154e24 req-ec4aef9e-46c9-4a16-865c-b19c4e28541d tempest-VolumesActionsTest-484617325 tempest-VolumesActionsTest-484617325-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8757892955046', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8757892520924', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28230808'] for port, after_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:12:37.052096 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-68f2a308-6f22-414d-866c-1bae95c209c2 tempest-AttachVolumeShelveTestJSON-979374878 tempest-AttachVolumeShelveTestJSON-979374878-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:12:37.060452 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.db [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] get_ports_and_sgs() called for port_ids ['c224c371-d72c-40eb-bc42-093f368d5b7b'] {{(pid=91831) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 25 17:12:37.063178 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-c9394eda-8060-4096-ae6c-e61b1b682439 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:12:37.090748 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-c9394eda-8060-4096-ae6c-e61b1b682439 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:12:37.099316 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ec4aef9e-46c9-4a16-865c-b19c4e28541d tempest-VolumesActionsTest-484617325 tempest-VolumesActionsTest-484617325-project] Pushing event deleted for resources: {'Port': ['ID=c224c371-d72c-40eb-bc42-093f368d5b7b,revision_number=None']} {{(pid=91829) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:12:37.130123 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-ec4aef9e-46c9-4a16-865c-b19c4e28541d tempest-VolumesActionsTest-484617325 tempest-VolumesActionsTest-484617325-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.078s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:12:37.146983 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-c9394eda-8060-4096-ae6c-e61b1b682439 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-640836'] for security_group, after_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:12:37.152859 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-0359d694-209e-40f3-b9f0-909aec736f53 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:12:37.167372 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c9394eda-8060-4096-ae6c-e61b1b682439 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=39b43a65-b8f8-4737-bb01-9115a092ae80,revision_number=None']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:12:37.169639 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-c9394eda-8060-4096-ae6c-e61b1b682439 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.017s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:12:37.176793 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.l3_dvrscheduler_db [req-b57d03ea-aa68-47ff-8766-7b5eb4154e24 req-ec4aef9e-46c9-4a16-865c-b19c4e28541d tempest-VolumesActionsTest-484617325 tempest-VolumesActionsTest-484617325-project] No DVR routers for this DVR port c224c371-d72c-40eb-bc42-093f368d5b7b on host hv-cinder-79049 {{(pid=91829) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 25 17:12:37.179466 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [req-b57d03ea-aa68-47ff-8766-7b5eb4154e24 req-ec4aef9e-46c9-4a16-865c-b19c4e28541d tempest-VolumesActionsTest-484617325 tempest-VolumesActionsTest-484617325-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-178712'] for port, before_response {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:12:37.182372 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'd32c84a4-1fb0-464f-96d2-b6839434a1a4', 'name': 'network-vif-deleted', 'tag': 'c224c371-d72c-40eb-bc42-093f368d5b7b'}] {{(pid=91829) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 25 17:12:37.187471 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-c9394eda-8060-4096-ae6c-e61b1b682439 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:12:37.189004 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [None req-c9394eda-8060-4096-ae6c-e61b1b682439 admin admin] 10.222.0.62 "DELETE /v2.0/security-groups/39b43a65-b8f8-4737-bb01-9115a092ae80 HTTP/1.1" status: 204 len: 168 time: 0.1862609 May 25 17:12:37.202939 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-b57d03ea-aa68-47ff-8766-7b5eb4154e24 req-ec4aef9e-46c9-4a16-865c-b19c4e28541d tempest-VolumesActionsTest-484617325 tempest-VolumesActionsTest-484617325-project] 10.222.0.32 "DELETE /v2.0/ports/c224c371-d72c-40eb-bc42-093f368d5b7b HTTP/1.1" status: 204 len: 173 time: 0.6666522 May 25 17:12:37.239822 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'd32c84a4-1fb0-464f-96d2-b6839434a1a4', 'name': 'network-vif-deleted', 'tag': 'c224c371-d72c-40eb-bc42-093f368d5b7b', 'status': 'completed', 'code': 200} May 25 17:12:37.315394 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.quota.resource [req-8e23d60b-a853-498f-bd5b-c80cf6c5133f req-0dcab873-7346-4839-ad09-3aa6614e2d26 tempest-VolumesActionsTest-484617325 tempest-VolumesActionsTest-484617325-project] Synchronizing usage tracker for tenant:f183c0c6666645e9ab8c3635833569c4 on resource:port {{(pid=91829) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 25 17:12:37.332426 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.quota.resource [req-8e23d60b-a853-498f-bd5b-c80cf6c5133f req-0dcab873-7346-4839-ad09-3aa6614e2d26 tempest-VolumesActionsTest-484617325 tempest-VolumesActionsTest-484617325-project] Unset dirty status for tenant:f183c0c6666645e9ab8c3635833569c4 on resource:port {{(pid=91829) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 25 17:12:37.341632 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-8e23d60b-a853-498f-bd5b-c80cf6c5133f req-0dcab873-7346-4839-ad09-3aa6614e2d26 tempest-VolumesActionsTest-484617325 tempest-VolumesActionsTest-484617325-project] 10.222.0.62 "GET /v2.0/ports?device_id=d32c84a4-1fb0-464f-96d2-b6839434a1a4 HTTP/1.1" status: 200 len: 210 time: 0.0685048 May 25 17:12:37.798154 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-eaf1c356-1a3d-49a7-962a-a51dd5cb450a req-89694149-0bf3-4371-af98-7082ced5eca1 service neutron] 10.222.0.32 "GET /v2.0/ports?device_id=6e10cbf6-87b6-452f-80e6-c8bd2ce073db&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0796390 May 25 17:12:38.054207 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eaf1c356-1a3d-49a7-962a-a51dd5cb450a req-4b5aae1f-7322-4682-945e-b1fae1a6c967 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:12:38.056442 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-eaf1c356-1a3d-49a7-962a-a51dd5cb450a req-4b5aae1f-7322-4682-945e-b1fae1a6c967 service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=5397bf60956945c3a2bf43c6b1aa614b&device_id=6e10cbf6-87b6-452f-80e6-c8bd2ce073db HTTP/1.1" status: 200 len: 1099 time: 0.1702609 May 25 17:12:38.206090 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eaf1c356-1a3d-49a7-962a-a51dd5cb450a req-5dd1c88c-8403-49e8-87bc-e8a4b6978022 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:12:38.207528 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-eaf1c356-1a3d-49a7-962a-a51dd5cb450a req-5dd1c88c-8403-49e8-87bc-e8a4b6978022 service neutron] 10.222.0.32 "GET /v2.0/networks?id=17a0e39e-1e1f-4550-b28b-d5ae3bdca362 HTTP/1.1" status: 200 len: 912 time: 0.1300728 May 25 17:12:38.313614 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-eaf1c356-1a3d-49a7-962a-a51dd5cb450a req-9a7ed3fd-76d0-469b-8e63-9abf58bb5fd1 service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=c68cea2d-169c-4346-87ef-27549285cb6b HTTP/1.1" status: 200 len: 1001 time: 0.0988023 May 25 17:12:38.384099 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eaf1c356-1a3d-49a7-962a-a51dd5cb450a req-d3ac407c-b6b9-4e9e-ad75-5c16fffdb9e1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:12:38.385777 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-eaf1c356-1a3d-49a7-962a-a51dd5cb450a req-d3ac407c-b6b9-4e9e-ad75-5c16fffdb9e1 service neutron] 10.222.0.32 "GET /v2.0/subnets?id=f5599a2e-9942-4423-a1ac-67e9b2650770 HTTP/1.1" status: 200 len: 850 time: 0.0617917 May 25 17:12:38.485601 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eaf1c356-1a3d-49a7-962a-a51dd5cb450a req-f62f1cfd-3948-4342-9073-720953f71bb5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:12:38.487197 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-eaf1c356-1a3d-49a7-962a-a51dd5cb450a req-f62f1cfd-3948-4342-9073-720953f71bb5 service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=17a0e39e-1e1f-4550-b28b-d5ae3bdca362&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0940278 May 25 17:12:38.630696 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-eaf1c356-1a3d-49a7-962a-a51dd5cb450a req-daf198f0-5266-4db4-adb7-2838ac2f097d service neutron] 10.222.0.32 "GET /v2.0/networks/17a0e39e-1e1f-4550-b28b-d5ae3bdca362?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1361010 May 25 17:12:38.878621 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-eaf1c356-1a3d-49a7-962a-a51dd5cb450a req-b6268c5d-8cf1-4b04-aa11-4dbfa09a9df5 service neutron] 10.222.0.32 "GET /v2.0/networks/17a0e39e-1e1f-4550-b28b-d5ae3bdca362?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2405505 May 25 17:12:38.886311 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c2830f7d-f15a-4495-8f79-ce3132937709 req-29b41a5e-9162-4387-8014-fcb1d05dd8d7 tempest-VolumesActionsTest-484617325 tempest-VolumesActionsTest-484617325-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:12:38.887989 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-c2830f7d-f15a-4495-8f79-ce3132937709 req-29b41a5e-9162-4387-8014-fcb1d05dd8d7 tempest-VolumesActionsTest-484617325 tempest-VolumesActionsTest-484617325-project] 10.222.0.62 "GET /v2.0/networks?id=1c289a65-8084-4eb2-85f5-ce070ae5d349 HTTP/1.1" status: 200 len: 809 time: 0.2315505 May 25 17:12:38.904178 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-c2830f7d-f15a-4495-8f79-ce3132937709 req-8cb8ed9a-66aa-452b-840a-6ac55defe4b3 tempest-VolumesActionsTest-484617325 tempest-VolumesActionsTest-484617325-project] 10.222.0.62 "GET /v2.0/quotas/f183c0c6666645e9ab8c3635833569c4 HTTP/1.1" status: 200 len: 375 time: 0.0098701 May 25 17:12:38.953754 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-c2830f7d-f15a-4495-8f79-ce3132937709 req-2879c073-d4e1-46d3-bc05-73fd002ceeaf tempest-VolumesActionsTest-484617325 tempest-VolumesActionsTest-484617325-project] 10.222.0.62 "GET /v2.0/ports?tenant_id=f183c0c6666645e9ab8c3635833569c4&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0422845 May 25 17:12:39.183380 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-c2830f7d-f15a-4495-8f79-ce3132937709 req-aa176858-682c-4dda-966c-fbb752f1e123 service neutron] 10.222.0.62 "GET /v2.0/networks/1c289a65-8084-4eb2-85f5-ce070ae5d349?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2228556 May 25 17:12:39.315893 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-c2830f7d-f15a-4495-8f79-ce3132937709 req-b2b552de-b985-4813-b05c-ae422aaca017 service neutron] 10.222.0.62 "GET /v2.0/networks/1c289a65-8084-4eb2-85f5-ce070ae5d349?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1268525 May 25 17:12:39.468289 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.rpc [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Device c224c371-d72c-40eb-bc42-093f368d5b7b no longer exists at agent hyperv_hv-cinder-79049 {{(pid=91831) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 25 17:12:39.498501 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-575e7a92-2a9a-4625-8ca3-d8e5c6642d73 req-f9f5ed36-be12-4ab4-9583-b183ad29bd4a tempest-VolumesActionsTest-484617325 tempest-VolumesActionsTest-484617325-project] 10.222.0.62 "GET /v2.0/ports?device_id=686f9b8c-f255-4b30-a26f-8891c3d39346 HTTP/1.1" status: 200 len: 210 time: 0.0483775 May 25 17:12:39.510882 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.plugin [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] No Port match for: c224c371-d72c-40eb-bc42-093f368d5b7b {{(pid=91831) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}} May 25 17:12:39.511358 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.rpc [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Device c224c371-d72c-40eb-bc42-093f368d5b7b not bound to the agent host hv-cinder-79049 {{(pid=91831) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 25 17:12:39.825119 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-686c7e5e-51be-4485-bafa-50ec177ccdb3 req-2dabfcba-68b7-4166-8742-5d615864601c tempest-VolumesNegativeTest-425728667 tempest-VolumesNegativeTest-425728667-project] 10.222.0.62 "GET /v2.0/networks?tenant_id=c7bdecd7f62b4bba97648c47533bc18a&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0284576 May 25 17:12:39.979305 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-686c7e5e-51be-4485-bafa-50ec177ccdb3 req-62594a3c-a998-45ec-ae3c-a6044024a053 tempest-VolumesNegativeTest-425728667 tempest-VolumesNegativeTest-425728667-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:12:39.980776 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-686c7e5e-51be-4485-bafa-50ec177ccdb3 req-62594a3c-a998-45ec-ae3c-a6044024a053 tempest-VolumesNegativeTest-425728667 tempest-VolumesNegativeTest-425728667-project] 10.222.0.62 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.1503420 May 25 17:12:39.995472 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-686c7e5e-51be-4485-bafa-50ec177ccdb3 req-267c4f4a-ae7a-4d36-bd86-663dc25203bc tempest-VolumesNegativeTest-425728667 tempest-VolumesNegativeTest-425728667-project] 10.222.0.62 "GET /v2.0/quotas/c7bdecd7f62b4bba97648c47533bc18a HTTP/1.1" status: 200 len: 375 time: 0.0091224 May 25 17:12:40.045812 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-686c7e5e-51be-4485-bafa-50ec177ccdb3 req-f389b723-a980-41ec-a12a-14e64b6aadc8 tempest-VolumesNegativeTest-425728667 tempest-VolumesNegativeTest-425728667-project] 10.222.0.62 "GET /v2.0/ports?tenant_id=c7bdecd7f62b4bba97648c47533bc18a&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0436878 May 25 17:12:40.220027 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-b842851e-99db-4269-9945-4e150a6a922c req-34109a68-f058-4c8c-b72c-185bf5ad376f tempest-VolumesNegativeTest-425728667 tempest-VolumesNegativeTest-425728667-project] 10.222.0.62 "GET /v2.0/ports?device_id=81a8b68c-799e-4135-a641-4dce2737b8a7 HTTP/1.1" status: 200 len: 210 time: 0.0419216 May 25 17:12:40.680720 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-ce7beae6-e94e-43bd-bffa-1c845069a943 req-d9672fbe-2908-4cdb-b47a-79d7addaad19 tempest-VolumesActionsTest-484617325 tempest-VolumesActionsTest-484617325-project] 10.222.0.62 "GET /v2.0/ports?device_id=686f9b8c-f255-4b30-a26f-8891c3d39346 HTTP/1.1" status: 200 len: 210 time: 0.0596492 May 25 17:12:40.734218 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c2830f7d-f15a-4495-8f79-ce3132937709 req-5c18130b-5f12-44cd-925d-1389487931c5 tempest-VolumesActionsTest-484617325 tempest-VolumesActionsTest-484617325-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:12:40.735620 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-c2830f7d-f15a-4495-8f79-ce3132937709 req-5c18130b-5f12-44cd-925d-1389487931c5 tempest-VolumesActionsTest-484617325 tempest-VolumesActionsTest-484617325-project] 10.222.0.32 "GET /v2.0/networks?id=1c289a65-8084-4eb2-85f5-ce070ae5d349 HTTP/1.1" status: 200 len: 809 time: 0.3153985 May 25 17:12:40.756645 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.v2.base [req-c2830f7d-f15a-4495-8f79-ce3132937709 req-5086b3d5-ca4f-4578-96cf-32c87fdf80e5 tempest-VolumesActionsTest-484617325 tempest-VolumesActionsTest-484617325-project] Request body: {'port': {'device_id': '686f9b8c-f255-4b30-a26f-8891c3d39346', 'network_id': '1c289a65-8084-4eb2-85f5-ce070ae5d349', 'admin_state_up': True, 'tenant_id': 'f183c0c6666645e9ab8c3635833569c4'}} {{(pid=91829) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 17:12:40.890984 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.quota.driver [req-c2830f7d-f15a-4495-8f79-ce3132937709 req-5086b3d5-ca4f-4578-96cf-32c87fdf80e5 tempest-VolumesActionsTest-484617325 tempest-VolumesActionsTest-484617325-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91829) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 17:12:40.900996 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.quota.driver [req-c2830f7d-f15a-4495-8f79-ce3132937709 req-5086b3d5-ca4f-4578-96cf-32c87fdf80e5 tempest-VolumesActionsTest-484617325 tempest-VolumesActionsTest-484617325-project] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=91829) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 17:12:40.910214 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-c2830f7d-f15a-4495-8f79-ce3132937709 req-5086b3d5-ca4f-4578-96cf-32c87fdf80e5 tempest-VolumesActionsTest-484617325 tempest-VolumesActionsTest-484617325-project] Made reservation on behalf of f183c0c6666645e9ab8c3635833569c4 for: {'port': 1} {{(pid=91829) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 25 17:12:40.913927 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [req-c2830f7d-f15a-4495-8f79-ce3132937709 req-5086b3d5-ca4f-4578-96cf-32c87fdf80e5 tempest-VolumesActionsTest-484617325 tempest-VolumesActionsTest-484617325-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3832070'] for port, before_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:12:41.075928 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.db_base_plugin_common [req-c2830f7d-f15a-4495-8f79-ce3132937709 req-5086b3d5-ca4f-4578-96cf-32c87fdf80e5 tempest-VolumesActionsTest-484617325 tempest-VolumesActionsTest-484617325-project] Allocated IP 172.20.0.12 (1c289a65-8084-4eb2-85f5-ce070ae5d349/1173229b-93b2-414d-aeb1-c1d1f24bf6d6/14ab3ce4-171b-446f-8273-18c9dce5690f) {{(pid=91829) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 25 17:12:41.293941 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [req-c2830f7d-f15a-4495-8f79-ce3132937709 req-5086b3d5-ca4f-4578-96cf-32c87fdf80e5 tempest-VolumesActionsTest-484617325 tempest-VolumesActionsTest-484617325-project] Notify callbacks [] for port, precommit_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:12:41.296374 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-686c7e5e-51be-4485-bafa-50ec177ccdb3 req-be05e32d-7b86-4108-b36c-827319abc391 tempest-VolumesNegativeTest-425728667 tempest-VolumesNegativeTest-425728667-project] 10.222.0.32 "GET /v2.0/networks?tenant_id=c7bdecd7f62b4bba97648c47533bc18a&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0294468 May 25 17:12:41.326349 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [req-c2830f7d-f15a-4495-8f79-ce3132937709 req-5086b3d5-ca4f-4578-96cf-32c87fdf80e5 tempest-VolumesActionsTest-484617325 tempest-VolumesActionsTest-484617325-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8757892520915', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28230808'] for port, after_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:12:41.333929 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-ec4aef9e-46c9-4a16-865c-b19c4e28541d tempest-VolumesActionsTest-484617325 tempest-VolumesActionsTest-484617325-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:12:41.435385 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-c2830f7d-f15a-4495-8f79-ce3132937709 req-5086b3d5-ca4f-4578-96cf-32c87fdf80e5 tempest-VolumesActionsTest-484617325 tempest-VolumesActionsTest-484617325-project] Network 1c289a65-8084-4eb2-85f5-ce070ae5d349 is already hosted by enough agents. {{(pid=91829) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 25 17:12:41.442765 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.scheduler.base_scheduler [req-c2830f7d-f15a-4495-8f79-ce3132937709 req-5086b3d5-ca4f-4578-96cf-32c87fdf80e5 tempest-VolumesActionsTest-484617325 tempest-VolumesActionsTest-484617325-project] Resources bound (agent type, host, resource id): {{(pid=91829) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 17:12:41.446030 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.l3_dvrscheduler_db [req-c2830f7d-f15a-4495-8f79-ce3132937709 req-5086b3d5-ca4f-4578-96cf-32c87fdf80e5 tempest-VolumesActionsTest-484617325 tempest-VolumesActionsTest-484617325-project] Received port after_create {{(pid=91829) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 25 17:12:41.483757 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-2828aaa5-e120-45ae-93db-9489c870f8af req-80552407-f1de-4f71-9240-ebcb32f6723e tempest-VolumesNegativeTest-425728667 tempest-VolumesNegativeTest-425728667-project] 10.222.0.62 "GET /v2.0/ports?device_id=81a8b68c-799e-4135-a641-4dce2737b8a7 HTTP/1.1" status: 200 len: 210 time: 0.1508963 May 25 17:12:41.506975 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5086b3d5-ca4f-4578-96cf-32c87fdf80e5 tempest-VolumesActionsTest-484617325 tempest-VolumesActionsTest-484617325-project] Pushing event updated for resources: {'Port': ['ID=14ab3ce4-171b-446f-8273-18c9dce5690f,revision_number=1']} {{(pid=91829) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:12:41.510891 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-5086b3d5-ca4f-4578-96cf-32c87fdf80e5 tempest-VolumesActionsTest-484617325 tempest-VolumesActionsTest-484617325-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.177s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:12:41.528439 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-686c7e5e-51be-4485-bafa-50ec177ccdb3 req-387ff2e3-fea8-421c-b192-7f3cda374783 tempest-VolumesNegativeTest-425728667 tempest-VolumesNegativeTest-425728667-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=91830) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:12:41.529549 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c2830f7d-f15a-4495-8f79-ce3132937709 req-5086b3d5-ca4f-4578-96cf-32c87fdf80e5 tempest-VolumesActionsTest-484617325 tempest-VolumesActionsTest-484617325-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:12:41.530238 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-686c7e5e-51be-4485-bafa-50ec177ccdb3 req-387ff2e3-fea8-421c-b192-7f3cda374783 tempest-VolumesNegativeTest-425728667 tempest-VolumesNegativeTest-425728667-project] 10.222.0.32 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.1575630 May 25 17:12:41.530527 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [req-c2830f7d-f15a-4495-8f79-ce3132937709 req-5086b3d5-ca4f-4578-96cf-32c87fdf80e5 tempest-VolumesActionsTest-484617325 tempest-VolumesActionsTest-484617325-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-178712'] for port, before_response {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:12:41.553557 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.v2.base [req-686c7e5e-51be-4485-bafa-50ec177ccdb3 req-1c73f251-dfca-490a-a14c-4b69dbd0e3af tempest-VolumesNegativeTest-425728667 tempest-VolumesNegativeTest-425728667-project] Request body: {'port': {'device_id': '81a8b68c-799e-4135-a641-4dce2737b8a7', 'network_id': '1ce76c3b-1539-44c4-b658-5acf80c14e4c', 'admin_state_up': True, 'tenant_id': 'c7bdecd7f62b4bba97648c47533bc18a'}} {{(pid=91830) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 17:12:41.554648 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-c2830f7d-f15a-4495-8f79-ce3132937709 req-5086b3d5-ca4f-4578-96cf-32c87fdf80e5 tempest-VolumesActionsTest-484617325 tempest-VolumesActionsTest-484617325-project] 10.222.0.32 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 0.8015690 May 25 17:12:41.574801 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.v2.base [req-c2830f7d-f15a-4495-8f79-ce3132937709 req-79f465bd-7fdb-453b-8bf3-81d325e33a50 service neutron] Request body: {'port': {'device_id': '686f9b8c-f255-4b30-a26f-8891c3d39346', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-79049'}} {{(pid=91829) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 17:12:41.686422 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [req-c2830f7d-f15a-4495-8f79-ce3132937709 req-79f465bd-7fdb-453b-8bf3-81d325e33a50 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3832070'] for port, before_update {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:12:41.693554 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.quota.driver [req-686c7e5e-51be-4485-bafa-50ec177ccdb3 req-1c73f251-dfca-490a-a14c-4b69dbd0e3af tempest-VolumesNegativeTest-425728667 tempest-VolumesNegativeTest-425728667-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91830) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 17:12:41.698168 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [req-686c7e5e-51be-4485-bafa-50ec177ccdb3 req-1c73f251-dfca-490a-a14c-4b69dbd0e3af tempest-VolumesNegativeTest-425728667 tempest-VolumesNegativeTest-425728667-project] Usage tracker for resource:port and tenant:c7bdecd7f62b4bba97648c47533bc18a is out of sync, need to count used quota {{(pid=91830) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 17:12:41.701363 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [req-686c7e5e-51be-4485-bafa-50ec177ccdb3 req-1c73f251-dfca-490a-a14c-4b69dbd0e3af tempest-VolumesNegativeTest-425728667 tempest-VolumesNegativeTest-425728667-project] Quota usage for port was recalculated. Used quota:0. {{(pid=91830) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 17:12:41.708936 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.quota.driver [req-686c7e5e-51be-4485-bafa-50ec177ccdb3 req-1c73f251-dfca-490a-a14c-4b69dbd0e3af tempest-VolumesNegativeTest-425728667 tempest-VolumesNegativeTest-425728667-project] Attempting to reserve 1 items for resource port. Total usage: 0; quota limit: 500; headroom:500 {{(pid=91830) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 17:12:41.719945 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-686c7e5e-51be-4485-bafa-50ec177ccdb3 req-1c73f251-dfca-490a-a14c-4b69dbd0e3af tempest-VolumesNegativeTest-425728667 tempest-VolumesNegativeTest-425728667-project] Made reservation on behalf of c7bdecd7f62b4bba97648c47533bc18a for: {'port': 1} {{(pid=91830) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 25 17:12:41.724124 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [req-686c7e5e-51be-4485-bafa-50ec177ccdb3 req-1c73f251-dfca-490a-a14c-4b69dbd0e3af tempest-VolumesNegativeTest-425728667 tempest-VolumesNegativeTest-425728667-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3832070'] for port, before_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:12:41.741093 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [req-686c7e5e-51be-4485-bafa-50ec177ccdb3 req-1c73f251-dfca-490a-a14c-4b69dbd0e3af tempest-VolumesNegativeTest-425728667 tempest-VolumesNegativeTest-425728667-project] Notify callbacks [] for security_group, before_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:12:41.756530 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.quota.driver [req-686c7e5e-51be-4485-bafa-50ec177ccdb3 req-1c73f251-dfca-490a-a14c-4b69dbd0e3af tempest-VolumesNegativeTest-425728667 tempest-VolumesNegativeTest-425728667-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91830) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 17:12:41.761010 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [req-686c7e5e-51be-4485-bafa-50ec177ccdb3 req-1c73f251-dfca-490a-a14c-4b69dbd0e3af tempest-VolumesNegativeTest-425728667 tempest-VolumesNegativeTest-425728667-project] Usage tracker for resource:security_group_rule and tenant:c7bdecd7f62b4bba97648c47533bc18a is out of sync, need to count used quota {{(pid=91830) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 17:12:41.764072 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [req-686c7e5e-51be-4485-bafa-50ec177ccdb3 req-1c73f251-dfca-490a-a14c-4b69dbd0e3af tempest-VolumesNegativeTest-425728667 tempest-VolumesNegativeTest-425728667-project] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91830) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 17:12:41.770421 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.quota.driver [req-686c7e5e-51be-4485-bafa-50ec177ccdb3 req-1c73f251-dfca-490a-a14c-4b69dbd0e3af tempest-VolumesNegativeTest-425728667 tempest-VolumesNegativeTest-425728667-project] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91830) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 17:12:41.859173 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [req-686c7e5e-51be-4485-bafa-50ec177ccdb3 req-1c73f251-dfca-490a-a14c-4b69dbd0e3af tempest-VolumesNegativeTest-425728667 tempest-VolumesNegativeTest-425728667-project] Notify callbacks [] for security_group, precommit_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:12:41.863712 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [req-686c7e5e-51be-4485-bafa-50ec177ccdb3 req-1c73f251-dfca-490a-a14c-4b69dbd0e3af tempest-VolumesNegativeTest-425728667 tempest-VolumesNegativeTest-425728667-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-640836'] for security_group, after_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:12:41.866622 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-29cc041a-1ce6-411d-b41f-85e35ccdc2b4 tempest-TestMinimumBasicScenario-1752651392 tempest-TestMinimumBasicScenario-1752651392-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:12:41.956801 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1c73f251-dfca-490a-a14c-4b69dbd0e3af tempest-VolumesNegativeTest-425728667 tempest-VolumesNegativeTest-425728667-project] Pushing event updated for resources: {'SecurityGroup': ['ID=092f47b9-90ca-4276-a44f-85bd46d518ba,revision_number=1']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:12:41.969856 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1c73f251-dfca-490a-a14c-4b69dbd0e3af tempest-VolumesNegativeTest-425728667 tempest-VolumesNegativeTest-425728667-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91830) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:12:41.970270 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1c73f251-dfca-490a-a14c-4b69dbd0e3af tempest-VolumesNegativeTest-425728667 tempest-VolumesNegativeTest-425728667-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91830) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:12:41.970650 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1c73f251-dfca-490a-a14c-4b69dbd0e3af tempest-VolumesNegativeTest-425728667 tempest-VolumesNegativeTest-425728667-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91830) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:12:41.971032 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1c73f251-dfca-490a-a14c-4b69dbd0e3af tempest-VolumesNegativeTest-425728667 tempest-VolumesNegativeTest-425728667-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91830) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:12:41.971394 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1c73f251-dfca-490a-a14c-4b69dbd0e3af tempest-VolumesNegativeTest-425728667 tempest-VolumesNegativeTest-425728667-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91830) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:12:41.971759 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1c73f251-dfca-490a-a14c-4b69dbd0e3af tempest-VolumesNegativeTest-425728667 tempest-VolumesNegativeTest-425728667-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91830) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:12:41.972128 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1c73f251-dfca-490a-a14c-4b69dbd0e3af tempest-VolumesNegativeTest-425728667 tempest-VolumesNegativeTest-425728667-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91830) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:12:41.972486 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1c73f251-dfca-490a-a14c-4b69dbd0e3af tempest-VolumesNegativeTest-425728667 tempest-VolumesNegativeTest-425728667-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91830) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:12:41.972846 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1c73f251-dfca-490a-a14c-4b69dbd0e3af tempest-VolumesNegativeTest-425728667 tempest-VolumesNegativeTest-425728667-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91830) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:12:41.973206 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1c73f251-dfca-490a-a14c-4b69dbd0e3af tempest-VolumesNegativeTest-425728667 tempest-VolumesNegativeTest-425728667-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91830) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:12:41.973563 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1c73f251-dfca-490a-a14c-4b69dbd0e3af tempest-VolumesNegativeTest-425728667 tempest-VolumesNegativeTest-425728667-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91830) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:12:41.973935 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1c73f251-dfca-490a-a14c-4b69dbd0e3af tempest-VolumesNegativeTest-425728667 tempest-VolumesNegativeTest-425728667-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91830) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:12:41.981484 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-1c73f251-dfca-490a-a14c-4b69dbd0e3af tempest-VolumesNegativeTest-425728667 tempest-VolumesNegativeTest-425728667-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.114s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:12:41.991666 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2a856cfe-446b-47c0-ae04-6e2ac2be230b req-7199cafa-5b36-4be8-9dd9-6cb3722c1261 tempest-VolumesActionsTest-484617325 tempest-VolumesActionsTest-484617325-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:12:41.992889 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.quota.resource [req-2a856cfe-446b-47c0-ae04-6e2ac2be230b req-7199cafa-5b36-4be8-9dd9-6cb3722c1261 tempest-VolumesActionsTest-484617325 tempest-VolumesActionsTest-484617325-project] Synchronizing usage tracker for tenant:f183c0c6666645e9ab8c3635833569c4 on resource:port {{(pid=91829) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 25 17:12:42.032569 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.quota.resource [req-2a856cfe-446b-47c0-ae04-6e2ac2be230b req-7199cafa-5b36-4be8-9dd9-6cb3722c1261 tempest-VolumesActionsTest-484617325 tempest-VolumesActionsTest-484617325-project] Unset dirty status for tenant:f183c0c6666645e9ab8c3635833569c4 on resource:port {{(pid=91829) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 25 17:12:42.033710 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-2a856cfe-446b-47c0-ae04-6e2ac2be230b req-7199cafa-5b36-4be8-9dd9-6cb3722c1261 tempest-VolumesActionsTest-484617325 tempest-VolumesActionsTest-484617325-project] 10.222.0.62 "GET /v2.0/ports?device_id=686f9b8c-f255-4b30-a26f-8891c3d39346 HTTP/1.1" status: 200 len: 932 time: 0.2300894 May 25 17:12:42.064490 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.db_base_plugin_common [req-686c7e5e-51be-4485-bafa-50ec177ccdb3 req-1c73f251-dfca-490a-a14c-4b69dbd0e3af tempest-VolumesNegativeTest-425728667 tempest-VolumesNegativeTest-425728667-project] Allocated IP 192.168.233.84 (1ce76c3b-1539-44c4-b658-5acf80c14e4c/391b1700-d90b-420a-b57e-7924e6bb1e75/6e3f2c00-d48a-49c0-9c1e-593505b07078) {{(pid=91830) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 25 17:12:42.124176 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-2a856cfe-446b-47c0-ae04-6e2ac2be230b req-410f9904-a9ee-4829-86ee-58069fc3b6b6 tempest-VolumesActionsTest-484617325 tempest-VolumesActionsTest-484617325-project] 10.222.0.62 "GET /v2.0/security-groups?id=af408198-1a2b-4ca3-aa88-275037ef85c5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0831659 May 25 17:12:42.148521 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.notifiers.nova [req-c2830f7d-f15a-4495-8f79-ce3132937709 req-79f465bd-7fdb-453b-8bf3-81d325e33a50 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 14ab3ce4-171b-446f-8273-18c9dce5690f {{(pid=91829) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} May 25 17:12:42.156486 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [req-c2830f7d-f15a-4495-8f79-ce3132937709 req-79f465bd-7fdb-453b-8bf3-81d325e33a50 service neutron] Notify callbacks [] for port, precommit_update {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:12:42.171072 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.provisioning_blocks [req-c2830f7d-f15a-4495-8f79-ce3132937709 req-79f465bd-7fdb-453b-8bf3-81d325e33a50 service neutron] Transition to ACTIVE for port object 14ab3ce4-171b-446f-8273-18c9dce5690f will not be triggered until provisioned by entity L2. {{(pid=91829) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 25 17:12:42.174475 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [req-c2830f7d-f15a-4495-8f79-ce3132937709 req-79f465bd-7fdb-453b-8bf3-81d325e33a50 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8757892955028', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8757892520933', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8757892521750', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28230801'] for port, after_update {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:12:42.179154 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-666f9931-eee4-49b6-9f2e-7f465eb384c1 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:12:42.274993 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [req-686c7e5e-51be-4485-bafa-50ec177ccdb3 req-1c73f251-dfca-490a-a14c-4b69dbd0e3af tempest-VolumesNegativeTest-425728667 tempest-VolumesNegativeTest-425728667-project] Notify callbacks [] for port, precommit_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:12:42.291174 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.provisioning_blocks [req-686c7e5e-51be-4485-bafa-50ec177ccdb3 req-1c73f251-dfca-490a-a14c-4b69dbd0e3af tempest-VolumesNegativeTest-425728667 tempest-VolumesNegativeTest-425728667-project] Transition to ACTIVE for port object 6e3f2c00-d48a-49c0-9c1e-593505b07078 will not be triggered until provisioned by entity DHCP. {{(pid=91830) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 25 17:12:42.315845 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [req-686c7e5e-51be-4485-bafa-50ec177ccdb3 req-1c73f251-dfca-490a-a14c-4b69dbd0e3af tempest-VolumesNegativeTest-425728667 tempest-VolumesNegativeTest-425728667-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8757892520915', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-27483019'] for port, after_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:12:42.321530 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-4c30f282-59bd-4370-bef4-246fd93f74c0 tempest-AttachVolumeTestJSON-1797504790 tempest-AttachVolumeTestJSON-1797504790-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:12:42.393279 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-686c7e5e-51be-4485-bafa-50ec177ccdb3 req-1c73f251-dfca-490a-a14c-4b69dbd0e3af tempest-VolumesNegativeTest-425728667 tempest-VolumesNegativeTest-425728667-project] Network 1ce76c3b-1539-44c4-b658-5acf80c14e4c is already hosted by enough agents. {{(pid=91830) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 25 17:12:42.396183 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.scheduler.base_scheduler [req-686c7e5e-51be-4485-bafa-50ec177ccdb3 req-1c73f251-dfca-490a-a14c-4b69dbd0e3af tempest-VolumesNegativeTest-425728667 tempest-VolumesNegativeTest-425728667-project] Resources bound (agent type, host, resource id): {{(pid=91830) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 17:12:42.400361 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.l3_dvrscheduler_db [req-686c7e5e-51be-4485-bafa-50ec177ccdb3 req-1c73f251-dfca-490a-a14c-4b69dbd0e3af tempest-VolumesNegativeTest-425728667 tempest-VolumesNegativeTest-425728667-project] Received port after_create {{(pid=91830) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 25 17:12:42.432447 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1c73f251-dfca-490a-a14c-4b69dbd0e3af tempest-VolumesNegativeTest-425728667 tempest-VolumesNegativeTest-425728667-project] Pushing event updated for resources: {'Port': ['ID=6e3f2c00-d48a-49c0-9c1e-593505b07078,revision_number=1']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:12:42.439112 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-1c73f251-dfca-490a-a14c-4b69dbd0e3af tempest-VolumesNegativeTest-425728667 tempest-VolumesNegativeTest-425728667-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.118s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:12:42.448817 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-79f465bd-7fdb-453b-8bf3-81d325e33a50 service neutron] Pushing event updated for resources: {'Port': ['ID=14ab3ce4-171b-446f-8273-18c9dce5690f,revision_number=2']} {{(pid=91829) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:12:42.455557 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-79f465bd-7fdb-453b-8bf3-81d325e33a50 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.276s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:12:42.469795 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-686c7e5e-51be-4485-bafa-50ec177ccdb3 req-1c73f251-dfca-490a-a14c-4b69dbd0e3af tempest-VolumesNegativeTest-425728667 tempest-VolumesNegativeTest-425728667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=91830) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:12:42.470430 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [req-686c7e5e-51be-4485-bafa-50ec177ccdb3 req-1c73f251-dfca-490a-a14c-4b69dbd0e3af tempest-VolumesNegativeTest-425728667 tempest-VolumesNegativeTest-425728667-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-178712'] for port, before_response {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:12:42.499854 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-686c7e5e-51be-4485-bafa-50ec177ccdb3 req-1c73f251-dfca-490a-a14c-4b69dbd0e3af tempest-VolumesNegativeTest-425728667 tempest-VolumesNegativeTest-425728667-project] 10.222.0.32 "POST /v2.0/ports HTTP/1.1" status: 201 len: 937 time: 0.9501500 May 25 17:12:42.515200 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.v2.base [req-686c7e5e-51be-4485-bafa-50ec177ccdb3 req-1a8b5df0-7388-43a8-8146-2be4117358de service neutron] Request body: {'port': {'device_id': '81a8b68c-799e-4135-a641-4dce2737b8a7', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-79049'}} {{(pid=91830) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 17:12:42.531709 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.plugins.ml2.managers [req-c2830f7d-f15a-4495-8f79-ce3132937709 req-79f465bd-7fdb-453b-8bf3-81d325e33a50 service neutron] Attempting to bind port 14ab3ce4-171b-446f-8273-18c9dce5690f on host hv-cinder-79049 for vnic_type normal with profile {{(pid=91829) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 25 17:12:42.532158 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.plugins.ml2.managers [req-c2830f7d-f15a-4495-8f79-ce3132937709 req-79f465bd-7fdb-453b-8bf3-81d325e33a50 service neutron] Attempting to bind port 14ab3ce4-171b-446f-8273-18c9dce5690f by drivers openvswitch,hyperv on host hv-cinder-79049 at level 0 using segments [{'id': 'e67ad559-7746-4ca1-858c-5806ab2906f0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 675, 'network_id': '1c289a65-8084-4eb2-85f5-ce070ae5d349'}] {{(pid=91829) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 25 17:12:42.532562 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c2830f7d-f15a-4495-8f79-ce3132937709 req-79f465bd-7fdb-453b-8bf3-81d325e33a50 service neutron] Attempting to bind port 14ab3ce4-171b-446f-8273-18c9dce5690f on network 1c289a65-8084-4eb2-85f5-ce070ae5d349 {{(pid=91829) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 25 17:12:42.537271 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c2830f7d-f15a-4495-8f79-ce3132937709 req-79f465bd-7fdb-453b-8bf3-81d325e33a50 service neutron] Port 14ab3ce4-171b-446f-8273-18c9dce5690f on network 1c289a65-8084-4eb2-85f5-ce070ae5d349 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-79049 {{(pid=91829) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 25 17:12:42.537659 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c2830f7d-f15a-4495-8f79-ce3132937709 req-79f465bd-7fdb-453b-8bf3-81d325e33a50 service neutron] Attempting to bind port 14ab3ce4-171b-446f-8273-18c9dce5690f on network 1c289a65-8084-4eb2-85f5-ce070ae5d349 {{(pid=91829) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 25 17:12:42.544893 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c2830f7d-f15a-4495-8f79-ce3132937709 req-79f465bd-7fdb-453b-8bf3-81d325e33a50 service neutron] Checking agent: {'id': '3a1fdee1-bff0-49fb-b470-e13b95ee1b4d', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-79049', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 25, 16, 56, 32), 'started_at': datetime.datetime(2021, 5, 25, 16, 56, 32), 'heartbeat_timestamp': datetime.datetime(2021, 5, 25, 17, 12, 37), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=91829) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 25 17:12:42.545317 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c2830f7d-f15a-4495-8f79-ce3132937709 req-79f465bd-7fdb-453b-8bf3-81d325e33a50 service neutron] Checking segment: {'id': 'e67ad559-7746-4ca1-858c-5806ab2906f0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 675, 'network_id': '1c289a65-8084-4eb2-85f5-ce070ae5d349'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91829) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 25 17:12:42.545763 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c2830f7d-f15a-4495-8f79-ce3132937709 req-79f465bd-7fdb-453b-8bf3-81d325e33a50 service neutron] Bound using segment: {'id': 'e67ad559-7746-4ca1-858c-5806ab2906f0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 675, 'network_id': '1c289a65-8084-4eb2-85f5-ce070ae5d349'} {{(pid=91829) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 25 17:12:42.546289 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.plugins.ml2.managers [req-c2830f7d-f15a-4495-8f79-ce3132937709 req-79f465bd-7fdb-453b-8bf3-81d325e33a50 service neutron] Bound port: 14ab3ce4-171b-446f-8273-18c9dce5690f, host: hv-cinder-79049, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'e67ad559-7746-4ca1-858c-5806ab2906f0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 675, 'network_id': '1c289a65-8084-4eb2-85f5-ce070ae5d349'}}] {{(pid=91829) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 25 17:12:42.546707 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [req-c2830f7d-f15a-4495-8f79-ce3132937709 req-79f465bd-7fdb-453b-8bf3-81d325e33a50 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3832070'] for port, before_update {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:12:42.624935 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.provisioning_blocks [None req-a4ca79ad-991d-4e65-96ec-cc24b25e225b None None] Provisioning for port 6e3f2c00-d48a-49c0-9c1e-593505b07078 completed by entity DHCP. {{(pid=91831) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 25 17:12:42.631176 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.provisioning_blocks [None req-a4ca79ad-991d-4e65-96ec-cc24b25e225b None None] Provisioning complete for port 6e3f2c00-d48a-49c0-9c1e-593505b07078 triggered by entity DHCP. {{(pid=91831) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 17:12:42.631558 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-a4ca79ad-991d-4e65-96ec-cc24b25e225b None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3854128'] for port, provisioning_complete {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:12:42.638862 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [req-686c7e5e-51be-4485-bafa-50ec177ccdb3 req-1a8b5df0-7388-43a8-8146-2be4117358de service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3832070'] for port, before_update {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:12:42.718107 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.plugins.ml2.db [req-c2830f7d-f15a-4495-8f79-ce3132937709 req-79f465bd-7fdb-453b-8bf3-81d325e33a50 service neutron] For port 14ab3ce4-171b-446f-8273-18c9dce5690f, host hv-cinder-79049, cleared binding levels {{(pid=91829) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 25 17:12:42.721952 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.plugins.ml2.db [req-c2830f7d-f15a-4495-8f79-ce3132937709 req-79f465bd-7fdb-453b-8bf3-81d325e33a50 service neutron] For port 14ab3ce4-171b-446f-8273-18c9dce5690f, host hv-cinder-79049, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79049',level=0,port_id=14ab3ce4-171b-446f-8273-18c9dce5690f,segment=NetworkSegment(e67ad559-7746-4ca1-858c-5806ab2906f0),segment_id=e67ad559-7746-4ca1-858c-5806ab2906f0)] {{(pid=91829) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 25 17:12:42.725821 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.plugin [None req-a4ca79ad-991d-4e65-96ec-cc24b25e225b None None] Port 6e3f2c00-d48a-49c0-9c1e-593505b07078 cannot update to ACTIVE because it is not bound. {{(pid=91831) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 25 17:12:42.731185 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [req-c2830f7d-f15a-4495-8f79-ce3132937709 req-79f465bd-7fdb-453b-8bf3-81d325e33a50 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8757892955028', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8757892520933', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8757892521750', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28230801'] for port, after_update {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:12:42.736414 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-80580940-6740-42e5-8c43-51ed00634953 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:12:42.780215 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-17468d76-6e79-482a-a1fd-784d3f7751d4 req-3ecacbbc-7538-424e-8aaf-0fd4b6ed300c tempest-VolumesNegativeTest-425728667 tempest-VolumesNegativeTest-425728667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:12:42.781670 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-17468d76-6e79-482a-a1fd-784d3f7751d4 req-3ecacbbc-7538-424e-8aaf-0fd4b6ed300c tempest-VolumesNegativeTest-425728667 tempest-VolumesNegativeTest-425728667-project] 10.222.0.62 "GET /v2.0/ports?device_id=81a8b68c-799e-4135-a641-4dce2737b8a7 HTTP/1.1" status: 200 len: 935 time: 0.1769614 May 25 17:12:42.803064 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c2830f7d-f15a-4495-8f79-ce3132937709 req-79f465bd-7fdb-453b-8bf3-81d325e33a50 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:12:42.803830 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [req-c2830f7d-f15a-4495-8f79-ce3132937709 req-79f465bd-7fdb-453b-8bf3-81d325e33a50 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-178712'] for port, before_response {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:12:42.805181 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-c2830f7d-f15a-4495-8f79-ce3132937709 req-79f465bd-7fdb-453b-8bf3-81d325e33a50 service neutron] 10.222.0.32 "PUT /v2.0/ports/14ab3ce4-171b-446f-8273-18c9dce5690f HTTP/1.1" status: 200 len: 1094 time: 1.2378817 May 25 17:12:42.808370 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '686f9b8c-f255-4b30-a26f-8891c3d39346', 'tag': '14ab3ce4-171b-446f-8273-18c9dce5690f'}] {{(pid=91829) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 25 17:12:42.891547 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '686f9b8c-f255-4b30-a26f-8891c3d39346', 'tag': '14ab3ce4-171b-446f-8273-18c9dce5690f', 'status': 'completed', 'code': 200} May 25 17:12:42.908635 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-79f465bd-7fdb-453b-8bf3-81d325e33a50 service neutron] Pushing event updated for resources: {'Port': ['ID=14ab3ce4-171b-446f-8273-18c9dce5690f,revision_number=3']} {{(pid=91829) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:12:42.918749 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-79f465bd-7fdb-453b-8bf3-81d325e33a50 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.182s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:12:42.921775 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-17468d76-6e79-482a-a1fd-784d3f7751d4 req-58b5e8ca-97cd-4e3d-91c5-5fdd9251d477 tempest-VolumesNegativeTest-425728667 tempest-VolumesNegativeTest-425728667-project] 10.222.0.62 "GET /v2.0/security-groups?id=092f47b9-90ca-4276-a44f-85bd46d518ba&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1238565 May 25 17:12:42.948300 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c2830f7d-f15a-4495-8f79-ce3132937709 req-0170e0d8-803a-4e76-ba9f-6201bc5ccb68 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:12:42.949734 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-c2830f7d-f15a-4495-8f79-ce3132937709 req-0170e0d8-803a-4e76-ba9f-6201bc5ccb68 service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=f183c0c6666645e9ab8c3635833569c4&device_id=686f9b8c-f255-4b30-a26f-8891c3d39346 HTTP/1.1" status: 200 len: 1097 time: 0.0929673 May 25 17:12:43.020474 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-c2830f7d-f15a-4495-8f79-ce3132937709 req-5b36f103-1e1a-4be9-b23b-1bc8f87a318d service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=14ab3ce4-171b-446f-8273-18c9dce5690f HTTP/1.1" status: 200 len: 217 time: 0.0622241 May 25 17:12:43.085839 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c2830f7d-f15a-4495-8f79-ce3132937709 req-592951e7-43a6-4022-8330-6e7d69525a38 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:12:43.087294 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-c2830f7d-f15a-4495-8f79-ce3132937709 req-592951e7-43a6-4022-8330-6e7d69525a38 service neutron] 10.222.0.32 "GET /v2.0/subnets?id=1173229b-93b2-414d-aeb1-c1d1f24bf6d6 HTTP/1.1" status: 200 len: 849 time: 0.0603135 May 25 17:12:43.094179 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.notifiers.nova [req-686c7e5e-51be-4485-bafa-50ec177ccdb3 req-1a8b5df0-7388-43a8-8146-2be4117358de service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 6e3f2c00-d48a-49c0-9c1e-593505b07078 {{(pid=91830) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} May 25 17:12:43.102091 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [req-686c7e5e-51be-4485-bafa-50ec177ccdb3 req-1a8b5df0-7388-43a8-8146-2be4117358de service neutron] Notify callbacks [] for port, precommit_update {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:12:43.115919 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.provisioning_blocks [req-686c7e5e-51be-4485-bafa-50ec177ccdb3 req-1a8b5df0-7388-43a8-8146-2be4117358de service neutron] Transition to ACTIVE for port object 6e3f2c00-d48a-49c0-9c1e-593505b07078 will not be triggered until provisioned by entity L2. {{(pid=91830) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 25 17:12:43.120336 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [req-686c7e5e-51be-4485-bafa-50ec177ccdb3 req-1a8b5df0-7388-43a8-8146-2be4117358de service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8757892955028', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8757892520933', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8757892521750', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-27483010'] for port, after_update {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:12:43.124899 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-e393b150-46a8-4165-b26b-60df4e8cbdbf service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:12:43.135592 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-c2830f7d-f15a-4495-8f79-ce3132937709 req-f3ee830b-1a89-4cf9-89e4-1784b41eb4db service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=1c289a65-8084-4eb2-85f5-ce070ae5d349&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0406404 May 25 17:12:43.290207 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1a8b5df0-7388-43a8-8146-2be4117358de service neutron] Pushing event updated for resources: {'Port': ['ID=6e3f2c00-d48a-49c0-9c1e-593505b07078,revision_number=2']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:12:43.320659 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-1a8b5df0-7388-43a8-8146-2be4117358de service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.196s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:12:43.341538 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-c2830f7d-f15a-4495-8f79-ce3132937709 req-bef03fb9-8e3b-406d-a632-cec643c21504 service neutron] 10.222.0.32 "GET /v2.0/networks/1c289a65-8084-4eb2-85f5-ce070ae5d349?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1972773 May 25 17:12:43.363260 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.plugins.ml2.managers [req-686c7e5e-51be-4485-bafa-50ec177ccdb3 req-1a8b5df0-7388-43a8-8146-2be4117358de service neutron] Attempting to bind port 6e3f2c00-d48a-49c0-9c1e-593505b07078 on host hv-cinder-79049 for vnic_type normal with profile {{(pid=91830) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 25 17:12:43.363591 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.plugins.ml2.managers [req-686c7e5e-51be-4485-bafa-50ec177ccdb3 req-1a8b5df0-7388-43a8-8146-2be4117358de service neutron] Attempting to bind port 6e3f2c00-d48a-49c0-9c1e-593505b07078 by drivers openvswitch,hyperv on host hv-cinder-79049 at level 0 using segments [{'id': '015e8123-0c21-4358-ae8e-caf4f629a10c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 684, 'network_id': '1ce76c3b-1539-44c4-b658-5acf80c14e4c'}] {{(pid=91830) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 25 17:12:43.363937 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-686c7e5e-51be-4485-bafa-50ec177ccdb3 req-1a8b5df0-7388-43a8-8146-2be4117358de service neutron] Attempting to bind port 6e3f2c00-d48a-49c0-9c1e-593505b07078 on network 1ce76c3b-1539-44c4-b658-5acf80c14e4c {{(pid=91830) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 25 17:12:43.368764 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-686c7e5e-51be-4485-bafa-50ec177ccdb3 req-1a8b5df0-7388-43a8-8146-2be4117358de service neutron] Port 6e3f2c00-d48a-49c0-9c1e-593505b07078 on network 1ce76c3b-1539-44c4-b658-5acf80c14e4c not bound, no agent of type Open vSwitch agent registered on host hv-cinder-79049 {{(pid=91830) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 25 17:12:43.369091 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-686c7e5e-51be-4485-bafa-50ec177ccdb3 req-1a8b5df0-7388-43a8-8146-2be4117358de service neutron] Attempting to bind port 6e3f2c00-d48a-49c0-9c1e-593505b07078 on network 1ce76c3b-1539-44c4-b658-5acf80c14e4c {{(pid=91830) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 25 17:12:43.374413 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-686c7e5e-51be-4485-bafa-50ec177ccdb3 req-1a8b5df0-7388-43a8-8146-2be4117358de service neutron] Checking agent: {'id': '3a1fdee1-bff0-49fb-b470-e13b95ee1b4d', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-79049', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 25, 16, 56, 32), 'started_at': datetime.datetime(2021, 5, 25, 16, 56, 32), 'heartbeat_timestamp': datetime.datetime(2021, 5, 25, 17, 12, 37), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=91830) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 25 17:12:43.374745 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-686c7e5e-51be-4485-bafa-50ec177ccdb3 req-1a8b5df0-7388-43a8-8146-2be4117358de service neutron] Checking segment: {'id': '015e8123-0c21-4358-ae8e-caf4f629a10c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 684, 'network_id': '1ce76c3b-1539-44c4-b658-5acf80c14e4c'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91830) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 25 17:12:43.375124 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-686c7e5e-51be-4485-bafa-50ec177ccdb3 req-1a8b5df0-7388-43a8-8146-2be4117358de service neutron] Bound using segment: {'id': '015e8123-0c21-4358-ae8e-caf4f629a10c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 684, 'network_id': '1ce76c3b-1539-44c4-b658-5acf80c14e4c'} {{(pid=91830) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 25 17:12:43.376124 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.plugins.ml2.managers [req-686c7e5e-51be-4485-bafa-50ec177ccdb3 req-1a8b5df0-7388-43a8-8146-2be4117358de service neutron] Bound port: 6e3f2c00-d48a-49c0-9c1e-593505b07078, host: hv-cinder-79049, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '015e8123-0c21-4358-ae8e-caf4f629a10c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 684, 'network_id': '1ce76c3b-1539-44c4-b658-5acf80c14e4c'}}] {{(pid=91830) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 25 17:12:43.376124 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [req-686c7e5e-51be-4485-bafa-50ec177ccdb3 req-1a8b5df0-7388-43a8-8146-2be4117358de service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3832070'] for port, before_update {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:12:43.429175 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9ba6a11d-3531-43e2-a085-b365db5fafe0 req-93be40f0-5527-46fc-8d45-6d3cdfe7ead9 tempest-VolumesActionsTest-484617325 tempest-VolumesActionsTest-484617325-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:12:43.430703 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-9ba6a11d-3531-43e2-a085-b365db5fafe0 req-93be40f0-5527-46fc-8d45-6d3cdfe7ead9 tempest-VolumesActionsTest-484617325 tempest-VolumesActionsTest-484617325-project] 10.222.0.62 "GET /v2.0/ports?device_id=686f9b8c-f255-4b30-a26f-8891c3d39346 HTTP/1.1" status: 200 len: 944 time: 0.1957276 May 25 17:12:43.469639 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.plugins.ml2.db [req-686c7e5e-51be-4485-bafa-50ec177ccdb3 req-1a8b5df0-7388-43a8-8146-2be4117358de service neutron] For port 6e3f2c00-d48a-49c0-9c1e-593505b07078, host hv-cinder-79049, cleared binding levels {{(pid=91830) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 25 17:12:43.472511 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.plugins.ml2.db [req-686c7e5e-51be-4485-bafa-50ec177ccdb3 req-1a8b5df0-7388-43a8-8146-2be4117358de service neutron] For port 6e3f2c00-d48a-49c0-9c1e-593505b07078, host hv-cinder-79049, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79049',level=0,port_id=6e3f2c00-d48a-49c0-9c1e-593505b07078,segment=NetworkSegment(015e8123-0c21-4358-ae8e-caf4f629a10c),segment_id=015e8123-0c21-4358-ae8e-caf4f629a10c)] {{(pid=91830) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 25 17:12:43.478854 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [req-686c7e5e-51be-4485-bafa-50ec177ccdb3 req-1a8b5df0-7388-43a8-8146-2be4117358de service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8757892955028', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8757892520933', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8757892521750', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-27483010'] for port, after_update {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:12:43.483366 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-7bf27a5a-bc7c-404a-8456-821154867166 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:12:43.509648 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-9ba6a11d-3531-43e2-a085-b365db5fafe0 req-2a3a4092-4dab-4170-b184-21c8f634428d tempest-VolumesActionsTest-484617325 tempest-VolumesActionsTest-484617325-project] 10.222.0.62 "GET /v2.0/security-groups?id=af408198-1a2b-4ca3-aa88-275037ef85c5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0714135 May 25 17:12:43.539940 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-c2830f7d-f15a-4495-8f79-ce3132937709 req-7472e485-56a1-42c5-92f7-6acba27c4e4c service neutron] 10.222.0.32 "GET /v2.0/networks/1c289a65-8084-4eb2-85f5-ce070ae5d349?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1899135 May 25 17:12:43.540416 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-686c7e5e-51be-4485-bafa-50ec177ccdb3 req-1a8b5df0-7388-43a8-8146-2be4117358de service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91830) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:12:43.541023 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [req-686c7e5e-51be-4485-bafa-50ec177ccdb3 req-1a8b5df0-7388-43a8-8146-2be4117358de service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-178712'] for port, before_response {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:12:43.542410 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-686c7e5e-51be-4485-bafa-50ec177ccdb3 req-1a8b5df0-7388-43a8-8146-2be4117358de service neutron] 10.222.0.32 "PUT /v2.0/ports/6e3f2c00-d48a-49c0-9c1e-593505b07078 HTTP/1.1" status: 200 len: 1097 time: 1.0317824 May 25 17:12:43.542922 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '81a8b68c-799e-4135-a641-4dce2737b8a7', 'tag': '6e3f2c00-d48a-49c0-9c1e-593505b07078'}] {{(pid=91830) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 25 17:12:43.564407 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1a8b5df0-7388-43a8-8146-2be4117358de service neutron] Pushing event updated for resources: {'Port': ['ID=6e3f2c00-d48a-49c0-9c1e-593505b07078,revision_number=3']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:12:43.567954 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-1a8b5df0-7388-43a8-8146-2be4117358de service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.085s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:12:43.680361 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-686c7e5e-51be-4485-bafa-50ec177ccdb3 req-6bcdf3de-2204-48e3-9934-65f62eb8933f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91830) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:12:43.682012 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-686c7e5e-51be-4485-bafa-50ec177ccdb3 req-6bcdf3de-2204-48e3-9934-65f62eb8933f service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=c7bdecd7f62b4bba97648c47533bc18a&device_id=81a8b68c-799e-4135-a641-4dce2737b8a7 HTTP/1.1" status: 200 len: 1100 time: 0.0847695 May 25 17:12:43.700657 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eb6630bb-d6af-4fc6-9271-d7e17e87e267 req-3112809a-2075-4bde-86f4-95b9c3884e4b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:12:43.702349 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-eb6630bb-d6af-4fc6-9271-d7e17e87e267 req-3112809a-2075-4bde-86f4-95b9c3884e4b service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=f183c0c6666645e9ab8c3635833569c4&device_id=686f9b8c-f255-4b30-a26f-8891c3d39346 HTTP/1.1" status: 200 len: 1097 time: 0.0873258 May 25 17:12:43.756834 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '81a8b68c-799e-4135-a641-4dce2737b8a7', 'tag': '6e3f2c00-d48a-49c0-9c1e-593505b07078', 'status': 'completed', 'code': 200} May 25 17:12:43.759402 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-686c7e5e-51be-4485-bafa-50ec177ccdb3 req-f4efa919-9fc3-4437-9a7f-2f88ff68593d service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.84&port_id=6e3f2c00-d48a-49c0-9c1e-593505b07078 HTTP/1.1" status: 200 len: 217 time: 0.0696447 May 25 17:12:43.825178 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-686c7e5e-51be-4485-bafa-50ec177ccdb3 req-ad850715-419c-4472-a0c0-2c2f06529e55 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91830) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:12:43.826682 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-686c7e5e-51be-4485-bafa-50ec177ccdb3 req-ad850715-419c-4472-a0c0-2c2f06529e55 service neutron] 10.222.0.32 "GET /v2.0/subnets?id=391b1700-d90b-420a-b57e-7924e6bb1e75 HTTP/1.1" status: 200 len: 843 time: 0.0609188 May 25 17:12:43.844372 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eb6630bb-d6af-4fc6-9271-d7e17e87e267 req-abc5f73f-2871-4d51-9956-04cc144b1cf6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:12:43.845807 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-eb6630bb-d6af-4fc6-9271-d7e17e87e267 req-abc5f73f-2871-4d51-9956-04cc144b1cf6 service neutron] 10.222.0.32 "GET /v2.0/networks?id=1c289a65-8084-4eb2-85f5-ce070ae5d349 HTTP/1.1" status: 200 len: 910 time: 0.1372530 May 25 17:12:43.905121 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-686c7e5e-51be-4485-bafa-50ec177ccdb3 req-a451e46d-adcb-479e-8d0b-e6953f59f4ba service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91830) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:12:43.906625 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-686c7e5e-51be-4485-bafa-50ec177ccdb3 req-a451e46d-adcb-479e-8d0b-e6953f59f4ba service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=1ce76c3b-1539-44c4-b658-5acf80c14e4c&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1178 time: 0.0723054 May 25 17:12:43.917783 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-eb6630bb-d6af-4fc6-9271-d7e17e87e267 req-ef8c784b-f69e-4cdb-a172-a67da20b6c4d service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=14ab3ce4-171b-446f-8273-18c9dce5690f HTTP/1.1" status: 200 len: 217 time: 0.0654531 May 25 17:12:43.983403 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eb6630bb-d6af-4fc6-9271-d7e17e87e267 req-c8a998e2-839d-44eb-8ff9-3a676a728c84 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:12:43.984921 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-eb6630bb-d6af-4fc6-9271-d7e17e87e267 req-c8a998e2-839d-44eb-8ff9-3a676a728c84 service neutron] 10.222.0.32 "GET /v2.0/subnets?id=1173229b-93b2-414d-aeb1-c1d1f24bf6d6 HTTP/1.1" status: 200 len: 849 time: 0.0615180 May 25 17:12:44.036581 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-eb6630bb-d6af-4fc6-9271-d7e17e87e267 req-f1e3cbc9-3cfb-4619-ab2a-344c3623beda service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=1c289a65-8084-4eb2-85f5-ce070ae5d349&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0440073 May 25 17:12:44.040975 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-686c7e5e-51be-4485-bafa-50ec177ccdb3 req-6137956e-2156-4710-a67e-f5aa5906b2f0 service neutron] 10.222.0.32 "GET /v2.0/networks/1ce76c3b-1539-44c4-b658-5acf80c14e4c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1266325 May 25 17:12:44.176366 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-686c7e5e-51be-4485-bafa-50ec177ccdb3 req-f8e6e46b-c816-4de0-8371-3137e39452aa service neutron] 10.222.0.32 "GET /v2.0/networks/1ce76c3b-1539-44c4-b658-5acf80c14e4c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1271732 May 25 17:12:44.295896 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cae00eb9-4073-4814-a3b7-02135861a143 req-eed4441e-dd1f-432d-890b-b8c8d290ee1f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91830) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:12:44.297719 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-cae00eb9-4073-4814-a3b7-02135861a143 req-eed4441e-dd1f-432d-890b-b8c8d290ee1f service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=c7bdecd7f62b4bba97648c47533bc18a&device_id=81a8b68c-799e-4135-a641-4dce2737b8a7 HTTP/1.1" status: 200 len: 1100 time: 0.0706112 May 25 17:12:44.332629 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-10e2b4ae-442f-4448-b3f8-dab263418f91 req-c34e7167-c238-4549-b75b-ad726332dd00 tempest-VolumesNegativeTest-425728667 tempest-VolumesNegativeTest-425728667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:12:44.334322 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-10e2b4ae-442f-4448-b3f8-dab263418f91 req-c34e7167-c238-4549-b75b-ad726332dd00 tempest-VolumesNegativeTest-425728667 tempest-VolumesNegativeTest-425728667-project] 10.222.0.62 "GET /v2.0/ports?device_id=81a8b68c-799e-4135-a641-4dce2737b8a7 HTTP/1.1" status: 200 len: 947 time: 0.2967670 May 25 17:12:44.336403 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-eb6630bb-d6af-4fc6-9271-d7e17e87e267 req-2c2bb619-1dd1-41ea-857f-63aa5bc28129 service neutron] 10.222.0.32 "GET /v2.0/networks/1c289a65-8084-4eb2-85f5-ce070ae5d349?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2639797 May 25 17:12:44.434774 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cae00eb9-4073-4814-a3b7-02135861a143 req-b26f1642-3dc6-4a39-b2e1-c12cb28566ad service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91830) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:12:44.436145 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-cae00eb9-4073-4814-a3b7-02135861a143 req-b26f1642-3dc6-4a39-b2e1-c12cb28566ad service neutron] 10.222.0.32 "GET /v2.0/networks?id=1ce76c3b-1539-44c4-b658-5acf80c14e4c HTTP/1.1" status: 200 len: 870 time: 0.1306462 May 25 17:12:44.459129 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-10e2b4ae-442f-4448-b3f8-dab263418f91 req-308c8e8d-af82-4cf1-a82b-5d2148ca90e2 tempest-VolumesNegativeTest-425728667 tempest-VolumesNegativeTest-425728667-project] 10.222.0.62 "GET /v2.0/security-groups?id=092f47b9-90ca-4276-a44f-85bd46d518ba&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1188087 May 25 17:12:44.505079 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-eb6630bb-d6af-4fc6-9271-d7e17e87e267 req-ccbf067f-aaae-46d9-a935-8992d5fd6366 service neutron] 10.222.0.32 "GET /v2.0/networks/1c289a65-8084-4eb2-85f5-ce070ae5d349?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1518946 May 25 17:12:44.510560 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-cae00eb9-4073-4814-a3b7-02135861a143 req-f42bb300-fcab-458a-ba4c-e46360946a72 service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.84&port_id=6e3f2c00-d48a-49c0-9c1e-593505b07078 HTTP/1.1" status: 200 len: 217 time: 0.0662270 May 25 17:12:44.577997 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cae00eb9-4073-4814-a3b7-02135861a143 req-3e3e2f23-a5fd-40ee-b260-cb8148f371e6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91830) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:12:44.579435 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-cae00eb9-4073-4814-a3b7-02135861a143 req-3e3e2f23-a5fd-40ee-b260-cb8148f371e6 service neutron] 10.222.0.32 "GET /v2.0/subnets?id=391b1700-d90b-420a-b57e-7924e6bb1e75 HTTP/1.1" status: 200 len: 843 time: 0.0622461 May 25 17:12:44.661561 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cae00eb9-4073-4814-a3b7-02135861a143 req-8aae8bc5-61ff-491b-a9ee-b8785c1d6f50 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91830) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:12:44.663067 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-cae00eb9-4073-4814-a3b7-02135861a143 req-8aae8bc5-61ff-491b-a9ee-b8785c1d6f50 service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=1ce76c3b-1539-44c4-b658-5acf80c14e4c&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1178 time: 0.0758560 May 25 17:12:44.700464 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5c99315b-8b9b-4125-a1ee-f797ab96f944 req-b467b03d-9c45-4bc8-8d9f-fd15a8922b39 tempest-VolumesActionsTest-484617325 tempest-VolumesActionsTest-484617325-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:12:44.701840 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-5c99315b-8b9b-4125-a1ee-f797ab96f944 req-b467b03d-9c45-4bc8-8d9f-fd15a8922b39 tempest-VolumesActionsTest-484617325 tempest-VolumesActionsTest-484617325-project] 10.222.0.62 "GET /v2.0/ports?device_id=686f9b8c-f255-4b30-a26f-8891c3d39346 HTTP/1.1" status: 200 len: 944 time: 0.0845935 May 25 17:12:44.747783 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-5c99315b-8b9b-4125-a1ee-f797ab96f944 req-fc363311-6ccc-4626-8384-915a9b1f7ac4 tempest-VolumesActionsTest-484617325 tempest-VolumesActionsTest-484617325-project] 10.222.0.62 "GET /v2.0/security-groups?id=af408198-1a2b-4ca3-aa88-275037ef85c5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0398815 May 25 17:12:44.879378 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-cae00eb9-4073-4814-a3b7-02135861a143 req-918b4d6a-f8b5-491f-9ac0-f8b22cb750bd service neutron] 10.222.0.32 "GET /v2.0/networks/1ce76c3b-1539-44c4-b658-5acf80c14e4c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2092612 May 25 17:12:45.013556 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-cae00eb9-4073-4814-a3b7-02135861a143 req-b3bc3765-959d-4f23-a13c-5461380d416b service neutron] 10.222.0.32 "GET /v2.0/networks/1ce76c3b-1539-44c4-b658-5acf80c14e4c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1248558 May 25 17:12:45.645600 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2779b18c-7450-4190-9fcc-4073c41f10ef req-34082ce8-49b0-4386-92fb-6f7acbfe5e60 tempest-VolumesNegativeTest-425728667 tempest-VolumesNegativeTest-425728667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:12:45.647047 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-2779b18c-7450-4190-9fcc-4073c41f10ef req-34082ce8-49b0-4386-92fb-6f7acbfe5e60 tempest-VolumesNegativeTest-425728667 tempest-VolumesNegativeTest-425728667-project] 10.222.0.62 "GET /v2.0/ports?device_id=81a8b68c-799e-4135-a641-4dce2737b8a7 HTTP/1.1" status: 200 len: 947 time: 0.0809786 May 25 17:12:45.690223 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-2779b18c-7450-4190-9fcc-4073c41f10ef req-84284021-e436-4797-8e4b-9b76dcf44360 tempest-VolumesNegativeTest-425728667 tempest-VolumesNegativeTest-425728667-project] 10.222.0.62 "GET /v2.0/security-groups?id=092f47b9-90ca-4276-a44f-85bd46d518ba&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0374587 May 25 17:12:45.937743 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9bc35e5c-92f0-4155-ae52-2c8befc53ff0 req-70ec8441-0369-49fd-bede-ad3f7917d52a tempest-VolumesActionsTest-484617325 tempest-VolumesActionsTest-484617325-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:12:45.939210 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-9bc35e5c-92f0-4155-ae52-2c8befc53ff0 req-70ec8441-0369-49fd-bede-ad3f7917d52a tempest-VolumesActionsTest-484617325 tempest-VolumesActionsTest-484617325-project] 10.222.0.62 "GET /v2.0/ports?device_id=686f9b8c-f255-4b30-a26f-8891c3d39346 HTTP/1.1" status: 200 len: 944 time: 0.0848253 May 25 17:12:45.983617 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-9bc35e5c-92f0-4155-ae52-2c8befc53ff0 req-cc34c093-0b1d-437c-a493-2fdf5300934e tempest-VolumesActionsTest-484617325 tempest-VolumesActionsTest-484617325-project] 10.222.0.62 "GET /v2.0/security-groups?id=af408198-1a2b-4ca3-aa88-275037ef85c5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0385828 May 25 17:12:46.871283 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-967acb1b-b95f-4e40-be9b-23f0d88f2ec8 req-596271ea-3230-4084-a31d-309b390d0830 tempest-VolumesNegativeTest-425728667 tempest-VolumesNegativeTest-425728667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:12:46.872717 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-967acb1b-b95f-4e40-be9b-23f0d88f2ec8 req-596271ea-3230-4084-a31d-309b390d0830 tempest-VolumesNegativeTest-425728667 tempest-VolumesNegativeTest-425728667-project] 10.222.0.62 "GET /v2.0/ports?device_id=81a8b68c-799e-4135-a641-4dce2737b8a7 HTTP/1.1" status: 200 len: 947 time: 0.0791504 May 25 17:12:46.922107 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-967acb1b-b95f-4e40-be9b-23f0d88f2ec8 req-2db43de7-5211-4108-a71e-bacbed8c4455 tempest-VolumesNegativeTest-425728667 tempest-VolumesNegativeTest-425728667-project] 10.222.0.62 "GET /v2.0/security-groups?id=092f47b9-90ca-4276-a44f-85bd46d518ba&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0438116 May 25 17:12:47.164192 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9259d9d3-f363-486d-9c05-b73a3225fe31 req-af78f285-8406-4b35-9028-c14ab7ca162a tempest-VolumesActionsTest-484617325 tempest-VolumesActionsTest-484617325-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:12:47.165619 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-9259d9d3-f363-486d-9c05-b73a3225fe31 req-af78f285-8406-4b35-9028-c14ab7ca162a tempest-VolumesActionsTest-484617325 tempest-VolumesActionsTest-484617325-project] 10.222.0.62 "GET /v2.0/ports?device_id=686f9b8c-f255-4b30-a26f-8891c3d39346 HTTP/1.1" status: 200 len: 944 time: 0.0790696 May 25 17:12:47.209594 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-9259d9d3-f363-486d-9c05-b73a3225fe31 req-e43bd724-16ff-451c-b387-58d7695e4031 tempest-VolumesActionsTest-484617325 tempest-VolumesActionsTest-484617325-project] 10.222.0.62 "GET /v2.0/security-groups?id=af408198-1a2b-4ca3-aa88-275037ef85c5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0384662 May 25 17:12:47.491598 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.rpc [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Device 14ab3ce4-171b-446f-8273-18c9dce5690f details requested by agent hyperv_hv-cinder-79049 with host hv-cinder-79049 {{(pid=91831) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 25 17:12:47.621528 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.db [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] For port 14ab3ce4-171b-446f-8273-18c9dce5690f, host hv-cinder-79049, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79049',level=0,port_id=14ab3ce4-171b-446f-8273-18c9dce5690f,segment=NetworkSegment(e67ad559-7746-4ca1-858c-5806ab2906f0),segment_id=e67ad559-7746-4ca1-858c-5806ab2906f0)] {{(pid=91831) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 17:12:47.634067 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.rpc [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Returning: {'device': '14ab3ce4-171b-446f-8273-18c9dce5690f', 'network_id': '1c289a65-8084-4eb2-85f5-ce070ae5d349', 'port_id': '14ab3ce4-171b-446f-8273-18c9dce5690f', 'mac_address': 'fa:16:3e:3a:47:1c', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 675, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '1173229b-93b2-414d-aeb1-c1d1f24bf6d6', 'ip_address': '172.20.0.12'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=91831) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 25 17:12:47.690772 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3832070'] for port, before_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:12:47.707126 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.notifiers.nova [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 14ab3ce4-171b-446f-8273-18c9dce5690f {{(pid=91831) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} May 25 17:12:47.721829 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.db [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] For port 14ab3ce4-171b-446f-8273-18c9dce5690f, host hv-cinder-79049, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79049',level=0,port_id=14ab3ce4-171b-446f-8273-18c9dce5690f,segment=NetworkSegment(e67ad559-7746-4ca1-858c-5806ab2906f0),segment_id=e67ad559-7746-4ca1-858c-5806ab2906f0)] {{(pid=91831) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 17:12:47.725792 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8757892955028', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8757892520933', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8757892521750'] for port, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:12:47.726561 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.rpc [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Device 6e3f2c00-d48a-49c0-9c1e-593505b07078 details requested by agent hyperv_hv-cinder-79049 with host hv-cinder-79049 {{(pid=91831) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 25 17:12:47.730097 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:12:47.863010 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Pushing event updated for resources: {'Port': ['ID=14ab3ce4-171b-446f-8273-18c9dce5690f,revision_number=4']} {{(pid=91831) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:12:47.874332 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.144s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:12:47.922438 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.db [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] For port 6e3f2c00-d48a-49c0-9c1e-593505b07078, host hv-cinder-79049, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79049',level=0,port_id=6e3f2c00-d48a-49c0-9c1e-593505b07078,segment=NetworkSegment(015e8123-0c21-4358-ae8e-caf4f629a10c),segment_id=015e8123-0c21-4358-ae8e-caf4f629a10c)] {{(pid=91831) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 17:12:47.935837 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.rpc [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Returning: {'device': '6e3f2c00-d48a-49c0-9c1e-593505b07078', 'network_id': '1ce76c3b-1539-44c4-b658-5acf80c14e4c', 'port_id': '6e3f2c00-d48a-49c0-9c1e-593505b07078', 'mac_address': 'fa:16:3e:42:e0:8b', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 684, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '391b1700-d90b-420a-b57e-7924e6bb1e75', 'ip_address': '192.168.233.84'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=91831) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 25 17:12:47.997453 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3832070'] for port, before_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:12:48.014765 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.notifiers.nova [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 6e3f2c00-d48a-49c0-9c1e-593505b07078 {{(pid=91831) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} May 25 17:12:48.030703 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.db [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] For port 6e3f2c00-d48a-49c0-9c1e-593505b07078, host hv-cinder-79049, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79049',level=0,port_id=6e3f2c00-d48a-49c0-9c1e-593505b07078,segment=NetworkSegment(015e8123-0c21-4358-ae8e-caf4f629a10c),segment_id=015e8123-0c21-4358-ae8e-caf4f629a10c)] {{(pid=91831) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 17:12:48.035091 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8757892955028', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8757892520933', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8757892521750'] for port, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:12:48.036872 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [None req-11bc4dd5-ae61-44ef-93dc-2365d150821b None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:12:48.102668 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Pushing event updated for resources: {'Port': ['ID=6e3f2c00-d48a-49c0-9c1e-593505b07078,revision_number=4']} {{(pid=91831) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:12:48.105723 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.069s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:12:48.111184 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b4292e7e-b19b-4c3e-b35c-8295f924b3e0 req-50a7d56b-6449-4b08-9414-ef0c6d1c0a80 tempest-VolumesNegativeTest-425728667 tempest-VolumesNegativeTest-425728667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:12:48.112675 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-b4292e7e-b19b-4c3e-b35c-8295f924b3e0 req-50a7d56b-6449-4b08-9414-ef0c6d1c0a80 tempest-VolumesNegativeTest-425728667 tempest-VolumesNegativeTest-425728667-project] 10.222.0.62 "GET /v2.0/ports?device_id=81a8b68c-799e-4135-a641-4dce2737b8a7 HTTP/1.1" status: 200 len: 948 time: 0.0856586 May 25 17:12:48.156635 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-b4292e7e-b19b-4c3e-b35c-8295f924b3e0 req-4c64a5bf-fb35-4fdf-9434-dcdb5ec9218e tempest-VolumesNegativeTest-425728667 tempest-VolumesNegativeTest-425728667-project] 10.222.0.62 "GET /v2.0/security-groups?id=092f47b9-90ca-4276-a44f-85bd46d518ba&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0376675 May 25 17:12:48.393463 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.db [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] get_ports_and_sgs() called for port_ids ['14ab3ce4-171b-446f-8273-18c9dce5690f'] {{(pid=91831) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 25 17:12:48.395043 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5d103a85-4cfd-4baa-ac5a-7fac92c5f5c1 req-bb9d8dcf-dff2-46f8-ab7c-4657706d9d40 tempest-VolumesActionsTest-484617325 tempest-VolumesActionsTest-484617325-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:12:48.396502 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-5d103a85-4cfd-4baa-ac5a-7fac92c5f5c1 req-bb9d8dcf-dff2-46f8-ab7c-4657706d9d40 tempest-VolumesActionsTest-484617325 tempest-VolumesActionsTest-484617325-project] 10.222.0.62 "GET /v2.0/ports?device_id=686f9b8c-f255-4b30-a26f-8891c3d39346 HTTP/1.1" status: 200 len: 945 time: 0.0789783 May 25 17:12:48.424037 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.db [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] get_ports_and_sgs() called for port_ids ['6e3f2c00-d48a-49c0-9c1e-593505b07078'] {{(pid=91831) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 25 17:12:48.442705 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-5d103a85-4cfd-4baa-ac5a-7fac92c5f5c1 req-b9964b29-15bf-4f53-9325-d3e28a872d7c tempest-VolumesActionsTest-484617325 tempest-VolumesActionsTest-484617325-project] 10.222.0.62 "GET /v2.0/security-groups?id=af408198-1a2b-4ca3-aa88-275037ef85c5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0397825 May 25 17:12:49.344793 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-40d7660a-7700-47d8-8780-528360ea4c0d req-1e0a6da7-a2d0-41bb-88b8-a53b85acd217 tempest-VolumesNegativeTest-425728667 tempest-VolumesNegativeTest-425728667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:12:49.346366 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-40d7660a-7700-47d8-8780-528360ea4c0d req-1e0a6da7-a2d0-41bb-88b8-a53b85acd217 tempest-VolumesNegativeTest-425728667 tempest-VolumesNegativeTest-425728667-project] 10.222.0.62 "GET /v2.0/ports?device_id=81a8b68c-799e-4135-a641-4dce2737b8a7 HTTP/1.1" status: 200 len: 948 time: 0.0842083 May 25 17:12:49.390182 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-40d7660a-7700-47d8-8780-528360ea4c0d req-d6c5b7e0-50f5-4ec0-bdd6-b46cd4c46a95 tempest-VolumesNegativeTest-425728667 tempest-VolumesNegativeTest-425728667-project] 10.222.0.62 "GET /v2.0/security-groups?id=092f47b9-90ca-4276-a44f-85bd46d518ba&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0381250 May 25 17:12:49.504729 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.rpc [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Device 6e3f2c00-d48a-49c0-9c1e-593505b07078 up at agent hyperv_hv-cinder-79049 {{(pid=91831) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 25 17:12:49.575981 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.provisioning_blocks [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Provisioning for port 6e3f2c00-d48a-49c0-9c1e-593505b07078 completed by entity L2. {{(pid=91831) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 25 17:12:49.580598 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.provisioning_blocks [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Provisioning complete for port 6e3f2c00-d48a-49c0-9c1e-593505b07078 triggered by entity L2. {{(pid=91831) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 17:12:49.580980 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3854128'] for port, provisioning_complete {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:12:49.628653 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-41f0f836-9621-4965-b7a4-200313b151e2 req-bb8e96ff-96d2-4304-a066-5d86110f880d tempest-VolumesActionsTest-484617325 tempest-VolumesActionsTest-484617325-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:12:49.630041 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-41f0f836-9621-4965-b7a4-200313b151e2 req-bb8e96ff-96d2-4304-a066-5d86110f880d tempest-VolumesActionsTest-484617325 tempest-VolumesActionsTest-484617325-project] 10.222.0.62 "GET /v2.0/ports?device_id=686f9b8c-f255-4b30-a26f-8891c3d39346 HTTP/1.1" status: 200 len: 945 time: 0.0796130 May 25 17:12:49.678554 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-41f0f836-9621-4965-b7a4-200313b151e2 req-f07fbfca-9a71-4d50-8062-4845c606ba4d tempest-VolumesActionsTest-484617325 tempest-VolumesActionsTest-484617325-project] 10.222.0.62 "GET /v2.0/security-groups?id=af408198-1a2b-4ca3-aa88-275037ef85c5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0415158 May 25 17:12:49.704840 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3832070'] for port, before_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:12:49.734131 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '81a8b68c-799e-4135-a641-4dce2737b8a7', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '6e3f2c00-d48a-49c0-9c1e-593505b07078'}] {{(pid=91831) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 25 17:12:49.744525 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.db [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] For port 6e3f2c00-d48a-49c0-9c1e-593505b07078, host hv-cinder-79049, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79049',level=0,port_id=6e3f2c00-d48a-49c0-9c1e-593505b07078,segment=NetworkSegment(015e8123-0c21-4358-ae8e-caf4f629a10c),segment_id=015e8123-0c21-4358-ae8e-caf4f629a10c)] {{(pid=91831) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 17:12:49.748372 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8757892955028', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8757892520933', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8757892521750'] for port, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:12:49.750235 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:12:49.820435 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Pushing event updated for resources: {'Port': ['ID=6e3f2c00-d48a-49c0-9c1e-593505b07078,revision_number=5']} {{(pid=91831) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:12:49.824574 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.074s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:12:49.916630 dv-cinder-790492-4-iscsi neutron-server[91831]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '81a8b68c-799e-4135-a641-4dce2737b8a7', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '6e3f2c00-d48a-49c0-9c1e-593505b07078', 'code': 200} May 25 17:12:50.139409 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6b1f19ab-cc17-408b-b01e-d5735d77dac2 req-d6561a6d-8711-4e69-9c4a-1d6627e5aa69 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91830) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:12:50.140817 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-6b1f19ab-cc17-408b-b01e-d5735d77dac2 req-d6561a6d-8711-4e69-9c4a-1d6627e5aa69 service neutron] 10.222.0.32 "GET /v2.0/ports?device_id=81a8b68c-799e-4135-a641-4dce2737b8a7 HTTP/1.1" status: 200 len: 1102 time: 0.0679152 May 25 17:12:50.185260 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-6b1f19ab-cc17-408b-b01e-d5735d77dac2 req-d988dd41-d3f6-491e-85fe-91305c804c0d service neutron] 10.222.0.32 "GET /v2.0/security-groups?id=092f47b9-90ca-4276-a44f-85bd46d518ba&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0370369 May 25 17:12:50.569354 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-668a8d3e-e83e-4e41-bb78-acab1f297830 req-e0b09641-c5d9-40ad-ac42-527c0db3f582 tempest-VolumesNegativeTest-425728667 tempest-VolumesNegativeTest-425728667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:12:50.570827 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-668a8d3e-e83e-4e41-bb78-acab1f297830 req-e0b09641-c5d9-40ad-ac42-527c0db3f582 tempest-VolumesNegativeTest-425728667 tempest-VolumesNegativeTest-425728667-project] 10.222.0.62 "GET /v2.0/ports?device_id=81a8b68c-799e-4135-a641-4dce2737b8a7 HTTP/1.1" status: 200 len: 949 time: 0.0780091 May 25 17:12:50.614504 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-668a8d3e-e83e-4e41-bb78-acab1f297830 req-8f68d12b-4d91-4669-b226-b64fa0e30f55 tempest-VolumesNegativeTest-425728667 tempest-VolumesNegativeTest-425728667-project] 10.222.0.62 "GET /v2.0/security-groups?id=092f47b9-90ca-4276-a44f-85bd46d518ba&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0375252 May 25 17:12:50.866584 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ecd47603-8e26-4663-aeda-9fa60d0c74df req-01bfbf50-5aa4-4015-b04a-a69b09ad5b7b tempest-VolumesActionsTest-484617325 tempest-VolumesActionsTest-484617325-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:12:50.868437 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-ecd47603-8e26-4663-aeda-9fa60d0c74df req-01bfbf50-5aa4-4015-b04a-a69b09ad5b7b tempest-VolumesActionsTest-484617325 tempest-VolumesActionsTest-484617325-project] 10.222.0.62 "GET /v2.0/ports?device_id=686f9b8c-f255-4b30-a26f-8891c3d39346 HTTP/1.1" status: 200 len: 945 time: 0.0824335 May 25 17:12:50.912735 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-ecd47603-8e26-4663-aeda-9fa60d0c74df req-0e8d2bdd-5073-4ee8-a665-054bf1614d43 tempest-VolumesActionsTest-484617325 tempest-VolumesActionsTest-484617325-project] 10.222.0.62 "GET /v2.0/security-groups?id=af408198-1a2b-4ca3-aa88-275037ef85c5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0385091 May 25 17:12:51.506406 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.rpc [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Device 14ab3ce4-171b-446f-8273-18c9dce5690f up at agent hyperv_hv-cinder-79049 {{(pid=91831) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 25 17:12:51.574588 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.provisioning_blocks [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Provisioning for port 14ab3ce4-171b-446f-8273-18c9dce5690f completed by entity L2. {{(pid=91831) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 25 17:12:51.579462 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.provisioning_blocks [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Provisioning complete for port 14ab3ce4-171b-446f-8273-18c9dce5690f triggered by entity L2. {{(pid=91831) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 17:12:51.579842 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3854128'] for port, provisioning_complete {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:12:51.698923 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3832070'] for port, before_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:12:51.731709 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.db [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] For port 14ab3ce4-171b-446f-8273-18c9dce5690f, host hv-cinder-79049, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79049',level=0,port_id=14ab3ce4-171b-446f-8273-18c9dce5690f,segment=NetworkSegment(e67ad559-7746-4ca1-858c-5806ab2906f0),segment_id=e67ad559-7746-4ca1-858c-5806ab2906f0)] {{(pid=91831) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 17:12:51.735907 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8757892955028', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8757892520933', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8757892521750'] for port, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:12:51.737780 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [None req-69f5aba3-a3df-4674-8291-310b0f175da9 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:12:51.800973 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-84e5455f-32ff-4aa6-b99c-3c577a5da679 req-66b95d78-f2fd-4eb7-82bb-b13d05b22d8e tempest-VolumesNegativeTest-425728667 tempest-VolumesNegativeTest-425728667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:12:51.802455 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-84e5455f-32ff-4aa6-b99c-3c577a5da679 req-66b95d78-f2fd-4eb7-82bb-b13d05b22d8e tempest-VolumesNegativeTest-425728667 tempest-VolumesNegativeTest-425728667-project] 10.222.0.62 "GET /v2.0/ports?device_id=81a8b68c-799e-4135-a641-4dce2737b8a7 HTTP/1.1" status: 200 len: 949 time: 0.0835297 May 25 17:12:51.806161 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Pushing event updated for resources: {'Port': ['ID=14ab3ce4-171b-446f-8273-18c9dce5690f,revision_number=5']} {{(pid=91831) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:12:51.809218 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.072s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:12:51.848854 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-84e5455f-32ff-4aa6-b99c-3c577a5da679 req-87ae6324-822d-43a5-b305-31ac3cdc314c tempest-VolumesNegativeTest-425728667 tempest-VolumesNegativeTest-425728667-project] 10.222.0.62 "GET /v2.0/security-groups?id=092f47b9-90ca-4276-a44f-85bd46d518ba&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0390534 May 25 17:12:51.917368 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '686f9b8c-f255-4b30-a26f-8891c3d39346', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '14ab3ce4-171b-446f-8273-18c9dce5690f'}] {{(pid=91831) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 25 17:12:51.961532 dv-cinder-790492-4-iscsi neutron-server[91831]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '686f9b8c-f255-4b30-a26f-8891c3d39346', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '14ab3ce4-171b-446f-8273-18c9dce5690f', 'code': 200} May 25 17:12:52.138976 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-67c68485-647d-42d7-9571-ed5cc5c525eb req-a873b671-5ced-46c4-a034-ac656a86c87d tempest-VolumesActionsTest-484617325 tempest-VolumesActionsTest-484617325-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:12:52.140456 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-67c68485-647d-42d7-9571-ed5cc5c525eb req-a873b671-5ced-46c4-a034-ac656a86c87d tempest-VolumesActionsTest-484617325 tempest-VolumesActionsTest-484617325-project] 10.222.0.62 "GET /v2.0/ports?device_id=686f9b8c-f255-4b30-a26f-8891c3d39346 HTTP/1.1" status: 200 len: 946 time: 0.0933883 May 25 17:12:52.186640 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-67c68485-647d-42d7-9571-ed5cc5c525eb req-bc8d9ec7-ff10-497e-b58a-4c8c7901fc7d tempest-VolumesActionsTest-484617325 tempest-VolumesActionsTest-484617325-project] 10.222.0.62 "GET /v2.0/security-groups?id=af408198-1a2b-4ca3-aa88-275037ef85c5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0395992 May 25 17:12:52.234952 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7ebc30ad-9ecb-4388-af9b-b2c85944f76d req-f5508fba-c54e-4c08-964e-3bfec87cfe98 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91830) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:12:52.236550 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-7ebc30ad-9ecb-4388-af9b-b2c85944f76d req-f5508fba-c54e-4c08-964e-3bfec87cfe98 service neutron] 10.222.0.32 "GET /v2.0/ports?device_id=686f9b8c-f255-4b30-a26f-8891c3d39346 HTTP/1.1" status: 200 len: 1099 time: 0.0719326 May 25 17:12:52.280875 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-7ebc30ad-9ecb-4388-af9b-b2c85944f76d req-93e74986-c5b4-41ed-973f-0b1f9b873d27 service neutron] 10.222.0.32 "GET /v2.0/security-groups?id=af408198-1a2b-4ca3-aa88-275037ef85c5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0359540 May 25 17:12:52.305546 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f2ff180d-71a6-4cfb-909a-ea1c50a23899 req-0d926c76-d59b-4902-bf8f-d28c57c511bc tempest-VolumesNegativeTest-425728667 tempest-VolumesNegativeTest-425728667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:12:52.306915 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-f2ff180d-71a6-4cfb-909a-ea1c50a23899 req-0d926c76-d59b-4902-bf8f-d28c57c511bc tempest-VolumesNegativeTest-425728667 tempest-VolumesNegativeTest-425728667-project] 10.222.0.62 "GET /v2.0/ports?device_id=81a8b68c-799e-4135-a641-4dce2737b8a7 HTTP/1.1" status: 200 len: 949 time: 0.0806386 May 25 17:12:52.350847 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-f2ff180d-71a6-4cfb-909a-ea1c50a23899 req-d8c2a55b-cbec-468d-99cb-074411ede753 tempest-VolumesNegativeTest-425728667 tempest-VolumesNegativeTest-425728667-project] 10.222.0.62 "GET /v2.0/security-groups?id=092f47b9-90ca-4276-a44f-85bd46d518ba&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0381818 May 25 17:12:53.373108 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a09c93aa-914c-44a8-828e-0b87131bf031 req-de04a26e-3925-4430-aea0-ea65e2c32e32 tempest-VolumesActionsTest-484617325 tempest-VolumesActionsTest-484617325-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:12:53.374556 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-a09c93aa-914c-44a8-828e-0b87131bf031 req-de04a26e-3925-4430-aea0-ea65e2c32e32 tempest-VolumesActionsTest-484617325 tempest-VolumesActionsTest-484617325-project] 10.222.0.62 "GET /v2.0/ports?device_id=686f9b8c-f255-4b30-a26f-8891c3d39346 HTTP/1.1" status: 200 len: 946 time: 0.0819464 May 25 17:12:53.419237 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-a09c93aa-914c-44a8-828e-0b87131bf031 req-8a20206f-7bfe-431c-9fea-5fa98247b472 tempest-VolumesActionsTest-484617325 tempest-VolumesActionsTest-484617325-project] 10.222.0.62 "GET /v2.0/security-groups?id=af408198-1a2b-4ca3-aa88-275037ef85c5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0389531 May 25 17:12:53.543966 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-79cd9d9c-c75c-454d-bac4-b4016d1aca89 req-ce741eb6-8bc2-4afa-8c98-e2b04672add7 tempest-VolumesNegativeTest-425728667 tempest-VolumesNegativeTest-425728667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:12:53.545418 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-79cd9d9c-c75c-454d-bac4-b4016d1aca89 req-ce741eb6-8bc2-4afa-8c98-e2b04672add7 tempest-VolumesNegativeTest-425728667 tempest-VolumesNegativeTest-425728667-project] 10.222.0.62 "GET /v2.0/ports?device_id=81a8b68c-799e-4135-a641-4dce2737b8a7 HTTP/1.1" status: 200 len: 949 time: 0.0805581 May 25 17:12:53.598052 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-79cd9d9c-c75c-454d-bac4-b4016d1aca89 req-8c297b56-0dce-416b-bedb-76302ec3f740 tempest-VolumesNegativeTest-425728667 tempest-VolumesNegativeTest-425728667-project] 10.222.0.62 "GET /v2.0/security-groups?id=092f47b9-90ca-4276-a44f-85bd46d518ba&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0435672 May 25 17:12:54.232165 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-324b8f0b-badb-4665-85de-a3be49fce515 req-f41e7897-1829-4c2b-bb9b-d5a6ef9dfcca tempest-VolumesNegativeTest-425728667 tempest-VolumesNegativeTest-425728667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91830) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:12:54.232858 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [req-324b8f0b-badb-4665-85de-a3be49fce515 req-f41e7897-1829-4c2b-bb9b-d5a6ef9dfcca tempest-VolumesNegativeTest-425728667 tempest-VolumesNegativeTest-425728667-project] Synchronizing usage tracker for tenant:c7bdecd7f62b4bba97648c47533bc18a on resource:port {{(pid=91830) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 25 17:12:54.249861 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [req-324b8f0b-badb-4665-85de-a3be49fce515 req-f41e7897-1829-4c2b-bb9b-d5a6ef9dfcca tempest-VolumesNegativeTest-425728667 tempest-VolumesNegativeTest-425728667-project] Unset dirty status for tenant:c7bdecd7f62b4bba97648c47533bc18a on resource:port {{(pid=91830) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 25 17:12:54.251007 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-324b8f0b-badb-4665-85de-a3be49fce515 req-f41e7897-1829-4c2b-bb9b-d5a6ef9dfcca tempest-VolumesNegativeTest-425728667 tempest-VolumesNegativeTest-425728667-project] 10.222.0.32 "GET /v2.0/ports?device_id=81a8b68c-799e-4135-a641-4dce2737b8a7 HTTP/1.1" status: 200 len: 949 time: 0.0991955 May 25 17:12:54.400397 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.plugins.ml2.plugin [req-324b8f0b-badb-4665-85de-a3be49fce515 req-c1b54ee4-55ee-4ad0-a247-c06d999bd44a tempest-VolumesNegativeTest-425728667 tempest-VolumesNegativeTest-425728667-project] Deleting port 6e3f2c00-d48a-49c0-9c1e-593505b07078 {{(pid=91830) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 25 17:12:54.401006 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [req-324b8f0b-badb-4665-85de-a3be49fce515 req-c1b54ee4-55ee-4ad0-a247-c06d999bd44a tempest-VolumesNegativeTest-425728667 tempest-VolumesNegativeTest-425728667-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8757892952899'] for port, before_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:12:54.539103 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.plugins.ml2.db [req-324b8f0b-badb-4665-85de-a3be49fce515 req-c1b54ee4-55ee-4ad0-a247-c06d999bd44a tempest-VolumesNegativeTest-425728667 tempest-VolumesNegativeTest-425728667-project] For port 6e3f2c00-d48a-49c0-9c1e-593505b07078, host hv-cinder-79049, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79049',level=0,port_id=6e3f2c00-d48a-49c0-9c1e-593505b07078,segment=NetworkSegment(015e8123-0c21-4358-ae8e-caf4f629a10c),segment_id=015e8123-0c21-4358-ae8e-caf4f629a10c)] {{(pid=91830) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 17:12:54.539461 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [req-324b8f0b-badb-4665-85de-a3be49fce515 req-c1b54ee4-55ee-4ad0-a247-c06d999bd44a tempest-VolumesNegativeTest-425728667 tempest-VolumesNegativeTest-425728667-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-683770'] for port, precommit_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:12:54.601974 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4cc15035-ecc4-434d-818d-2e9d09168b07 req-937536b0-a25d-4a91-9e8a-b4fe0f8bd889 tempest-VolumesActionsTest-484617325 tempest-VolumesActionsTest-484617325-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:12:54.603974 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-4cc15035-ecc4-434d-818d-2e9d09168b07 req-937536b0-a25d-4a91-9e8a-b4fe0f8bd889 tempest-VolumesActionsTest-484617325 tempest-VolumesActionsTest-484617325-project] 10.222.0.62 "GET /v2.0/ports?device_id=686f9b8c-f255-4b30-a26f-8891c3d39346 HTTP/1.1" status: 200 len: 946 time: 0.0798178 May 25 17:12:54.649325 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-4cc15035-ecc4-434d-818d-2e9d09168b07 req-6ebc2341-acdf-411b-866e-b6849c623e3c tempest-VolumesActionsTest-484617325 tempest-VolumesActionsTest-484617325-project] 10.222.0.62 "GET /v2.0/security-groups?id=af408198-1a2b-4ca3-aa88-275037ef85c5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0396216 May 25 17:12:54.670129 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.plugins.ml2.plugin [req-324b8f0b-badb-4665-85de-a3be49fce515 req-c1b54ee4-55ee-4ad0-a247-c06d999bd44a tempest-VolumesNegativeTest-425728667 tempest-VolumesNegativeTest-425728667-project] Calling delete_port for 6e3f2c00-d48a-49c0-9c1e-593505b07078 owned by compute:nova {{(pid=91830) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 25 17:12:54.793446 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [req-324b8f0b-badb-4665-85de-a3be49fce515 req-c1b54ee4-55ee-4ad0-a247-c06d999bd44a tempest-VolumesNegativeTest-425728667 tempest-VolumesNegativeTest-425728667-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8757892955046', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8757892520924', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-27483019'] for port, after_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:12:54.800076 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-39832d44-63ae-4e83-b8ae-4fa49fd193a6 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:12:54.806058 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.db [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] get_ports_and_sgs() called for port_ids ['6e3f2c00-d48a-49c0-9c1e-593505b07078'] {{(pid=91831) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 25 17:12:54.852767 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c1b54ee4-55ee-4ad0-a247-c06d999bd44a tempest-VolumesNegativeTest-425728667 tempest-VolumesNegativeTest-425728667-project] Pushing event deleted for resources: {'Port': ['ID=6e3f2c00-d48a-49c0-9c1e-593505b07078,revision_number=None']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:12:54.856844 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-c1b54ee4-55ee-4ad0-a247-c06d999bd44a tempest-VolumesNegativeTest-425728667 tempest-VolumesNegativeTest-425728667-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.057s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:12:54.908080 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-15bb439b-5c42-40a7-b8e5-9ec2f048fac9 req-c93eb430-421a-4eea-93bf-94f65a55f0ae tempest-VolumesNegativeTest-425728667 tempest-VolumesNegativeTest-425728667-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:12:54.909783 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-15bb439b-5c42-40a7-b8e5-9ec2f048fac9 req-c93eb430-421a-4eea-93bf-94f65a55f0ae tempest-VolumesNegativeTest-425728667 tempest-VolumesNegativeTest-425728667-project] 10.222.0.62 "GET /v2.0/ports?device_id=81a8b68c-799e-4135-a641-4dce2737b8a7 HTTP/1.1" status: 200 len: 867 time: 0.2019687 May 25 17:12:54.939159 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.l3_dvrscheduler_db [req-324b8f0b-badb-4665-85de-a3be49fce515 req-c1b54ee4-55ee-4ad0-a247-c06d999bd44a tempest-VolumesNegativeTest-425728667 tempest-VolumesNegativeTest-425728667-project] No DVR routers for this DVR port 6e3f2c00-d48a-49c0-9c1e-593505b07078 on host hv-cinder-79049 {{(pid=91830) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 25 17:12:54.941735 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [req-324b8f0b-badb-4665-85de-a3be49fce515 req-c1b54ee4-55ee-4ad0-a247-c06d999bd44a tempest-VolumesNegativeTest-425728667 tempest-VolumesNegativeTest-425728667-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-178712'] for port, before_response {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:12:54.944723 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '81a8b68c-799e-4135-a641-4dce2737b8a7', 'name': 'network-vif-deleted', 'tag': '6e3f2c00-d48a-49c0-9c1e-593505b07078'}] {{(pid=91830) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 25 17:12:54.968705 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-15bb439b-5c42-40a7-b8e5-9ec2f048fac9 req-0bd352f2-428f-455d-9abc-879db0da3721 tempest-VolumesNegativeTest-425728667 tempest-VolumesNegativeTest-425728667-project] 10.222.0.62 "GET /v2.0/security-groups?id=092f47b9-90ca-4276-a44f-85bd46d518ba&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0516231 May 25 17:12:54.978701 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-324b8f0b-badb-4665-85de-a3be49fce515 req-c1b54ee4-55ee-4ad0-a247-c06d999bd44a tempest-VolumesNegativeTest-425728667 tempest-VolumesNegativeTest-425728667-project] 10.222.0.32 "DELETE /v2.0/ports/6e3f2c00-d48a-49c0-9c1e-593505b07078 HTTP/1.1" status: 204 len: 173 time: 0.7207801 May 25 17:12:55.007609 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '81a8b68c-799e-4135-a641-4dce2737b8a7', 'name': 'network-vif-deleted', 'tag': '6e3f2c00-d48a-49c0-9c1e-593505b07078', 'status': 'completed', 'code': 200} May 25 17:12:55.146730 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.db.agents_db [None req-504cb04f-4543-46c1-8db7-349e21db7634 None None] Agent healthcheck: found 6 active agents {{(pid=91832) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} May 25 17:12:55.330357 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-c5c253e2-620f-46c9-a646-152c1117f063 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:12:55.849147 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c9834368-4f7b-4119-942a-85f4cabba078 req-6f020e07-0379-4b7a-a69b-ef2cfe100ffc tempest-VolumesActionsTest-484617325 tempest-VolumesActionsTest-484617325-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:12:55.850613 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-c9834368-4f7b-4119-942a-85f4cabba078 req-6f020e07-0379-4b7a-a69b-ef2cfe100ffc tempest-VolumesActionsTest-484617325 tempest-VolumesActionsTest-484617325-project] 10.222.0.62 "GET /v2.0/ports?device_id=686f9b8c-f255-4b30-a26f-8891c3d39346 HTTP/1.1" status: 200 len: 946 time: 0.0801098 May 25 17:12:55.895655 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-c9834368-4f7b-4119-942a-85f4cabba078 req-3887ea44-5778-4756-a50a-6d07048d8385 tempest-VolumesActionsTest-484617325 tempest-VolumesActionsTest-484617325-project] 10.222.0.62 "GET /v2.0/security-groups?id=af408198-1a2b-4ca3-aa88-275037ef85c5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0390308 May 25 17:12:57.097716 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-66934afa-2802-4934-8cbb-105672b8d353 req-b01e0e4b-a1da-4b08-bebe-0a26ee4ca8bd tempest-VolumesActionsTest-484617325 tempest-VolumesActionsTest-484617325-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:12:57.099494 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-66934afa-2802-4934-8cbb-105672b8d353 req-b01e0e4b-a1da-4b08-bebe-0a26ee4ca8bd tempest-VolumesActionsTest-484617325 tempest-VolumesActionsTest-484617325-project] 10.222.0.62 "GET /v2.0/ports?device_id=686f9b8c-f255-4b30-a26f-8891c3d39346 HTTP/1.1" status: 200 len: 946 time: 0.0959921 May 25 17:12:57.145108 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-66934afa-2802-4934-8cbb-105672b8d353 req-094d4047-6c26-41b4-93a5-7acd179eeb6f tempest-VolumesActionsTest-484617325 tempest-VolumesActionsTest-484617325-project] 10.222.0.62 "GET /v2.0/security-groups?id=af408198-1a2b-4ca3-aa88-275037ef85c5&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0387795 May 25 17:12:57.457351 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-57e2fc3f-c750-4a30-a849-a2129fdbe762 req-7c2dcfa9-fbb9-4abc-88c7-56c408eaab78 tempest-VolumesActionsTest-484617325 tempest-VolumesActionsTest-484617325-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91830) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:12:57.458851 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-57e2fc3f-c750-4a30-a849-a2129fdbe762 req-7c2dcfa9-fbb9-4abc-88c7-56c408eaab78 tempest-VolumesActionsTest-484617325 tempest-VolumesActionsTest-484617325-project] 10.222.0.32 "GET /v2.0/ports?device_id=686f9b8c-f255-4b30-a26f-8891c3d39346 HTTP/1.1" status: 200 len: 946 time: 0.0873868 May 25 17:12:57.542247 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.rpc [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Device 6e3f2c00-d48a-49c0-9c1e-593505b07078 no longer exists at agent hyperv_hv-cinder-79049 {{(pid=91831) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 25 17:12:57.578678 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.plugin [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] No Port match for: 6e3f2c00-d48a-49c0-9c1e-593505b07078 {{(pid=91831) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}} May 25 17:12:57.579132 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.rpc [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Device 6e3f2c00-d48a-49c0-9c1e-593505b07078 not bound to the agent host hv-cinder-79049 {{(pid=91831) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 25 17:12:57.600720 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.plugins.ml2.plugin [req-57e2fc3f-c750-4a30-a849-a2129fdbe762 req-f353bc25-faf5-4f05-b542-e0d11839ac52 tempest-VolumesActionsTest-484617325 tempest-VolumesActionsTest-484617325-project] Deleting port 14ab3ce4-171b-446f-8273-18c9dce5690f {{(pid=91830) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 25 17:12:57.601206 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [req-57e2fc3f-c750-4a30-a849-a2129fdbe762 req-f353bc25-faf5-4f05-b542-e0d11839ac52 tempest-VolumesActionsTest-484617325 tempest-VolumesActionsTest-484617325-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8757892952899'] for port, before_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:12:57.722255 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-034161f5-bb2a-43de-8d56-6555743a8ebc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:12:57.742969 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.plugins.ml2.db [req-57e2fc3f-c750-4a30-a849-a2129fdbe762 req-f353bc25-faf5-4f05-b542-e0d11839ac52 tempest-VolumesActionsTest-484617325 tempest-VolumesActionsTest-484617325-project] For port 14ab3ce4-171b-446f-8273-18c9dce5690f, host hv-cinder-79049, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79049',level=0,port_id=14ab3ce4-171b-446f-8273-18c9dce5690f,segment=NetworkSegment(e67ad559-7746-4ca1-858c-5806ab2906f0),segment_id=e67ad559-7746-4ca1-858c-5806ab2906f0)] {{(pid=91830) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 17:12:57.743319 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [req-57e2fc3f-c750-4a30-a849-a2129fdbe762 req-f353bc25-faf5-4f05-b542-e0d11839ac52 tempest-VolumesActionsTest-484617325 tempest-VolumesActionsTest-484617325-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-683770'] for port, precommit_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:12:57.921855 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:12:57.966658 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.plugins.ml2.plugin [req-57e2fc3f-c750-4a30-a849-a2129fdbe762 req-f353bc25-faf5-4f05-b542-e0d11839ac52 tempest-VolumesActionsTest-484617325 tempest-VolumesActionsTest-484617325-project] Calling delete_port for 14ab3ce4-171b-446f-8273-18c9dce5690f owned by compute:nova {{(pid=91830) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 25 17:12:58.085169 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [req-57e2fc3f-c750-4a30-a849-a2129fdbe762 req-f353bc25-faf5-4f05-b542-e0d11839ac52 tempest-VolumesActionsTest-484617325 tempest-VolumesActionsTest-484617325-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8757892955046', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8757892520924', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-27483019'] for port, after_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:12:58.091533 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-53aed091-e8c2-4860-9ae4-0e2389881683 tempest-AttachVolumeNegativeTest-828645077 tempest-AttachVolumeNegativeTest-828645077-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:12:58.097289 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.db [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] get_ports_and_sgs() called for port_ids ['14ab3ce4-171b-446f-8273-18c9dce5690f'] {{(pid=91831) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 25 17:12:58.140304 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f353bc25-faf5-4f05-b542-e0d11839ac52 tempest-VolumesActionsTest-484617325 tempest-VolumesActionsTest-484617325-project] Pushing event deleted for resources: {'Port': ['ID=14ab3ce4-171b-446f-8273-18c9dce5690f,revision_number=None']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:12:58.144157 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-f353bc25-faf5-4f05-b542-e0d11839ac52 tempest-VolumesActionsTest-484617325 tempest-VolumesActionsTest-484617325-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.053s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:12:58.219414 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.l3_dvrscheduler_db [req-57e2fc3f-c750-4a30-a849-a2129fdbe762 req-f353bc25-faf5-4f05-b542-e0d11839ac52 tempest-VolumesActionsTest-484617325 tempest-VolumesActionsTest-484617325-project] No DVR routers for this DVR port 14ab3ce4-171b-446f-8273-18c9dce5690f on host hv-cinder-79049 {{(pid=91830) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 25 17:12:58.221941 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [req-57e2fc3f-c750-4a30-a849-a2129fdbe762 req-f353bc25-faf5-4f05-b542-e0d11839ac52 tempest-VolumesActionsTest-484617325 tempest-VolumesActionsTest-484617325-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-178712'] for port, before_response {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:12:58.228591 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '686f9b8c-f255-4b30-a26f-8891c3d39346', 'name': 'network-vif-deleted', 'tag': '14ab3ce4-171b-446f-8273-18c9dce5690f'}] {{(pid=91830) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 25 17:12:58.241287 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-57e2fc3f-c750-4a30-a849-a2129fdbe762 req-f353bc25-faf5-4f05-b542-e0d11839ac52 tempest-VolumesActionsTest-484617325 tempest-VolumesActionsTest-484617325-project] 10.222.0.32 "DELETE /v2.0/ports/14ab3ce4-171b-446f-8273-18c9dce5690f HTTP/1.1" status: 204 len: 173 time: 0.7761405 May 25 17:12:58.287745 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '686f9b8c-f255-4b30-a26f-8891c3d39346', 'name': 'network-vif-deleted', 'tag': '14ab3ce4-171b-446f-8273-18c9dce5690f', 'status': 'completed', 'code': 200} May 25 17:12:58.311078 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-6878f716-41da-4f7c-8059-4afa25fc4b49 req-b8d7f2a2-d47e-49a7-a908-f12dc062c0f3 tempest-VolumesActionsTest-484617325 tempest-VolumesActionsTest-484617325-project] 10.222.0.62 "GET /v2.0/ports?device_id=686f9b8c-f255-4b30-a26f-8891c3d39346 HTTP/1.1" status: 200 len: 210 time: 0.0525837 May 25 17:12:58.661442 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-0a55eb4a-8b57-4233-84d6-6b423b4ed6db None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:13:00.266880 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-57f11b47-1f51-4191-b7c9-af248a48372c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:13:00.738487 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.wsgi [-] (91830) accepted ('10.222.0.62', 39060) {{(pid=91830) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:13:00.886573 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [None req-8a532224-c71e-4789-9c9e-aa7cf8eebd77 admin admin] 10.222.0.62 "GET /v2.0/security-groups?tenant_id=c7bdecd7f62b4bba97648c47533bc18a&name=default HTTP/1.1" status: 200 len: 2979 time: 0.1468735 May 25 17:13:00.889385 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.wsgi [-] (91830) accepted ('10.222.0.62', 39066) {{(pid=91830) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:13:00.945681 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-99e876a7-19cb-44c4-b4f2-e1edd2720344 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:13:00.972057 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-99e876a7-19cb-44c4-b4f2-e1edd2720344 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:13:01.025222 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-99e876a7-19cb-44c4-b4f2-e1edd2720344 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-640836'] for security_group, after_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:13:01.029930 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-60ffbf40-2518-4c43-be32-932670a713b5 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:13:01.042838 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-99e876a7-19cb-44c4-b4f2-e1edd2720344 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=092f47b9-90ca-4276-a44f-85bd46d518ba,revision_number=None']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:13:01.045713 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-99e876a7-19cb-44c4-b4f2-e1edd2720344 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.015s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:13:01.047663 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-99e876a7-19cb-44c4-b4f2-e1edd2720344 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:13:01.049618 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [None req-99e876a7-19cb-44c4-b4f2-e1edd2720344 admin admin] 10.222.0.62 "DELETE /v2.0/security-groups/092f47b9-90ca-4276-a44f-85bd46d518ba HTTP/1.1" status: 204 len: 168 time: 0.1584506 May 25 17:13:03.017051 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.rpc [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Device 14ab3ce4-171b-446f-8273-18c9dce5690f no longer exists at agent hyperv_hv-cinder-79049 {{(pid=91831) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 25 17:13:03.051774 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.plugin [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] No Port match for: 14ab3ce4-171b-446f-8273-18c9dce5690f {{(pid=91831) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}} May 25 17:13:03.052124 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.rpc [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Device 14ab3ce4-171b-446f-8273-18c9dce5690f not bound to the agent host hv-cinder-79049 {{(pid=91831) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 25 17:13:06.607089 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:13:22.082088 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.wsgi [-] (91830) accepted ('10.222.0.62', 39246) {{(pid=91830) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:13:22.144641 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.db_base_plugin_v2 [None req-7b57fba2-e76e-4f31-aefd-abd2de446386 admin admin] Deleting subnet 1173229b-93b2-414d-aeb1-c1d1f24bf6d6 {{(pid=91830) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}} May 25 17:13:22.147585 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-7b57fba2-e76e-4f31-aefd-abd2de446386 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:13:22.195882 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-7b57fba2-e76e-4f31-aefd-abd2de446386 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-28085025'] for subnet, precommit_delete_associations {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:13:22.250114 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-7b57fba2-e76e-4f31-aefd-abd2de446386 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3856586'] for subnet, precommit_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:13:22.489504 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-7b57fba2-e76e-4f31-aefd-abd2de446386 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3857535', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55886', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-28085112', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1152740'] for subnet, after_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:13:22.493817 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-ff6e1081-fc32-45e5-9ee6-43775065da52 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:13:22.525966 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7b57fba2-e76e-4f31-aefd-abd2de446386 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=1173229b-93b2-414d-aeb1-c1d1f24bf6d6,revision_number=None']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:13:22.529458 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-7b57fba2-e76e-4f31-aefd-abd2de446386 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.036s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:13:22.530427 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-7b57fba2-e76e-4f31-aefd-abd2de446386 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-551373'] for subnet, before_response {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:13:22.536542 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [None req-7b57fba2-e76e-4f31-aefd-abd2de446386 admin admin] 10.222.0.62 "DELETE /v2.0/subnets/1173229b-93b2-414d-aeb1-c1d1f24bf6d6 HTTP/1.1" status: 204 len: 168 time: 0.4534898 May 25 17:13:22.538968 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.wsgi [-] (91830) accepted ('10.222.0.62', 39250) {{(pid=91830) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:13:22.651843 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-19044039-def7-45b7-8c33-888d3d5e5b0a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3867326'] for network, before_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:13:22.774218 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-19044039-def7-45b7-8c33-888d3d5e5b0a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3858245', 'neutron.services.segments.db._delete_segments_for_network-8757892982492'] for network, precommit_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:13:22.787019 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.services.segments.db [None req-19044039-def7-45b7-8c33-888d3d5e5b0a admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['1c289a65-8084-4eb2-85f5-ce070ae5d349']}} {{(pid=91830) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 17:13:22.801816 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.services.segments.db [None req-19044039-def7-45b7-8c33-888d3d5e5b0a admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'e67ad559-7746-4ca1-858c-5806ab2906f0') {'for_net_delete': True} {{(pid=91830) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 17:13:22.802129 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.services.segments.db [None req-19044039-def7-45b7-8c33-888d3d5e5b0a admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'e67ad559-7746-4ca1-858c-5806ab2906f0') {} {{(pid=91830) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 17:13:22.813008 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-19044039-def7-45b7-8c33-888d3d5e5b0a admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8757892991389', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-28085034'] for segment, before_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:13:22.829184 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-19044039-def7-45b7-8c33-888d3d5e5b0a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3809789'] for segment, precommit_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:13:22.835050 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-19044039-def7-45b7-8c33-888d3d5e5b0a admin admin] Releasing vlan 675 on physical network physnet1 to pool {{(pid=91830) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 25 17:13:22.835487 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-19044039-def7-45b7-8c33-888d3d5e5b0a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3809789', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-27483102'] for segment, after_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:13:22.848851 dv-cinder-790492-4-iscsi neutron-server[91830]: Traceback (most recent call last): May 25 17:13:22.848851 dv-cinder-790492-4-iscsi neutron-server[91830]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 25 17:13:22.848851 dv-cinder-790492-4-iscsi neutron-server[91830]: timer() May 25 17:13:22.848851 dv-cinder-790492-4-iscsi neutron-server[91830]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 25 17:13:22.848851 dv-cinder-790492-4-iscsi neutron-server[91830]: cb(*args, **kw) May 25 17:13:22.848851 dv-cinder-790492-4-iscsi neutron-server[91830]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper May 25 17:13:22.848851 dv-cinder-790492-4-iscsi neutron-server[91830]: return func(*args, **kwargs) May 25 17:13:22.848851 dv-cinder-790492-4-iscsi neutron-server[91830]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 25 17:13:22.848851 dv-cinder-790492-4-iscsi neutron-server[91830]: self._notify() May 25 17:13:22.848851 dv-cinder-790492-4-iscsi neutron-server[91830]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 25 17:13:22.848851 dv-cinder-790492-4-iscsi neutron-server[91830]: self.callback(batched_events) May 25 17:13:22.848851 dv-cinder-790492-4-iscsi neutron-server[91830]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 25 17:13:22.848851 dv-cinder-790492-4-iscsi neutron-server[91830]: event.method(event) May 25 17:13:22.848851 dv-cinder-790492-4-iscsi neutron-server[91830]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 25 17:13:22.848851 dv-cinder-790492-4-iscsi neutron-server[91830]: aggregate_id = self._get_aggregate_id(event.segment_id) May 25 17:13:22.848851 dv-cinder-790492-4-iscsi neutron-server[91830]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 25 17:13:22.848851 dv-cinder-790492-4-iscsi neutron-server[91830]: aggregate_uuid = self.p_client.list_aggregates( May 25 17:13:22.848851 dv-cinder-790492-4-iscsi neutron-server[91830]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 25 17:13:22.848851 dv-cinder-790492-4-iscsi neutron-server[91830]: return f(self, *a, **k) May 25 17:13:22.848851 dv-cinder-790492-4-iscsi neutron-server[91830]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 25 17:13:22.848851 dv-cinder-790492-4-iscsi neutron-server[91830]: return self._get(url).json() May 25 17:13:22.848851 dv-cinder-790492-4-iscsi neutron-server[91830]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 25 17:13:22.848851 dv-cinder-790492-4-iscsi neutron-server[91830]: return self._client.get(url, endpoint_filter=self._ks_filter, May 25 17:13:22.848851 dv-cinder-790492-4-iscsi neutron-server[91830]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 25 17:13:22.848851 dv-cinder-790492-4-iscsi neutron-server[91830]: return self.request(url, 'GET', **kwargs) May 25 17:13:22.848851 dv-cinder-790492-4-iscsi neutron-server[91830]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 25 17:13:22.848851 dv-cinder-790492-4-iscsi neutron-server[91830]: base_url = self.get_endpoint(auth, allow=allow, May 25 17:13:22.848851 dv-cinder-790492-4-iscsi neutron-server[91830]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 25 17:13:22.848851 dv-cinder-790492-4-iscsi neutron-server[91830]: auth = self._auth_required(auth, 'determine endpoint URL') May 25 17:13:22.848851 dv-cinder-790492-4-iscsi neutron-server[91830]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 25 17:13:22.848851 dv-cinder-790492-4-iscsi neutron-server[91830]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 25 17:13:22.848851 dv-cinder-790492-4-iscsi neutron-server[91830]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 25 17:13:22.920860 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-19044039-def7-45b7-8c33-888d3d5e5b0a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3858252', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-640806', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-551400', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-683051'] for network, after_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:13:22.924327 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:13:22.936948 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-19044039-def7-45b7-8c33-888d3d5e5b0a admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-551373'] for network, before_response {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:13:22.950805 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [None req-19044039-def7-45b7-8c33-888d3d5e5b0a admin admin] 10.222.0.62 "DELETE /v2.0/networks/1c289a65-8084-4eb2-85f5-ce070ae5d349 HTTP/1.1" status: 204 len: 168 time: 0.4109275 May 25 17:13:22.951724 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-19044039-def7-45b7-8c33-888d3d5e5b0a admin admin] Pushing event deleted for resources: {'Network': ['ID=1c289a65-8084-4eb2-85f5-ce070ae5d349,revision_number=None']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:13:22.955544 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-19044039-def7-45b7-8c33-888d3d5e5b0a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.031s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:13:23.125770 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.wsgi [-] (91829) accepted ('10.222.0.62', 39256) {{(pid=91829) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:13:23.179602 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [None req-d5d197ea-7b94-47f7-b349-1de21b0ea86b admin admin] 10.222.0.62 "GET /v2.0/security-groups?tenant_id=f183c0c6666645e9ab8c3635833569c4&name=default HTTP/1.1" status: 200 len: 2979 time: 0.0524404 May 25 17:13:23.181873 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.wsgi [-] (91829) accepted ('10.222.0.62', 39260) {{(pid=91829) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:13:23.237243 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-f397341b-81ff-4e79-936b-c1e684950598 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:13:23.262671 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-f397341b-81ff-4e79-936b-c1e684950598 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:13:23.311749 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-f397341b-81ff-4e79-936b-c1e684950598 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-640836'] for security_group, after_delete {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:13:23.315752 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-821fab7e-d038-4b7a-a539-27cd8e447392 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:13:23.328680 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f397341b-81ff-4e79-936b-c1e684950598 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=af408198-1a2b-4ca3-aa88-275037ef85c5,revision_number=None']} {{(pid=91829) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:13:23.338788 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-f397341b-81ff-4e79-936b-c1e684950598 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:13:23.339888 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [None req-f397341b-81ff-4e79-936b-c1e684950598 admin admin] 10.222.0.62 "DELETE /v2.0/security-groups/af408198-1a2b-4ca3-aa88-275037ef85c5 HTTP/1.1" status: 204 len: 168 time: 0.1571248 May 25 17:13:23.341212 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f397341b-81ff-4e79-936b-c1e684950598 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91829) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:13:23.341592 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f397341b-81ff-4e79-936b-c1e684950598 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91829) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:13:23.342009 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f397341b-81ff-4e79-936b-c1e684950598 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91829) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:13:23.342391 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f397341b-81ff-4e79-936b-c1e684950598 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91829) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:13:23.342752 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f397341b-81ff-4e79-936b-c1e684950598 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91829) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:13:23.343115 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f397341b-81ff-4e79-936b-c1e684950598 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91829) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:13:23.343472 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f397341b-81ff-4e79-936b-c1e684950598 admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91829) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:13:23.344224 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f397341b-81ff-4e79-936b-c1e684950598 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91829) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:13:23.344224 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f397341b-81ff-4e79-936b-c1e684950598 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91829) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:13:23.344519 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f397341b-81ff-4e79-936b-c1e684950598 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91829) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:13:23.344873 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f397341b-81ff-4e79-936b-c1e684950598 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91829) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:13:23.345224 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f397341b-81ff-4e79-936b-c1e684950598 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91829) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:13:23.348643 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-f397341b-81ff-4e79-936b-c1e684950598 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.033s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:13:25.332146 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-b40f4e75-5d0c-4d03-ad10-77fc48a4ad82 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:13:27.726676 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-6d8e2394-bd21-47fc-a53d-10e0fc10efd4 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:13:27.911097 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:13:28.656265 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-0a55eb4a-8b57-4233-84d6-6b423b4ed6db None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:13:30.270454 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-57f11b47-1f51-4191-b7c9-af248a48372c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:13:32.148931 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.db.agents_db [None req-504cb04f-4543-46c1-8db7-349e21db7634 None None] Agent healthcheck: found 6 active agents {{(pid=91832) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} May 25 17:13:36.620314 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:13:46.964255 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.wsgi [req-5f4db9b9-925c-49a0-b135-97eff6e1e27e req-0379b749-6201-4202-a8b1-6efe2f143922 service neutron] (91830) timed out ('10.222.0.32', 55649) {{(pid=91830) process_request /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:830}} May 25 17:13:50.250734 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-1a73619c-e293-47f1-8c4e-c8caef90f11e req-a0245c6f-b9cf-4df7-b2cb-ce4ed4dceef7 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] 10.222.0.62 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-1745610358&fields=id&tenant_id=5397bf60956945c3a2bf43c6b1aa614b HTTP/1.1" status: 200 len: 267 time: 0.0394099 May 25 17:13:50.411196 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1a73619c-e293-47f1-8c4e-c8caef90f11e req-d3334bcd-0967-4735-b8f0-3de3a6e5f204 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:13:50.412764 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-1a73619c-e293-47f1-8c4e-c8caef90f11e req-d3334bcd-0967-4735-b8f0-3de3a6e5f204 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] 10.222.0.62 "GET /v2.0/networks?id=17a0e39e-1e1f-4550-b28b-d5ae3bdca362 HTTP/1.1" status: 200 len: 811 time: 0.1556840 May 25 17:13:50.427895 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-1a73619c-e293-47f1-8c4e-c8caef90f11e req-bd38729b-e790-40c6-8e1d-c21915d3948b tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] 10.222.0.62 "GET /v2.0/quotas/5397bf60956945c3a2bf43c6b1aa614b HTTP/1.1" status: 200 len: 375 time: 0.0092344 May 25 17:13:50.523574 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-1a73619c-e293-47f1-8c4e-c8caef90f11e req-9f973dcb-018d-4f41-8e95-453c72e1e908 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] 10.222.0.62 "GET /v2.0/ports?tenant_id=5397bf60956945c3a2bf43c6b1aa614b&fields=id HTTP/1.1" status: 200 len: 440 time: 0.0903840 May 25 17:13:50.666932 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-1a73619c-e293-47f1-8c4e-c8caef90f11e req-df90293e-2db6-4265-969f-3cca774297a8 service neutron] 10.222.0.62 "GET /v2.0/networks/17a0e39e-1e1f-4550-b28b-d5ae3bdca362?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1291656 May 25 17:13:50.803367 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-1a73619c-e293-47f1-8c4e-c8caef90f11e req-bcf833e5-3770-4783-91a4-1954c975cf37 service neutron] 10.222.0.62 "GET /v2.0/networks/17a0e39e-1e1f-4550-b28b-d5ae3bdca362?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1301386 May 25 17:13:51.403215 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-9c1ae339-13b7-4759-9e7b-9ea26ff85016 req-b81925c3-7fb1-4df1-aa66-9cb1072b823e tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] 10.222.0.62 "GET /v2.0/ports?device_id=c44e76f7-ac65-4901-b0dc-0566b81b2c3f HTTP/1.1" status: 200 len: 210 time: 0.2473693 May 25 17:13:52.234676 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1a73619c-e293-47f1-8c4e-c8caef90f11e req-47138f20-c6c8-4651-8621-6baf5db5ffbb tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=91830) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:13:52.235351 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [req-1a73619c-e293-47f1-8c4e-c8caef90f11e req-47138f20-c6c8-4651-8621-6baf5db5ffbb tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Synchronizing usage tracker for tenant:5397bf60956945c3a2bf43c6b1aa614b on resource:network {{(pid=91830) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 25 17:13:52.251521 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [req-1a73619c-e293-47f1-8c4e-c8caef90f11e req-47138f20-c6c8-4651-8621-6baf5db5ffbb tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Unset dirty status for tenant:5397bf60956945c3a2bf43c6b1aa614b on resource:network {{(pid=91830) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 25 17:13:52.252752 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-1a73619c-e293-47f1-8c4e-c8caef90f11e req-47138f20-c6c8-4651-8621-6baf5db5ffbb tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] 10.222.0.32 "GET /v2.0/networks?id=17a0e39e-1e1f-4550-b28b-d5ae3bdca362 HTTP/1.1" status: 200 len: 811 time: 0.1710382 May 25 17:13:52.303466 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [req-1a73619c-e293-47f1-8c4e-c8caef90f11e req-3f398caa-8f4d-426d-815b-3ed060b680fb tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Synchronizing usage tracker for tenant:5397bf60956945c3a2bf43c6b1aa614b on resource:security_group {{(pid=91830) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 25 17:13:52.314715 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [req-1a73619c-e293-47f1-8c4e-c8caef90f11e req-3f398caa-8f4d-426d-815b-3ed060b680fb tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Unset dirty status for tenant:5397bf60956945c3a2bf43c6b1aa614b on resource:security_group {{(pid=91830) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 25 17:13:52.315791 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-1a73619c-e293-47f1-8c4e-c8caef90f11e req-3f398caa-8f4d-426d-815b-3ed060b680fb tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] 10.222.0.32 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=5397bf60956945c3a2bf43c6b1aa614b HTTP/1.1" status: 200 len: 380 time: 0.0535891 May 25 17:13:52.325901 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.v2.base [req-1a73619c-e293-47f1-8c4e-c8caef90f11e req-1cf8737f-83ae-4e03-9172-bec0e4b4cc20 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Request body: {'port': {'device_id': 'c44e76f7-ac65-4901-b0dc-0566b81b2c3f', 'network_id': '17a0e39e-1e1f-4550-b28b-d5ae3bdca362', 'admin_state_up': True, 'tenant_id': '5397bf60956945c3a2bf43c6b1aa614b', 'security_groups': ['58fab80b-49b2-4bca-89e6-fef7473221ef']}} {{(pid=91830) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 17:13:52.554122 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.quota.driver [req-1a73619c-e293-47f1-8c4e-c8caef90f11e req-1cf8737f-83ae-4e03-9172-bec0e4b4cc20 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91830) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 17:13:52.562847 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-430c5daf-2a92-4d29-a095-1e1e14d8debc req-e4412a0c-180e-4cff-977f-50f1d2617022 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] 10.222.0.62 "GET /v2.0/ports?device_id=c44e76f7-ac65-4901-b0dc-0566b81b2c3f HTTP/1.1" status: 200 len: 210 time: 0.0480149 May 25 17:13:52.564200 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.quota.driver [req-1a73619c-e293-47f1-8c4e-c8caef90f11e req-1cf8737f-83ae-4e03-9172-bec0e4b4cc20 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Attempting to reserve 1 items for resource port. Total usage: 4; quota limit: 500; headroom:496 {{(pid=91830) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 17:13:52.574025 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-1a73619c-e293-47f1-8c4e-c8caef90f11e req-1cf8737f-83ae-4e03-9172-bec0e4b4cc20 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Made reservation on behalf of 5397bf60956945c3a2bf43c6b1aa614b for: {'port': 1} {{(pid=91830) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} May 25 17:13:52.577629 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [req-1a73619c-e293-47f1-8c4e-c8caef90f11e req-1cf8737f-83ae-4e03-9172-bec0e4b4cc20 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3832070'] for port, before_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:13:52.746986 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.db_base_plugin_common [req-1a73619c-e293-47f1-8c4e-c8caef90f11e req-1cf8737f-83ae-4e03-9172-bec0e4b4cc20 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Allocated IP 172.20.0.12 (17a0e39e-1e1f-4550-b28b-d5ae3bdca362/f5599a2e-9942-4423-a1ac-67e9b2650770/76597caa-0aed-4769-95f7-9a9f6456a519) {{(pid=91830) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 25 17:13:52.945632 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [req-1a73619c-e293-47f1-8c4e-c8caef90f11e req-1cf8737f-83ae-4e03-9172-bec0e4b4cc20 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Notify callbacks [] for port, precommit_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:13:52.964218 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.provisioning_blocks [req-1a73619c-e293-47f1-8c4e-c8caef90f11e req-1cf8737f-83ae-4e03-9172-bec0e4b4cc20 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Transition to ACTIVE for port object 76597caa-0aed-4769-95f7-9a9f6456a519 will not be triggered until provisioned by entity DHCP. {{(pid=91830) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 25 17:13:52.993783 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [req-1a73619c-e293-47f1-8c4e-c8caef90f11e req-1cf8737f-83ae-4e03-9172-bec0e4b4cc20 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8757892520915', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-27483019'] for port, after_create {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:13:53.000267 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-ce51d90b-5f33-4c35-9e54-8ee391fb227b admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:13:53.070143 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-1a73619c-e293-47f1-8c4e-c8caef90f11e req-1cf8737f-83ae-4e03-9172-bec0e4b4cc20 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Network 17a0e39e-1e1f-4550-b28b-d5ae3bdca362 is already hosted by enough agents. {{(pid=91830) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 25 17:13:53.072981 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.scheduler.base_scheduler [req-1a73619c-e293-47f1-8c4e-c8caef90f11e req-1cf8737f-83ae-4e03-9172-bec0e4b4cc20 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Resources bound (agent type, host, resource id): {{(pid=91830) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 17:13:53.076934 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.l3_dvrscheduler_db [req-1a73619c-e293-47f1-8c4e-c8caef90f11e req-1cf8737f-83ae-4e03-9172-bec0e4b4cc20 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Received port after_create {{(pid=91830) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 25 17:13:53.112197 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1cf8737f-83ae-4e03-9172-bec0e4b4cc20 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Pushing event updated for resources: {'Port': ['ID=76597caa-0aed-4769-95f7-9a9f6456a519,revision_number=1']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:13:53.132620 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1cf8737f-83ae-4e03-9172-bec0e4b4cc20 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91830) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:13:53.133005 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1cf8737f-83ae-4e03-9172-bec0e4b4cc20 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91830) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:13:53.133385 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1cf8737f-83ae-4e03-9172-bec0e4b4cc20 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91830) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:13:53.133757 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1cf8737f-83ae-4e03-9172-bec0e4b4cc20 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91830) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:13:53.134148 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1cf8737f-83ae-4e03-9172-bec0e4b4cc20 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91830) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:13:53.134738 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1cf8737f-83ae-4e03-9172-bec0e4b4cc20 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91830) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:13:53.135113 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1cf8737f-83ae-4e03-9172-bec0e4b4cc20 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91830) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:13:53.135478 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1cf8737f-83ae-4e03-9172-bec0e4b4cc20 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91830) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:13:53.135841 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1cf8737f-83ae-4e03-9172-bec0e4b4cc20 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91830) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:13:53.136201 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1cf8737f-83ae-4e03-9172-bec0e4b4cc20 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91830) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:13:53.136558 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1cf8737f-83ae-4e03-9172-bec0e4b4cc20 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91830) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:13:53.136953 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1cf8737f-83ae-4e03-9172-bec0e4b4cc20 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91830) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:13:53.142836 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-1cf8737f-83ae-4e03-9172-bec0e4b4cc20 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.143s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:13:53.161651 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1a73619c-e293-47f1-8c4e-c8caef90f11e req-1cf8737f-83ae-4e03-9172-bec0e4b4cc20 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=91830) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:13:53.162312 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [req-1a73619c-e293-47f1-8c4e-c8caef90f11e req-1cf8737f-83ae-4e03-9172-bec0e4b4cc20 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-178712'] for port, before_response {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:13:53.190279 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-1a73619c-e293-47f1-8c4e-c8caef90f11e req-1cf8737f-83ae-4e03-9172-bec0e4b4cc20 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] 10.222.0.32 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 0.8684902 May 25 17:13:53.202660 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.v2.base [req-1a73619c-e293-47f1-8c4e-c8caef90f11e req-c4b3aac7-2451-4eff-8175-6b8c50213b59 service neutron] Request body: {'port': {'device_id': 'c44e76f7-ac65-4901-b0dc-0566b81b2c3f', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-79049'}} {{(pid=91830) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 17:13:53.307121 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.provisioning_blocks [None req-6412308b-efdc-498b-ad63-6f71217803e3 None None] Provisioning for port 76597caa-0aed-4769-95f7-9a9f6456a519 completed by entity DHCP. {{(pid=91831) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 25 17:13:53.312290 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.provisioning_blocks [None req-6412308b-efdc-498b-ad63-6f71217803e3 None None] Provisioning complete for port 76597caa-0aed-4769-95f7-9a9f6456a519 triggered by entity DHCP. {{(pid=91831) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 17:13:53.312762 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-6412308b-efdc-498b-ad63-6f71217803e3 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3854128'] for port, provisioning_complete {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:13:53.322310 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [req-1a73619c-e293-47f1-8c4e-c8caef90f11e req-c4b3aac7-2451-4eff-8175-6b8c50213b59 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3832070'] for port, before_update {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:13:53.368127 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.plugin [None req-6412308b-efdc-498b-ad63-6f71217803e3 None None] Port 76597caa-0aed-4769-95f7-9a9f6456a519 cannot update to ACTIVE because it is not bound. {{(pid=91831) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:337}} May 25 17:13:53.703220 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.notifiers.nova [req-1a73619c-e293-47f1-8c4e-c8caef90f11e req-c4b3aac7-2451-4eff-8175-6b8c50213b59 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 76597caa-0aed-4769-95f7-9a9f6456a519 {{(pid=91830) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} May 25 17:13:53.710773 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [req-1a73619c-e293-47f1-8c4e-c8caef90f11e req-c4b3aac7-2451-4eff-8175-6b8c50213b59 service neutron] Notify callbacks [] for port, precommit_update {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:13:53.726918 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.provisioning_blocks [req-1a73619c-e293-47f1-8c4e-c8caef90f11e req-c4b3aac7-2451-4eff-8175-6b8c50213b59 service neutron] Transition to ACTIVE for port object 76597caa-0aed-4769-95f7-9a9f6456a519 will not be triggered until provisioned by entity L2. {{(pid=91830) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} May 25 17:13:53.731648 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [req-1a73619c-e293-47f1-8c4e-c8caef90f11e req-c4b3aac7-2451-4eff-8175-6b8c50213b59 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8757892955028', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8757892520933', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8757892521750', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-27483010'] for port, after_update {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:13:53.737588 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-028ded24-f221-4014-a310-834e174107ce admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:13:53.751067 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ffee8351-7133-4c2f-aeca-54d1f2178d2c req-ce6819ef-ac0f-4945-b391-1e476b73af47 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:13:53.752495 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-ffee8351-7133-4c2f-aeca-54d1f2178d2c req-ce6819ef-ac0f-4945-b391-1e476b73af47 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] 10.222.0.62 "GET /v2.0/ports?device_id=c44e76f7-ac65-4901-b0dc-0566b81b2c3f HTTP/1.1" status: 200 len: 932 time: 0.0818393 May 25 17:13:53.801455 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-ffee8351-7133-4c2f-aeca-54d1f2178d2c req-cc972bda-b4df-4d58-9079-03b1a0561a0a tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] 10.222.0.62 "GET /v2.0/security-groups?id=58fab80b-49b2-4bca-89e6-fef7473221ef&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0428426 May 25 17:13:53.937870 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c4b3aac7-2451-4eff-8175-6b8c50213b59 service neutron] Pushing event updated for resources: {'Port': ['ID=76597caa-0aed-4769-95f7-9a9f6456a519,revision_number=2']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:13:53.944292 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-c4b3aac7-2451-4eff-8175-6b8c50213b59 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.207s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:13:53.990334 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.plugins.ml2.managers [req-1a73619c-e293-47f1-8c4e-c8caef90f11e req-c4b3aac7-2451-4eff-8175-6b8c50213b59 service neutron] Attempting to bind port 76597caa-0aed-4769-95f7-9a9f6456a519 on host hv-cinder-79049 for vnic_type normal with profile {{(pid=91830) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} May 25 17:13:53.990703 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.plugins.ml2.managers [req-1a73619c-e293-47f1-8c4e-c8caef90f11e req-c4b3aac7-2451-4eff-8175-6b8c50213b59 service neutron] Attempting to bind port 76597caa-0aed-4769-95f7-9a9f6456a519 by drivers openvswitch,hyperv on host hv-cinder-79049 at level 0 using segments [{'id': '50ed67e9-f8d3-4927-b257-bd17654cce34', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 657, 'network_id': '17a0e39e-1e1f-4550-b28b-d5ae3bdca362'}] {{(pid=91830) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} May 25 17:13:53.991075 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1a73619c-e293-47f1-8c4e-c8caef90f11e req-c4b3aac7-2451-4eff-8175-6b8c50213b59 service neutron] Attempting to bind port 76597caa-0aed-4769-95f7-9a9f6456a519 on network 17a0e39e-1e1f-4550-b28b-d5ae3bdca362 {{(pid=91830) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 25 17:13:53.996469 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1a73619c-e293-47f1-8c4e-c8caef90f11e req-c4b3aac7-2451-4eff-8175-6b8c50213b59 service neutron] Port 76597caa-0aed-4769-95f7-9a9f6456a519 on network 17a0e39e-1e1f-4550-b28b-d5ae3bdca362 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-79049 {{(pid=91830) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:98}} May 25 17:13:53.996782 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1a73619c-e293-47f1-8c4e-c8caef90f11e req-c4b3aac7-2451-4eff-8175-6b8c50213b59 service neutron] Attempting to bind port 76597caa-0aed-4769-95f7-9a9f6456a519 on network 17a0e39e-1e1f-4550-b28b-d5ae3bdca362 {{(pid=91830) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:86}} May 25 17:13:54.001927 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1a73619c-e293-47f1-8c4e-c8caef90f11e req-c4b3aac7-2451-4eff-8175-6b8c50213b59 service neutron] Checking agent: {'id': '3a1fdee1-bff0-49fb-b470-e13b95ee1b4d', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-79049', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 5, 25, 16, 56, 32), 'started_at': datetime.datetime(2021, 5, 25, 16, 56, 32), 'heartbeat_timestamp': datetime.datetime(2021, 5, 25, 17, 13, 37), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=91830) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:105}} May 25 17:13:54.002275 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1a73619c-e293-47f1-8c4e-c8caef90f11e req-c4b3aac7-2451-4eff-8175-6b8c50213b59 service neutron] Checking segment: {'id': '50ed67e9-f8d3-4927-b257-bd17654cce34', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 657, 'network_id': '17a0e39e-1e1f-4550-b28b-d5ae3bdca362'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=91830) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:341}} May 25 17:13:54.002655 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1a73619c-e293-47f1-8c4e-c8caef90f11e req-c4b3aac7-2451-4eff-8175-6b8c50213b59 service neutron] Bound using segment: {'id': '50ed67e9-f8d3-4927-b257-bd17654cce34', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 657, 'network_id': '17a0e39e-1e1f-4550-b28b-d5ae3bdca362'} {{(pid=91830) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:115}} May 25 17:13:54.003079 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.plugins.ml2.managers [req-1a73619c-e293-47f1-8c4e-c8caef90f11e req-c4b3aac7-2451-4eff-8175-6b8c50213b59 service neutron] Bound port: 76597caa-0aed-4769-95f7-9a9f6456a519, host: hv-cinder-79049, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '50ed67e9-f8d3-4927-b257-bd17654cce34', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 657, 'network_id': '17a0e39e-1e1f-4550-b28b-d5ae3bdca362'}}] {{(pid=91830) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} May 25 17:13:54.003428 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [req-1a73619c-e293-47f1-8c4e-c8caef90f11e req-c4b3aac7-2451-4eff-8175-6b8c50213b59 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3832070'] for port, before_update {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:13:54.098309 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.plugins.ml2.db [req-1a73619c-e293-47f1-8c4e-c8caef90f11e req-c4b3aac7-2451-4eff-8175-6b8c50213b59 service neutron] For port 76597caa-0aed-4769-95f7-9a9f6456a519, host hv-cinder-79049, cleared binding levels {{(pid=91830) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:88}} May 25 17:13:54.101220 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.plugins.ml2.db [req-1a73619c-e293-47f1-8c4e-c8caef90f11e req-c4b3aac7-2451-4eff-8175-6b8c50213b59 service neutron] For port 76597caa-0aed-4769-95f7-9a9f6456a519, host hv-cinder-79049, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79049',level=0,port_id=76597caa-0aed-4769-95f7-9a9f6456a519,segment=NetworkSegment(50ed67e9-f8d3-4927-b257-bd17654cce34),segment_id=50ed67e9-f8d3-4927-b257-bd17654cce34)] {{(pid=91830) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:60}} May 25 17:13:54.105487 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [req-1a73619c-e293-47f1-8c4e-c8caef90f11e req-c4b3aac7-2451-4eff-8175-6b8c50213b59 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8757892955028', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8757892520933', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8757892521750', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-27483010'] for port, after_update {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:13:54.110384 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-f353bc25-faf5-4f05-b542-e0d11839ac52 tempest-VolumesActionsTest-484617325 tempest-VolumesActionsTest-484617325-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:13:54.172123 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1a73619c-e293-47f1-8c4e-c8caef90f11e req-c4b3aac7-2451-4eff-8175-6b8c50213b59 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91830) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:13:54.172731 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [req-1a73619c-e293-47f1-8c4e-c8caef90f11e req-c4b3aac7-2451-4eff-8175-6b8c50213b59 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-178712'] for port, before_response {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:13:54.174121 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-1a73619c-e293-47f1-8c4e-c8caef90f11e req-c4b3aac7-2451-4eff-8175-6b8c50213b59 service neutron] 10.222.0.32 "PUT /v2.0/ports/76597caa-0aed-4769-95f7-9a9f6456a519 HTTP/1.1" status: 200 len: 1094 time: 0.9758928 May 25 17:13:54.174637 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'c44e76f7-ac65-4901-b0dc-0566b81b2c3f', 'tag': '76597caa-0aed-4769-95f7-9a9f6456a519'}] {{(pid=91830) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 25 17:13:54.197679 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c4b3aac7-2451-4eff-8175-6b8c50213b59 service neutron] Pushing event updated for resources: {'Port': ['ID=76597caa-0aed-4769-95f7-9a9f6456a519,revision_number=3']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:13:54.201520 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-c4b3aac7-2451-4eff-8175-6b8c50213b59 service neutron] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.091s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:13:54.250488 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'c44e76f7-ac65-4901-b0dc-0566b81b2c3f', 'tag': '76597caa-0aed-4769-95f7-9a9f6456a519', 'status': 'completed', 'code': 200} May 25 17:13:54.292398 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1a73619c-e293-47f1-8c4e-c8caef90f11e req-38af1b27-20d8-4f90-af73-8e6c71833cc6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91830) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:13:54.294144 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-1a73619c-e293-47f1-8c4e-c8caef90f11e req-38af1b27-20d8-4f90-af73-8e6c71833cc6 service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=5397bf60956945c3a2bf43c6b1aa614b&device_id=c44e76f7-ac65-4901-b0dc-0566b81b2c3f HTTP/1.1" status: 200 len: 1097 time: 0.0761073 May 25 17:13:54.372311 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-1a73619c-e293-47f1-8c4e-c8caef90f11e req-60c53e0b-317a-4357-a7f9-0f0cdeca3772 service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=76597caa-0aed-4769-95f7-9a9f6456a519 HTTP/1.1" status: 200 len: 217 time: 0.0681663 May 25 17:13:54.437154 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1a73619c-e293-47f1-8c4e-c8caef90f11e req-a41fb30b-d30c-4c91-b1a7-017e17319439 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91830) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:13:54.438538 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-1a73619c-e293-47f1-8c4e-c8caef90f11e req-a41fb30b-d30c-4c91-b1a7-017e17319439 service neutron] 10.222.0.32 "GET /v2.0/subnets?id=f5599a2e-9942-4423-a1ac-67e9b2650770 HTTP/1.1" status: 200 len: 850 time: 0.0615416 May 25 17:13:54.611943 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1a73619c-e293-47f1-8c4e-c8caef90f11e req-371831ba-60d6-456e-9ef2-cfd0da4a0a1f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91830) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:13:54.613417 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-1a73619c-e293-47f1-8c4e-c8caef90f11e req-371831ba-60d6-456e-9ef2-cfd0da4a0a1f service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=17a0e39e-1e1f-4550-b28b-d5ae3bdca362&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.1676843 May 25 17:13:54.749722 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-1a73619c-e293-47f1-8c4e-c8caef90f11e req-bf2d312c-b369-4442-8a26-3302a0d488b4 service neutron] 10.222.0.32 "GET /v2.0/networks/17a0e39e-1e1f-4550-b28b-d5ae3bdca362?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1272562 May 25 17:13:54.890779 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-1a73619c-e293-47f1-8c4e-c8caef90f11e req-b4af3bcd-5282-45ff-b3b2-2ceaaa8450d5 service neutron] 10.222.0.32 "GET /v2.0/networks/17a0e39e-1e1f-4550-b28b-d5ae3bdca362?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1328638 May 25 17:13:55.004165 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-39137e8e-3c92-44ee-b4f0-b5e0507cec40 req-70c0f1dd-7e4f-47b4-9917-80e85b61accc tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:13:55.005509 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-39137e8e-3c92-44ee-b4f0-b5e0507cec40 req-70c0f1dd-7e4f-47b4-9917-80e85b61accc tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] 10.222.0.62 "GET /v2.0/ports?device_id=c44e76f7-ac65-4901-b0dc-0566b81b2c3f HTTP/1.1" status: 200 len: 944 time: 0.0891693 May 25 17:13:55.009355 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-51df4c77-aeeb-428c-9c78-6f4dce2355d5 req-6fa93cbb-9d84-441e-a5ea-07e38a01692a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91830) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:13:55.010875 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-51df4c77-aeeb-428c-9c78-6f4dce2355d5 req-6fa93cbb-9d84-441e-a5ea-07e38a01692a service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=5397bf60956945c3a2bf43c6b1aa614b&device_id=c44e76f7-ac65-4901-b0dc-0566b81b2c3f HTTP/1.1" status: 200 len: 1097 time: 0.0713098 May 25 17:13:55.055678 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-39137e8e-3c92-44ee-b4f0-b5e0507cec40 req-23057dc6-b418-4f55-8b32-5b7ee0e456f5 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] 10.222.0.62 "GET /v2.0/security-groups?id=58fab80b-49b2-4bca-89e6-fef7473221ef&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0442519 May 25 17:13:55.147889 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-51df4c77-aeeb-428c-9c78-6f4dce2355d5 req-08f87cff-9698-4666-9043-b9bf63fa973b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91830) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:13:55.149326 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-51df4c77-aeeb-428c-9c78-6f4dce2355d5 req-08f87cff-9698-4666-9043-b9bf63fa973b service neutron] 10.222.0.32 "GET /v2.0/networks?id=17a0e39e-1e1f-4550-b28b-d5ae3bdca362 HTTP/1.1" status: 200 len: 912 time: 0.1321180 May 25 17:13:55.222579 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-51df4c77-aeeb-428c-9c78-6f4dce2355d5 req-936d8951-0c0f-4890-97f6-08862ab3090c service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=76597caa-0aed-4769-95f7-9a9f6456a519 HTTP/1.1" status: 200 len: 217 time: 0.0654547 May 25 17:13:55.286695 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-51df4c77-aeeb-428c-9c78-6f4dce2355d5 req-dc19c637-6539-43aa-a32d-f6f4105d4a6c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91830) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:13:55.288061 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-51df4c77-aeeb-428c-9c78-6f4dce2355d5 req-dc19c637-6539-43aa-a32d-f6f4105d4a6c service neutron] 10.222.0.32 "GET /v2.0/subnets?id=f5599a2e-9942-4423-a1ac-67e9b2650770 HTTP/1.1" status: 200 len: 850 time: 0.0582666 May 25 17:13:55.335062 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-04808edb-48a5-4f5b-9d30-c4ccc9d7adfe None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:13:55.373765 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-51df4c77-aeeb-428c-9c78-6f4dce2355d5 req-308acaad-107a-44fd-bfc7-876667bbf84f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91830) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:13:55.375258 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-51df4c77-aeeb-428c-9c78-6f4dce2355d5 req-308acaad-107a-44fd-bfc7-876667bbf84f service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=17a0e39e-1e1f-4550-b28b-d5ae3bdca362&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0807033 May 25 17:13:55.512597 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-51df4c77-aeeb-428c-9c78-6f4dce2355d5 req-8b28a930-8667-4b38-b0d5-a098498b4b92 service neutron] 10.222.0.32 "GET /v2.0/networks/17a0e39e-1e1f-4550-b28b-d5ae3bdca362?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1288819 May 25 17:13:55.651470 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-51df4c77-aeeb-428c-9c78-6f4dce2355d5 req-6a65b174-8ddd-4821-92a7-ef46c5b5d791 service neutron] 10.222.0.32 "GET /v2.0/networks/17a0e39e-1e1f-4550-b28b-d5ae3bdca362?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1324623 May 25 17:13:56.244247 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2771c6d2-ee3b-495c-a90a-46f351f489bc req-a13c3605-a349-40e3-9d7f-30f4a7f97a47 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:13:56.245696 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-2771c6d2-ee3b-495c-a90a-46f351f489bc req-a13c3605-a349-40e3-9d7f-30f4a7f97a47 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] 10.222.0.62 "GET /v2.0/ports?device_id=c44e76f7-ac65-4901-b0dc-0566b81b2c3f HTTP/1.1" status: 200 len: 944 time: 0.0809610 May 25 17:13:56.291284 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-2771c6d2-ee3b-495c-a90a-46f351f489bc req-a2117676-856e-4585-b107-ea2dd853fc37 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] 10.222.0.62 "GET /v2.0/security-groups?id=58fab80b-49b2-4bca-89e6-fef7473221ef&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0396700 May 25 17:13:57.481719 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ead2cf89-deb2-46b5-aa2f-5533326cfea3 req-ec0b7b51-0d6a-43a4-ac58-7e544924c012 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:13:57.483187 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-ead2cf89-deb2-46b5-aa2f-5533326cfea3 req-ec0b7b51-0d6a-43a4-ac58-7e544924c012 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] 10.222.0.62 "GET /v2.0/ports?device_id=c44e76f7-ac65-4901-b0dc-0566b81b2c3f HTTP/1.1" status: 200 len: 944 time: 0.0842607 May 25 17:13:57.527994 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-ead2cf89-deb2-46b5-aa2f-5533326cfea3 req-f58c5ef7-3de7-49d3-b621-51e2ca781260 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] 10.222.0.62 "GET /v2.0/security-groups?id=58fab80b-49b2-4bca-89e6-fef7473221ef&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0386274 May 25 17:13:57.730047 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-e1306638-7049-4a69-abec-e160324e6ba8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:13:57.914172 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:13:58.659067 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-0a55eb4a-8b57-4233-84d6-6b423b4ed6db None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:13:58.713423 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-80b5f4dc-1b8f-41cc-9811-195fc2f3fc27 req-9a4278d0-5372-47f4-b20a-04f43413173f tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:13:58.715204 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-80b5f4dc-1b8f-41cc-9811-195fc2f3fc27 req-9a4278d0-5372-47f4-b20a-04f43413173f tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] 10.222.0.62 "GET /v2.0/ports?device_id=c44e76f7-ac65-4901-b0dc-0566b81b2c3f HTTP/1.1" status: 200 len: 944 time: 0.0831952 May 25 17:13:58.765100 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-80b5f4dc-1b8f-41cc-9811-195fc2f3fc27 req-925ac57a-4ee8-4583-b5dc-6c8ea142fc61 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] 10.222.0.62 "GET /v2.0/security-groups?id=58fab80b-49b2-4bca-89e6-fef7473221ef&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0443735 May 25 17:13:59.954424 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-31e96ea7-318f-4341-af1a-055a6aae918a req-e6fcacd8-0c6d-4d44-9967-bdcd91bef7c2 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:13:59.955869 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-31e96ea7-318f-4341-af1a-055a6aae918a req-e6fcacd8-0c6d-4d44-9967-bdcd91bef7c2 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] 10.222.0.62 "GET /v2.0/ports?device_id=c44e76f7-ac65-4901-b0dc-0566b81b2c3f HTTP/1.1" status: 200 len: 944 time: 0.0827584 May 25 17:14:00.000778 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-31e96ea7-318f-4341-af1a-055a6aae918a req-f47e6174-419c-4414-8e1a-4e4d49ec8d44 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] 10.222.0.62 "GET /v2.0/security-groups?id=58fab80b-49b2-4bca-89e6-fef7473221ef&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0392194 May 25 17:14:00.273742 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-57f11b47-1f51-4191-b7c9-af248a48372c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:14:01.190536 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5b1da13b-e6cd-4f85-8225-1309bc9fc58f req-8a34f12e-00d4-40eb-89f9-37f0dd11daed tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:14:01.192016 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-5b1da13b-e6cd-4f85-8225-1309bc9fc58f req-8a34f12e-00d4-40eb-89f9-37f0dd11daed tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] 10.222.0.62 "GET /v2.0/ports?device_id=c44e76f7-ac65-4901-b0dc-0566b81b2c3f HTTP/1.1" status: 200 len: 944 time: 0.0842400 May 25 17:14:01.236979 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-5b1da13b-e6cd-4f85-8225-1309bc9fc58f req-df471a67-e7b1-4e40-9057-48e654296acf tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] 10.222.0.62 "GET /v2.0/security-groups?id=58fab80b-49b2-4bca-89e6-fef7473221ef&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0387917 May 25 17:14:02.424022 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-419c5646-2194-4fb1-a3df-cabbaa007b92 req-2f5e7561-fe8b-4ebb-92b7-8c69e8f117f6 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:14:02.425480 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-419c5646-2194-4fb1-a3df-cabbaa007b92 req-2f5e7561-fe8b-4ebb-92b7-8c69e8f117f6 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] 10.222.0.62 "GET /v2.0/ports?device_id=c44e76f7-ac65-4901-b0dc-0566b81b2c3f HTTP/1.1" status: 200 len: 944 time: 0.0850623 May 25 17:14:02.470358 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-419c5646-2194-4fb1-a3df-cabbaa007b92 req-3b2a10ed-50a5-4d09-b4ee-2a04812443f6 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] 10.222.0.62 "GET /v2.0/security-groups?id=58fab80b-49b2-4bca-89e6-fef7473221ef&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0391827 May 25 17:14:03.749184 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2188c7ae-91a0-4007-8c56-7f99c4e3267e req-cb61729f-231e-402b-9a55-e02ccdf1d5ab tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:14:03.750634 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-2188c7ae-91a0-4007-8c56-7f99c4e3267e req-cb61729f-231e-402b-9a55-e02ccdf1d5ab tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] 10.222.0.62 "GET /v2.0/ports?device_id=c44e76f7-ac65-4901-b0dc-0566b81b2c3f HTTP/1.1" status: 200 len: 944 time: 0.1750243 May 25 17:14:03.796039 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-2188c7ae-91a0-4007-8c56-7f99c4e3267e req-6311d5b3-52cf-4965-b07a-5a6f823e3a56 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] 10.222.0.62 "GET /v2.0/security-groups?id=58fab80b-49b2-4bca-89e6-fef7473221ef&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0396552 May 25 17:14:04.614898 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.rpc [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Device 76597caa-0aed-4769-95f7-9a9f6456a519 details requested by agent hyperv_hv-cinder-79049 with host hv-cinder-79049 {{(pid=91831) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:88}} May 25 17:14:04.748086 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.db [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] For port 76597caa-0aed-4769-95f7-9a9f6456a519, host hv-cinder-79049, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79049',level=0,port_id=76597caa-0aed-4769-95f7-9a9f6456a519,segment=NetworkSegment(50ed67e9-f8d3-4927-b257-bd17654cce34),segment_id=50ed67e9-f8d3-4927-b257-bd17654cce34)] {{(pid=91831) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 17:14:04.761445 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.rpc [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Returning: {'device': '76597caa-0aed-4769-95f7-9a9f6456a519', 'network_id': '17a0e39e-1e1f-4550-b28b-d5ae3bdca362', 'port_id': '76597caa-0aed-4769-95f7-9a9f6456a519', 'mac_address': 'fa:16:3e:8d:09:50', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 657, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'f5599a2e-9942-4423-a1ac-67e9b2650770', 'ip_address': '172.20.0.12'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=91831) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:168}} May 25 17:14:04.821403 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3832070'] for port, before_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:14:04.839549 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.notifiers.nova [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 76597caa-0aed-4769-95f7-9a9f6456a519 {{(pid=91831) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} May 25 17:14:04.856423 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.db [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] For port 76597caa-0aed-4769-95f7-9a9f6456a519, host hv-cinder-79049, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79049',level=0,port_id=76597caa-0aed-4769-95f7-9a9f6456a519,segment=NetworkSegment(50ed67e9-f8d3-4927-b257-bd17654cce34),segment_id=50ed67e9-f8d3-4927-b257-bd17654cce34)] {{(pid=91831) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 17:14:04.860839 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8757892955028', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8757892520933', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8757892521750'] for port, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:14:04.862640 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:14:04.928167 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Pushing event updated for resources: {'Port': ['ID=76597caa-0aed-4769-95f7-9a9f6456a519,revision_number=4']} {{(pid=91831) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:14:04.936565 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91831) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:14:04.936904 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91831) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:14:04.937249 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91831) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:14:04.937577 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91831) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:14:04.938012 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91831) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:14:04.938346 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91831) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:14:04.938668 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91831) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:14:04.938983 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91831) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:14:04.939303 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91831) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:14:04.939625 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91831) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:14:04.939933 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91831) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:14:04.940249 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91831) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:14:04.944248 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.082s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:14:05.009678 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b727befd-c1d8-4947-8fe8-cc0ade4f7514 req-ea1640e0-499a-4a11-9efc-3ec187514c83 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:14:05.011061 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-b727befd-c1d8-4947-8fe8-cc0ade4f7514 req-ea1640e0-499a-4a11-9efc-3ec187514c83 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] 10.222.0.62 "GET /v2.0/ports?device_id=c44e76f7-ac65-4901-b0dc-0566b81b2c3f HTTP/1.1" status: 200 len: 945 time: 0.0904226 May 25 17:14:05.056489 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-b727befd-c1d8-4947-8fe8-cc0ade4f7514 req-8ead11ff-eaa8-40f5-b518-b1512e210518 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] 10.222.0.62 "GET /v2.0/security-groups?id=58fab80b-49b2-4bca-89e6-fef7473221ef&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0392749 May 25 17:14:05.330507 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.db [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] get_ports_and_sgs() called for port_ids ['76597caa-0aed-4769-95f7-9a9f6456a519'] {{(pid=91831) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:164}} May 25 17:14:06.236400 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3cd66466-669f-4759-b60d-bd00c72786a9 req-5768ed66-2ad1-40e5-a7b0-1219e60aaed1 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:14:06.237745 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-3cd66466-669f-4759-b60d-bd00c72786a9 req-5768ed66-2ad1-40e5-a7b0-1219e60aaed1 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] 10.222.0.62 "GET /v2.0/ports?device_id=c44e76f7-ac65-4901-b0dc-0566b81b2c3f HTTP/1.1" status: 200 len: 945 time: 0.0773201 May 25 17:14:06.283252 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-3cd66466-669f-4759-b60d-bd00c72786a9 req-5508ea92-ee9d-45cd-bafe-d692be2be286 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] 10.222.0.62 "GET /v2.0/security-groups?id=58fab80b-49b2-4bca-89e6-fef7473221ef&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0385361 May 25 17:14:06.621441 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.rpc [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Device 76597caa-0aed-4769-95f7-9a9f6456a519 up at agent hyperv_hv-cinder-79049 {{(pid=91831) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:278}} May 25 17:14:06.676654 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:14:06.696500 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.provisioning_blocks [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Provisioning for port 76597caa-0aed-4769-95f7-9a9f6456a519 completed by entity L2. {{(pid=91831) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} May 25 17:14:06.701056 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.provisioning_blocks [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Provisioning complete for port 76597caa-0aed-4769-95f7-9a9f6456a519 triggered by entity L2. {{(pid=91831) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} May 25 17:14:06.701434 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-3854128'] for port, provisioning_complete {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:14:06.819311 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3832070'] for port, before_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:14:06.846050 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'c44e76f7-ac65-4901-b0dc-0566b81b2c3f', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '76597caa-0aed-4769-95f7-9a9f6456a519'}] {{(pid=91831) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 25 17:14:06.856951 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.db [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] For port 76597caa-0aed-4769-95f7-9a9f6456a519, host hv-cinder-79049, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79049',level=0,port_id=76597caa-0aed-4769-95f7-9a9f6456a519,segment=NetworkSegment(50ed67e9-f8d3-4927-b257-bd17654cce34),segment_id=50ed67e9-f8d3-4927-b257-bd17654cce34)] {{(pid=91831) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 17:14:06.861669 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8757892955028', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8757892520933', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8757892521750'] for port, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:14:06.863715 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:14:06.895264 dv-cinder-790492-4-iscsi neutron-server[91831]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'c44e76f7-ac65-4901-b0dc-0566b81b2c3f', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '76597caa-0aed-4769-95f7-9a9f6456a519', 'code': 200} May 25 17:14:06.934127 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Pushing event updated for resources: {'Port': ['ID=76597caa-0aed-4769-95f7-9a9f6456a519,revision_number=5']} {{(pid=91831) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:14:06.936960 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.073s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:14:07.182953 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d1d3bf4b-dad8-47dc-960a-5965cfda967b req-c666a9d8-a643-4438-a8fe-caf46c9d0cf6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91830) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:14:07.184290 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-d1d3bf4b-dad8-47dc-960a-5965cfda967b req-c666a9d8-a643-4438-a8fe-caf46c9d0cf6 service neutron] 10.222.0.32 "GET /v2.0/ports?device_id=c44e76f7-ac65-4901-b0dc-0566b81b2c3f HTTP/1.1" status: 200 len: 1099 time: 0.0698867 May 25 17:14:07.224376 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-d1d3bf4b-dad8-47dc-960a-5965cfda967b req-aa5acf97-9b1a-4f04-b65e-bd9a6580e926 service neutron] 10.222.0.32 "GET /v2.0/security-groups?id=58fab80b-49b2-4bca-89e6-fef7473221ef&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0334749 May 25 17:14:07.474759 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-49b37181-ad32-4979-9206-858ef044e03b req-051d7dbd-b18f-4c96-9769-9aecdd1ddd3c tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:14:07.476115 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-49b37181-ad32-4979-9206-858ef044e03b req-051d7dbd-b18f-4c96-9769-9aecdd1ddd3c tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] 10.222.0.62 "GET /v2.0/ports?device_id=c44e76f7-ac65-4901-b0dc-0566b81b2c3f HTTP/1.1" status: 200 len: 946 time: 0.0891268 May 25 17:14:07.519325 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-49b37181-ad32-4979-9206-858ef044e03b req-f279655d-255e-427b-a424-2b7fa9aebe2a tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] 10.222.0.62 "GET /v2.0/security-groups?id=58fab80b-49b2-4bca-89e6-fef7473221ef&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0376236 May 25 17:14:08.705388 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8d8c9640-f854-48b1-ab30-4b565278306b req-fa2c8b73-15d5-45f7-ba18-939460d8d562 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:14:08.706887 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-8d8c9640-f854-48b1-ab30-4b565278306b req-fa2c8b73-15d5-45f7-ba18-939460d8d562 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] 10.222.0.62 "GET /v2.0/ports?device_id=c44e76f7-ac65-4901-b0dc-0566b81b2c3f HTTP/1.1" status: 200 len: 946 time: 0.0808001 May 25 17:14:08.750965 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-8d8c9640-f854-48b1-ab30-4b565278306b req-851aa349-acc8-49a3-97f9-a9e9af47ca35 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] 10.222.0.62 "GET /v2.0/security-groups?id=58fab80b-49b2-4bca-89e6-fef7473221ef&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0384841 May 25 17:14:09.147749 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.db.agents_db [None req-504cb04f-4543-46c1-8db7-349e21db7634 None None] Agent healthcheck: found 6 active agents {{(pid=91832) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} May 25 17:14:09.940298 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3d29386b-a9f7-4607-8847-143a5e7f942c req-e9fb2762-e283-4aa5-b6bf-8e92d41b7a1c tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:14:09.941767 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-3d29386b-a9f7-4607-8847-143a5e7f942c req-e9fb2762-e283-4aa5-b6bf-8e92d41b7a1c tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] 10.222.0.62 "GET /v2.0/ports?device_id=c44e76f7-ac65-4901-b0dc-0566b81b2c3f HTTP/1.1" status: 200 len: 946 time: 0.0850930 May 25 17:14:09.989989 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-3d29386b-a9f7-4607-8847-143a5e7f942c req-c79f2ad3-5b6f-4909-966b-5043f644eb40 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] 10.222.0.62 "GET /v2.0/security-groups?id=58fab80b-49b2-4bca-89e6-fef7473221ef&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0422182 May 25 17:14:10.169479 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-152dd859-ce73-4b68-be99-715636831932 req-de426a83-0eaf-48d6-9d54-a0ece73275b4 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:14:10.170942 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-152dd859-ce73-4b68-be99-715636831932 req-de426a83-0eaf-48d6-9d54-a0ece73275b4 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] 10.222.0.62 "GET /v2.0/ports?device_id=c44e76f7-ac65-4901-b0dc-0566b81b2c3f HTTP/1.1" status: 200 len: 946 time: 0.0797510 May 25 17:14:10.218699 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-152dd859-ce73-4b68-be99-715636831932 req-beadf3f1-1aaa-4e0f-873b-e6511e1d0ce1 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] 10.222.0.62 "GET /v2.0/security-groups?id=58fab80b-49b2-4bca-89e6-fef7473221ef&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0422657 May 25 17:14:10.240927 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.wsgi [-] (91829) accepted ('10.222.0.62', 39606) {{(pid=91829) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:14:10.413162 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c104509e-8055-49ce-8eb9-a5d79ce3deff tempest-TestVolumeBootPattern-1585578645 tempest-TestVolumeBootPattern-1585578645-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:14:10.414668 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [None req-c104509e-8055-49ce-8eb9-a5d79ce3deff tempest-TestVolumeBootPattern-1585578645 tempest-TestVolumeBootPattern-1585578645-project-admin] 10.222.0.62 "GET /v2.0/ports?device_id=c44e76f7-ac65-4901-b0dc-0566b81b2c3f HTTP/1.1" status: 200 len: 1094 time: 0.1728196 May 25 17:14:10.417446 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.wsgi [-] (91829) accepted ('10.222.0.62', 39612) {{(pid=91829) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:14:10.422728 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.v2.base [None req-e348567c-1715-412d-a004-a291b1a6fe46 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Request body: {'floatingip': {'floating_network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'port_id': '76597caa-0aed-4769-95f7-9a9f6456a519', 'tenant_id': '5397bf60956945c3a2bf43c6b1aa614b', 'fixed_ip_address': '172.20.0.12'}} {{(pid=91829) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} May 25 17:14:10.428495 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.quota.driver [None req-e348567c-1715-412d-a004-a291b1a6fe46 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91829) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 17:14:10.432224 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.quota.resource [None req-e348567c-1715-412d-a004-a291b1a6fe46 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Usage tracker for resource:floatingip and tenant:5397bf60956945c3a2bf43c6b1aa614b is out of sync, need to count used quota {{(pid=91829) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 17:14:10.434999 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.quota.resource [None req-e348567c-1715-412d-a004-a291b1a6fe46 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Quota usage for floatingip was recalculated. Used quota:2. {{(pid=91829) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 17:14:10.441246 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.quota.driver [None req-e348567c-1715-412d-a004-a291b1a6fe46 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Attempting to reserve 1 items for resource floatingip. Total usage: 2; quota limit: 50; headroom:48 {{(pid=91829) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 17:14:10.453200 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-e348567c-1715-412d-a004-a291b1a6fe46 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Notify callbacks [] for floatingip, before_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:14:10.592514 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-e348567c-1715-412d-a004-a291b1a6fe46 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3832070'] for port, before_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:14:10.727289 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.db_base_plugin_common [None req-e348567c-1715-412d-a004-a291b1a6fe46 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Allocated IP 172.27.2.106 (4364b6ab-4117-4a92-baeb-f5ee2f45bf74/b947e790-d731-4b63-afc4-4aa112afe0f6/e0b43dfe-9059-4f37-9a64-880907616b7c) {{(pid=91829) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} May 25 17:14:10.871456 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-e348567c-1715-412d-a004-a291b1a6fe46 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Notify callbacks [] for port, precommit_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:14:10.900413 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-e348567c-1715-412d-a004-a291b1a6fe46 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8757892520915', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-28230808'] for port, after_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:14:10.904813 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-79f465bd-7fdb-453b-8bf3-81d325e33a50 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:14:10.964489 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e348567c-1715-412d-a004-a291b1a6fe46 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Network 4364b6ab-4117-4a92-baeb-f5ee2f45bf74 is already hosted by enough agents. {{(pid=91829) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} May 25 17:14:10.967008 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.scheduler.base_scheduler [None req-e348567c-1715-412d-a004-a291b1a6fe46 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Resources bound (agent type, host, resource id): {{(pid=91829) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} May 25 17:14:10.971097 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e348567c-1715-412d-a004-a291b1a6fe46 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Received port after_create {{(pid=91829) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:537}} May 25 17:14:11.008433 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e348567c-1715-412d-a004-a291b1a6fe46 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Pushing event updated for resources: {'Port': ['ID=e0b43dfe-9059-4f37-9a64-880907616b7c,revision_number=1']} {{(pid=91829) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:14:11.012790 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-e348567c-1715-412d-a004-a291b1a6fe46 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.108s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:14:11.482036 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-e348567c-1715-412d-a004-a291b1a6fe46 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Notify callbacks [] for floatingip, precommit_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:14:11.553835 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-e348567c-1715-412d-a004-a291b1a6fe46 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler_port-3832070'] for port, before_update {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:14:11.757315 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-e348567c-1715-412d-a004-a291b1a6fe46 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Notify callbacks [] for port, precommit_update {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:14:11.761703 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-e348567c-1715-412d-a004-a291b1a6fe46 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8757892955028', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8757892520933', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8757892521750', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-28230801'] for port, after_update {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:14:11.766709 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-79f465bd-7fdb-453b-8bf3-81d325e33a50 service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:14:11.869588 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e348567c-1715-412d-a004-a291b1a6fe46 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Pushing event updated for resources: {'Port': ['ID=e0b43dfe-9059-4f37-9a64-880907616b7c,revision_number=2']} {{(pid=91829) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:14:11.872327 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-e348567c-1715-412d-a004-a291b1a6fe46 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.106s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:14:11.879263 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-e348567c-1715-412d-a004-a291b1a6fe46 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-683033'] for floatingip, after_update {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:14:12.052588 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.db.l3_db [None req-e348567c-1715-412d-a004-a291b1a6fe46 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Floating IP 1832f981-0c86-4d30-be86-cbe5cf0a87b6 associated. External IP: 172.27.2.106, port: 76597caa-0aed-4769-95f7-9a9f6456a519. May 25 17:14:12.395990 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-e348567c-1715-412d-a004-a291b1a6fe46 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Router 269c6b7b-91cc-4880-9e6d-b8889bac29f6 has already been hosted by L3 agent a2d427c1-2d07-43e8-afbe-218c9f7d0445 {{(pid=91829) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 25 17:14:12.589201 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-e348567c-1715-412d-a004-a291b1a6fe46 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Notify agent at l3_agent.dv-cinder-790492-4-iscsi the message routers_updated {{(pid=91829) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 25 17:14:12.598598 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6b4384b0-4cb2-4496-b63c-2a7c58c67286 None None] Sync routers for ids ['269c6b7b-91cc-4880-9e6d-b8889bac29f6'] in dv-cinder-790492-4-iscsi {{(pid=91831) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 25 17:14:12.608057 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6b4384b0-4cb2-4496-b63c-2a7c58c67286 None None] Routers {'269c6b7b-91cc-4880-9e6d-b8889bac29f6'} bound to L3 agent in host dv-cinder-790492-4-iscsi {{(pid=91831) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 17:14:12.608741 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.l3_hamode_db [None req-6b4384b0-4cb2-4496-b63c-2a7c58c67286 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-790492-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-05-25T16:50:28Z,description=,heartbeat_timestamp=2021-05-25T17:13:58Z,host='dv-cinder-790492-4-iscsi',id=a2d427c1-2d07-43e8-afbe-218c9f7d0445,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T16:50:28Z,topic='l3_agent')) {'router_ids': ['269c6b7b-91cc-4880-9e6d-b8889bac29f6'], 'active': True} {{(pid=91831) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 17:14:12.613120 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-e348567c-1715-412d-a004-a291b1a6fe46 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-178712'] for floatingip, before_response {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:14:12.667856 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [None req-e348567c-1715-412d-a004-a291b1a6fe46 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] 10.222.0.62 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 997 time: 2.2492912 May 25 17:14:12.668493 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'c44e76f7-ac65-4901-b0dc-0566b81b2c3f', 'tag': '76597caa-0aed-4769-95f7-9a9f6456a519'}] {{(pid=91829) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 25 17:14:12.714177 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'c44e76f7-ac65-4901-b0dc-0566b81b2c3f', 'tag': '76597caa-0aed-4769-95f7-9a9f6456a519', 'status': 'completed', 'code': 200} May 25 17:14:12.791919 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.l3_dvr_db [None req-6b4384b0-4cb2-4496-b63c-2a7c58c67286 None None] Set router 269c6b7b-91cc-4880-9e6d-b8889bac29f6 gateway port host: dv-cinder-790492-4-iscsi {{(pid=91831) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 17:14:12.825983 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-882ebf2a-b657-4996-96a8-f3c7977f85b7 req-a48c3ed9-b612-4d20-921b-9e62af993755 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91830) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:14:12.827442 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-882ebf2a-b657-4996-96a8-f3c7977f85b7 req-a48c3ed9-b612-4d20-921b-9e62af993755 service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=5397bf60956945c3a2bf43c6b1aa614b&device_id=c44e76f7-ac65-4901-b0dc-0566b81b2c3f HTTP/1.1" status: 200 len: 1099 time: 0.0790629 May 25 17:14:12.962071 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-882ebf2a-b657-4996-96a8-f3c7977f85b7 req-6c947cc5-5f2a-4b77-9e8d-a3b1918738f3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91830) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:14:12.963504 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-882ebf2a-b657-4996-96a8-f3c7977f85b7 req-6c947cc5-5f2a-4b77-9e8d-a3b1918738f3 service neutron] 10.222.0.32 "GET /v2.0/networks?id=17a0e39e-1e1f-4550-b28b-d5ae3bdca362 HTTP/1.1" status: 200 len: 912 time: 0.1284704 May 25 17:14:13.064812 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-882ebf2a-b657-4996-96a8-f3c7977f85b7 req-ebe0df62-ddfb-40a9-9311-b3b7463a74eb service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=76597caa-0aed-4769-95f7-9a9f6456a519 HTTP/1.1" status: 200 len: 1000 time: 0.0941565 May 25 17:14:13.133045 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-882ebf2a-b657-4996-96a8-f3c7977f85b7 req-2abcf054-1ed1-4701-807a-80ace55f8c9d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91830) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:14:13.134511 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-882ebf2a-b657-4996-96a8-f3c7977f85b7 req-2abcf054-1ed1-4701-807a-80ace55f8c9d service neutron] 10.222.0.32 "GET /v2.0/subnets?id=f5599a2e-9942-4423-a1ac-67e9b2650770 HTTP/1.1" status: 200 len: 850 time: 0.0620852 May 25 17:14:13.173487 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.l3_hamode_db [None req-6b4384b0-4cb2-4496-b63c-2a7c58c67286 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '269c6b7b-91cc-4880-9e6d-b8889bac29f6', 'name': 'tempest-TestVolumeBootPattern-219116984-router', 'tenant_id': '5397bf60956945c3a2bf43c6b1aa614b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'external_fixed_ips': [{'subnet_id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'ip_address': '172.27.2.227'}], 'enable_snat': True}, 'gw_port_id': '2fef7852-acf7-462f-beee-5679d3df0ad2', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T17:07:09Z', 'updated_at': '2021-05-25T17:07:13Z', 'revision_number': 4, 'project_id': '5397bf60956945c3a2bf43c6b1aa614b', 'gw_port': {'id': '2fef7852-acf7-462f-beee-5679d3df0ad2', 'name': '', 'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'tenant_id': '', 'mac_address': 'fa:16:3e:35:b9:d0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '269c6b7b-91cc-4880-9e6d-b8889bac29f6', 'device_owner': 'network:router_gateway', 'standard_attr_id': 533, 'fixed_ips': [{'subnet_id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'ip_address': '172.27.2.227', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790492-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:07:09Z', 'updated_at': '2021-05-25T17:07:16Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-790492-4-iscsi', '_floatingips': [{'id': '1832f981-0c86-4d30-be86-cbe5cf0a87b6', 'tenant_id': '5397bf60956945c3a2bf43c6b1aa614b', 'floating_ip_address': '172.27.2.106', 'floating_network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'router_id': '269c6b7b-91cc-4880-9e6d-b8889bac29f6', 'port_id': '76597caa-0aed-4769-95f7-9a9f6456a519', 'fixed_ip_address': '172.20.0.12', 'status': 'DOWN', 'standard_attr_id': 682, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '17a0e39e-1e1f-4550-b28b-d5ae3bdca362', 'mac_address': 'fa:16:3e:8d:09:50', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c44e76f7-ac65-4901-b0dc-0566b81b2c3f', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-25T17:14:11Z', 'updated_at': '2021-05-25T17:14:11Z', 'revision_number': 0, 'project_id': '5397bf60956945c3a2bf43c6b1aa614b', 'fixed_ip_address_scope': None}, {'id': '29e0fa6c-2b2a-4eff-85c0-77fa15ffbdec', 'tenant_id': '5397bf60956945c3a2bf43c6b1aa614b', 'floating_ip_address': '172.27.2.75', 'floating_network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'router_id': '269c6b7b-91cc-4880-9e6d-b8889bac29f6', 'port_id': 'c68cea2d-169c-4346-87ef-27549285cb6b', 'fixed_ip_address': '172.20.0.10', 'status': 'ACTIVE', 'standard_attr_id': 577, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '17a0e39e-1e1f-4550-b28b-d5ae3bdca362', 'mac_address': 'fa:16:3e:7a:1d:60', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6e10cbf6-87b6-452f-80e6-c8bd2ce073db', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-25T17:11:17Z', 'updated_at': '2021-05-25T17:11:20Z', 'revision_number': 1, 'project_id': '5397bf60956945c3a2bf43c6b1aa614b', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '4972e3a9-91eb-48ce-8b7b-b0906822cebf', 'name': '', 'network_id': '17a0e39e-1e1f-4550-b28b-d5ae3bdca362', 'tenant_id': '5397bf60956945c3a2bf43c6b1aa614b', 'mac_address': 'fa:16:3e:ce:fe:1a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '269c6b7b-91cc-4880-9e6d-b8889bac29f6', 'device_owner': 'network:router_interface', 'standard_attr_id': 534, 'fixed_ips': [{'subnet_id': 'f5599a2e-9942-4423-a1ac-67e9b2650770', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790492-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:07:12Z', 'updated_at': '2021-05-25T17:07:20Z', 'revision_number': 5, 'project_id': '5397bf60956945c3a2bf43c6b1aa614b', 'subnets': [{'id': 'f5599a2e-9942-4423-a1ac-67e9b2650770', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-790492-4-iscsi', False) {} {{(pid=91831) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 17:14:13.177398 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6b4384b0-4cb2-4496-b63c-2a7c58c67286 None None] Checking router: 269c6b7b-91cc-4880-9e6d-b8889bac29f6 for host: dv-cinder-790492-4-iscsi {{(pid=91831) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 25 17:14:13.186191 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6b4384b0-4cb2-4496-b63c-2a7c58c67286 None None] Routers {'269c6b7b-91cc-4880-9e6d-b8889bac29f6'} bound to L3 agent in host dv-cinder-790492-4-iscsi {{(pid=91831) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 17:14:13.186812 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.l3_hamode_db [None req-6b4384b0-4cb2-4496-b63c-2a7c58c67286 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-790492-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-05-25T16:50:28Z,description=,heartbeat_timestamp=2021-05-25T17:13:58Z,host='dv-cinder-790492-4-iscsi',id=a2d427c1-2d07-43e8-afbe-218c9f7d0445,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T16:50:28Z,topic='l3_agent')) {'router_ids': ['269c6b7b-91cc-4880-9e6d-b8889bac29f6'], 'active': True} {{(pid=91831) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 17:14:13.210369 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-882ebf2a-b657-4996-96a8-f3c7977f85b7 req-c40b2140-3f23-432f-8645-35a632396498 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91830) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:14:13.211820 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-882ebf2a-b657-4996-96a8-f3c7977f85b7 req-c40b2140-3f23-432f-8645-35a632396498 service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=17a0e39e-1e1f-4550-b28b-d5ae3bdca362&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0708728 May 25 17:14:13.369446 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.l3_dvr_db [None req-6b4384b0-4cb2-4496-b63c-2a7c58c67286 None None] Set router 269c6b7b-91cc-4880-9e6d-b8889bac29f6 gateway port host: dv-cinder-790492-4-iscsi {{(pid=91831) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 17:14:13.431178 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-882ebf2a-b657-4996-96a8-f3c7977f85b7 req-8367add3-1ad8-40eb-a408-e5945bc1d620 service neutron] 10.222.0.32 "GET /v2.0/networks/17a0e39e-1e1f-4550-b28b-d5ae3bdca362?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2116063 May 25 17:14:13.566388 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-882ebf2a-b657-4996-96a8-f3c7977f85b7 req-86195d2e-3e52-425e-9e55-e7ad39dbecc4 service neutron] 10.222.0.32 "GET /v2.0/networks/17a0e39e-1e1f-4550-b28b-d5ae3bdca362?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1233451 May 25 17:14:13.715111 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.l3_hamode_db [None req-6b4384b0-4cb2-4496-b63c-2a7c58c67286 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '269c6b7b-91cc-4880-9e6d-b8889bac29f6', 'name': 'tempest-TestVolumeBootPattern-219116984-router', 'tenant_id': '5397bf60956945c3a2bf43c6b1aa614b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'external_fixed_ips': [{'subnet_id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'ip_address': '172.27.2.227'}], 'enable_snat': True}, 'gw_port_id': '2fef7852-acf7-462f-beee-5679d3df0ad2', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T17:07:09Z', 'updated_at': '2021-05-25T17:07:13Z', 'revision_number': 4, 'project_id': '5397bf60956945c3a2bf43c6b1aa614b', 'gw_port': {'id': '2fef7852-acf7-462f-beee-5679d3df0ad2', 'name': '', 'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'tenant_id': '', 'mac_address': 'fa:16:3e:35:b9:d0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '269c6b7b-91cc-4880-9e6d-b8889bac29f6', 'device_owner': 'network:router_gateway', 'standard_attr_id': 533, 'fixed_ips': [{'subnet_id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'ip_address': '172.27.2.227', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790492-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:07:09Z', 'updated_at': '2021-05-25T17:07:16Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-790492-4-iscsi', '_floatingips': [{'id': '1832f981-0c86-4d30-be86-cbe5cf0a87b6', 'tenant_id': '5397bf60956945c3a2bf43c6b1aa614b', 'floating_ip_address': '172.27.2.106', 'floating_network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'router_id': '269c6b7b-91cc-4880-9e6d-b8889bac29f6', 'port_id': '76597caa-0aed-4769-95f7-9a9f6456a519', 'fixed_ip_address': '172.20.0.12', 'status': 'DOWN', 'standard_attr_id': 682, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '17a0e39e-1e1f-4550-b28b-d5ae3bdca362', 'mac_address': 'fa:16:3e:8d:09:50', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c44e76f7-ac65-4901-b0dc-0566b81b2c3f', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-25T17:14:11Z', 'updated_at': '2021-05-25T17:14:11Z', 'revision_number': 0, 'project_id': '5397bf60956945c3a2bf43c6b1aa614b', 'fixed_ip_address_scope': None}, {'id': '29e0fa6c-2b2a-4eff-85c0-77fa15ffbdec', 'tenant_id': '5397bf60956945c3a2bf43c6b1aa614b', 'floating_ip_address': '172.27.2.75', 'floating_network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'router_id': '269c6b7b-91cc-4880-9e6d-b8889bac29f6', 'port_id': 'c68cea2d-169c-4346-87ef-27549285cb6b', 'fixed_ip_address': '172.20.0.10', 'status': 'ACTIVE', 'standard_attr_id': 577, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '17a0e39e-1e1f-4550-b28b-d5ae3bdca362', 'mac_address': 'fa:16:3e:7a:1d:60', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6e10cbf6-87b6-452f-80e6-c8bd2ce073db', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-25T17:11:17Z', 'updated_at': '2021-05-25T17:11:20Z', 'revision_number': 1, 'project_id': '5397bf60956945c3a2bf43c6b1aa614b', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '4972e3a9-91eb-48ce-8b7b-b0906822cebf', 'name': '', 'network_id': '17a0e39e-1e1f-4550-b28b-d5ae3bdca362', 'tenant_id': '5397bf60956945c3a2bf43c6b1aa614b', 'mac_address': 'fa:16:3e:ce:fe:1a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '269c6b7b-91cc-4880-9e6d-b8889bac29f6', 'device_owner': 'network:router_interface', 'standard_attr_id': 534, 'fixed_ips': [{'subnet_id': 'f5599a2e-9942-4423-a1ac-67e9b2650770', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790492-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:07:12Z', 'updated_at': '2021-05-25T17:07:20Z', 'revision_number': 5, 'project_id': '5397bf60956945c3a2bf43c6b1aa614b', 'subnets': [{'id': 'f5599a2e-9942-4423-a1ac-67e9b2650770', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-790492-4-iscsi', False) {} {{(pid=91831) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 17:14:13.719426 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6b4384b0-4cb2-4496-b63c-2a7c58c67286 None None] The sync data for ids ['269c6b7b-91cc-4880-9e6d-b8889bac29f6'] in dv-cinder-790492-4-iscsi is: [{'id': '269c6b7b-91cc-4880-9e6d-b8889bac29f6', 'name': 'tempest-TestVolumeBootPattern-219116984-router', 'tenant_id': '5397bf60956945c3a2bf43c6b1aa614b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'external_fixed_ips': [{'subnet_id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'ip_address': '172.27.2.227'}], 'enable_snat': True}, 'gw_port_id': '2fef7852-acf7-462f-beee-5679d3df0ad2', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T17:07:09Z', 'updated_at': '2021-05-25T17:07:13Z', 'revision_number': 4, 'project_id': '5397bf60956945c3a2bf43c6b1aa614b', 'gw_port': {'id': '2fef7852-acf7-462f-beee-5679d3df0ad2', 'name': '', 'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'tenant_id': '', 'mac_address': 'fa:16:3e:35:b9:d0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '269c6b7b-91cc-4880-9e6d-b8889bac29f6', 'device_owner': 'network:router_gateway', 'standard_attr_id': 533, 'fixed_ips': [{'subnet_id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'ip_address': '172.27.2.227', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790492-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:07:09Z', 'updated_at': '2021-05-25T17:07:16Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-790492-4-iscsi', '_floatingips': [{'id': '1832f981-0c86-4d30-be86-cbe5cf0a87b6', 'tenant_id': '5397bf60956945c3a2bf43c6b1aa614b', 'floating_ip_address': '172.27.2.106', 'floating_network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'router_id': '269c6b7b-91cc-4880-9e6d-b8889bac29f6', 'port_id': '76597caa-0aed-4769-95f7-9a9f6456a519', 'fixed_ip_address': '172.20.0.12', 'status': 'DOWN', 'standard_attr_id': 682, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '17a0e39e-1e1f-4550-b28b-d5ae3bdca362', 'mac_address': 'fa:16:3e:8d:09:50', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'c44e76f7-ac65-4901-b0dc-0566b81b2c3f', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-25T17:14:11Z', 'updated_at': '2021-05-25T17:14:11Z', 'revision_number': 0, 'project_id': '5397bf60956945c3a2bf43c6b1aa614b', 'fixed_ip_address_scope': None}, {'id': '29e0fa6c-2b2a-4eff-85c0-77fa15ffbdec', 'tenant_id': '5397bf60956945c3a2bf43c6b1aa614b', 'floating_ip_address': '172.27.2.75', 'floating_network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'router_id': '269c6b7b-91cc-4880-9e6d-b8889bac29f6', 'port_id': 'c68cea2d-169c-4346-87ef-27549285cb6b', 'fixed_ip_address': '172.20.0.10', 'status': 'ACTIVE', 'standard_attr_id': 577, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '17a0e39e-1e1f-4550-b28b-d5ae3bdca362', 'mac_address': 'fa:16:3e:7a:1d:60', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6e10cbf6-87b6-452f-80e6-c8bd2ce073db', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-25T17:11:17Z', 'updated_at': '2021-05-25T17:11:20Z', 'revision_number': 1, 'project_id': '5397bf60956945c3a2bf43c6b1aa614b', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '4972e3a9-91eb-48ce-8b7b-b0906822cebf', 'name': '', 'network_id': '17a0e39e-1e1f-4550-b28b-d5ae3bdca362', 'tenant_id': '5397bf60956945c3a2bf43c6b1aa614b', 'mac_address': 'fa:16:3e:ce:fe:1a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '269c6b7b-91cc-4880-9e6d-b8889bac29f6', 'device_owner': 'network:router_interface', 'standard_attr_id': 534, 'fixed_ips': [{'subnet_id': 'f5599a2e-9942-4423-a1ac-67e9b2650770', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790492-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:07:12Z', 'updated_at': '2021-05-25T17:07:20Z', 'revision_number': 5, 'project_id': '5397bf60956945c3a2bf43c6b1aa614b', 'subnets': [{'id': 'f5599a2e-9942-4423-a1ac-67e9b2650770', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=91831) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 25 17:14:13.904799 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-cd292639-9371-4460-a683-cdbe793820f6 None None] New status for floating IP 1832f981-0c86-4d30-be86-cbe5cf0a87b6: ACTIVE {{(pid=91832) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} May 25 17:14:25.337984 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-ec25e247-aea6-4cb5-b026-394cca3d6aa2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:14:25.689113 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.wsgi [-] (91829) accepted ('10.222.0.62', 39680) {{(pid=91829) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:14:25.804876 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-6fae13f2-7fe7-43c2-b7e6-7d2ce1ed9a7a admin admin] Notify callbacks [] for security_group, before_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:14:25.819687 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.quota.driver [None req-6fae13f2-7fe7-43c2-b7e6-7d2ce1ed9a7a admin admin] Resources subnetpool have unlimited quota limit. It is not required to calculate headroom {{(pid=91829) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:219}} May 25 17:14:25.823726 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.quota.resource [None req-6fae13f2-7fe7-43c2-b7e6-7d2ce1ed9a7a admin admin] Usage tracker for resource:security_group_rule and tenant:467dd6ba8dc6496e9f1a4ee4d3650260 is out of sync, need to count used quota {{(pid=91829) count_used /opt/stack/neutron/neutron/quota/resource.py:270}} May 25 17:14:25.826503 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.quota.resource [None req-6fae13f2-7fe7-43c2-b7e6-7d2ce1ed9a7a admin admin] Quota usage for security_group_rule was recalculated. Used quota:0. {{(pid=91829) count_used /opt/stack/neutron/neutron/quota/resource.py:290}} May 25 17:14:25.832142 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.db.quota.driver [None req-6fae13f2-7fe7-43c2-b7e6-7d2ce1ed9a7a admin admin] Attempting to reserve 4 items for resource security_group_rule. Total usage: 0; quota limit: 100; headroom:100 {{(pid=91829) make_reservation /opt/stack/neutron/neutron/db/quota/driver.py:246}} May 25 17:14:25.915102 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-6fae13f2-7fe7-43c2-b7e6-7d2ce1ed9a7a admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:14:25.918713 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron_lib.callbacks.manager [None req-6fae13f2-7fe7-43c2-b7e6-7d2ce1ed9a7a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-640836'] for security_group, after_create {{(pid=91829) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:14:25.927418 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-f397341b-81ff-4e79-936b-c1e684950598 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:14:25.966580 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [None req-6fae13f2-7fe7-43c2-b7e6-7d2ce1ed9a7a admin admin] 10.222.0.62 "GET /v2.0/security-groups?tenant_id=467dd6ba8dc6496e9f1a4ee4d3650260&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2764401 May 25 17:14:25.967554 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6fae13f2-7fe7-43c2-b7e6-7d2ce1ed9a7a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=4597493a-0039-4dd7-b330-307b9a51a001,revision_number=1']} {{(pid=91829) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:14:25.969306 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.wsgi [-] (91830) accepted ('10.222.0.62', 39686) {{(pid=91830) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:14:25.975578 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6fae13f2-7fe7-43c2-b7e6-7d2ce1ed9a7a admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91829) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:14:25.975959 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6fae13f2-7fe7-43c2-b7e6-7d2ce1ed9a7a admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91829) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:14:25.976330 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6fae13f2-7fe7-43c2-b7e6-7d2ce1ed9a7a admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91829) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:14:25.976692 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6fae13f2-7fe7-43c2-b7e6-7d2ce1ed9a7a admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91829) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:14:25.977057 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6fae13f2-7fe7-43c2-b7e6-7d2ce1ed9a7a admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91829) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:14:25.977422 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6fae13f2-7fe7-43c2-b7e6-7d2ce1ed9a7a admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91829) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:14:25.977779 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6fae13f2-7fe7-43c2-b7e6-7d2ce1ed9a7a admin admin] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91829) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:14:25.978160 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6fae13f2-7fe7-43c2-b7e6-7d2ce1ed9a7a admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91829) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:14:25.978517 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6fae13f2-7fe7-43c2-b7e6-7d2ce1ed9a7a admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91829) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:14:25.978869 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6fae13f2-7fe7-43c2-b7e6-7d2ce1ed9a7a admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91829) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:14:25.979219 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6fae13f2-7fe7-43c2-b7e6-7d2ce1ed9a7a admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91829) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:14:25.979566 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6fae13f2-7fe7-43c2-b7e6-7d2ce1ed9a7a admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91829) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:14:25.983515 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG oslo_concurrency.lockutils [None req-6fae13f2-7fe7-43c2-b7e6-7d2ce1ed9a7a admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.056s {{(pid=91829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:14:26.035595 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-9a13eeff-2bc4-4582-82da-356cbe12e3b0 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:14:26.060979 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-9a13eeff-2bc4-4582-82da-356cbe12e3b0 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:14:26.111455 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-9a13eeff-2bc4-4582-82da-356cbe12e3b0 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-640836'] for security_group, after_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:14:26.116243 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-55bef877-72b7-41dd-ae68-f526f610c8ab admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:14:26.128877 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9a13eeff-2bc4-4582-82da-356cbe12e3b0 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=4597493a-0039-4dd7-b330-307b9a51a001,revision_number=None']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:14:26.133515 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-9a13eeff-2bc4-4582-82da-356cbe12e3b0 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.017s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:14:26.134440 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-9a13eeff-2bc4-4582-82da-356cbe12e3b0 admin admin] Notify callbacks [] for security_group, before_response {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:14:26.138231 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [None req-9a13eeff-2bc4-4582-82da-356cbe12e3b0 admin admin] 10.222.0.62 "DELETE /v2.0/security-groups/4597493a-0039-4dd7-b330-307b9a51a001 HTTP/1.1" status: 204 len: 168 time: 0.1673419 May 25 17:14:27.734289 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-74efeb6a-3bec-47c0-983e-4a07caf6e175 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:14:27.915854 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:14:28.660578 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-0a55eb4a-8b57-4233-84d6-6b423b4ed6db None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:14:30.276464 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-57f11b47-1f51-4191-b7c9-af248a48372c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:14:36.637856 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:14:39.879423 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-92b7ee0f-bfe5-4459-b913-b52ba7833049 req-032acbd0-f775-433d-81a0-ab9ff7e7a72e service neutron] 10.222.0.32 "GET /v2.0/ports?device_id=6e10cbf6-87b6-452f-80e6-c8bd2ce073db&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.1667140 May 25 17:14:40.023610 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-92b7ee0f-bfe5-4459-b913-b52ba7833049 req-738aa523-d65e-44df-af41-d4a67c90b081 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91830) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:14:40.024454 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-92b7ee0f-bfe5-4459-b913-b52ba7833049 req-738aa523-d65e-44df-af41-d4a67c90b081 service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=5397bf60956945c3a2bf43c6b1aa614b&device_id=6e10cbf6-87b6-452f-80e6-c8bd2ce073db HTTP/1.1" status: 200 len: 1099 time: 0.0730937 May 25 17:14:40.172626 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-92b7ee0f-bfe5-4459-b913-b52ba7833049 req-58355409-2218-457d-96e0-4653d1aeb6d1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91830) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:14:40.174102 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-92b7ee0f-bfe5-4459-b913-b52ba7833049 req-58355409-2218-457d-96e0-4653d1aeb6d1 service neutron] 10.222.0.32 "GET /v2.0/networks?id=17a0e39e-1e1f-4550-b28b-d5ae3bdca362 HTTP/1.1" status: 200 len: 912 time: 0.1269052 May 25 17:14:40.277668 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-92b7ee0f-bfe5-4459-b913-b52ba7833049 req-29543642-c13c-4125-817f-4c4044a3bd8c service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=c68cea2d-169c-4346-87ef-27549285cb6b HTTP/1.1" status: 200 len: 1001 time: 0.0960102 May 25 17:14:40.342761 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-92b7ee0f-bfe5-4459-b913-b52ba7833049 req-ac99bbd4-1994-4670-abfa-1f10c4d47529 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91830) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:14:40.344102 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-92b7ee0f-bfe5-4459-b913-b52ba7833049 req-ac99bbd4-1994-4670-abfa-1f10c4d47529 service neutron] 10.222.0.32 "GET /v2.0/subnets?id=f5599a2e-9942-4423-a1ac-67e9b2650770 HTTP/1.1" status: 200 len: 850 time: 0.0560732 May 25 17:14:40.421560 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-92b7ee0f-bfe5-4459-b913-b52ba7833049 req-ab189b3c-a0c7-422a-a53b-5e2eee6498d1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91830) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:14:40.423050 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-92b7ee0f-bfe5-4459-b913-b52ba7833049 req-ab189b3c-a0c7-422a-a53b-5e2eee6498d1 service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=17a0e39e-1e1f-4550-b28b-d5ae3bdca362&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0722206 May 25 17:14:40.554165 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-92b7ee0f-bfe5-4459-b913-b52ba7833049 req-bb23eaa7-0801-4155-ac31-f309921af3f6 service neutron] 10.222.0.32 "GET /v2.0/networks/17a0e39e-1e1f-4550-b28b-d5ae3bdca362?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1236656 May 25 17:14:40.683710 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-92b7ee0f-bfe5-4459-b913-b52ba7833049 req-e458d18a-4159-40e3-9508-74dc3929beae service neutron] 10.222.0.32 "GET /v2.0/networks/17a0e39e-1e1f-4550-b28b-d5ae3bdca362?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1226535 May 25 17:14:46.146964 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.db.agents_db [None req-504cb04f-4543-46c1-8db7-349e21db7634 None None] Agent healthcheck: found 6 active agents {{(pid=91832) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} May 25 17:14:55.339322 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-0a195ea6-83cf-4c5d-b048-6f819e8d650d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:14:57.736277 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-5793cefb-5c5c-4a93-b12d-3e52dd018c85 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:14:57.923077 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:14:58.664199 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-0a55eb4a-8b57-4233-84d6-6b423b4ed6db None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:15:00.279014 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-57f11b47-1f51-4191-b7c9-af248a48372c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:15:06.642208 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:15:23.146138 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.db.agents_db [None req-504cb04f-4543-46c1-8db7-349e21db7634 None None] Agent healthcheck: found 6 active agents {{(pid=91832) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} May 25 17:15:25.340470 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-c808e3c5-b7ff-4856-8381-741cb37bf3fc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:15:27.738209 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-927b040c-67e4-4701-8dba-367176d2c694 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:15:27.916030 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:15:28.666653 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-0a55eb4a-8b57-4233-84d6-6b423b4ed6db None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:15:30.281379 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-57f11b47-1f51-4191-b7c9-af248a48372c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:15:36.646912 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:15:41.814646 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-c6354583-7d38-48c3-861d-93f6739fb369 req-1a5d4cdf-5ac7-4402-a091-cfd1033e4df3 service neutron] 10.222.0.32 "GET /v2.0/ports?device_id=c44e76f7-ac65-4901-b0dc-0566b81b2c3f&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0693307 May 25 17:15:41.905247 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c6354583-7d38-48c3-861d-93f6739fb369 req-e74b6815-56be-4ad3-9b03-c1a74f4eddc3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91830) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:15:41.906727 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-c6354583-7d38-48c3-861d-93f6739fb369 req-e74b6815-56be-4ad3-9b03-c1a74f4eddc3 service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=5397bf60956945c3a2bf43c6b1aa614b&device_id=c44e76f7-ac65-4901-b0dc-0566b81b2c3f HTTP/1.1" status: 200 len: 1099 time: 0.0696416 May 25 17:15:42.051444 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c6354583-7d38-48c3-861d-93f6739fb369 req-137610fe-d19d-418c-a196-43bca6611234 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91830) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:15:42.052854 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-c6354583-7d38-48c3-861d-93f6739fb369 req-137610fe-d19d-418c-a196-43bca6611234 service neutron] 10.222.0.32 "GET /v2.0/networks?id=17a0e39e-1e1f-4550-b28b-d5ae3bdca362 HTTP/1.1" status: 200 len: 912 time: 0.1261640 May 25 17:15:42.156034 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-c6354583-7d38-48c3-861d-93f6739fb369 req-dc547b9d-e750-4658-baac-ae723f10e0bb service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=76597caa-0aed-4769-95f7-9a9f6456a519 HTTP/1.1" status: 200 len: 1002 time: 0.0954633 May 25 17:15:42.304134 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c6354583-7d38-48c3-861d-93f6739fb369 req-550498e5-8762-4ce0-82f0-2d65a0bff935 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91830) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:15:42.305531 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-c6354583-7d38-48c3-861d-93f6739fb369 req-550498e5-8762-4ce0-82f0-2d65a0bff935 service neutron] 10.222.0.32 "GET /v2.0/subnets?id=f5599a2e-9942-4423-a1ac-67e9b2650770 HTTP/1.1" status: 200 len: 850 time: 0.1416452 May 25 17:15:42.380029 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c6354583-7d38-48c3-861d-93f6739fb369 req-da58b075-5075-4bf3-b9ba-fd6ee75d0ce9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91830) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:15:42.381464 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-c6354583-7d38-48c3-861d-93f6739fb369 req-da58b075-5075-4bf3-b9ba-fd6ee75d0ce9 service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=17a0e39e-1e1f-4550-b28b-d5ae3bdca362&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0683951 May 25 17:15:42.513625 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-c6354583-7d38-48c3-861d-93f6739fb369 req-5bc20f55-8627-44a7-a19e-528cb1876ddf service neutron] 10.222.0.32 "GET /v2.0/networks/17a0e39e-1e1f-4550-b28b-d5ae3bdca362?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1238871 May 25 17:15:42.646454 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-c6354583-7d38-48c3-861d-93f6739fb369 req-cbc211ac-8a12-4e4d-b82f-87541c911926 service neutron] 10.222.0.32 "GET /v2.0/networks/17a0e39e-1e1f-4550-b28b-d5ae3bdca362?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1256149 May 25 17:15:55.341675 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-793003b5-678a-4c8b-a0ce-89b926502f51 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:15:57.739921 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-ddc32a24-0ac9-4ea1-9b9e-6248e286ea10 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:15:57.924470 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:15:58.667521 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-0a55eb4a-8b57-4233-84d6-6b423b4ed6db None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:16:00.145700 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.db.agents_db [None req-504cb04f-4543-46c1-8db7-349e21db7634 None None] Agent healthcheck: found 6 active agents {{(pid=91832) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} May 25 17:16:00.285533 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-57f11b47-1f51-4191-b7c9-af248a48372c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:16:06.672068 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:16:19.857200 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.wsgi [-] (91830) accepted ('10.222.0.62', 39720) {{(pid=91830) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:16:20.121357 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.plugins.ml2.plugin [None req-659cd907-baf7-428e-8b90-86f564641f32 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Deleting port e0b43dfe-9059-4f37-9a64-880907616b7c {{(pid=91830) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 25 17:16:20.121608 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-659cd907-baf7-428e-8b90-86f564641f32 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8757892952899'] for port, before_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:16:20.241846 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-659cd907-baf7-428e-8b90-86f564641f32 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-683770'] for port, precommit_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:16:20.242198 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-659cd907-baf7-428e-8b90-86f564641f32 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:16:20.363647 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.plugins.ml2.plugin [None req-659cd907-baf7-428e-8b90-86f564641f32 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Calling delete_port for e0b43dfe-9059-4f37-9a64-880907616b7c owned by network:floatingip {{(pid=91830) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 25 17:16:20.488814 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-659cd907-baf7-428e-8b90-86f564641f32 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8757892955046', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8757892520924', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-27483019'] for port, after_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:16:20.493511 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-29ae2bd1-e009-4964-856e-4f466056fe97 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:16:20.535808 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-659cd907-baf7-428e-8b90-86f564641f32 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Pushing event deleted for resources: {'Port': ['ID=e0b43dfe-9059-4f37-9a64-880907616b7c,revision_number=None']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:16:20.581002 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-659cd907-baf7-428e-8b90-86f564641f32 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91830) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:16:20.581386 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-659cd907-baf7-428e-8b90-86f564641f32 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91830) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:16:20.581760 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-659cd907-baf7-428e-8b90-86f564641f32 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91830) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:16:20.582154 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-659cd907-baf7-428e-8b90-86f564641f32 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91830) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:16:20.582520 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-659cd907-baf7-428e-8b90-86f564641f32 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91830) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:16:20.582884 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-659cd907-baf7-428e-8b90-86f564641f32 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91830) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:16:20.583245 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-659cd907-baf7-428e-8b90-86f564641f32 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91830) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:16:20.583598 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-659cd907-baf7-428e-8b90-86f564641f32 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91830) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:16:20.584002 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-659cd907-baf7-428e-8b90-86f564641f32 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91830) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:16:20.584621 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-659cd907-baf7-428e-8b90-86f564641f32 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91830) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:16:20.585015 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-659cd907-baf7-428e-8b90-86f564641f32 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91830) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:16:20.585426 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-659cd907-baf7-428e-8b90-86f564641f32 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91830) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:16:20.612360 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-659cd907-baf7-428e-8b90-86f564641f32 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.119s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:16:20.644997 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-659cd907-baf7-428e-8b90-86f564641f32 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Notify callbacks [] for floatingip, after_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:16:20.645288 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.db.l3_db [None req-659cd907-baf7-428e-8b90-86f564641f32 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Floating IP 1832f981-0c86-4d30-be86-cbe5cf0a87b6 disassociated (deleted). External IP: 172.27.2.106, port: 76597caa-0aed-4769-95f7-9a9f6456a519. May 25 17:16:21.082758 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-659cd907-baf7-428e-8b90-86f564641f32 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Router 269c6b7b-91cc-4880-9e6d-b8889bac29f6 has already been hosted by L3 agent a2d427c1-2d07-43e8-afbe-218c9f7d0445 {{(pid=91830) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 25 17:16:21.260564 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-659cd907-baf7-428e-8b90-86f564641f32 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Notify agent at l3_agent.dv-cinder-790492-4-iscsi the message routers_updated {{(pid=91830) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 25 17:16:21.269646 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d9c900d7-1303-4cf2-ba05-e83f89a45361 None None] Sync routers for ids ['269c6b7b-91cc-4880-9e6d-b8889bac29f6'] in dv-cinder-790492-4-iscsi {{(pid=91831) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 25 17:16:21.276223 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-659cd907-baf7-428e-8b90-86f564641f32 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-178712'] for floatingip, before_response {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:16:21.279600 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d9c900d7-1303-4cf2-ba05-e83f89a45361 None None] Routers {'269c6b7b-91cc-4880-9e6d-b8889bac29f6'} bound to L3 agent in host dv-cinder-790492-4-iscsi {{(pid=91831) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 17:16:21.280221 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.l3_hamode_db [None req-d9c900d7-1303-4cf2-ba05-e83f89a45361 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-790492-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-05-25T16:50:28Z,description=,heartbeat_timestamp=2021-05-25T17:15:58Z,host='dv-cinder-790492-4-iscsi',id=a2d427c1-2d07-43e8-afbe-218c9f7d0445,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T16:50:28Z,topic='l3_agent')) {'router_ids': ['269c6b7b-91cc-4880-9e6d-b8889bac29f6'], 'active': True} {{(pid=91831) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 17:16:21.331299 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [None req-659cd907-baf7-428e-8b90-86f564641f32 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] 10.222.0.62 "DELETE /v2.0/floatingips/1832f981-0c86-4d30-be86-cbe5cf0a87b6 HTTP/1.1" status: 204 len: 168 time: 1.4730175 May 25 17:16:21.331967 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'c44e76f7-ac65-4901-b0dc-0566b81b2c3f', 'tag': '76597caa-0aed-4769-95f7-9a9f6456a519'}] {{(pid=91830) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 25 17:16:21.381890 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'c44e76f7-ac65-4901-b0dc-0566b81b2c3f', 'tag': '76597caa-0aed-4769-95f7-9a9f6456a519', 'status': 'completed', 'code': 200} May 25 17:16:21.471011 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.l3_dvr_db [None req-d9c900d7-1303-4cf2-ba05-e83f89a45361 None None] Set router 269c6b7b-91cc-4880-9e6d-b8889bac29f6 gateway port host: dv-cinder-790492-4-iscsi {{(pid=91831) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 17:16:21.485041 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-677a9b81-e003-41c4-bbb5-75e1aad9e051 req-a5eda016-a694-41ed-b93f-f4d8bd3a2cf3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91830) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:16:21.486561 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-677a9b81-e003-41c4-bbb5-75e1aad9e051 req-a5eda016-a694-41ed-b93f-f4d8bd3a2cf3 service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=5397bf60956945c3a2bf43c6b1aa614b&device_id=c44e76f7-ac65-4901-b0dc-0566b81b2c3f HTTP/1.1" status: 200 len: 1099 time: 0.0816810 May 25 17:16:21.629257 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-677a9b81-e003-41c4-bbb5-75e1aad9e051 req-d8e0c7e1-f42f-40dd-a51d-dd30e2fd4ea5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91830) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:16:21.631011 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-677a9b81-e003-41c4-bbb5-75e1aad9e051 req-d8e0c7e1-f42f-40dd-a51d-dd30e2fd4ea5 service neutron] 10.222.0.32 "GET /v2.0/networks?id=17a0e39e-1e1f-4550-b28b-d5ae3bdca362 HTTP/1.1" status: 200 len: 912 time: 0.1378207 May 25 17:16:21.701187 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-677a9b81-e003-41c4-bbb5-75e1aad9e051 req-94fd29f8-ad8f-4716-82c2-b3454aca67b7 service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=76597caa-0aed-4769-95f7-9a9f6456a519 HTTP/1.1" status: 200 len: 217 time: 0.0627451 May 25 17:16:21.769443 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-677a9b81-e003-41c4-bbb5-75e1aad9e051 req-9290e29e-dc63-44ef-b7a2-8e09641e5419 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91830) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:16:21.770914 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-677a9b81-e003-41c4-bbb5-75e1aad9e051 req-9290e29e-dc63-44ef-b7a2-8e09641e5419 service neutron] 10.222.0.32 "GET /v2.0/subnets?id=f5599a2e-9942-4423-a1ac-67e9b2650770 HTTP/1.1" status: 200 len: 850 time: 0.0621021 May 25 17:16:21.833824 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f1ecae1f-2d1e-4667-990f-8863fe9485a6 req-192863d7-8399-4fc3-82fc-1428320b6c0e tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:16:21.835497 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-f1ecae1f-2d1e-4667-990f-8863fe9485a6 req-192863d7-8399-4fc3-82fc-1428320b6c0e tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] 10.222.0.62 "GET /v2.0/ports?device_id=c44e76f7-ac65-4901-b0dc-0566b81b2c3f HTTP/1.1" status: 200 len: 946 time: 0.2145069 May 25 17:16:21.852959 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-677a9b81-e003-41c4-bbb5-75e1aad9e051 req-be39279a-c24e-4975-8c5a-092fcb54504c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91830) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:16:21.854512 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-677a9b81-e003-41c4-bbb5-75e1aad9e051 req-be39279a-c24e-4975-8c5a-092fcb54504c service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=17a0e39e-1e1f-4550-b28b-d5ae3bdca362&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0765707 May 25 17:16:21.882805 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.l3_hamode_db [None req-d9c900d7-1303-4cf2-ba05-e83f89a45361 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '269c6b7b-91cc-4880-9e6d-b8889bac29f6', 'name': 'tempest-TestVolumeBootPattern-219116984-router', 'tenant_id': '5397bf60956945c3a2bf43c6b1aa614b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'external_fixed_ips': [{'subnet_id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'ip_address': '172.27.2.227'}], 'enable_snat': True}, 'gw_port_id': '2fef7852-acf7-462f-beee-5679d3df0ad2', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T17:07:09Z', 'updated_at': '2021-05-25T17:07:13Z', 'revision_number': 4, 'project_id': '5397bf60956945c3a2bf43c6b1aa614b', 'gw_port': {'id': '2fef7852-acf7-462f-beee-5679d3df0ad2', 'name': '', 'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'tenant_id': '', 'mac_address': 'fa:16:3e:35:b9:d0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '269c6b7b-91cc-4880-9e6d-b8889bac29f6', 'device_owner': 'network:router_gateway', 'standard_attr_id': 533, 'fixed_ips': [{'subnet_id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'ip_address': '172.27.2.227', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790492-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:07:09Z', 'updated_at': '2021-05-25T17:07:16Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-790492-4-iscsi', '_floatingips': [{'id': '29e0fa6c-2b2a-4eff-85c0-77fa15ffbdec', 'tenant_id': '5397bf60956945c3a2bf43c6b1aa614b', 'floating_ip_address': '172.27.2.75', 'floating_network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'router_id': '269c6b7b-91cc-4880-9e6d-b8889bac29f6', 'port_id': 'c68cea2d-169c-4346-87ef-27549285cb6b', 'fixed_ip_address': '172.20.0.10', 'status': 'ACTIVE', 'standard_attr_id': 577, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '17a0e39e-1e1f-4550-b28b-d5ae3bdca362', 'mac_address': 'fa:16:3e:7a:1d:60', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6e10cbf6-87b6-452f-80e6-c8bd2ce073db', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-25T17:11:17Z', 'updated_at': '2021-05-25T17:11:20Z', 'revision_number': 1, 'project_id': '5397bf60956945c3a2bf43c6b1aa614b', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '4972e3a9-91eb-48ce-8b7b-b0906822cebf', 'name': '', 'network_id': '17a0e39e-1e1f-4550-b28b-d5ae3bdca362', 'tenant_id': '5397bf60956945c3a2bf43c6b1aa614b', 'mac_address': 'fa:16:3e:ce:fe:1a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '269c6b7b-91cc-4880-9e6d-b8889bac29f6', 'device_owner': 'network:router_interface', 'standard_attr_id': 534, 'fixed_ips': [{'subnet_id': 'f5599a2e-9942-4423-a1ac-67e9b2650770', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790492-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:07:12Z', 'updated_at': '2021-05-25T17:07:20Z', 'revision_number': 5, 'project_id': '5397bf60956945c3a2bf43c6b1aa614b', 'subnets': [{'id': 'f5599a2e-9942-4423-a1ac-67e9b2650770', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-790492-4-iscsi', False) {} {{(pid=91831) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 17:16:21.884170 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-f1ecae1f-2d1e-4667-990f-8863fe9485a6 req-3f991142-bb1a-4968-be89-61c1840354cb tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] 10.222.0.62 "GET /v2.0/security-groups?id=58fab80b-49b2-4bca-89e6-fef7473221ef&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0425038 May 25 17:16:21.886756 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d9c900d7-1303-4cf2-ba05-e83f89a45361 None None] Checking router: 269c6b7b-91cc-4880-9e6d-b8889bac29f6 for host: dv-cinder-790492-4-iscsi {{(pid=91831) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 25 17:16:21.895692 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d9c900d7-1303-4cf2-ba05-e83f89a45361 None None] Routers {'269c6b7b-91cc-4880-9e6d-b8889bac29f6'} bound to L3 agent in host dv-cinder-790492-4-iscsi {{(pid=91831) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 17:16:21.896315 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.l3_hamode_db [None req-d9c900d7-1303-4cf2-ba05-e83f89a45361 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-790492-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-05-25T16:50:28Z,description=,heartbeat_timestamp=2021-05-25T17:15:58Z,host='dv-cinder-790492-4-iscsi',id=a2d427c1-2d07-43e8-afbe-218c9f7d0445,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T16:50:28Z,topic='l3_agent')) {'router_ids': ['269c6b7b-91cc-4880-9e6d-b8889bac29f6'], 'active': True} {{(pid=91831) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 17:16:21.993133 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-677a9b81-e003-41c4-bbb5-75e1aad9e051 req-09092817-7fa1-4612-a29b-fde0aa3d6c72 service neutron] 10.222.0.32 "GET /v2.0/networks/17a0e39e-1e1f-4550-b28b-d5ae3bdca362?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1304939 May 25 17:16:22.076721 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.l3_dvr_db [None req-d9c900d7-1303-4cf2-ba05-e83f89a45361 None None] Set router 269c6b7b-91cc-4880-9e6d-b8889bac29f6 gateway port host: dv-cinder-790492-4-iscsi {{(pid=91831) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 17:16:22.129569 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-677a9b81-e003-41c4-bbb5-75e1aad9e051 req-81f004a9-e352-4173-9931-c2f48546fd18 service neutron] 10.222.0.32 "GET /v2.0/networks/17a0e39e-1e1f-4550-b28b-d5ae3bdca362?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1263354 May 25 17:16:22.425217 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.l3_hamode_db [None req-d9c900d7-1303-4cf2-ba05-e83f89a45361 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '269c6b7b-91cc-4880-9e6d-b8889bac29f6', 'name': 'tempest-TestVolumeBootPattern-219116984-router', 'tenant_id': '5397bf60956945c3a2bf43c6b1aa614b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'external_fixed_ips': [{'subnet_id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'ip_address': '172.27.2.227'}], 'enable_snat': True}, 'gw_port_id': '2fef7852-acf7-462f-beee-5679d3df0ad2', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T17:07:09Z', 'updated_at': '2021-05-25T17:07:13Z', 'revision_number': 4, 'project_id': '5397bf60956945c3a2bf43c6b1aa614b', 'gw_port': {'id': '2fef7852-acf7-462f-beee-5679d3df0ad2', 'name': '', 'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'tenant_id': '', 'mac_address': 'fa:16:3e:35:b9:d0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '269c6b7b-91cc-4880-9e6d-b8889bac29f6', 'device_owner': 'network:router_gateway', 'standard_attr_id': 533, 'fixed_ips': [{'subnet_id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'ip_address': '172.27.2.227', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790492-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:07:09Z', 'updated_at': '2021-05-25T17:07:16Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-790492-4-iscsi', '_floatingips': [{'id': '29e0fa6c-2b2a-4eff-85c0-77fa15ffbdec', 'tenant_id': '5397bf60956945c3a2bf43c6b1aa614b', 'floating_ip_address': '172.27.2.75', 'floating_network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'router_id': '269c6b7b-91cc-4880-9e6d-b8889bac29f6', 'port_id': 'c68cea2d-169c-4346-87ef-27549285cb6b', 'fixed_ip_address': '172.20.0.10', 'status': 'ACTIVE', 'standard_attr_id': 577, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '17a0e39e-1e1f-4550-b28b-d5ae3bdca362', 'mac_address': 'fa:16:3e:7a:1d:60', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6e10cbf6-87b6-452f-80e6-c8bd2ce073db', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-25T17:11:17Z', 'updated_at': '2021-05-25T17:11:20Z', 'revision_number': 1, 'project_id': '5397bf60956945c3a2bf43c6b1aa614b', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '4972e3a9-91eb-48ce-8b7b-b0906822cebf', 'name': '', 'network_id': '17a0e39e-1e1f-4550-b28b-d5ae3bdca362', 'tenant_id': '5397bf60956945c3a2bf43c6b1aa614b', 'mac_address': 'fa:16:3e:ce:fe:1a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '269c6b7b-91cc-4880-9e6d-b8889bac29f6', 'device_owner': 'network:router_interface', 'standard_attr_id': 534, 'fixed_ips': [{'subnet_id': 'f5599a2e-9942-4423-a1ac-67e9b2650770', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790492-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:07:12Z', 'updated_at': '2021-05-25T17:07:20Z', 'revision_number': 5, 'project_id': '5397bf60956945c3a2bf43c6b1aa614b', 'subnets': [{'id': 'f5599a2e-9942-4423-a1ac-67e9b2650770', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-790492-4-iscsi', False) {} {{(pid=91831) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 17:16:22.428991 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d9c900d7-1303-4cf2-ba05-e83f89a45361 None None] The sync data for ids ['269c6b7b-91cc-4880-9e6d-b8889bac29f6'] in dv-cinder-790492-4-iscsi is: [{'id': '269c6b7b-91cc-4880-9e6d-b8889bac29f6', 'name': 'tempest-TestVolumeBootPattern-219116984-router', 'tenant_id': '5397bf60956945c3a2bf43c6b1aa614b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'external_fixed_ips': [{'subnet_id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'ip_address': '172.27.2.227'}], 'enable_snat': True}, 'gw_port_id': '2fef7852-acf7-462f-beee-5679d3df0ad2', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T17:07:09Z', 'updated_at': '2021-05-25T17:07:13Z', 'revision_number': 4, 'project_id': '5397bf60956945c3a2bf43c6b1aa614b', 'gw_port': {'id': '2fef7852-acf7-462f-beee-5679d3df0ad2', 'name': '', 'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'tenant_id': '', 'mac_address': 'fa:16:3e:35:b9:d0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '269c6b7b-91cc-4880-9e6d-b8889bac29f6', 'device_owner': 'network:router_gateway', 'standard_attr_id': 533, 'fixed_ips': [{'subnet_id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'ip_address': '172.27.2.227', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790492-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:07:09Z', 'updated_at': '2021-05-25T17:07:16Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-790492-4-iscsi', '_floatingips': [{'id': '29e0fa6c-2b2a-4eff-85c0-77fa15ffbdec', 'tenant_id': '5397bf60956945c3a2bf43c6b1aa614b', 'floating_ip_address': '172.27.2.75', 'floating_network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'router_id': '269c6b7b-91cc-4880-9e6d-b8889bac29f6', 'port_id': 'c68cea2d-169c-4346-87ef-27549285cb6b', 'fixed_ip_address': '172.20.0.10', 'status': 'ACTIVE', 'standard_attr_id': 577, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '17a0e39e-1e1f-4550-b28b-d5ae3bdca362', 'mac_address': 'fa:16:3e:7a:1d:60', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6e10cbf6-87b6-452f-80e6-c8bd2ce073db', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-05-25T17:11:17Z', 'updated_at': '2021-05-25T17:11:20Z', 'revision_number': 1, 'project_id': '5397bf60956945c3a2bf43c6b1aa614b', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '4972e3a9-91eb-48ce-8b7b-b0906822cebf', 'name': '', 'network_id': '17a0e39e-1e1f-4550-b28b-d5ae3bdca362', 'tenant_id': '5397bf60956945c3a2bf43c6b1aa614b', 'mac_address': 'fa:16:3e:ce:fe:1a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '269c6b7b-91cc-4880-9e6d-b8889bac29f6', 'device_owner': 'network:router_interface', 'standard_attr_id': 534, 'fixed_ips': [{'subnet_id': 'f5599a2e-9942-4423-a1ac-67e9b2650770', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790492-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:07:12Z', 'updated_at': '2021-05-25T17:07:20Z', 'revision_number': 5, 'project_id': '5397bf60956945c3a2bf43c6b1aa614b', 'subnets': [{'id': 'f5599a2e-9942-4423-a1ac-67e9b2650770', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=91831) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 25 17:16:22.620048 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-90d74dcc-7186-484b-89e4-674bf2ee58bc None None] New status for floating IP 1832f981-0c86-4d30-be86-cbe5cf0a87b6: DOWN {{(pid=91832) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} May 25 17:16:23.162285 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-90969a74-714d-4304-b344-4e55adc81d0e req-acdd9b2e-462f-4f9e-bbd2-d5363fce57c8 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:16:23.163707 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-90969a74-714d-4304-b344-4e55adc81d0e req-acdd9b2e-462f-4f9e-bbd2-d5363fce57c8 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] 10.222.0.62 "GET /v2.0/ports?device_id=c44e76f7-ac65-4901-b0dc-0566b81b2c3f HTTP/1.1" status: 200 len: 946 time: 0.1709402 May 25 17:16:23.207605 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-90969a74-714d-4304-b344-4e55adc81d0e req-675e9a1f-424d-4d6a-8548-7c9d266d7b74 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] 10.222.0.62 "GET /v2.0/security-groups?id=58fab80b-49b2-4bca-89e6-fef7473221ef&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0382161 May 25 17:16:23.551042 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5017791a-6875-4a3c-bea4-8b1cbb66de4e req-8761f5a8-3ce8-4238-b66e-dd1ae7f5a95d tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91830) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:16:23.551736 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [req-5017791a-6875-4a3c-bea4-8b1cbb66de4e req-8761f5a8-3ce8-4238-b66e-dd1ae7f5a95d tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Synchronizing usage tracker for tenant:5397bf60956945c3a2bf43c6b1aa614b on resource:port {{(pid=91830) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 25 17:16:23.566842 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [req-5017791a-6875-4a3c-bea4-8b1cbb66de4e req-8761f5a8-3ce8-4238-b66e-dd1ae7f5a95d tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Unset dirty status for tenant:5397bf60956945c3a2bf43c6b1aa614b on resource:port {{(pid=91830) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 25 17:16:23.567994 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-5017791a-6875-4a3c-bea4-8b1cbb66de4e req-8761f5a8-3ce8-4238-b66e-dd1ae7f5a95d tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] 10.222.0.32 "GET /v2.0/ports?device_id=c44e76f7-ac65-4901-b0dc-0566b81b2c3f HTTP/1.1" status: 200 len: 946 time: 0.0993009 May 25 17:16:23.702659 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.plugins.ml2.plugin [req-5017791a-6875-4a3c-bea4-8b1cbb66de4e req-08f8e327-cbbf-4e2f-8f0d-d5f50cc5757d tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Deleting port 76597caa-0aed-4769-95f7-9a9f6456a519 {{(pid=91830) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 25 17:16:23.703545 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [req-5017791a-6875-4a3c-bea4-8b1cbb66de4e req-08f8e327-cbbf-4e2f-8f0d-d5f50cc5757d tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8757892952899'] for port, before_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:16:23.836576 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.plugins.ml2.db [req-5017791a-6875-4a3c-bea4-8b1cbb66de4e req-08f8e327-cbbf-4e2f-8f0d-d5f50cc5757d tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] For port 76597caa-0aed-4769-95f7-9a9f6456a519, host hv-cinder-79049, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79049',level=0,port_id=76597caa-0aed-4769-95f7-9a9f6456a519,segment=NetworkSegment(50ed67e9-f8d3-4927-b257-bd17654cce34),segment_id=50ed67e9-f8d3-4927-b257-bd17654cce34)] {{(pid=91830) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 17:16:23.836851 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [req-5017791a-6875-4a3c-bea4-8b1cbb66de4e req-08f8e327-cbbf-4e2f-8f0d-d5f50cc5757d tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-683770'] for port, precommit_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:16:24.045838 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.plugins.ml2.plugin [req-5017791a-6875-4a3c-bea4-8b1cbb66de4e req-08f8e327-cbbf-4e2f-8f0d-d5f50cc5757d tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Calling delete_port for 76597caa-0aed-4769-95f7-9a9f6456a519 owned by compute:nova {{(pid=91830) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 25 17:16:24.153316 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [req-5017791a-6875-4a3c-bea4-8b1cbb66de4e req-08f8e327-cbbf-4e2f-8f0d-d5f50cc5757d tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8757892955046', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8757892520924', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-27483019'] for port, after_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:16:24.159770 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-df34a865-d97f-448a-9bd2-9e88941951e4 tempest-ServerRescueNegativeTestJSON-1728051656 tempest-ServerRescueNegativeTestJSON-1728051656-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:16:24.207065 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-08f8e327-cbbf-4e2f-8f0d-d5f50cc5757d tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Pushing event deleted for resources: {'Port': ['ID=76597caa-0aed-4769-95f7-9a9f6456a519,revision_number=None']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:16:24.209955 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-08f8e327-cbbf-4e2f-8f0d-d5f50cc5757d tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.051s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:16:24.281850 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.l3_dvrscheduler_db [req-5017791a-6875-4a3c-bea4-8b1cbb66de4e req-08f8e327-cbbf-4e2f-8f0d-d5f50cc5757d tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] No DVR routers for this DVR port 76597caa-0aed-4769-95f7-9a9f6456a519 on host hv-cinder-79049 {{(pid=91830) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 25 17:16:24.284330 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [req-5017791a-6875-4a3c-bea4-8b1cbb66de4e req-08f8e327-cbbf-4e2f-8f0d-d5f50cc5757d tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-178712'] for port, before_response {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:16:24.286860 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'c44e76f7-ac65-4901-b0dc-0566b81b2c3f', 'name': 'network-vif-deleted', 'tag': '76597caa-0aed-4769-95f7-9a9f6456a519'}] {{(pid=91830) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 25 17:16:24.303694 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-5017791a-6875-4a3c-bea4-8b1cbb66de4e req-08f8e327-cbbf-4e2f-8f0d-d5f50cc5757d tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] 10.222.0.32 "DELETE /v2.0/ports/76597caa-0aed-4769-95f7-9a9f6456a519 HTTP/1.1" status: 204 len: 173 time: 0.7300696 May 25 17:16:24.335940 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'c44e76f7-ac65-4901-b0dc-0566b81b2c3f', 'name': 'network-vif-deleted', 'tag': '76597caa-0aed-4769-95f7-9a9f6456a519', 'status': 'completed', 'code': 200} May 25 17:16:24.378355 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-6cca86d4-1c19-4d5c-9a78-49df16cfcc9b req-6af7421a-133c-494a-b908-8fc25c4151b6 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] 10.222.0.62 "GET /v2.0/ports?device_id=c44e76f7-ac65-4901-b0dc-0566b81b2c3f HTTP/1.1" status: 200 len: 210 time: 0.0466034 May 25 17:16:25.344350 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-bb09e405-64d4-48f8-b0d6-3145f27334e4 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:16:27.299388 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.rpc [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Device 76597caa-0aed-4769-95f7-9a9f6456a519 no longer exists at agent hyperv_hv-cinder-79049 {{(pid=91831) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 25 17:16:27.338109 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.plugin [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] No Port match for: 76597caa-0aed-4769-95f7-9a9f6456a519 {{(pid=91831) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}} May 25 17:16:27.338461 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.rpc [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Device 76597caa-0aed-4769-95f7-9a9f6456a519 not bound to the agent host hv-cinder-79049 {{(pid=91831) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 25 17:16:27.741479 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-7ff4a0cc-3fb9-4e56-baed-b62e4bf20500 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:16:27.862603 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.wsgi [-] (91830) accepted ('10.222.0.62', 39760) {{(pid=91830) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:16:27.926778 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:16:28.127840 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.plugins.ml2.plugin [None req-f9552585-c38c-4da1-905a-711bf8b5b7d1 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Deleting port 87e0da25-c33f-4251-b133-114e1bc8f03d {{(pid=91830) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 25 17:16:28.128180 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-f9552585-c38c-4da1-905a-711bf8b5b7d1 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8757892952899'] for port, before_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:16:28.247941 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-f9552585-c38c-4da1-905a-711bf8b5b7d1 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-683770'] for port, precommit_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:16:28.248265 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-f9552585-c38c-4da1-905a-711bf8b5b7d1 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:16:28.377682 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.plugins.ml2.plugin [None req-f9552585-c38c-4da1-905a-711bf8b5b7d1 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Calling delete_port for 87e0da25-c33f-4251-b133-114e1bc8f03d owned by network:floatingip {{(pid=91830) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 25 17:16:28.494315 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-f9552585-c38c-4da1-905a-711bf8b5b7d1 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8757892955046', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8757892520924', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-27483019'] for port, after_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:16:28.498657 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-64442b91-1a28-4d7d-b9ec-f1cb42b9f2bd admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:16:28.546120 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f9552585-c38c-4da1-905a-711bf8b5b7d1 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Pushing event deleted for resources: {'Port': ['ID=87e0da25-c33f-4251-b133-114e1bc8f03d,revision_number=None']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:16:28.573630 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-f9552585-c38c-4da1-905a-711bf8b5b7d1 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.075s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:16:28.638294 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-f9552585-c38c-4da1-905a-711bf8b5b7d1 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Notify callbacks [] for floatingip, after_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:16:28.638614 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.db.l3_db [None req-f9552585-c38c-4da1-905a-711bf8b5b7d1 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Floating IP 29e0fa6c-2b2a-4eff-85c0-77fa15ffbdec disassociated (deleted). External IP: 172.27.2.75, port: c68cea2d-169c-4346-87ef-27549285cb6b. May 25 17:16:28.670908 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-0a55eb4a-8b57-4233-84d6-6b423b4ed6db None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:16:28.990326 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-f9552585-c38c-4da1-905a-711bf8b5b7d1 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Router 269c6b7b-91cc-4880-9e6d-b8889bac29f6 has already been hosted by L3 agent a2d427c1-2d07-43e8-afbe-218c9f7d0445 {{(pid=91830) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 25 17:16:29.256556 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-f9552585-c38c-4da1-905a-711bf8b5b7d1 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Notify agent at l3_agent.dv-cinder-790492-4-iscsi the message routers_updated {{(pid=91830) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 25 17:16:29.266088 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5002adde-9565-4a88-a460-a4d122576a45 None None] Sync routers for ids ['269c6b7b-91cc-4880-9e6d-b8889bac29f6'] in dv-cinder-790492-4-iscsi {{(pid=91831) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 25 17:16:29.272943 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-f9552585-c38c-4da1-905a-711bf8b5b7d1 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-178712'] for floatingip, before_response {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:16:29.275062 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5002adde-9565-4a88-a460-a4d122576a45 None None] Routers {'269c6b7b-91cc-4880-9e6d-b8889bac29f6'} bound to L3 agent in host dv-cinder-790492-4-iscsi {{(pid=91831) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 17:16:29.275718 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.l3_hamode_db [None req-5002adde-9565-4a88-a460-a4d122576a45 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-790492-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-05-25T16:50:28Z,description=,heartbeat_timestamp=2021-05-25T17:16:28Z,host='dv-cinder-790492-4-iscsi',id=a2d427c1-2d07-43e8-afbe-218c9f7d0445,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T16:50:28Z,topic='l3_agent')) {'router_ids': ['269c6b7b-91cc-4880-9e6d-b8889bac29f6'], 'active': True} {{(pid=91831) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 17:16:29.327535 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [None req-f9552585-c38c-4da1-905a-711bf8b5b7d1 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] 10.222.0.62 "DELETE /v2.0/floatingips/29e0fa6c-2b2a-4eff-85c0-77fa15ffbdec HTTP/1.1" status: 204 len: 168 time: 1.4638634 May 25 17:16:29.329311 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '6e10cbf6-87b6-452f-80e6-c8bd2ce073db', 'tag': 'c68cea2d-169c-4346-87ef-27549285cb6b'}] {{(pid=91830) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 25 17:16:29.371862 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '6e10cbf6-87b6-452f-80e6-c8bd2ce073db', 'tag': 'c68cea2d-169c-4346-87ef-27549285cb6b', 'status': 'completed', 'code': 200} May 25 17:16:29.462823 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.l3_dvr_db [None req-5002adde-9565-4a88-a460-a4d122576a45 None None] Set router 269c6b7b-91cc-4880-9e6d-b8889bac29f6 gateway port host: dv-cinder-790492-4-iscsi {{(pid=91831) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 17:16:29.472527 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a76f7848-767b-4bcb-94bc-e54fc967e9d4 req-a80bbbee-524a-482a-8bc7-954cf43f2244 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91830) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:16:29.474301 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-a76f7848-767b-4bcb-94bc-e54fc967e9d4 req-a80bbbee-524a-482a-8bc7-954cf43f2244 service neutron] 10.222.0.32 "GET /v2.0/ports?tenant_id=5397bf60956945c3a2bf43c6b1aa614b&device_id=6e10cbf6-87b6-452f-80e6-c8bd2ce073db HTTP/1.1" status: 200 len: 1099 time: 0.0782695 May 25 17:16:29.626631 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a76f7848-767b-4bcb-94bc-e54fc967e9d4 req-71441592-01af-472d-a70f-ac6f3272d39b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=91830) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:16:29.628120 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-a76f7848-767b-4bcb-94bc-e54fc967e9d4 req-71441592-01af-472d-a70f-ac6f3272d39b service neutron] 10.222.0.32 "GET /v2.0/networks?id=17a0e39e-1e1f-4550-b28b-d5ae3bdca362 HTTP/1.1" status: 200 len: 912 time: 0.1456115 May 25 17:16:29.701652 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-a76f7848-767b-4bcb-94bc-e54fc967e9d4 req-6dbdc768-d034-4f77-977e-3091fffd709f service neutron] 10.222.0.32 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=c68cea2d-169c-4346-87ef-27549285cb6b HTTP/1.1" status: 200 len: 217 time: 0.0657289 May 25 17:16:29.705860 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6c637f56-1451-4f83-a329-d1b013f5ab2b req-b41b935a-b5fd-402c-8d7a-2cabdff18ca0 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:16:29.707333 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-6c637f56-1451-4f83-a329-d1b013f5ab2b req-b41b935a-b5fd-402c-8d7a-2cabdff18ca0 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] 10.222.0.62 "GET /v2.0/ports?device_id=6e10cbf6-87b6-452f-80e6-c8bd2ce073db HTTP/1.1" status: 200 len: 946 time: 0.0847461 May 25 17:16:29.754415 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-6c637f56-1451-4f83-a329-d1b013f5ab2b req-94987d90-2235-4d93-a77f-90f75d03bec2 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] 10.222.0.62 "GET /v2.0/security-groups?id=58fab80b-49b2-4bca-89e6-fef7473221ef&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0408900 May 25 17:16:29.766225 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a76f7848-767b-4bcb-94bc-e54fc967e9d4 req-6a0d1a02-3e92-46a3-93aa-3c468b358155 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=91830) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:16:29.768185 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-a76f7848-767b-4bcb-94bc-e54fc967e9d4 req-6a0d1a02-3e92-46a3-93aa-3c468b358155 service neutron] 10.222.0.32 "GET /v2.0/subnets?id=f5599a2e-9942-4423-a1ac-67e9b2650770 HTTP/1.1" status: 200 len: 850 time: 0.0601230 May 25 17:16:29.791288 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.l3_hamode_db [None req-5002adde-9565-4a88-a460-a4d122576a45 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '269c6b7b-91cc-4880-9e6d-b8889bac29f6', 'name': 'tempest-TestVolumeBootPattern-219116984-router', 'tenant_id': '5397bf60956945c3a2bf43c6b1aa614b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'external_fixed_ips': [{'subnet_id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'ip_address': '172.27.2.227'}], 'enable_snat': True}, 'gw_port_id': '2fef7852-acf7-462f-beee-5679d3df0ad2', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T17:07:09Z', 'updated_at': '2021-05-25T17:07:13Z', 'revision_number': 4, 'project_id': '5397bf60956945c3a2bf43c6b1aa614b', 'gw_port': {'id': '2fef7852-acf7-462f-beee-5679d3df0ad2', 'name': '', 'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'tenant_id': '', 'mac_address': 'fa:16:3e:35:b9:d0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '269c6b7b-91cc-4880-9e6d-b8889bac29f6', 'device_owner': 'network:router_gateway', 'standard_attr_id': 533, 'fixed_ips': [{'subnet_id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'ip_address': '172.27.2.227', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790492-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:07:09Z', 'updated_at': '2021-05-25T17:07:16Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-790492-4-iscsi', '_interfaces': [{'id': '4972e3a9-91eb-48ce-8b7b-b0906822cebf', 'name': '', 'network_id': '17a0e39e-1e1f-4550-b28b-d5ae3bdca362', 'tenant_id': '5397bf60956945c3a2bf43c6b1aa614b', 'mac_address': 'fa:16:3e:ce:fe:1a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '269c6b7b-91cc-4880-9e6d-b8889bac29f6', 'device_owner': 'network:router_interface', 'standard_attr_id': 534, 'fixed_ips': [{'subnet_id': 'f5599a2e-9942-4423-a1ac-67e9b2650770', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790492-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:07:12Z', 'updated_at': '2021-05-25T17:07:20Z', 'revision_number': 5, 'project_id': '5397bf60956945c3a2bf43c6b1aa614b', 'subnets': [{'id': 'f5599a2e-9942-4423-a1ac-67e9b2650770', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-790492-4-iscsi', False) {} {{(pid=91831) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 17:16:29.795118 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5002adde-9565-4a88-a460-a4d122576a45 None None] Checking router: 269c6b7b-91cc-4880-9e6d-b8889bac29f6 for host: dv-cinder-790492-4-iscsi {{(pid=91831) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 25 17:16:29.804001 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5002adde-9565-4a88-a460-a4d122576a45 None None] Routers {'269c6b7b-91cc-4880-9e6d-b8889bac29f6'} bound to L3 agent in host dv-cinder-790492-4-iscsi {{(pid=91831) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 17:16:29.804609 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.l3_hamode_db [None req-5002adde-9565-4a88-a460-a4d122576a45 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-790492-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-05-25T16:50:28Z,description=,heartbeat_timestamp=2021-05-25T17:16:28Z,host='dv-cinder-790492-4-iscsi',id=a2d427c1-2d07-43e8-afbe-218c9f7d0445,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T16:50:28Z,topic='l3_agent')) {'router_ids': ['269c6b7b-91cc-4880-9e6d-b8889bac29f6'], 'active': True} {{(pid=91831) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 17:16:29.848316 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a76f7848-767b-4bcb-94bc-e54fc967e9d4 req-bdd5968e-4826-4c57-82bc-e8b9c7fecfdb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=91830) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:16:29.849772 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-a76f7848-767b-4bcb-94bc-e54fc967e9d4 req-bdd5968e-4826-4c57-82bc-e8b9c7fecfdb service neutron] 10.222.0.32 "GET /v2.0/ports?network_id=17a0e39e-1e1f-4550-b28b-d5ae3bdca362&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0735469 May 25 17:16:29.987156 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-a76f7848-767b-4bcb-94bc-e54fc967e9d4 req-a7021bcb-df6d-41aa-8153-6f69c6b6e374 service neutron] 10.222.0.32 "GET /v2.0/networks/17a0e39e-1e1f-4550-b28b-d5ae3bdca362?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1291041 May 25 17:16:30.023323 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.l3_dvr_db [None req-5002adde-9565-4a88-a460-a4d122576a45 None None] Set router 269c6b7b-91cc-4880-9e6d-b8889bac29f6 gateway port host: dv-cinder-790492-4-iscsi {{(pid=91831) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 17:16:30.120594 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-a76f7848-767b-4bcb-94bc-e54fc967e9d4 req-bd685bea-fff7-47b7-8e75-413cb405c26a service neutron] 10.222.0.32 "GET /v2.0/networks/17a0e39e-1e1f-4550-b28b-d5ae3bdca362?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1253502 May 25 17:16:30.382621 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-57f11b47-1f51-4191-b7c9-af248a48372c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:16:30.432136 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.l3_hamode_db [None req-5002adde-9565-4a88-a460-a4d122576a45 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '269c6b7b-91cc-4880-9e6d-b8889bac29f6', 'name': 'tempest-TestVolumeBootPattern-219116984-router', 'tenant_id': '5397bf60956945c3a2bf43c6b1aa614b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'external_fixed_ips': [{'subnet_id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'ip_address': '172.27.2.227'}], 'enable_snat': True}, 'gw_port_id': '2fef7852-acf7-462f-beee-5679d3df0ad2', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T17:07:09Z', 'updated_at': '2021-05-25T17:07:13Z', 'revision_number': 4, 'project_id': '5397bf60956945c3a2bf43c6b1aa614b', 'gw_port': {'id': '2fef7852-acf7-462f-beee-5679d3df0ad2', 'name': '', 'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'tenant_id': '', 'mac_address': 'fa:16:3e:35:b9:d0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '269c6b7b-91cc-4880-9e6d-b8889bac29f6', 'device_owner': 'network:router_gateway', 'standard_attr_id': 533, 'fixed_ips': [{'subnet_id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'ip_address': '172.27.2.227', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790492-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:07:09Z', 'updated_at': '2021-05-25T17:07:16Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-790492-4-iscsi', '_interfaces': [{'id': '4972e3a9-91eb-48ce-8b7b-b0906822cebf', 'name': '', 'network_id': '17a0e39e-1e1f-4550-b28b-d5ae3bdca362', 'tenant_id': '5397bf60956945c3a2bf43c6b1aa614b', 'mac_address': 'fa:16:3e:ce:fe:1a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '269c6b7b-91cc-4880-9e6d-b8889bac29f6', 'device_owner': 'network:router_interface', 'standard_attr_id': 534, 'fixed_ips': [{'subnet_id': 'f5599a2e-9942-4423-a1ac-67e9b2650770', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790492-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:07:12Z', 'updated_at': '2021-05-25T17:07:20Z', 'revision_number': 5, 'project_id': '5397bf60956945c3a2bf43c6b1aa614b', 'subnets': [{'id': 'f5599a2e-9942-4423-a1ac-67e9b2650770', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-790492-4-iscsi', False) {} {{(pid=91831) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 17:16:30.437377 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5002adde-9565-4a88-a460-a4d122576a45 None None] The sync data for ids ['269c6b7b-91cc-4880-9e6d-b8889bac29f6'] in dv-cinder-790492-4-iscsi is: [{'id': '269c6b7b-91cc-4880-9e6d-b8889bac29f6', 'name': 'tempest-TestVolumeBootPattern-219116984-router', 'tenant_id': '5397bf60956945c3a2bf43c6b1aa614b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'external_fixed_ips': [{'subnet_id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'ip_address': '172.27.2.227'}], 'enable_snat': True}, 'gw_port_id': '2fef7852-acf7-462f-beee-5679d3df0ad2', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T17:07:09Z', 'updated_at': '2021-05-25T17:07:13Z', 'revision_number': 4, 'project_id': '5397bf60956945c3a2bf43c6b1aa614b', 'gw_port': {'id': '2fef7852-acf7-462f-beee-5679d3df0ad2', 'name': '', 'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'tenant_id': '', 'mac_address': 'fa:16:3e:35:b9:d0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '269c6b7b-91cc-4880-9e6d-b8889bac29f6', 'device_owner': 'network:router_gateway', 'standard_attr_id': 533, 'fixed_ips': [{'subnet_id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'ip_address': '172.27.2.227', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790492-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:07:09Z', 'updated_at': '2021-05-25T17:07:16Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-790492-4-iscsi', '_interfaces': [{'id': '4972e3a9-91eb-48ce-8b7b-b0906822cebf', 'name': '', 'network_id': '17a0e39e-1e1f-4550-b28b-d5ae3bdca362', 'tenant_id': '5397bf60956945c3a2bf43c6b1aa614b', 'mac_address': 'fa:16:3e:ce:fe:1a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '269c6b7b-91cc-4880-9e6d-b8889bac29f6', 'device_owner': 'network:router_interface', 'standard_attr_id': 534, 'fixed_ips': [{'subnet_id': 'f5599a2e-9942-4423-a1ac-67e9b2650770', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790492-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:07:12Z', 'updated_at': '2021-05-25T17:07:20Z', 'revision_number': 5, 'project_id': '5397bf60956945c3a2bf43c6b1aa614b', 'subnets': [{'id': 'f5599a2e-9942-4423-a1ac-67e9b2650770', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=91831) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 25 17:16:30.580668 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cf68c52e-42f2-46ae-a5ef-90ce7dec02c7 req-eea096fa-f19b-48b0-b9e4-88bcbed26496 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91830) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:16:30.581387 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [req-cf68c52e-42f2-46ae-a5ef-90ce7dec02c7 req-eea096fa-f19b-48b0-b9e4-88bcbed26496 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Synchronizing usage tracker for tenant:5397bf60956945c3a2bf43c6b1aa614b on resource:port {{(pid=91830) resync /opt/stack/neutron/neutron/quota/resource.py:241}} May 25 17:16:30.598016 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.quota.resource [req-cf68c52e-42f2-46ae-a5ef-90ce7dec02c7 req-eea096fa-f19b-48b0-b9e4-88bcbed26496 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Unset dirty status for tenant:5397bf60956945c3a2bf43c6b1aa614b on resource:port {{(pid=91830) _resync /opt/stack/neutron/neutron/quota/resource.py:233}} May 25 17:16:30.599191 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-cf68c52e-42f2-46ae-a5ef-90ce7dec02c7 req-eea096fa-f19b-48b0-b9e4-88bcbed26496 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] 10.222.0.32 "GET /v2.0/ports?device_id=6e10cbf6-87b6-452f-80e6-c8bd2ce073db HTTP/1.1" status: 200 len: 946 time: 0.1001136 May 25 17:16:30.644754 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c740a677-7048-4d84-9a53-7960c76c3c25 None None] New status for floating IP 29e0fa6c-2b2a-4eff-85c0-77fa15ffbdec: DOWN {{(pid=91832) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} May 25 17:16:30.737012 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.plugins.ml2.plugin [req-cf68c52e-42f2-46ae-a5ef-90ce7dec02c7 req-9e6d4f6d-e559-4cab-8e99-c1da99e818ae tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Deleting port c68cea2d-169c-4346-87ef-27549285cb6b {{(pid=91830) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 25 17:16:30.737347 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [req-cf68c52e-42f2-46ae-a5ef-90ce7dec02c7 req-9e6d4f6d-e559-4cab-8e99-c1da99e818ae tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8757892952899'] for port, before_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:16:30.874771 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.plugins.ml2.db [req-cf68c52e-42f2-46ae-a5ef-90ce7dec02c7 req-9e6d4f6d-e559-4cab-8e99-c1da99e818ae tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] For port c68cea2d-169c-4346-87ef-27549285cb6b, host hv-cinder-79049, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79049',level=0,port_id=c68cea2d-169c-4346-87ef-27549285cb6b,segment=NetworkSegment(50ed67e9-f8d3-4927-b257-bd17654cce34),segment_id=50ed67e9-f8d3-4927-b257-bd17654cce34)] {{(pid=91830) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 17:16:30.875127 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [req-cf68c52e-42f2-46ae-a5ef-90ce7dec02c7 req-9e6d4f6d-e559-4cab-8e99-c1da99e818ae tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-683770'] for port, precommit_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:16:31.008449 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.plugins.ml2.plugin [req-cf68c52e-42f2-46ae-a5ef-90ce7dec02c7 req-9e6d4f6d-e559-4cab-8e99-c1da99e818ae tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Calling delete_port for c68cea2d-169c-4346-87ef-27549285cb6b owned by compute:nova {{(pid=91830) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 25 17:16:31.095276 dv-cinder-790492-4-iscsi neutron-server[91829]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1cf92192-5e44-4ae2-bb9c-0a188c744533 req-8cfba0ed-788c-4018-ac1b-a5a998ada03d tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=91829) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} May 25 17:16:31.096819 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-1cf92192-5e44-4ae2-bb9c-0a188c744533 req-8cfba0ed-788c-4018-ac1b-a5a998ada03d tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] 10.222.0.62 "GET /v2.0/ports?device_id=6e10cbf6-87b6-452f-80e6-c8bd2ce073db HTTP/1.1" status: 200 len: 946 time: 0.0845916 May 25 17:16:31.144449 dv-cinder-790492-4-iscsi neutron-server[91829]: INFO neutron.wsgi [req-1cf92192-5e44-4ae2-bb9c-0a188c744533 req-4040d97a-d245-494d-beeb-c9599f3c4cae tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] 10.222.0.62 "GET /v2.0/security-groups?id=58fab80b-49b2-4bca-89e6-fef7473221ef&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0412617 May 25 17:16:31.218658 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [req-cf68c52e-42f2-46ae-a5ef-90ce7dec02c7 req-9e6d4f6d-e559-4cab-8e99-c1da99e818ae tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8757892955046', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8757892520924', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-27483019'] for port, after_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:16:31.223925 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-1c73f251-dfca-490a-a14c-4b69dbd0e3af tempest-VolumesNegativeTest-425728667 tempest-VolumesNegativeTest-425728667-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:16:31.270834 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9e6d4f6d-e559-4cab-8e99-c1da99e818ae tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Pushing event deleted for resources: {'Port': ['ID=c68cea2d-169c-4346-87ef-27549285cb6b,revision_number=None']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:16:31.297464 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-9e6d4f6d-e559-4cab-8e99-c1da99e818ae tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.073s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:16:31.346824 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.l3_dvrscheduler_db [req-cf68c52e-42f2-46ae-a5ef-90ce7dec02c7 req-9e6d4f6d-e559-4cab-8e99-c1da99e818ae tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] No DVR routers for this DVR port c68cea2d-169c-4346-87ef-27549285cb6b on host hv-cinder-79049 {{(pid=91830) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 25 17:16:31.349196 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [req-cf68c52e-42f2-46ae-a5ef-90ce7dec02c7 req-9e6d4f6d-e559-4cab-8e99-c1da99e818ae tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-178712'] for port, before_response {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:16:31.362158 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [req-cf68c52e-42f2-46ae-a5ef-90ce7dec02c7 req-9e6d4f6d-e559-4cab-8e99-c1da99e818ae tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] 10.222.0.32 "DELETE /v2.0/ports/c68cea2d-169c-4346-87ef-27549285cb6b HTTP/1.1" status: 204 len: 173 time: 0.7569180 May 25 17:16:31.372875 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '6e10cbf6-87b6-452f-80e6-c8bd2ce073db', 'name': 'network-vif-deleted', 'tag': 'c68cea2d-169c-4346-87ef-27549285cb6b'}] {{(pid=91830) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} May 25 17:16:31.419282 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '6e10cbf6-87b6-452f-80e6-c8bd2ce073db', 'name': 'network-vif-deleted', 'tag': 'c68cea2d-169c-4346-87ef-27549285cb6b', 'status': 'completed', 'code': 200} May 25 17:16:32.240174 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.wsgi [-] (91830) accepted ('10.222.0.62', 39776) {{(pid=91830) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:16:32.457167 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.plugins.ml2.plugin [None req-e3e22376-e241-438c-b2f4-c2bd6ead386f tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Deleting port 30ba6fd4-41df-4530-8e1d-306e49a95743 {{(pid=91830) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 25 17:16:32.457508 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-e3e22376-e241-438c-b2f4-c2bd6ead386f tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8757892952899'] for port, before_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:16:32.574174 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-e3e22376-e241-438c-b2f4-c2bd6ead386f tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-683770'] for port, precommit_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:16:32.574499 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-e3e22376-e241-438c-b2f4-c2bd6ead386f tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:16:32.696648 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.plugins.ml2.plugin [None req-e3e22376-e241-438c-b2f4-c2bd6ead386f tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Calling delete_port for 30ba6fd4-41df-4530-8e1d-306e49a95743 owned by network:floatingip {{(pid=91830) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 25 17:16:32.812750 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-e3e22376-e241-438c-b2f4-c2bd6ead386f tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8757892955046', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8757892520924', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-27483019'] for port, after_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:16:32.817773 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-a5cb100a-fc0f-4f4b-9097-c93df1368518 tempest-TestShelveInstance-1742602899 tempest-TestShelveInstance-1742602899-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:16:32.861635 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e3e22376-e241-438c-b2f4-c2bd6ead386f tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Pushing event deleted for resources: {'Port': ['ID=30ba6fd4-41df-4530-8e1d-306e49a95743,revision_number=None']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:16:32.893528 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-e3e22376-e241-438c-b2f4-c2bd6ead386f tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.076s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:16:32.954352 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-e3e22376-e241-438c-b2f4-c2bd6ead386f tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Notify callbacks [] for floatingip, after_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:16:32.968320 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-e3e22376-e241-438c-b2f4-c2bd6ead386f tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-178712'] for floatingip, before_response {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:16:32.969438 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [None req-e3e22376-e241-438c-b2f4-c2bd6ead386f tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] 10.222.0.62 "DELETE /v2.0/floatingips/c1e3ebd3-1b86-4539-8592-0028e75cf6d4 HTTP/1.1" status: 204 len: 168 time: 0.7283025 May 25 17:16:33.340865 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.rpc [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Device c68cea2d-169c-4346-87ef-27549285cb6b no longer exists at agent hyperv_hv-cinder-79049 {{(pid=91831) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 25 17:16:33.381972 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.plugin [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] No Port match for: c68cea2d-169c-4346-87ef-27549285cb6b {{(pid=91831) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}} May 25 17:16:33.382381 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.rpc [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Device c68cea2d-169c-4346-87ef-27549285cb6b not bound to the agent host hv-cinder-79049 {{(pid=91831) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 25 17:16:34.361619 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.wsgi [-] (91830) accepted ('10.222.0.62', 39790) {{(pid=91830) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:16:34.431235 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-7cd0e68a-3e58-4d4d-bbd9-c185c37cb1a6 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Notify callbacks [] for security_group, before_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:16:34.461999 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-7cd0e68a-3e58-4d4d-bbd9-c185c37cb1a6 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Notify callbacks [] for security_group, precommit_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:16:34.525548 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-7cd0e68a-3e58-4d4d-bbd9-c185c37cb1a6 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-640836'] for security_group, after_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:16:34.529171 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-315c3727-21d4-4a87-9945-88ddf7d59291 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:16:34.544456 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7cd0e68a-3e58-4d4d-bbd9-c185c37cb1a6 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=58fab80b-49b2-4bca-89e6-fef7473221ef,revision_number=None']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:16:34.547262 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-7cd0e68a-3e58-4d4d-bbd9-c185c37cb1a6 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.018s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:16:34.555153 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-7cd0e68a-3e58-4d4d-bbd9-c185c37cb1a6 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Notify callbacks [] for security_group, before_response {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:16:34.556248 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [None req-7cd0e68a-3e58-4d4d-bbd9-c185c37cb1a6 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] 10.222.0.62 "DELETE /v2.0/security-groups/58fab80b-49b2-4bca-89e6-fef7473221ef HTTP/1.1" status: 204 len: 168 time: 0.1936533 May 25 17:16:35.635405 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.wsgi [-] (91830) accepted ('10.222.0.62', 39800) {{(pid=91830) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:16:36.371089 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-272ae87d-d098-42f9-863c-69c5060f22cc admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-679979'] for router_interface, before_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:16:36.670178 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:16:36.773140 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.plugins.ml2.plugin [None req-272ae87d-d098-42f9-863c-69c5060f22cc admin admin] Deleting port 4972e3a9-91eb-48ce-8b7b-b0906822cebf {{(pid=91830) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 25 17:16:36.773726 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-272ae87d-d098-42f9-863c-69c5060f22cc admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8757892952899'] for port, before_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:16:36.893255 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.plugins.ml2.db [None req-272ae87d-d098-42f9-863c-69c5060f22cc admin admin] For port 4972e3a9-91eb-48ce-8b7b-b0906822cebf, host dv-cinder-790492-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-790492-4-iscsi',level=0,port_id=4972e3a9-91eb-48ce-8b7b-b0906822cebf,segment=NetworkSegment(50ed67e9-f8d3-4927-b257-bd17654cce34),segment_id=50ed67e9-f8d3-4927-b257-bd17654cce34)] {{(pid=91830) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 17:16:36.893596 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-272ae87d-d098-42f9-863c-69c5060f22cc admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-683770'] for port, precommit_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:16:37.019885 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.plugins.ml2.plugin [None req-272ae87d-d098-42f9-863c-69c5060f22cc admin admin] Calling delete_port for 4972e3a9-91eb-48ce-8b7b-b0906822cebf owned by network:router_interface {{(pid=91830) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 25 17:16:37.145396 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.db.agents_db [None req-504cb04f-4543-46c1-8db7-349e21db7634 None None] Agent healthcheck: found 6 active agents {{(pid=91832) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} May 25 17:16:37.164120 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-272ae87d-d098-42f9-863c-69c5060f22cc admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8757892955046', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8757892520924', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-27483019'] for port, after_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:16:37.168649 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-f9552585-c38c-4da1-905a-711bf8b5b7d1 tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:16:37.211679 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-272ae87d-d098-42f9-863c-69c5060f22cc admin admin] Pushing event deleted for resources: {'Port': ['ID=4972e3a9-91eb-48ce-8b7b-b0906822cebf,revision_number=None']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:16:37.215480 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-272ae87d-d098-42f9-863c-69c5060f22cc admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.047s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:16:37.484790 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-272ae87d-d098-42f9-863c-69c5060f22cc admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-551393', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-682171'] for router_interface, after_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:16:37.936204 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-272ae87d-d098-42f9-863c-69c5060f22cc admin admin] Router 269c6b7b-91cc-4880-9e6d-b8889bac29f6 has already been hosted by L3 agent a2d427c1-2d07-43e8-afbe-218c9f7d0445 {{(pid=91830) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 25 17:16:38.114512 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-272ae87d-d098-42f9-863c-69c5060f22cc admin admin] Notify agent at l3_agent.dv-cinder-790492-4-iscsi the message routers_updated {{(pid=91830) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 25 17:16:38.122819 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-43d9c066-d7e7-4500-9292-1c090accc04d None None] Sync routers for ids ['269c6b7b-91cc-4880-9e6d-b8889bac29f6'] in dv-cinder-790492-4-iscsi {{(pid=91831) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 25 17:16:38.127490 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [None req-272ae87d-d098-42f9-863c-69c5060f22cc admin admin] 10.222.0.62 "PUT /v2.0/routers/269c6b7b-91cc-4880-9e6d-b8889bac29f6/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 2.4910340 May 25 17:16:38.129989 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.wsgi [-] (91830) accepted ('10.222.0.62', 39812) {{(pid=91830) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:16:38.132428 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.l3_dvrscheduler_db [None req-43d9c066-d7e7-4500-9292-1c090accc04d None None] Routers {'269c6b7b-91cc-4880-9e6d-b8889bac29f6'} bound to L3 agent in host dv-cinder-790492-4-iscsi {{(pid=91831) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 17:16:38.133042 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.l3_hamode_db [None req-43d9c066-d7e7-4500-9292-1c090accc04d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-790492-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-05-25T16:50:28Z,description=,heartbeat_timestamp=2021-05-25T17:16:28Z,host='dv-cinder-790492-4-iscsi',id=a2d427c1-2d07-43e8-afbe-218c9f7d0445,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T16:50:28Z,topic='l3_agent')) {'router_ids': ['269c6b7b-91cc-4880-9e6d-b8889bac29f6'], 'active': True} {{(pid=91831) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 17:16:38.310488 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-8cb10f27-1c32-4bb8-be60-2857bacc9ae8 admin admin] Notify callbacks [] for router, before_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:16:38.312130 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.l3_dvr_db [None req-43d9c066-d7e7-4500-9292-1c090accc04d None None] Set router 269c6b7b-91cc-4880-9e6d-b8889bac29f6 gateway port host: dv-cinder-790492-4-iscsi {{(pid=91831) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 17:16:38.481154 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-8cb10f27-1c32-4bb8-be60-2857bacc9ae8 admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:16:38.553701 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.plugins.ml2.plugin [None req-8cb10f27-1c32-4bb8-be60-2857bacc9ae8 admin admin] Deleting port 2fef7852-acf7-462f-beee-5679d3df0ad2 {{(pid=91830) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 25 17:16:38.554079 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-8cb10f27-1c32-4bb8-be60-2857bacc9ae8 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8757892952899'] for port, before_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:16:38.594717 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.l3_hamode_db [None req-43d9c066-d7e7-4500-9292-1c090accc04d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '269c6b7b-91cc-4880-9e6d-b8889bac29f6', 'name': 'tempest-TestVolumeBootPattern-219116984-router', 'tenant_id': '5397bf60956945c3a2bf43c6b1aa614b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'external_fixed_ips': [{'subnet_id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'ip_address': '172.27.2.227'}], 'enable_snat': True}, 'gw_port_id': '2fef7852-acf7-462f-beee-5679d3df0ad2', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T17:07:09Z', 'updated_at': '2021-05-25T17:16:37Z', 'revision_number': 5, 'project_id': '5397bf60956945c3a2bf43c6b1aa614b', 'gw_port': {'id': '2fef7852-acf7-462f-beee-5679d3df0ad2', 'name': '', 'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'tenant_id': '', 'mac_address': 'fa:16:3e:35:b9:d0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '269c6b7b-91cc-4880-9e6d-b8889bac29f6', 'device_owner': 'network:router_gateway', 'standard_attr_id': 533, 'fixed_ips': [{'subnet_id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'ip_address': '172.27.2.227', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790492-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:07:09Z', 'updated_at': '2021-05-25T17:07:16Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-790492-4-iscsi'}], 'dv-cinder-790492-4-iscsi', False) {} {{(pid=91831) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 17:16:38.598465 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-43d9c066-d7e7-4500-9292-1c090accc04d None None] Checking router: 269c6b7b-91cc-4880-9e6d-b8889bac29f6 for host: dv-cinder-790492-4-iscsi {{(pid=91831) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 25 17:16:38.606495 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.l3_dvrscheduler_db [None req-43d9c066-d7e7-4500-9292-1c090accc04d None None] Routers {'269c6b7b-91cc-4880-9e6d-b8889bac29f6'} bound to L3 agent in host dv-cinder-790492-4-iscsi {{(pid=91831) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 17:16:38.607094 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.l3_hamode_db [None req-43d9c066-d7e7-4500-9292-1c090accc04d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-790492-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-05-25T16:50:28Z,description=,heartbeat_timestamp=2021-05-25T17:16:28Z,host='dv-cinder-790492-4-iscsi',id=a2d427c1-2d07-43e8-afbe-218c9f7d0445,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T16:50:28Z,topic='l3_agent')) {'router_ids': ['269c6b7b-91cc-4880-9e6d-b8889bac29f6'], 'active': True} {{(pid=91831) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 17:16:38.674260 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.plugins.ml2.db [None req-8cb10f27-1c32-4bb8-be60-2857bacc9ae8 admin admin] For port 2fef7852-acf7-462f-beee-5679d3df0ad2, host dv-cinder-790492-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-790492-4-iscsi',level=0,port_id=2fef7852-acf7-462f-beee-5679d3df0ad2,segment=NetworkSegment(414a8468-1d66-4792-9e81-d8ac5ccf1512),segment_id=414a8468-1d66-4792-9e81-d8ac5ccf1512)] {{(pid=91830) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 17:16:38.674617 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-8cb10f27-1c32-4bb8-be60-2857bacc9ae8 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-683770'] for port, precommit_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:16:38.794103 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.l3_dvr_db [None req-43d9c066-d7e7-4500-9292-1c090accc04d None None] Set router 269c6b7b-91cc-4880-9e6d-b8889bac29f6 gateway port host: None {{(pid=91831) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 17:16:38.801369 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.plugins.ml2.plugin [None req-8cb10f27-1c32-4bb8-be60-2857bacc9ae8 admin admin] Calling delete_port for 2fef7852-acf7-462f-beee-5679d3df0ad2 owned by network:router_gateway {{(pid=91830) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 25 17:16:38.902225 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.l3_hamode_db [None req-43d9c066-d7e7-4500-9292-1c090accc04d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '269c6b7b-91cc-4880-9e6d-b8889bac29f6', 'name': 'tempest-TestVolumeBootPattern-219116984-router', 'tenant_id': '5397bf60956945c3a2bf43c6b1aa614b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T17:07:09Z', 'updated_at': '2021-05-25T17:16:38Z', 'revision_number': 6, 'project_id': '5397bf60956945c3a2bf43c6b1aa614b', 'gw_port_host': None}], 'dv-cinder-790492-4-iscsi', False) {} {{(pid=91831) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 17:16:38.906226 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-43d9c066-d7e7-4500-9292-1c090accc04d None None] The sync data for ids ['269c6b7b-91cc-4880-9e6d-b8889bac29f6'] in dv-cinder-790492-4-iscsi is: [{'id': '269c6b7b-91cc-4880-9e6d-b8889bac29f6', 'name': 'tempest-TestVolumeBootPattern-219116984-router', 'tenant_id': '5397bf60956945c3a2bf43c6b1aa614b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T17:07:09Z', 'updated_at': '2021-05-25T17:16:38Z', 'revision_number': 6, 'project_id': '5397bf60956945c3a2bf43c6b1aa614b', 'gw_port_host': None}] {{(pid=91831) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 25 17:16:38.948302 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-8cb10f27-1c32-4bb8-be60-2857bacc9ae8 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8757892955046', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8757892520924', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-27483019'] for port, after_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:16:38.952116 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-e3e22376-e241-438c-b2f4-c2bd6ead386f tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:16:38.996837 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8cb10f27-1c32-4bb8-be60-2857bacc9ae8 admin admin] Pushing event deleted for resources: {'Port': ['ID=2fef7852-acf7-462f-beee-5679d3df0ad2,revision_number=None']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:16:39.000318 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-8cb10f27-1c32-4bb8-be60-2857bacc9ae8 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.048s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:16:39.192183 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-8cb10f27-1c32-4bb8-be60-2857bacc9ae8 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-683062'] for router_gateway, after_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:16:39.366875 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-8cb10f27-1c32-4bb8-be60-2857bacc9ae8 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-684987', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-31024'] for router, precommit_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:16:39.369042 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-8cb10f27-1c32-4bb8-be60-2857bacc9ae8 admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:16:39.391370 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-8cb10f27-1c32-4bb8-be60-2857bacc9ae8 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-685959'] for router, after_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:16:39.391903 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-8cb10f27-1c32-4bb8-be60-2857bacc9ae8 admin admin] Fanout notify agent at l3_agent the message router_deleted on router 269c6b7b-91cc-4880-9e6d-b8889bac29f6 {{(pid=91830) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}} May 25 17:16:39.404109 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-8cb10f27-1c32-4bb8-be60-2857bacc9ae8 admin admin] Notify callbacks [] for router, before_response {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:16:39.405213 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [None req-8cb10f27-1c32-4bb8-be60-2857bacc9ae8 admin admin] 10.222.0.62 "DELETE /v2.0/routers/269c6b7b-91cc-4880-9e6d-b8889bac29f6 HTTP/1.1" status: 204 len: 168 time: 1.2743366 May 25 17:16:39.408303 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.wsgi [-] (91830) accepted ('10.222.0.62', 39818) {{(pid=91830) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:16:39.469198 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.db_base_plugin_v2 [None req-a293a522-8344-4521-9c8c-c2c0d9589e1f admin admin] Deleting subnet f5599a2e-9942-4423-a1ac-67e9b2650770 {{(pid=91830) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}} May 25 17:16:39.472537 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-a293a522-8344-4521-9c8c-c2c0d9589e1f admin admin] Notify callbacks [] for subnet, before_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:16:39.520945 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-a293a522-8344-4521-9c8c-c2c0d9589e1f admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-28085025'] for subnet, precommit_delete_associations {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:16:39.597377 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-a293a522-8344-4521-9c8c-c2c0d9589e1f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3856586'] for subnet, precommit_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:16:39.852468 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-a293a522-8344-4521-9c8c-c2c0d9589e1f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3857535', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55886', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-28085112', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1152740'] for subnet, after_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:16:39.856364 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-1a71fb0a-4a65-4e62-975b-7c6e874df1d4 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:16:39.891413 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a293a522-8344-4521-9c8c-c2c0d9589e1f admin admin] Pushing event deleted for resources: {'Subnet': ['ID=f5599a2e-9942-4423-a1ac-67e9b2650770,revision_number=None']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:16:39.894664 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-a293a522-8344-4521-9c8c-c2c0d9589e1f admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.038s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:16:39.897198 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-a293a522-8344-4521-9c8c-c2c0d9589e1f admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-551373'] for subnet, before_response {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:16:39.902917 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0c4050b6-46d8-4fad-a14c-500c9e90a716 None None] Network 17a0e39e-1e1f-4550-b28b-d5ae3bdca362 requested from dv-cinder-790492-4-iscsi {{(pid=91831) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} May 25 17:16:39.904001 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [None req-a293a522-8344-4521-9c8c-c2c0d9589e1f admin admin] 10.222.0.62 "DELETE /v2.0/subnets/f5599a2e-9942-4423-a1ac-67e9b2650770 HTTP/1.1" status: 204 len: 168 time: 0.4947445 May 25 17:16:39.906412 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.wsgi [-] (91830) accepted ('10.222.0.62', 39822) {{(pid=91830) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:16:40.012416 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-234d8844-0525-458c-863a-93952ca69457 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3867326'] for network, before_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:16:40.088151 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.plugins.ml2.plugin [None req-234d8844-0525-458c-863a-93952ca69457 admin admin] Deleting port 3b3711a7-5c0c-4ba2-9c64-ab0275cc49da {{(pid=91830) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 25 17:16:40.088486 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-234d8844-0525-458c-863a-93952ca69457 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8757892952899'] for port, before_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:16:40.161478 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d11cab15-2324-4023-960c-7a12b933120b None None] DHCP port deletion for 17a0e39e-1e1f-4550-b28b-d5ae3bdca362 request from dv-cinder-790492-4-iscsi {{(pid=91831) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} May 25 17:16:40.191772 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.plugins.ml2.db [None req-234d8844-0525-458c-863a-93952ca69457 admin admin] For port 3b3711a7-5c0c-4ba2-9c64-ab0275cc49da, host dv-cinder-790492-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-790492-4-iscsi',level=0,port_id=3b3711a7-5c0c-4ba2-9c64-ab0275cc49da,segment=NetworkSegment(50ed67e9-f8d3-4927-b257-bd17654cce34),segment_id=50ed67e9-f8d3-4927-b257-bd17654cce34)] {{(pid=91830) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 17:16:40.192131 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-234d8844-0525-458c-863a-93952ca69457 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-683770'] for port, precommit_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:16:40.225803 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.plugin [None req-d11cab15-2324-4023-960c-7a12b933120b None None] Deleting port 3b3711a7-5c0c-4ba2-9c64-ab0275cc49da {{(pid=91831) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 25 17:16:40.226219 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-d11cab15-2324-4023-960c-7a12b933120b None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8757892952899'] for port, before_delete {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:16:40.239313 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.rpc [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Device 4972e3a9-91eb-48ce-8b7b-b0906822cebf no longer exists at agent ovs-agent-dv-cinder-790492-4-iscsi {{(pid=91831) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 25 17:16:40.279367 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.plugin [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] No Port match for: 4972e3a9-91eb-48ce-8b7b-b0906822cebf {{(pid=91831) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}} May 25 17:16:40.279676 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.rpc [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Device 4972e3a9-91eb-48ce-8b7b-b0906822cebf not bound to the agent host dv-cinder-790492-4-iscsi {{(pid=91831) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 25 17:16:40.280023 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.rpc [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Device 3b3711a7-5c0c-4ba2-9c64-ab0275cc49da no longer exists at agent ovs-agent-dv-cinder-790492-4-iscsi {{(pid=91831) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 25 17:16:40.318221 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.plugins.ml2.plugin [None req-234d8844-0525-458c-863a-93952ca69457 admin admin] Calling delete_port for 3b3711a7-5c0c-4ba2-9c64-ab0275cc49da owned by network:dhcp {{(pid=91830) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 25 17:16:40.364466 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-234d8844-0525-458c-863a-93952ca69457 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8757892955046', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8757892520924', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-27483019'] for port, after_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:16:40.369062 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-0935f172-8e49-445a-962d-f389193256be admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:16:40.408249 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.db [None req-d11cab15-2324-4023-960c-7a12b933120b None None] For port 3b3711a7-5c0c-4ba2-9c64-ab0275cc49da, host dv-cinder-790492-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-790492-4-iscsi',level=0,port_id=3b3711a7-5c0c-4ba2-9c64-ab0275cc49da,segment=NetworkSegment(50ed67e9-f8d3-4927-b257-bd17654cce34),segment_id=50ed67e9-f8d3-4927-b257-bd17654cce34)] {{(pid=91831) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 17:16:40.408681 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-d11cab15-2324-4023-960c-7a12b933120b None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-683770'] for port, precommit_delete {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:16:40.414199 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-234d8844-0525-458c-863a-93952ca69457 admin admin] Pushing event deleted for resources: {'Port': ['ID=3b3711a7-5c0c-4ba2-9c64-ab0275cc49da,revision_number=None']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:16:40.415998 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.l3_dvrscheduler_db [None req-234d8844-0525-458c-863a-93952ca69457 admin admin] No DVR routers for this DVR port 3b3711a7-5c0c-4ba2-9c64-ab0275cc49da on host dv-cinder-790492-4-iscsi {{(pid=91830) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 25 17:16:40.417488 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-234d8844-0525-458c-863a-93952ca69457 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.048s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:16:40.419879 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.db [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] No active binding found for port 3b3711a7-5c0c-4ba2-9c64-ab0275cc49da {{(pid=91831) get_port_binding_host /opt/stack/neutron/neutron/plugins/ml2/db.py:224}} May 25 17:16:40.419879 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.rpc [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Device 3b3711a7-5c0c-4ba2-9c64-ab0275cc49da not bound to the agent host dv-cinder-790492-4-iscsi {{(pid=91831) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 25 17:16:40.420208 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.rpc [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Device 2fef7852-acf7-462f-beee-5679d3df0ad2 no longer exists at agent ovs-agent-dv-cinder-790492-4-iscsi {{(pid=91831) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 25 17:16:40.532577 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-234d8844-0525-458c-863a-93952ca69457 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3858245', 'neutron.services.segments.db._delete_segments_for_network-8757892982492'] for network, precommit_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:16:40.545365 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.services.segments.db [None req-234d8844-0525-458c-863a-93952ca69457 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['17a0e39e-1e1f-4550-b28b-d5ae3bdca362']}} {{(pid=91830) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 17:16:40.553726 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.plugin [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] No Port match for: 2fef7852-acf7-462f-beee-5679d3df0ad2 {{(pid=91831) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}} May 25 17:16:40.554100 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.rpc [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Device 2fef7852-acf7-462f-beee-5679d3df0ad2 not bound to the agent host dv-cinder-790492-4-iscsi {{(pid=91831) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 25 17:16:40.558500 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.services.segments.db [None req-234d8844-0525-458c-863a-93952ca69457 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '50ed67e9-f8d3-4927-b257-bd17654cce34') {'for_net_delete': True} {{(pid=91830) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 17:16:40.558831 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.services.segments.db [None req-234d8844-0525-458c-863a-93952ca69457 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '50ed67e9-f8d3-4927-b257-bd17654cce34') {} {{(pid=91830) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 17:16:40.564556 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.plugin [None req-d11cab15-2324-4023-960c-7a12b933120b None None] Calling delete_port for 3b3711a7-5c0c-4ba2-9c64-ab0275cc49da owned by network:dhcp {{(pid=91831) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 25 17:16:40.571908 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-234d8844-0525-458c-863a-93952ca69457 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8757892991389', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-28085034'] for segment, before_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:16:40.592034 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-234d8844-0525-458c-863a-93952ca69457 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3809789'] for segment, precommit_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:16:40.598180 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-234d8844-0525-458c-863a-93952ca69457 admin admin] Releasing vlan 657 on physical network physnet1 to pool {{(pid=91830) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 25 17:16:40.598533 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-234d8844-0525-458c-863a-93952ca69457 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3809789', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-27483102'] for segment, after_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:16:40.606649 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-d11cab15-2324-4023-960c-7a12b933120b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8757892955046', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8757892520924'] for port, after_delete {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:16:40.610234 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [None req-11bc4dd5-ae61-44ef-93dc-2365d150821b None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:16:40.655984 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d11cab15-2324-4023-960c-7a12b933120b None None] Pushing event deleted for resources: {'Port': ['ID=3b3711a7-5c0c-4ba2-9c64-ab0275cc49da,revision_number=None']} {{(pid=91831) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:16:40.658963 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d11cab15-2324-4023-960c-7a12b933120b None None] No DVR routers for this DVR port 3b3711a7-5c0c-4ba2-9c64-ab0275cc49da on host dv-cinder-790492-4-iscsi {{(pid=91831) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 25 17:16:40.668137 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d11cab15-2324-4023-960c-7a12b933120b None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91831) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:16:40.668721 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d11cab15-2324-4023-960c-7a12b933120b None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91831) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:16:40.669050 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d11cab15-2324-4023-960c-7a12b933120b None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91831) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:16:40.669383 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d11cab15-2324-4023-960c-7a12b933120b None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91831) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:16:40.669697 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d11cab15-2324-4023-960c-7a12b933120b None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91831) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:16:40.670050 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d11cab15-2324-4023-960c-7a12b933120b None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91831) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:16:40.670369 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d11cab15-2324-4023-960c-7a12b933120b None None] Version for resource type QosPolicy changed None to 1.8 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91831) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:16:40.670682 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d11cab15-2324-4023-960c-7a12b933120b None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91831) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:16:40.670997 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d11cab15-2324-4023-960c-7a12b933120b None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91831) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:16:40.671308 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d11cab15-2324-4023-960c-7a12b933120b None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91831) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:16:40.671616 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d11cab15-2324-4023-960c-7a12b933120b None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91831) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:16:40.671925 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d11cab15-2324-4023-960c-7a12b933120b None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-790492-4-iscsi {{(pid=91831) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} May 25 17:16:40.675663 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [None req-d11cab15-2324-4023-960c-7a12b933120b None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.065s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:16:40.701454 dv-cinder-790492-4-iscsi neutron-server[91830]: Traceback (most recent call last): May 25 17:16:40.701454 dv-cinder-790492-4-iscsi neutron-server[91830]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 25 17:16:40.701454 dv-cinder-790492-4-iscsi neutron-server[91830]: timer() May 25 17:16:40.701454 dv-cinder-790492-4-iscsi neutron-server[91830]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 25 17:16:40.701454 dv-cinder-790492-4-iscsi neutron-server[91830]: cb(*args, **kw) May 25 17:16:40.701454 dv-cinder-790492-4-iscsi neutron-server[91830]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper May 25 17:16:40.701454 dv-cinder-790492-4-iscsi neutron-server[91830]: return func(*args, **kwargs) May 25 17:16:40.701454 dv-cinder-790492-4-iscsi neutron-server[91830]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 25 17:16:40.701454 dv-cinder-790492-4-iscsi neutron-server[91830]: self._notify() May 25 17:16:40.701454 dv-cinder-790492-4-iscsi neutron-server[91830]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 25 17:16:40.701454 dv-cinder-790492-4-iscsi neutron-server[91830]: self.callback(batched_events) May 25 17:16:40.701454 dv-cinder-790492-4-iscsi neutron-server[91830]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 25 17:16:40.701454 dv-cinder-790492-4-iscsi neutron-server[91830]: event.method(event) May 25 17:16:40.701454 dv-cinder-790492-4-iscsi neutron-server[91830]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 25 17:16:40.701454 dv-cinder-790492-4-iscsi neutron-server[91830]: aggregate_id = self._get_aggregate_id(event.segment_id) May 25 17:16:40.701454 dv-cinder-790492-4-iscsi neutron-server[91830]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 25 17:16:40.701454 dv-cinder-790492-4-iscsi neutron-server[91830]: aggregate_uuid = self.p_client.list_aggregates( May 25 17:16:40.701454 dv-cinder-790492-4-iscsi neutron-server[91830]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 25 17:16:40.701454 dv-cinder-790492-4-iscsi neutron-server[91830]: return f(self, *a, **k) May 25 17:16:40.701454 dv-cinder-790492-4-iscsi neutron-server[91830]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 25 17:16:40.701454 dv-cinder-790492-4-iscsi neutron-server[91830]: return self._get(url).json() May 25 17:16:40.701454 dv-cinder-790492-4-iscsi neutron-server[91830]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 25 17:16:40.701454 dv-cinder-790492-4-iscsi neutron-server[91830]: return self._client.get(url, endpoint_filter=self._ks_filter, May 25 17:16:40.701454 dv-cinder-790492-4-iscsi neutron-server[91830]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 25 17:16:40.701454 dv-cinder-790492-4-iscsi neutron-server[91830]: return self.request(url, 'GET', **kwargs) May 25 17:16:40.701454 dv-cinder-790492-4-iscsi neutron-server[91830]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 25 17:16:40.701454 dv-cinder-790492-4-iscsi neutron-server[91830]: base_url = self.get_endpoint(auth, allow=allow, May 25 17:16:40.701454 dv-cinder-790492-4-iscsi neutron-server[91830]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 25 17:16:40.701454 dv-cinder-790492-4-iscsi neutron-server[91830]: auth = self._auth_required(auth, 'determine endpoint URL') May 25 17:16:40.701454 dv-cinder-790492-4-iscsi neutron-server[91830]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 25 17:16:40.701454 dv-cinder-790492-4-iscsi neutron-server[91830]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 25 17:16:40.701454 dv-cinder-790492-4-iscsi neutron-server[91830]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 25 17:16:40.778300 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-234d8844-0525-458c-863a-93952ca69457 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3858252', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-640806', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-551400', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-683051'] for network, after_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:16:40.783705 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-234d8844-0525-458c-863a-93952ca69457 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-551373'] for network, before_response {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:16:40.786052 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:16:40.811176 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-234d8844-0525-458c-863a-93952ca69457 admin admin] Pushing event deleted for resources: {'Network': ['ID=17a0e39e-1e1f-4550-b28b-d5ae3bdca362,revision_number=None']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:16:40.813760 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-234d8844-0525-458c-863a-93952ca69457 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.028s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:16:40.824136 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [None req-234d8844-0525-458c-863a-93952ca69457 admin admin] 10.222.0.62 "DELETE /v2.0/networks/17a0e39e-1e1f-4550-b28b-d5ae3bdca362 HTTP/1.1" status: 204 len: 168 time: 0.9167125 May 25 17:16:40.827151 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.wsgi [-] (91830) accepted ('10.222.0.62', 39826) {{(pid=91830) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:16:41.366930 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-8cb1fe29-828e-40b5-9675-f5c2ba747d4e admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-679979'] for router_interface, before_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:16:41.774933 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.plugins.ml2.plugin [None req-8cb1fe29-828e-40b5-9675-f5c2ba747d4e admin admin] Deleting port 5cd66991-16ba-46db-b805-74a3af76a470 {{(pid=91830) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 25 17:16:41.775189 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-8cb1fe29-828e-40b5-9675-f5c2ba747d4e admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8757892952899'] for port, before_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:16:41.894952 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.plugins.ml2.db [None req-8cb1fe29-828e-40b5-9675-f5c2ba747d4e admin admin] For port 5cd66991-16ba-46db-b805-74a3af76a470, host dv-cinder-790492-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-790492-4-iscsi',level=0,port_id=5cd66991-16ba-46db-b805-74a3af76a470,segment=NetworkSegment(f72d7b23-e2ca-41dd-83c7-c64087195ce8),segment_id=f72d7b23-e2ca-41dd-83c7-c64087195ce8)] {{(pid=91830) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 17:16:41.895319 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-8cb1fe29-828e-40b5-9675-f5c2ba747d4e admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-683770'] for port, precommit_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:16:42.020297 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.plugins.ml2.plugin [None req-8cb1fe29-828e-40b5-9675-f5c2ba747d4e admin admin] Calling delete_port for 5cd66991-16ba-46db-b805-74a3af76a470 owned by network:router_interface {{(pid=91830) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 25 17:16:42.278126 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-8cb1fe29-828e-40b5-9675-f5c2ba747d4e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8757892955046', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8757892520924', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-27483019'] for port, after_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:16:42.282564 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-e3c6847d-62e9-4952-9b33-3c2837c5eec8 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:16:42.354141 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8cb1fe29-828e-40b5-9675-f5c2ba747d4e admin admin] Pushing event deleted for resources: {'Port': ['ID=5cd66991-16ba-46db-b805-74a3af76a470,revision_number=None']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:16:42.356546 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-8cb1fe29-828e-40b5-9675-f5c2ba747d4e admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.074s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:16:42.594637 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-8cb1fe29-828e-40b5-9675-f5c2ba747d4e admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-551393', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-682171'] for router_interface, after_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:16:42.953324 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-8cb1fe29-828e-40b5-9675-f5c2ba747d4e admin admin] Router a31e34e2-420e-4dd6-820b-1ec7d895549e has already been hosted by L3 agent a2d427c1-2d07-43e8-afbe-218c9f7d0445 {{(pid=91830) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:127}} May 25 17:16:43.130565 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-8cb1fe29-828e-40b5-9675-f5c2ba747d4e admin admin] Notify agent at l3_agent.dv-cinder-790492-4-iscsi the message routers_updated {{(pid=91830) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:68}} May 25 17:16:43.138875 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-66875a8b-a808-4f65-af5a-c5ef06da0d48 None None] Sync routers for ids ['a31e34e2-420e-4dd6-820b-1ec7d895549e'] in dv-cinder-790492-4-iscsi {{(pid=91832) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} May 25 17:16:43.146712 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [None req-8cb1fe29-828e-40b5-9675-f5c2ba747d4e admin admin] 10.222.0.62 "PUT /v2.0/routers/a31e34e2-420e-4dd6-820b-1ec7d895549e/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 2.3185730 May 25 17:16:43.148442 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.db.l3_dvrscheduler_db [None req-66875a8b-a808-4f65-af5a-c5ef06da0d48 None None] Routers {'a31e34e2-420e-4dd6-820b-1ec7d895549e'} bound to L3 agent in host dv-cinder-790492-4-iscsi {{(pid=91832) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 17:16:43.149057 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.db.l3_hamode_db [None req-66875a8b-a808-4f65-af5a-c5ef06da0d48 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-790492-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-05-25T16:50:28Z,description=,heartbeat_timestamp=2021-05-25T17:16:28Z,host='dv-cinder-790492-4-iscsi',id=a2d427c1-2d07-43e8-afbe-218c9f7d0445,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T16:50:28Z,topic='l3_agent')) {'router_ids': ['a31e34e2-420e-4dd6-820b-1ec7d895549e'], 'active': True} {{(pid=91832) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 17:16:43.149234 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.wsgi [-] (91830) accepted ('10.222.0.62', 39832) {{(pid=91830) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:16:43.322136 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-6f3d74c6-1e5e-4271-81c1-3b94b2133390 admin admin] Notify callbacks [] for router, before_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:16:43.322472 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.db.l3_dvr_db [None req-66875a8b-a808-4f65-af5a-c5ef06da0d48 None None] Set router a31e34e2-420e-4dd6-820b-1ec7d895549e gateway port host: dv-cinder-790492-4-iscsi {{(pid=91832) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 17:16:43.606914 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-6f3d74c6-1e5e-4271-81c1-3b94b2133390 admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:16:43.609950 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.db.l3_hamode_db [None req-66875a8b-a808-4f65-af5a-c5ef06da0d48 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'a31e34e2-420e-4dd6-820b-1ec7d895549e', 'name': 'tempest-TestVolumeBootPattern-2097476481-router', 'tenant_id': 'ebceaa13caaa4258abf32e19141de493', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'external_fixed_ips': [{'subnet_id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'ip_address': '172.27.2.190'}], 'enable_snat': True}, 'gw_port_id': '4ee74cc9-30db-4402-aed3-82be47c1be1e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T17:07:16Z', 'updated_at': '2021-05-25T17:16:42Z', 'revision_number': 5, 'project_id': 'ebceaa13caaa4258abf32e19141de493', 'gw_port': {'id': '4ee74cc9-30db-4402-aed3-82be47c1be1e', 'name': '', 'network_id': '4364b6ab-4117-4a92-baeb-f5ee2f45bf74', 'tenant_id': '', 'mac_address': 'fa:16:3e:b9:81:81', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a31e34e2-420e-4dd6-820b-1ec7d895549e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 552, 'fixed_ips': [{'subnet_id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'ip_address': '172.27.2.190', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-790492-4-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-05-25T17:07:17Z', 'updated_at': '2021-05-25T17:07:24Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'b947e790-d731-4b63-afc4-4aa112afe0f6', 'cidr': '172.27.2.0/24', 'gateway_ip': '172.27.2.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-790492-4-iscsi'}], 'dv-cinder-790492-4-iscsi', False) {} {{(pid=91832) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 17:16:43.613818 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-66875a8b-a808-4f65-af5a-c5ef06da0d48 None None] Checking router: a31e34e2-420e-4dd6-820b-1ec7d895549e for host: dv-cinder-790492-4-iscsi {{(pid=91832) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} May 25 17:16:43.622119 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.db.l3_dvrscheduler_db [None req-66875a8b-a808-4f65-af5a-c5ef06da0d48 None None] Routers {'a31e34e2-420e-4dd6-820b-1ec7d895549e'} bound to L3 agent in host dv-cinder-790492-4-iscsi {{(pid=91832) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:422}} May 25 17:16:43.622722 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.db.l3_hamode_db [None req-66875a8b-a808-4f65-af5a-c5ef06da0d48 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-790492-4-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-05-25T16:50:28Z,description=,heartbeat_timestamp=2021-05-25T17:16:28Z,host='dv-cinder-790492-4-iscsi',id=a2d427c1-2d07-43e8-afbe-218c9f7d0445,load=0,resource_versions=,resources_synced=,started_at=2021-05-25T16:50:28Z,topic='l3_agent')) {'router_ids': ['a31e34e2-420e-4dd6-820b-1ec7d895549e'], 'active': True} {{(pid=91832) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 17:16:43.677120 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.plugins.ml2.plugin [None req-6f3d74c6-1e5e-4271-81c1-3b94b2133390 admin admin] Deleting port 4ee74cc9-30db-4402-aed3-82be47c1be1e {{(pid=91830) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 25 17:16:43.677494 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-6f3d74c6-1e5e-4271-81c1-3b94b2133390 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8757892952899'] for port, before_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:16:43.773111 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.db.l3_dvr_db [None req-66875a8b-a808-4f65-af5a-c5ef06da0d48 None None] Set router a31e34e2-420e-4dd6-820b-1ec7d895549e gateway port host: None {{(pid=91832) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:820}} May 25 17:16:43.800615 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.plugins.ml2.db [None req-6f3d74c6-1e5e-4271-81c1-3b94b2133390 admin admin] For port 4ee74cc9-30db-4402-aed3-82be47c1be1e, host dv-cinder-790492-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-790492-4-iscsi',level=0,port_id=4ee74cc9-30db-4402-aed3-82be47c1be1e,segment=NetworkSegment(414a8468-1d66-4792-9e81-d8ac5ccf1512),segment_id=414a8468-1d66-4792-9e81-d8ac5ccf1512)] {{(pid=91830) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 17:16:43.800972 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-6f3d74c6-1e5e-4271-81c1-3b94b2133390 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-683770'] for port, precommit_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:16:43.888405 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.db.l3_hamode_db [None req-66875a8b-a808-4f65-af5a-c5ef06da0d48 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'a31e34e2-420e-4dd6-820b-1ec7d895549e', 'name': 'tempest-TestVolumeBootPattern-2097476481-router', 'tenant_id': 'ebceaa13caaa4258abf32e19141de493', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T17:07:16Z', 'updated_at': '2021-05-25T17:16:43Z', 'revision_number': 6, 'project_id': 'ebceaa13caaa4258abf32e19141de493', 'gw_port_host': None}], 'dv-cinder-790492-4-iscsi', False) {} {{(pid=91832) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 17:16:43.892293 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-66875a8b-a808-4f65-af5a-c5ef06da0d48 None None] The sync data for ids ['a31e34e2-420e-4dd6-820b-1ec7d895549e'] in dv-cinder-790492-4-iscsi is: [{'id': 'a31e34e2-420e-4dd6-820b-1ec7d895549e', 'name': 'tempest-TestVolumeBootPattern-2097476481-router', 'tenant_id': 'ebceaa13caaa4258abf32e19141de493', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-05-25T17:07:16Z', 'updated_at': '2021-05-25T17:16:43Z', 'revision_number': 6, 'project_id': 'ebceaa13caaa4258abf32e19141de493', 'gw_port_host': None}] {{(pid=91832) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} May 25 17:16:43.935861 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.plugins.ml2.plugin [None req-6f3d74c6-1e5e-4271-81c1-3b94b2133390 admin admin] Calling delete_port for 4ee74cc9-30db-4402-aed3-82be47c1be1e owned by network:router_gateway {{(pid=91830) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 25 17:16:44.071732 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-6f3d74c6-1e5e-4271-81c1-3b94b2133390 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8757892955046', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8757892520924', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-27483019'] for port, after_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:16:44.075205 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-08f8e327-cbbf-4e2f-8f0d-d5f50cc5757d tempest-TestVolumeBootPattern-1167811377 tempest-TestVolumeBootPattern-1167811377-project] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:16:44.118548 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6f3d74c6-1e5e-4271-81c1-3b94b2133390 admin admin] Pushing event deleted for resources: {'Port': ['ID=4ee74cc9-30db-4402-aed3-82be47c1be1e,revision_number=None']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:16:44.121208 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-6f3d74c6-1e5e-4271-81c1-3b94b2133390 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.046s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:16:44.217052 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-6f3d74c6-1e5e-4271-81c1-3b94b2133390 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-683062'] for router_gateway, after_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:16:44.392425 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-6f3d74c6-1e5e-4271-81c1-3b94b2133390 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-684987', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-31024'] for router, precommit_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:16:44.394754 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-6f3d74c6-1e5e-4271-81c1-3b94b2133390 admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:16:44.417456 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-6f3d74c6-1e5e-4271-81c1-3b94b2133390 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network-685959'] for router, after_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:16:44.418008 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-6f3d74c6-1e5e-4271-81c1-3b94b2133390 admin admin] Fanout notify agent at l3_agent the message router_deleted on router a31e34e2-420e-4dd6-820b-1ec7d895549e {{(pid=91830) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:118}} May 25 17:16:44.430252 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-6f3d74c6-1e5e-4271-81c1-3b94b2133390 admin admin] Notify callbacks [] for router, before_response {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:16:44.432477 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [None req-6f3d74c6-1e5e-4271-81c1-3b94b2133390 admin admin] 10.222.0.62 "DELETE /v2.0/routers/a31e34e2-420e-4dd6-820b-1ec7d895549e HTTP/1.1" status: 204 len: 168 time: 1.2812402 May 25 17:16:44.433974 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.wsgi [-] (91830) accepted ('10.222.0.62', 39836) {{(pid=91830) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:16:44.492929 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.db_base_plugin_v2 [None req-6dabab54-1fba-4cd8-b3ed-67be907edcfb admin admin] Deleting subnet 6d7b3521-40af-42b0-b9ba-0605d0b34e3b {{(pid=91830) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1043}} May 25 17:16:44.495802 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-6dabab54-1fba-4cd8-b3ed-67be907edcfb admin admin] Notify callbacks [] for subnet, before_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:16:44.546118 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-6dabab54-1fba-4cd8-b3ed-67be907edcfb admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-28085025'] for subnet, precommit_delete_associations {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:16:44.623472 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-6dabab54-1fba-4cd8-b3ed-67be907edcfb admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-3856586'] for subnet, precommit_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:16:44.629540 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.rpc [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Device 5cd66991-16ba-46db-b805-74a3af76a470 no longer exists at agent ovs-agent-dv-cinder-790492-4-iscsi {{(pid=91831) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 25 17:16:44.665100 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.plugin [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] No Port match for: 5cd66991-16ba-46db-b805-74a3af76a470 {{(pid=91831) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}} May 25 17:16:44.665532 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.rpc [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Device 5cd66991-16ba-46db-b805-74a3af76a470 not bound to the agent host dv-cinder-790492-4-iscsi {{(pid=91831) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 25 17:16:44.880820 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-6dabab54-1fba-4cd8-b3ed-67be907edcfb admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-3857535', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55886', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-28085112', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-1152740'] for subnet, after_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:16:44.885198 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-f8a3338a-6824-491b-8482-a9c96ad06943 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:16:44.922165 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-6dabab54-1fba-4cd8-b3ed-67be907edcfb admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-551373'] for subnet, before_response {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:16:44.925362 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6dabab54-1fba-4cd8-b3ed-67be907edcfb admin admin] Pushing event deleted for resources: {'Subnet': ['ID=6d7b3521-40af-42b0-b9ba-0605d0b34e3b,revision_number=None']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:16:44.927132 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f509ca10-29cf-47ed-8192-876ccdafa1f4 None None] Network 3fa72d6e-1a8d-4d69-93de-30a32f8d5423 requested from dv-cinder-790492-4-iscsi {{(pid=91831) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} May 25 17:16:44.927671 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-6dabab54-1fba-4cd8-b3ed-67be907edcfb admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.043s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:16:44.934614 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [None req-6dabab54-1fba-4cd8-b3ed-67be907edcfb admin admin] 10.222.0.62 "DELETE /v2.0/subnets/6d7b3521-40af-42b0-b9ba-0605d0b34e3b HTTP/1.1" status: 204 len: 168 time: 0.4970949 May 25 17:16:44.934732 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.wsgi [-] (91830) accepted ('10.222.0.62', 39840) {{(pid=91830) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:16:45.042891 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-d3234e4c-5503-4296-93ac-5e7f2326cb70 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-3867326'] for network, before_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:16:45.113277 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.plugins.ml2.plugin [None req-d3234e4c-5503-4296-93ac-5e7f2326cb70 admin admin] Deleting port 421abc1f-bb97-4830-9969-bc5d30acd0d7 {{(pid=91830) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 25 17:16:45.113613 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-d3234e4c-5503-4296-93ac-5e7f2326cb70 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8757892952899'] for port, before_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:16:45.176808 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4b8d1210-e96e-4a1b-abf4-cf66ceb1bdc1 None None] DHCP port deletion for 3fa72d6e-1a8d-4d69-93de-30a32f8d5423 request from dv-cinder-790492-4-iscsi {{(pid=91831) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} May 25 17:16:45.243517 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.plugin [None req-4b8d1210-e96e-4a1b-abf4-cf66ceb1bdc1 None None] Deleting port 421abc1f-bb97-4830-9969-bc5d30acd0d7 {{(pid=91831) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1897}} May 25 17:16:45.243894 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-4b8d1210-e96e-4a1b-abf4-cf66ceb1bdc1 None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8757892952899'] for port, before_delete {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:16:45.311250 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.plugins.ml2.db [None req-d3234e4c-5503-4296-93ac-5e7f2326cb70 admin admin] For port 421abc1f-bb97-4830-9969-bc5d30acd0d7, host dv-cinder-790492-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-790492-4-iscsi',level=0,port_id=421abc1f-bb97-4830-9969-bc5d30acd0d7,segment=NetworkSegment(f72d7b23-e2ca-41dd-83c7-c64087195ce8),segment_id=f72d7b23-e2ca-41dd-83c7-c64087195ce8)] {{(pid=91830) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 17:16:45.311609 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-d3234e4c-5503-4296-93ac-5e7f2326cb70 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-683770'] for port, precommit_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:16:45.342966 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.db [None req-4b8d1210-e96e-4a1b-abf4-cf66ceb1bdc1 None None] For port 421abc1f-bb97-4830-9969-bc5d30acd0d7, host dv-cinder-790492-4-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-790492-4-iscsi',level=0,port_id=421abc1f-bb97-4830-9969-bc5d30acd0d7,segment=NetworkSegment(f72d7b23-e2ca-41dd-83c7-c64087195ce8),segment_id=f72d7b23-e2ca-41dd-83c7-c64087195ce8)] {{(pid=91831) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:75}} May 25 17:16:45.343364 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-4b8d1210-e96e-4a1b-abf4-cf66ceb1bdc1 None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-683770'] for port, precommit_delete {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:16:45.441476 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.plugins.ml2.plugin [None req-d3234e4c-5503-4296-93ac-5e7f2326cb70 admin admin] Calling delete_port for 421abc1f-bb97-4830-9969-bc5d30acd0d7 owned by network:dhcp {{(pid=91830) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 25 17:16:45.488213 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-d3234e4c-5503-4296-93ac-5e7f2326cb70 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8757892955046', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8757892520924', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-27483019'] for port, after_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:16:45.492951 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-1a8b5df0-7388-43a8-8146-2be4117358de service neutron] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:16:45.510275 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.plugin [None req-4b8d1210-e96e-4a1b-abf4-cf66ceb1bdc1 None None] Calling delete_port for 421abc1f-bb97-4830-9969-bc5d30acd0d7 owned by network:dhcp {{(pid=91831) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1970}} May 25 17:16:45.539862 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d3234e4c-5503-4296-93ac-5e7f2326cb70 admin admin] Pushing event deleted for resources: {'Port': ['ID=421abc1f-bb97-4830-9969-bc5d30acd0d7,revision_number=None']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:16:45.542089 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d3234e4c-5503-4296-93ac-5e7f2326cb70 admin admin] No DVR routers for this DVR port 421abc1f-bb97-4830-9969-bc5d30acd0d7 on host dv-cinder-790492-4-iscsi {{(pid=91830) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 25 17:16:45.543936 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-d3234e4c-5503-4296-93ac-5e7f2326cb70 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.051s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:16:45.554981 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-4b8d1210-e96e-4a1b-abf4-cf66ceb1bdc1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin.notify_sg_on_port_change-3832785', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-55894', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-551411', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8757892955046', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8757892520924'] for port, after_delete {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:16:45.558511 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [None req-ea0551dd-5aa4-4d4f-9f41-1d5509d14814 None None] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:16:45.601184 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4b8d1210-e96e-4a1b-abf4-cf66ceb1bdc1 None None] Pushing event deleted for resources: {'Port': ['ID=421abc1f-bb97-4830-9969-bc5d30acd0d7,revision_number=None']} {{(pid=91831) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:16:45.603984 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG oslo_concurrency.lockutils [None req-4b8d1210-e96e-4a1b-abf4-cf66ceb1bdc1 None None] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.045s {{(pid=91831) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:16:45.607755 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4b8d1210-e96e-4a1b-abf4-cf66ceb1bdc1 None None] No DVR routers for this DVR port 421abc1f-bb97-4830-9969-bc5d30acd0d7 on host dv-cinder-790492-4-iscsi {{(pid=91831) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} May 25 17:16:45.662835 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-d3234e4c-5503-4296-93ac-5e7f2326cb70 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-3858245', 'neutron.services.segments.db._delete_segments_for_network-8757892982492'] for network, precommit_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:16:45.675932 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.services.segments.db [None req-d3234e4c-5503-4296-93ac-5e7f2326cb70 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['3fa72d6e-1a8d-4d69-93de-30a32f8d5423']}} {{(pid=91830) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 17:16:45.687806 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.services.segments.db [None req-d3234e4c-5503-4296-93ac-5e7f2326cb70 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'f72d7b23-e2ca-41dd-83c7-c64087195ce8') {'for_net_delete': True} {{(pid=91830) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 17:16:45.688100 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.services.segments.db [None req-d3234e4c-5503-4296-93ac-5e7f2326cb70 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'f72d7b23-e2ca-41dd-83c7-c64087195ce8') {} {{(pid=91830) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} May 25 17:16:45.700203 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-d3234e4c-5503-4296-93ac-5e7f2326cb70 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8757892991389', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-28085034'] for segment, before_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:16:45.716266 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-d3234e4c-5503-4296-93ac-5e7f2326cb70 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3809789'] for segment, precommit_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:16:45.722287 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-d3234e4c-5503-4296-93ac-5e7f2326cb70 admin admin] Releasing vlan 687 on physical network physnet1 to pool {{(pid=91830) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} May 25 17:16:45.722670 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-d3234e4c-5503-4296-93ac-5e7f2326cb70 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-3809789', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-27483102'] for segment, after_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:16:45.735858 dv-cinder-790492-4-iscsi neutron-server[91830]: Traceback (most recent call last): May 25 17:16:45.735858 dv-cinder-790492-4-iscsi neutron-server[91830]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 25 17:16:45.735858 dv-cinder-790492-4-iscsi neutron-server[91830]: timer() May 25 17:16:45.735858 dv-cinder-790492-4-iscsi neutron-server[91830]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 25 17:16:45.735858 dv-cinder-790492-4-iscsi neutron-server[91830]: cb(*args, **kw) May 25 17:16:45.735858 dv-cinder-790492-4-iscsi neutron-server[91830]: File "/opt/stack/neutron/neutron/common/utils.py", line 905, in wrapper May 25 17:16:45.735858 dv-cinder-790492-4-iscsi neutron-server[91830]: return func(*args, **kwargs) May 25 17:16:45.735858 dv-cinder-790492-4-iscsi neutron-server[91830]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send May 25 17:16:45.735858 dv-cinder-790492-4-iscsi neutron-server[91830]: self._notify() May 25 17:16:45.735858 dv-cinder-790492-4-iscsi neutron-server[91830]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify May 25 17:16:45.735858 dv-cinder-790492-4-iscsi neutron-server[91830]: self.callback(batched_events) May 25 17:16:45.735858 dv-cinder-790492-4-iscsi neutron-server[91830]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications May 25 17:16:45.735858 dv-cinder-790492-4-iscsi neutron-server[91830]: event.method(event) May 25 17:16:45.735858 dv-cinder-790492-4-iscsi neutron-server[91830]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 379, in _delete_nova_inventory May 25 17:16:45.735858 dv-cinder-790492-4-iscsi neutron-server[91830]: aggregate_id = self._get_aggregate_id(event.segment_id) May 25 17:16:45.735858 dv-cinder-790492-4-iscsi neutron-server[91830]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 366, in _get_aggregate_id May 25 17:16:45.735858 dv-cinder-790492-4-iscsi neutron-server[91830]: aggregate_uuid = self.p_client.list_aggregates( May 25 17:16:45.735858 dv-cinder-790492-4-iscsi neutron-server[91830]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 57, in wrapper May 25 17:16:45.735858 dv-cinder-790492-4-iscsi neutron-server[91830]: return f(self, *a, **k) May 25 17:16:45.735858 dv-cinder-790492-4-iscsi neutron-server[91830]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 553, in list_aggregates May 25 17:16:45.735858 dv-cinder-790492-4-iscsi neutron-server[91830]: return self._get(url).json() May 25 17:16:45.735858 dv-cinder-790492-4-iscsi neutron-server[91830]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 189, in _get May 25 17:16:45.735858 dv-cinder-790492-4-iscsi neutron-server[91830]: return self._client.get(url, endpoint_filter=self._ks_filter, May 25 17:16:45.735858 dv-cinder-790492-4-iscsi neutron-server[91830]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get May 25 17:16:45.735858 dv-cinder-790492-4-iscsi neutron-server[91830]: return self.request(url, 'GET', **kwargs) May 25 17:16:45.735858 dv-cinder-790492-4-iscsi neutron-server[91830]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request May 25 17:16:45.735858 dv-cinder-790492-4-iscsi neutron-server[91830]: base_url = self.get_endpoint(auth, allow=allow, May 25 17:16:45.735858 dv-cinder-790492-4-iscsi neutron-server[91830]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint May 25 17:16:45.735858 dv-cinder-790492-4-iscsi neutron-server[91830]: auth = self._auth_required(auth, 'determine endpoint URL') May 25 17:16:45.735858 dv-cinder-790492-4-iscsi neutron-server[91830]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required May 25 17:16:45.735858 dv-cinder-790492-4-iscsi neutron-server[91830]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) May 25 17:16:45.735858 dv-cinder-790492-4-iscsi neutron-server[91830]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL May 25 17:16:45.812365 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-d3234e4c-5503-4296-93ac-5e7f2326cb70 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-3858252', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_payload_event-640806', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification_payload-551400', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-683051'] for network, after_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:16:45.816220 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [-] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:16:45.829007 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-d3234e4c-5503-4296-93ac-5e7f2326cb70 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-551373'] for network, before_response {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:16:45.838678 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d3234e4c-5503-4296-93ac-5e7f2326cb70 admin admin] Pushing event deleted for resources: {'Network': ['ID=3fa72d6e-1a8d-4d69-93de-30a32f8d5423,revision_number=None']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:16:45.842700 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-d3234e4c-5503-4296-93ac-5e7f2326cb70 admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.026s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:16:45.846066 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [None req-d3234e4c-5503-4296-93ac-5e7f2326cb70 admin admin] 10.222.0.62 "DELETE /v2.0/networks/3fa72d6e-1a8d-4d69-93de-30a32f8d5423 HTTP/1.1" status: 204 len: 168 time: 0.9102883 May 25 17:16:45.958881 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.wsgi [-] (91830) accepted ('10.222.0.62', 39846) {{(pid=91830) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:16:46.007065 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [None req-df6c5312-0748-4cdd-98e9-6b39638237cc admin admin] 10.222.0.62 "GET /v2.0/security-groups?tenant_id=5397bf60956945c3a2bf43c6b1aa614b&name=default HTTP/1.1" status: 200 len: 2979 time: 0.0469563 May 25 17:16:46.009347 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.wsgi [-] (91830) accepted ('10.222.0.62', 39850) {{(pid=91830) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:16:46.070651 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-540b44f8-1f8c-4fb9-9d49-19e2ea9f5d7d admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:16:46.095563 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-540b44f8-1f8c-4fb9-9d49-19e2ea9f5d7d admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:16:46.147014 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-540b44f8-1f8c-4fb9-9d49-19e2ea9f5d7d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-640836'] for security_group, after_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:16:46.150610 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-e40fe5a2-30a8-4b58-878f-3e7b748af96a admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:16:46.164979 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-540b44f8-1f8c-4fb9-9d49-19e2ea9f5d7d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=714f2890-bd30-467f-967a-8a9670a5bdb0,revision_number=None']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:16:46.168769 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-540b44f8-1f8c-4fb9-9d49-19e2ea9f5d7d admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.018s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:16:46.175172 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-540b44f8-1f8c-4fb9-9d49-19e2ea9f5d7d admin admin] Notify callbacks [] for security_group, before_response {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:16:46.175172 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [None req-540b44f8-1f8c-4fb9-9d49-19e2ea9f5d7d admin admin] 10.222.0.62 "DELETE /v2.0/security-groups/714f2890-bd30-467f-967a-8a9670a5bdb0 HTTP/1.1" status: 204 len: 168 time: 0.1632004 May 25 17:16:46.240954 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.rpc [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Device 4ee74cc9-30db-4402-aed3-82be47c1be1e no longer exists at agent ovs-agent-dv-cinder-790492-4-iscsi {{(pid=91831) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 25 17:16:46.275835 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.plugin [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] No Port match for: 4ee74cc9-30db-4402-aed3-82be47c1be1e {{(pid=91831) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}} May 25 17:16:46.276189 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.rpc [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Device 4ee74cc9-30db-4402-aed3-82be47c1be1e not bound to the agent host dv-cinder-790492-4-iscsi {{(pid=91831) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 25 17:16:46.276604 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.rpc [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Device 421abc1f-bb97-4830-9969-bc5d30acd0d7 no longer exists at agent ovs-agent-dv-cinder-790492-4-iscsi {{(pid=91831) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:243}} May 25 17:16:46.313970 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.plugin [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] No Port match for: 421abc1f-bb97-4830-9969-bc5d30acd0d7 {{(pid=91831) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2224}} May 25 17:16:46.314317 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron.plugins.ml2.rpc [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Device 421abc1f-bb97-4830-9969-bc5d30acd0d7 not bound to the agent host dv-cinder-790492-4-iscsi {{(pid=91831) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:251}} May 25 17:16:46.524185 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.wsgi [-] (91830) accepted ('10.222.0.62', 39858) {{(pid=91830) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:16:46.573035 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [None req-c6b169fb-f02b-4f48-a4e0-4f3b3432928a admin admin] 10.222.0.62 "GET /v2.0/security-groups?tenant_id=ebceaa13caaa4258abf32e19141de493&name=default HTTP/1.1" status: 200 len: 2979 time: 0.0476341 May 25 17:16:46.575363 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.wsgi [-] (91830) accepted ('10.222.0.62', 39862) {{(pid=91830) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:992}} May 25 17:16:46.632399 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-fd1b292a-f71b-40cc-899b-722b476a31cf admin admin] Notify callbacks [] for security_group, before_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:16:46.661475 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-fd1b292a-f71b-40cc-899b-722b476a31cf admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:16:46.712346 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-fd1b292a-f71b-40cc-899b-722b476a31cf admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-640836'] for security_group, after_delete {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:16:46.715710 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-c710aa0e-8f21-44c5-a7c8-39c7f77a6ae6 admin admin] Lock "event-dispatch" acquired by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: waited 0.000s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 25 17:16:46.726744 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fd1b292a-f71b-40cc-899b-722b476a31cf admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=a56427ce-fa79-41d7-bed3-5f8568d1a417,revision_number=None']} {{(pid=91830) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} May 25 17:16:46.730088 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG oslo_concurrency.lockutils [None req-fd1b292a-f71b-40cc-899b-722b476a31cf admin admin] Lock "event-dispatch" released by "neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.dispatch_events" :: held 0.014s {{(pid=91830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 25 17:16:46.733189 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron_lib.callbacks.manager [None req-fd1b292a-f71b-40cc-899b-722b476a31cf admin admin] Notify callbacks [] for security_group, before_response {{(pid=91830) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:16:46.734322 dv-cinder-790492-4-iscsi neutron-server[91830]: INFO neutron.wsgi [None req-fd1b292a-f71b-40cc-899b-722b476a31cf admin admin] 10.222.0.62 "DELETE /v2.0/security-groups/a56427ce-fa79-41d7-bed3-5f8568d1a417 HTTP/1.1" status: 204 len: 168 time: 0.1578746 May 25 17:16:55.346040 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-3e7e222b-2ec0-494f-9468-a27fc2746cc3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:16:57.741705 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-709cff70-1783-42de-8a81-03021984450b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:16:57.919043 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:16:58.672697 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-0a55eb4a-8b57-4233-84d6-6b423b4ed6db None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:17:00.291274 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-57f11b47-1f51-4191-b7c9-af248a48372c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:17:06.697648 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:17:14.144230 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.db.agents_db [None req-504cb04f-4543-46c1-8db7-349e21db7634 None None] Agent healthcheck: found 6 active agents {{(pid=91832) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} May 25 17:17:25.347279 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-d694e575-d16c-4032-9ff4-d0a739330260 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:17:27.742766 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-d6b62c99-d9a5-4e4c-a485-87f5274ba2af None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:17:27.920974 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:17:28.675711 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-0a55eb4a-8b57-4233-84d6-6b423b4ed6db None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:17:30.294511 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-57f11b47-1f51-4191-b7c9-af248a48372c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:17:36.703451 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:17:51.143087 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.db.agents_db [None req-504cb04f-4543-46c1-8db7-349e21db7634 None None] Agent healthcheck: found 6 active agents {{(pid=91832) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} May 25 17:17:55.349113 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-bdf5e8a0-48df-4a53-815f-2de46a2b9d41 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:17:57.743947 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-d3623060-6e11-4723-bf9c-9fafdf1e89e3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:17:57.923094 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:17:58.678454 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-0a55eb4a-8b57-4233-84d6-6b423b4ed6db None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:18:00.297883 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-57f11b47-1f51-4191-b7c9-af248a48372c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:18:06.702566 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:18:23.901516 dv-cinder-790492-4-iscsi neutron-server[91830]: DEBUG neutron.wsgi [req-9e90af47-4007-410e-8221-5ebb523fa8b8 req-53fe7fad-e56e-4902-a603-9b6970cb68d0 service neutron] (91830) timed out ('10.222.0.32', 55655) {{(pid=91830) process_request /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:830}} May 25 17:18:25.349322 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-6b455ef3-9a60-4e68-9555-52a7f1a9964a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:18:27.745021 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-f54974ac-8e82-4e69-a65b-3f3b7ed23494 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:18:27.923738 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:18:28.142527 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.db.agents_db [None req-504cb04f-4543-46c1-8db7-349e21db7634 None None] Agent healthcheck: found 6 active agents {{(pid=91832) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} May 25 17:18:28.680869 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-0a55eb4a-8b57-4233-84d6-6b423b4ed6db None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:18:30.352575 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-57f11b47-1f51-4191-b7c9-af248a48372c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:18:36.703188 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:18:55.353058 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-83730fc0-d39f-42b6-86c2-087602c555b4 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:18:57.745820 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-b15d8e78-c9b8-47c9-8e45-e35465f4ec36 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:18:57.927584 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:18:58.682894 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-0a55eb4a-8b57-4233-84d6-6b423b4ed6db None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:19:00.303870 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-57f11b47-1f51-4191-b7c9-af248a48372c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:19:05.142001 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.db.agents_db [None req-504cb04f-4543-46c1-8db7-349e21db7634 None None] Agent healthcheck: found 6 active agents {{(pid=91832) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} May 25 17:19:06.764952 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:19:25.354404 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-fc5c5d1d-d3c9-48e7-a4ae-1921d264c3e0 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:19:27.745978 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-1c2ecaba-a701-4f75-8e9b-6f74bb959505 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:19:27.929597 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:19:28.685479 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-0a55eb4a-8b57-4233-84d6-6b423b4ed6db None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:19:30.307363 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-57f11b47-1f51-4191-b7c9-af248a48372c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:19:36.776188 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:19:42.141263 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.db.agents_db [None req-504cb04f-4543-46c1-8db7-349e21db7634 None None] Agent healthcheck: found 6 active agents {{(pid=91832) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} May 25 17:19:55.355647 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-405c65a2-9886-45e9-a292-bc56f1a77478 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:19:57.746472 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-4cc1f122-0ce2-47a2-b2e0-954e516510f6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:19:57.930889 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:19:58.687049 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-0a55eb4a-8b57-4233-84d6-6b423b4ed6db None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:20:00.309731 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-57f11b47-1f51-4191-b7c9-af248a48372c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:20:06.811765 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:20:19.140307 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.db.agents_db [None req-504cb04f-4543-46c1-8db7-349e21db7634 None None] Agent healthcheck: found 6 active agents {{(pid=91832) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} May 25 17:20:25.359329 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-e51d6aef-f2c8-4c21-8563-d95fe7cdcec3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:20:27.748431 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-c14a7253-9d9c-4ebc-a361-e8594e3a3a95 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:20:27.931732 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:20:28.689741 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-0a55eb4a-8b57-4233-84d6-6b423b4ed6db None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:20:30.320665 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-57f11b47-1f51-4191-b7c9-af248a48372c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:20:36.800041 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:20:55.361173 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-f632a291-f620-498d-891f-04e96447fdd5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:20:56.139142 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.db.agents_db [None req-504cb04f-4543-46c1-8db7-349e21db7634 None None] Agent healthcheck: found 6 active agents {{(pid=91832) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} May 25 17:20:57.749188 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-a3e3ad0f-d8cf-4155-9370-50d6bd8d2b1b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:20:57.934212 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:20:58.693202 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-0a55eb4a-8b57-4233-84d6-6b423b4ed6db None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:21:00.318913 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-57f11b47-1f51-4191-b7c9-af248a48372c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:21:06.802810 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:21:25.362862 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-a6ea6fbe-c05a-4cc5-a469-371ec03b82d2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:21:27.752398 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-14af1888-df30-4d7a-b3b5-d0292241f97d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:21:27.935546 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:21:28.695363 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-0a55eb4a-8b57-4233-84d6-6b423b4ed6db None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:21:30.320141 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-57f11b47-1f51-4191-b7c9-af248a48372c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:21:33.138501 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.db.agents_db [None req-504cb04f-4543-46c1-8db7-349e21db7634 None None] Agent healthcheck: found 6 active agents {{(pid=91832) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}} May 25 17:21:36.829019 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:21:55.363695 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-c72c0fcb-98ec-4402-a2ad-fbe452d1a7c0 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:21:57.754163 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-51f2b20f-c446-48c6-8b18-fff24f0f5a5d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:21:57.936857 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-abeaf5c7-1fb3-48cd-b0bf-ef035f70e6f6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:21:58.698627 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-0a55eb4a-8b57-4233-84d6-6b423b4ed6db None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:22:00.325877 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-57f11b47-1f51-4191-b7c9-af248a48372c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:22:06.816179 dv-cinder-790492-4-iscsi neutron-server[91831]: DEBUG neutron_lib.callbacks.manager [None req-c5403f9a-c80d-4bc7-89c7-7d792930c546 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8757892982510', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-3852427'] for agent, after_update {{(pid=91831) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} May 25 17:22:10.137591 dv-cinder-790492-4-iscsi neutron-server[91832]: DEBUG neutron.db.agents_db [None req-504cb04f-4543-46c1-8db7-349e21db7634 None None] Agent healthcheck: found 6 active agents {{(pid=91832) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:314}}